-- Logs begin at Sat 2022-06-18 20:01:13 UTC, end at Sat 2022-06-18 23:29:33 UTC. -- Jun 18 21:49:57.135246 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 18 21:49:57.144490 ncdv-master-1 devstack@n-api.service[114986]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 21:49:57 2022] *** Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: nodename: ncdv-master-1 Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: machine: x86_64 Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: clock source: unix Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: pcre jit disabled Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: detected number of CPU cores: 4 Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: current working directory: / Jun 18 21:49:57.146598 ncdv-master-1 devstack@n-api.service[114986]: detected binary path: /usr/bin/uwsgi-core Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: your processes number limit is 47680 Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: your memory page size is 4096 bytes Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: detected max file descriptor number: 2048 Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: lock engine: pthread robust mutexes Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: thunder lock: enabled Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 18 21:49:57.147312 ncdv-master-1 devstack@n-api.service[114986]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 21:49:57.197584 ncdv-master-1 devstack@n-api.service[114986]: Python main interpreter initialized at 0x56277a5d49c0 Jun 18 21:49:57.197584 ncdv-master-1 devstack@n-api.service[114986]: python threads support enabled Jun 18 21:49:57.197584 ncdv-master-1 devstack@n-api.service[114986]: your server socket listen backlog is limited to 100 connections Jun 18 21:49:57.197584 ncdv-master-1 devstack@n-api.service[114986]: your mercy for graceful operations on workers is 90 seconds Jun 18 21:49:57.197923 ncdv-master-1 devstack@n-api.service[114986]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 21:49:57.197993 ncdv-master-1 devstack@n-api.service[114986]: *** Operational MODE: preforking *** Jun 18 21:49:57.198315 ncdv-master-1 devstack@n-api.service[114986]: *** uWSGI is running in multiple interpreter mode *** Jun 18 21:49:57.198315 ncdv-master-1 devstack@n-api.service[114986]: spawned uWSGI master process (pid: 114986) Jun 18 21:49:57.199719 ncdv-master-1 devstack@n-api.service[114986]: spawned uWSGI worker 1 (pid: 114987, cores: 1) Jun 18 21:49:57.199719 ncdv-master-1 devstack@n-api.service[114986]: spawned uWSGI worker 2 (pid: 114988, cores: 1) Jun 18 21:49:57.199719 ncdv-master-1 devstack@n-api.service[114986]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 21:49:57.202929 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 18 21:49:58.504227 ncdv-master-1 devstack@n-api.service[114987]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 21:49:58.574175 ncdv-master-1 devstack@n-api.service[114988]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 21:49:59.171342 ncdv-master-1 devstack@n-api.service[114987]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:49:59.171342 ncdv-master-1 devstack@n-api.service[114987]: from cryptography.utils import int_from_bytes Jun 18 21:49:59.171618 ncdv-master-1 devstack@n-api.service[114987]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:49:59.171618 ncdv-master-1 devstack@n-api.service[114987]: from cryptography.utils import int_from_bytes Jun 18 21:49:59.252124 ncdv-master-1 devstack@n-api.service[114988]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:49:59.252124 ncdv-master-1 devstack@n-api.service[114988]: from cryptography.utils import int_from_bytes Jun 18 21:49:59.252417 ncdv-master-1 devstack@n-api.service[114988]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 21:49:59.252417 ncdv-master-1 devstack@n-api.service[114988]: from cryptography.utils import int_from_bytes Jun 18 21:50:01.704147 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 21:50:01.704856 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 21:50:01.704948 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 21:50:01.705333 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 21:50:01.705425 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 21:50:01.705503 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 21:50:01.705503 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 21:50:01.705639 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 21:50:01.705852 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.705943 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 21:50:01.706159 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 21:50:01.706322 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.706514 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.706963 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.707121 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.707228 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.707476 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.707617 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.707770 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.707917 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708112 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708248 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708408 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708547 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708724 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708875 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.708974 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.709084 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.709315 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.709447 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.709613 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.709761 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.709922 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710053 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710221 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710392 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710518 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710650 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710824 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.710950 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.711121 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.711249 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.711437 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.711579 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.711730 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.711858 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.712052 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.712241 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.712397 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.713475 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.713607 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.713741 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.713866 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.713997 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714130 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714256 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714377 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714501 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714611 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714727 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714845 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.714964 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715088 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715212 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715329 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715461 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715577 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715694 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715812 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.715812 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716044 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716174 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716293 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716422 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716540 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716690 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.716816 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.717067 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.717188 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.717431 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.717557 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.717740 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.717866 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718031 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718157 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718351 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718486 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718659 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718804 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.718926 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.719042 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.719286 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.719421 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.719596 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.719733 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.719905 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720033 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720210 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720348 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720470 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720596 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720782 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.720909 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721109 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721239 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721408 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721537 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721714 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721842 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.721970 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722097 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722235 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722356 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722506 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722640 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722831 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.722958 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723139 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723267 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723408 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723535 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723665 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723800 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.723932 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724057 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724207 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724336 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724522 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724652 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724823 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.724951 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.725117 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.725303 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.725439 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.725568 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.725718 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.725856 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726027 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726160 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726310 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726436 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726618 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726747 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.726919 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727046 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727251 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727385 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727509 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727628 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727812 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.727949 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.728124 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.728251 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.728421 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.728561 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.728768 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.728910 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.729060 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.729194 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.729421 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.729547 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.729737 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.729881 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730010 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730129 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730344 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730469 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730655 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730834 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.730956 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731073 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731247 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731375 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731532 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731659 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731812 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.731942 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732139 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732267 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732450 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732576 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732695 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732815 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.732967 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.733134 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.733267 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.733396 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.733546 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.733680 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.733869 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734034 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734170 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734293 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734420 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734541 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734732 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.734920 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735054 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735183 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735361 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735490 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735663 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735801 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.735924 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736043 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736238 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736373 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736523 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736660 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736833 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.736961 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.737153 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.737296 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.737417 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.737546 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.737726 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.737853 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738036 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738165 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738345 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738480 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738608 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738727 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.738918 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739048 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739184 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739319 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739498 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739625 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739806 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.739933 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740103 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740241 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740392 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740535 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740693 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740824 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.740997 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.741181 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.741304 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.741430 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.741622 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.741750 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.741909 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742046 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742217 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742345 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742511 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742643 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742773 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.742891 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743083 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743211 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743390 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743517 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743675 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743803 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.743985 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744119 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744270 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744404 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744564 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744691 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744861 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.744996 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.745172 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.745299 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.745441 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.745563 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.745755 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.745884 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746033 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746176 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746336 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746465 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746660 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746785 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.746956 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747101 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747229 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747348 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747542 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747670 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747849 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 21:50:01.747996 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.748181 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.748310 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.748494 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.748616 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.748811 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.748950 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.749146 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.749272 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.749469 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.749599 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.749792 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.749919 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.750096 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.750223 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.750386 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.750520 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.750722 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.750850 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751040 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751168 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751350 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751478 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751638 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751764 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.751953 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752094 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752252 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752388 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752599 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752732 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752855 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.752974 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.753166 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.753287 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.753477 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.753602 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.753787 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.753919 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.754092 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.754217 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.754400 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.754525 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.754717 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.754843 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.755025 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.755156 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.755328 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.755459 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.755659 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.755785 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756042 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756177 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756298 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756416 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756600 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756733 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.756913 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757075 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757250 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757377 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757547 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757674 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757852 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.757987 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.758171 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.758335 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.758479 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.758601 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.758786 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.758909 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.759093 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.759222 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.759398 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.759520 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.759703 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.759828 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760007 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760132 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760310 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760434 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760614 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760740 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.760937 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.761095 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.761277 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.761402 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.761589 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.761713 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.761903 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762027 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762213 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762346 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762517 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762639 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762825 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.762962 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.763126 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.763259 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.763421 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.763543 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.763718 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.763849 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764015 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764156 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764316 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764445 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764609 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764738 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.764919 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.765102 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.765261 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.765388 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.765559 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.765683 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.765880 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766003 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766224 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766351 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766528 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766652 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766831 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.766957 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.767130 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.767261 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.767423 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.767545 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.767724 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.767850 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768027 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768149 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768321 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768444 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768635 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768761 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.768936 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769092 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769254 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769386 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769568 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769692 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769864 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.769989 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.770161 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.770299 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.770467 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.770592 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.770771 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.770896 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771074 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771214 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771379 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771504 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771682 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771807 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.771994 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.772127 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.772301 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.772433 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.772605 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.772731 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.772928 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.773077 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.773271 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.773394 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.773567 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.773704 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.773883 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774001 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774196 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774330 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774498 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774620 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774790 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.774922 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775092 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775209 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775388 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775520 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775726 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775850 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.775969 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776088 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776253 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776386 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776546 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776671 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776841 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.776965 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.777159 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.777297 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.777454 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.777587 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.777746 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.777871 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778056 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778189 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778355 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778480 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778652 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778776 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.778945 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.779078 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.779239 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.779363 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.779570 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.779695 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.779866 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780001 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780197 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780321 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780523 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780646 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780830 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.780954 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.781168 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.781435 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.781559 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.781697 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.781829 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.781950 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782071 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782190 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782364 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782497 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782686 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782817 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.782968 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.783094 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.783277 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.783401 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.783579 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.783704 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.783889 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784013 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784190 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784324 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784502 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784634 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784802 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.784932 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.785133 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.785297 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.785427 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.785547 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.785724 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.785848 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786055 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786188 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786380 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786503 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786687 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786818 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.786993 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.787132 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.787295 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.787417 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.787602 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.787734 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.787904 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788036 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788207 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788340 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788508 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788633 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788811 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.788937 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.789141 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.789759 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.789759 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790005 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790138 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790259 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790378 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790499 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790618 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790746 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790876 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.790997 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791124 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791245 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791364 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791485 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791614 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791832 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.791966 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792087 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792225 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792356 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792486 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792607 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792727 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792858 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.792988 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.793146 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.793291 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.793416 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.793592 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.793725 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.793895 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794034 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794193 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794325 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794488 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794614 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794790 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.794923 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795095 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795219 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795397 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795529 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795700 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795826 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.795994 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.796127 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.796299 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.796423 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.796599 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.796724 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.796892 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797015 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797210 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797427 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797564 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797685 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797866 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.797992 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.798170 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.798295 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.798483 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.798609 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.798784 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.798908 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.799725 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.799872 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800005 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800126 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800254 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800374 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800494 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800622 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800743 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800862 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.800991 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801156 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801279 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801404 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801525 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801646 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801765 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.801894 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802015 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802144 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802144 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802378 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802498 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802617 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802745 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802875 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.802996 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.803151 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.803276 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.803456 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.803659 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.803784 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.803903 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804058 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804191 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804366 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804500 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804667 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804791 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.804968 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.805161 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.805286 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.805415 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.805581 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.805710 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.805882 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806019 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806195 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806339 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806519 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806657 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806785 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.806906 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.807087 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.807213 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.807382 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.807506 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.807682 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.807979 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.808119 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.808313 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.808537 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.808662 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.808863 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.808988 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.809196 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.809323 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.809512 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.809637 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.809824 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.809957 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.810136 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.810268 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.810458 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.810582 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.810777 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.810918 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.811118 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.811241 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.811418 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.811543 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.811719 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.811842 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812014 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812145 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812314 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812440 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812618 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812751 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.812937 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813104 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813260 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813386 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813556 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813680 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813859 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.813992 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.814154 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.814279 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.814450 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.814576 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.814747 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.814880 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815044 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815168 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815350 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815473 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815645 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815783 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.815945 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816069 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816239 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816362 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816541 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816666 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816843 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.816966 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.817161 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.817297 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.817459 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.817594 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.817753 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.817885 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.818086 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.818212 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.818382 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.818507 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.818711 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.818836 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819034 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819160 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819339 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819462 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819652 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819788 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.819950 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820085 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820253 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820376 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820549 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820681 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820846 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.820979 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.821169 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.821294 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.821471 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.821588 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.821772 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.821909 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822066 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822192 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822367 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822491 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822668 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822808 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.822966 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823099 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823271 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823393 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823566 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823689 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823867 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.823995 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.824165 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.824289 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.824464 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.824595 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.824762 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.824892 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825068 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825198 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825385 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825517 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825689 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825822 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.825988 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.826127 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.826284 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.826409 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.826586 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.826711 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.826879 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827088 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827214 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827335 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827454 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827582 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827756 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.827888 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828052 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828177 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828351 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828473 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828698 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828830 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.828993 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.829136 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.829331 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.829446 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.829632 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.829765 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.829930 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830063 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830224 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830348 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830524 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830648 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830818 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.830941 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.831118 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.831241 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.831419 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.831544 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832058 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832182 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832366 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832498 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832665 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832798 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.832965 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833119 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833285 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833408 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833580 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833706 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833875 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.833999 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.834177 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.834314 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.834470 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.834592 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.834767 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.834892 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835062 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835195 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835355 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835480 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835650 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835767 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.835962 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836099 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836262 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836398 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836556 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836682 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836853 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.836987 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.837169 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.837295 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.837501 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.837635 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.837796 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.837921 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.838140 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.838262 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.838435 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.838557 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.838740 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.838866 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839048 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839170 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839349 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839471 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839650 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839782 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.839950 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840073 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840246 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840378 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840551 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840676 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840849 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.840972 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.841175 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.841313 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.841469 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.841599 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.841764 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.841900 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842073 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842207 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842373 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842497 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842673 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842805 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.842984 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.843116 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.843293 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.843415 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.843600 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.843732 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.843891 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.844023 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.844211 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.844338 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.844516 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.844707 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.844890 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.845133 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.845321 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.845513 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.845700 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.845893 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.846108 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.846304 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.846456 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.846643 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.846841 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847040 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847258 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847443 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847570 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847690 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847809 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.847929 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848064 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848186 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848305 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848424 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848551 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848671 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.848859 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849133 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849323 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849450 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849569 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849688 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849810 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.849930 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850052 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850180 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850302 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850462 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850619 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850740 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850868 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.850996 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.851115 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.851296 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.851488 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.851680 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.851870 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.852061 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.852239 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.852442 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.852648 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.852813 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.852936 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853073 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853209 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853333 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853461 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853595 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853716 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853835 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.853968 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854096 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854217 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854345 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854467 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854587 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854720 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854832 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.854961 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855081 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855199 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855318 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855519 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855643 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855762 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.855892 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856022 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856161 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856283 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856402 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856522 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856649 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856769 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.856897 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.857017 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.857221 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.857359 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.857526 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.857652 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.857929 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858053 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858236 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858367 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858546 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858681 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858866 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.858991 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.859185 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.859310 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.859504 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.859638 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.859883 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.860290 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.860290 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.860556 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.860680 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.860809 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.860935 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861108 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861244 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861366 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861487 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861609 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861729 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861858 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.861993 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862114 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862233 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862355 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862548 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862689 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862860 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.862984 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.863162 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.863295 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.863474 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.863609 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.863880 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864006 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864193 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864318 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864497 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864622 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864810 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.864930 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.865146 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.865272 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.865480 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.865603 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.865732 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.865854 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866015 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866140 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866311 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866437 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866610 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866742 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.866914 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867048 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867206 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867329 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867507 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867634 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867812 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.867944 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.868111 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.868234 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.868405 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.868530 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.868703 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.868838 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869006 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869168 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869323 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869446 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869638 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869773 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.869945 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870071 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870261 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870384 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870563 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870702 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870856 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.870979 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.871175 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.871302 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.871478 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.871602 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.871770 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.871902 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872069 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872199 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872363 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872493 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872695 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872820 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.872994 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.873155 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.873334 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.873459 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.873653 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.873786 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.873963 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.874095 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.874264 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.874388 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.874589 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.874729 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.874905 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875038 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875212 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875336 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875546 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875680 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875854 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.875986 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.876146 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.876271 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.876442 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.876567 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.876743 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.876876 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877097 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877225 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877358 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877484 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877634 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877761 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.877937 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878062 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878229 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878362 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878524 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878650 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878819 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.878944 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.879130 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.879256 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.879423 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.879551 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.879734 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.879860 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880034 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880159 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880329 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880455 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880623 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880762 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.880913 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.881072 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.881266 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.881390 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.881581 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.881709 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.881879 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882018 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882185 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882309 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882492 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882624 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882811 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.882950 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.883113 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.883238 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.883426 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.883550 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.883735 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.883870 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884041 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884166 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884347 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884471 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884653 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884779 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.884958 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.885139 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.885288 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.885412 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.885591 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.885709 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.885891 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.886016 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.886197 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.886334 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.886499 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.886625 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.886805 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.887019 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.887318 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.887442 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.887640 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.887766 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.887949 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888083 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888256 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888389 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888560 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888686 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888866 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.888993 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.889194 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.889331 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.889497 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.889622 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.889798 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.889923 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.890099 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.890233 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.890402 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.890529 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.890719 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.890843 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.891082 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.891217 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.891420 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.891546 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.891736 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.891862 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892050 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892177 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892356 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892479 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892662 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892788 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.892967 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.893149 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.893336 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.893459 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.893643 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.893850 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.893975 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894107 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894230 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894350 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894533 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894667 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894842 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.894971 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.895146 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.895271 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.895451 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.895584 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.895756 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.895881 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896061 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896185 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896366 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896493 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896670 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896794 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.896975 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.897118 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.897303 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.897438 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.897618 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.897753 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.897946 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.898078 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.898256 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.898380 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.898561 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.898686 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.898868 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.899002 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.899174 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.899385 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.899684 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.899809 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.899993 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.900127 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.900319 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.900446 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.900636 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.900762 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.900948 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.901123 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.901283 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.901405 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.901593 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.901720 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.901896 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902020 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902198 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902330 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902494 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902618 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902801 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.902928 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.903102 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.903366 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.903491 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.903694 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.903828 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.903974 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.904106 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.904282 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.904406 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.904578 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.904718 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.904891 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.905146 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.905275 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.905497 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.905747 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.905883 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.906091 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.906217 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.906402 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.906527 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.906753 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.906886 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907059 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907183 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907372 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907495 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907670 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907796 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.907971 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.908094 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.908270 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.908405 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.908567 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.908693 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.908876 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909007 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909202 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909344 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909504 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909622 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909801 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.909926 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.910101 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.910236 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.910404 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.910527 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.910700 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.910826 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911004 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911138 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911305 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911438 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911606 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911729 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.911911 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912038 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912206 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912330 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912502 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912627 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912809 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.912932 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.913125 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.913253 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.913424 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.913561 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.913724 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.913850 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914022 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914148 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914326 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914454 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914621 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914747 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.914923 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915047 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915220 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915354 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915525 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915658 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915822 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.915954 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.916127 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.916262 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.916463 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.916586 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.916766 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.916899 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.917086 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.917226 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.917388 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.917512 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.917698 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.917824 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918002 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918139 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918313 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918436 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918616 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918747 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.918919 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.919057 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.919260 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.919482 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.919608 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.919817 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.920090 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.920216 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.920418 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.920556 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.920734 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.920858 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921081 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921210 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921389 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921513 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921692 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921816 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.921997 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.922122 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.922317 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.922445 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.922661 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.922869 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.922993 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923114 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923263 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923399 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923570 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923703 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923872 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.923995 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.924176 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.924301 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.924482 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.924621 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.924787 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.924912 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.925114 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.925241 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.925458 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.925591 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.925721 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.925849 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926019 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926142 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926323 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926449 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926625 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926752 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.926935 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.927069 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.927265 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.927388 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.927575 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.927696 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.927886 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928020 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928192 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928315 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928502 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928633 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928803 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.928935 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.929130 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.929264 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.929420 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.929545 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.929726 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.929866 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930038 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930164 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930339 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930463 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930657 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930789 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.930955 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.931081 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.931361 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.931484 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.931668 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.931791 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.931980 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.932105 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.932292 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.932415 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.932598 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.932724 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.932913 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.933059 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.933251 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.933377 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.933559 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.933686 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.933872 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934010 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934178 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934317 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934501 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934626 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934834 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.934967 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.935159 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.935292 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.935467 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.935592 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.935766 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.935903 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936067 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936203 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936365 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936500 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936671 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936796 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.936973 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.937139 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.937303 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.937428 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.937600 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.937735 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.937916 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938054 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938223 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938349 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938522 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938647 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938821 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.938955 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.939117 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.939242 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.939418 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.939541 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.939719 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.939844 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940018 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940143 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940314 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940449 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940613 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940738 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.940906 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941051 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941230 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941373 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941528 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941654 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941830 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.941966 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.942126 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.942257 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.942425 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.942551 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.942720 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.942846 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943016 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943143 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943311 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943442 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943633 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943758 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.943959 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.944085 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.944272 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.944398 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.944585 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.944711 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.944889 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945021 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945226 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945362 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945533 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945665 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945845 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.945969 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.946156 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.946279 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.946462 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.946592 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.946765 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.946890 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947078 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947203 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947384 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947517 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947688 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947822 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.947992 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.948125 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.948297 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.948431 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.948602 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.948728 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.948904 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949050 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949246 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949389 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949567 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949700 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949868 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.949986 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.950189 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.950313 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.950497 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.950620 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.950808 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.950934 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.951132 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.951316 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.951440 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.951669 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.951796 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.951984 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.952153 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.952303 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.952425 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.952610 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.952735 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.952914 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.953095 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.953225 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.953347 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.953575 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.953704 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.953893 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954028 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954265 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954398 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954519 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954639 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954823 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.954958 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.955140 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.955273 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.955456 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.955580 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.955798 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.955924 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.956106 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.956232 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.956443 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.956577 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957100 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957229 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957416 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957541 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957719 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957855 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.957978 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114988) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 21:50:01.958097 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 21:50:01.958245 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114987) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 21:50:02.024769 ncdv-master-1 devstack@n-api.service[114987]: INFO dbcounter [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Registered counter for database nova_api Jun 18 21:50:02.025002 ncdv-master-1 devstack@n-api.service[114988]: INFO dbcounter [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Registered counter for database nova_api Jun 18 21:50:02.043948 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_db.sqlalchemy.engines [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.045666 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_db.sqlalchemy.engines [None req-a5494def-bcef-40f7-9201-03487a065316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.050827 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writer thread running {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.052681 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writer thread running {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.106819 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.context [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=114987) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 21:50:02.108549 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.context [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=114988) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 21:50:02.110981 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:50:02.112558 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:50:02.112690 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:50:02.113366 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:50:02.114292 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:50:02.115059 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:50:02.115317 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_concurrency.lockutils [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114987) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:50:02.117101 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:50:02.117338 ncdv-master-1 devstack@n-api.service[114987]: INFO dbcounter [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Registered counter for database nova_cell0 Jun 18 21:50:02.119074 ncdv-master-1 devstack@n-api.service[114988]: INFO dbcounter [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Registered counter for database nova_cell0 Jun 18 21:50:02.121412 ncdv-master-1 devstack@n-api.service[114987]: INFO dbcounter [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Registered counter for database nova_cell1 Jun 18 21:50:02.123031 ncdv-master-1 devstack@n-api.service[114988]: INFO dbcounter [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Registered counter for database nova_cell1 Jun 18 21:50:02.128748 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_db.sqlalchemy.engines [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.130065 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_db.sqlalchemy.engines [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.131881 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_db.sqlalchemy.engines [None req-a5494def-bcef-40f7-9201-03487a065316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.135094 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_db.sqlalchemy.engines [None req-a5494def-bcef-40f7-9201-03487a065316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.135296 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writer thread running {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.137940 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writer thread running {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.143653 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writer thread running {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.276635 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writer thread running {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.283706 ncdv-master-1 devstack@n-api.service[114987]: INFO dbcounter [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Registered counter for database nova_cell0 Jun 18 21:50:02.286037 ncdv-master-1 devstack@n-api.service[114988]: INFO dbcounter [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Registered counter for database nova_cell0 Jun 18 21:50:02.294692 ncdv-master-1 devstack@n-api.service[114987]: DEBUG oslo_db.sqlalchemy.engines [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114987) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.298715 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_db.sqlalchemy.engines [None req-a5494def-bcef-40f7-9201-03487a065316 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114988) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 21:50:02.300650 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writer thread running {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.303476 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writer thread running {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 21:50:02.758952 ncdv-master-1 devstack@n-api.service[114988]: WARNING keystonemiddleware.auth_token [None req-a5494def-bcef-40f7-9201-03487a065316 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 21:50:02.764585 ncdv-master-1 devstack@n-api.service[114987]: WARNING keystonemiddleware.auth_token [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 21:50:02.766299 ncdv-master-1 devstack@n-api.service[114988]: WARNING keystonemiddleware.auth_token [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 21:50:02.771964 ncdv-master-1 devstack@n-api.service[114987]: WARNING keystonemiddleware.auth_token [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 21:50:02.980986 ncdv-master-1 devstack@n-api.service[114988]: WARNING keystonemiddleware.auth_token [None req-a5494def-bcef-40f7-9201-03487a065316 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 21:50:02.986996 ncdv-master-1 devstack@n-api.service[114988]: WARNING keystonemiddleware.auth_token [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 21:50:02.988063 ncdv-master-1 devstack@n-api.service[114987]: WARNING keystonemiddleware.auth_token [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 21:50:02.992233 ncdv-master-1 devstack@n-api.service[114988]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56277a5d49c0 pid: 114988 (default app) Jun 18 21:50:02.994051 ncdv-master-1 devstack@n-api.service[114987]: WARNING keystonemiddleware.auth_token [None req-b7d3e3a0-b003-42ef-a5d9-1c8afccb8a02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 21:50:02.994323 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:50:02.995541 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-a5494def-bcef-40f7-9201-03487a065316 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jun 18 21:50:02.995954 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sat Jun 18 21:50:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:50:02.999103 ncdv-master-1 devstack@n-api.service[114987]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56277a5d49c0 pid: 114987 (default app) Jun 18 21:51:23.887910 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:23.888795 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-a5494def-bcef-40f7-9201-03487a065316 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 18 21:51:23.889410 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:23.907709 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writing DB stats nova_api:SELECT=3 {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:23.908624 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writing DB stats nova_cell1:SELECT=3 {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:23.909538 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writing DB stats nova_cell0:SELECT=3 {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:23.910222 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:24.344329 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-90b0c481-94d9-456f-a506-b96957d35a52 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:24.374702 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-90b0c481-94d9-456f-a506-b96957d35a52 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478152 Jun 18 21:51:24.375711 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 21:51:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:26.733613 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-a5494def-bcef-40f7-9201-03487a065316 None None] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:26.734622 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-a5494def-bcef-40f7-9201-03487a065316 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 18 21:51:26.735169 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:26.804501 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-58c45886-62e9-414e-aa93-5a109e0ea386 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:26.824221 ncdv-master-1 devstack@n-api.service[114987]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:51:26.824221 ncdv-master-1 devstack@n-api.service[114987]: warnings.warn(msg) Jun 18 21:51:26.854585 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-58c45886-62e9-414e-aa93-5a109e0ea386 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.113568 Jun 18 21:51:26.855314 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 21:51:26.869423 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_api:SELECT=3 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:26.870643 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_cell0:SELECT=3 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:26.871762 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_cell1:SELECT=3 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:26.872516 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:51:27.077688 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8fd72666-8ba2-4e44-a360-c6de0b2aa869 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:27.080415 ncdv-master-1 devstack@n-api.service[114988]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:51:27.080415 ncdv-master-1 devstack@n-api.service[114988]: warnings.warn(msg) Jun 18 21:51:27.141236 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8fd72666-8ba2-4e44-a360-c6de0b2aa869 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277526 Jun 18 21:51:27.145090 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Jun 18 21:51:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:29.467895 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-58c45886-62e9-414e-aa93-5a109e0ea386 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:29.468994 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-58c45886-62e9-414e-aa93-5a109e0ea386 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 18 21:51:29.469454 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:29.576450 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-f9bc92b9-830b-4955-a9c8-4a05f4eea99a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:29.595498 ncdv-master-1 devstack@n-api.service[114988]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:51:29.595498 ncdv-master-1 devstack@n-api.service[114988]: warnings.warn(msg) Jun 18 21:51:29.615714 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-f9bc92b9-830b-4955-a9c8-4a05f4eea99a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140486 Jun 18 21:51:29.616269 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:51:29.628201 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-c12709ab-510d-40d3-8adb-c7745e268cd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:29.629714 ncdv-master-1 devstack@n-api.service[114987]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:51:29.629714 ncdv-master-1 devstack@n-api.service[114987]: warnings.warn(msg) Jun 18 21:51:29.662431 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-c12709ab-510d-40d3-8adb-c7745e268cd0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037624 Jun 18 21:51:29.662957 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Jun 18 21:51:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:32.107669 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-f9bc92b9-830b-4955-a9c8-4a05f4eea99a admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:32.109528 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-f9bc92b9-830b-4955-a9c8-4a05f4eea99a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Jun 18 21:51:32.110315 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:32.236430 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-feed0a39-3b89-4ea3-a660-1ce99d4c9478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "ram": 1024}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:32.271921 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-feed0a39-3b89-4ea3-a660-1ce99d4c9478 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153867 Jun 18 21:51:32.272788 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 21:51:32.284610 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-5cd21e3b-d5e3-469f-89fc-93173d1a1fb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:32.311229 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-5cd21e3b-d5e3-469f-89fc-93173d1a1fb7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030207 Jun 18 21:51:32.312842 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Jun 18 21:51:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:34.788567 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-feed0a39-3b89-4ea3-a660-1ce99d4c9478 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:34.790505 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-feed0a39-3b89-4ea3-a660-1ce99d4c9478 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Jun 18 21:51:34.791360 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:34.856001 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-ff05012e-546f-4995-995d-db85fadf442b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:34.879103 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-ff05012e-546f-4995-995d-db85fadf442b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081182 Jun 18 21:51:34.886850 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:51:34.895355 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-f514ac93-505f-4cde-bd41-6af1549f5bce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:34.932471 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-f514ac93-505f-4cde-bd41-6af1549f5bce admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041239 Jun 18 21:51:34.945193 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Jun 18 21:51:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:37.503025 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-ff05012e-546f-4995-995d-db85fadf442b admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:37.504158 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-ff05012e-546f-4995-995d-db85fadf442b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 18 21:51:37.504759 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:37.567099 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-21a70367-5e4c-40c1-b45e-eef0cd68039a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "name": "ds4G", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:37.587361 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-21a70367-5e4c-40c1-b45e-eef0cd68039a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076549 Jun 18 21:51:37.588465 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:51:37.600070 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-a841f9b3-fb1d-4ff2-b67c-8f5f686f8550 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:37.630629 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-a841f9b3-fb1d-4ff2-b67c-8f5f686f8550 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034052 Jun 18 21:51:37.631478 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1335 bytes} [Sat Jun 18 21:51:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:40.367181 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-21a70367-5e4c-40c1-b45e-eef0cd68039a admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:40.368204 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-21a70367-5e4c-40c1-b45e-eef0cd68039a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 18 21:51:40.368584 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:40.433947 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-21d541ee-8b97-431a-b2e7-934c900e3100 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:40.461215 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-21d541ee-8b97-431a-b2e7-934c900e3100 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086228 Jun 18 21:51:40.461745 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 21:51:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:51:42.826795 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-21a70367-5e4c-40c1-b45e-eef0cd68039a admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:42.827996 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-21a70367-5e4c-40c1-b45e-eef0cd68039a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Jun 18 21:51:42.828475 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:42.892862 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-41436e54-cff1-4568-8399-c4bc1d676c21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "swap": 0, "disk": 1}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:42.911674 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-41436e54-cff1-4568-8399-c4bc1d676c21 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076915 Jun 18 21:51:42.912223 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 21:51:42.924144 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-251b7404-5f8d-4575-9327-41fdd50e7554 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:42.948653 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-251b7404-5f8d-4575-9327-41fdd50e7554 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028191 Jun 18 21:51:42.949601 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Jun 18 21:51:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 21:51:45.310493 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-41436e54-cff1-4568-8399-c4bc1d676c21 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:45.311624 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-41436e54-cff1-4568-8399-c4bc1d676c21 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 18 21:51:45.312037 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:45.384203 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-5375d858-24b2-43df-925a-48b3d7127c88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:45.409248 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-5375d858-24b2-43df-925a-48b3d7127c88 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.090985 Jun 18 21:51:45.409923 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:51:45.423838 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-0862ae67-dcf4-4ddf-8c12-8bf8cfb70629 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:45.451492 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-0862ae67-dcf4-4ddf-8c12-8bf8cfb70629 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032951 Jun 18 21:51:45.452094 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Jun 18 21:51:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:47.804287 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-5375d858-24b2-43df-925a-48b3d7127c88 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:47.805327 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-5375d858-24b2-43df-925a-48b3d7127c88 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 18 21:51:47.805720 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 21:51:47.875764 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-f50bd94a-8b43-40ab-b02c-e2a5280c90f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "ram": 4096}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:47.898417 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-f50bd94a-8b43-40ab-b02c-e2a5280c90f7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085446 Jun 18 21:51:47.899188 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:51:47.915960 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-3f4c530f-e3e4-4a0f-aafb-ec40648198da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:47.944830 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-3f4c530f-e3e4-4a0f-aafb-ec40648198da admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035146 Jun 18 21:51:47.945623 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Jun 18 21:51:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:50.501067 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-f50bd94a-8b43-40ab-b02c-e2a5280c90f7 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:50.502394 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-f50bd94a-8b43-40ab-b02c-e2a5280c90f7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jun 18 21:51:50.502886 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:50.570926 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-29147b91-a0af-4a7d-bdba-e62176ff7c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:50.595510 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-29147b91-a0af-4a7d-bdba-e62176ff7c84 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084952 Jun 18 21:51:50.596058 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:51:50.609506 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-976d3002-93c1-416c-963b-060322ba840e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:50.636986 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-976d3002-93c1-416c-963b-060322ba840e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032426 Jun 18 21:51:50.637591 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Jun 18 21:51:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:51:53.032464 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-29147b91-a0af-4a7d-bdba-e62176ff7c84 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:51:53.033526 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-29147b91-a0af-4a7d-bdba-e62176ff7c84 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 18 21:51:53.033919 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:51:53.092457 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8c74ffec-12d4-4eff-aba5-1b8d555d3f9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "id": "5"}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:53.113089 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8c74ffec-12d4-4eff-aba5-1b8d555d3f9e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073024 Jun 18 21:51:53.113647 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1282 bytes} [Sat Jun 18 21:51:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 21:51:53.125710 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-1b47aee8-09f3-404f-b906-25e8760bece5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:51:53.148425 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-1b47aee8-09f3-404f-b906-25e8760bece5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026397 Jun 18 21:51:53.148997 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1332 bytes} [Sat Jun 18 21:51:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 21:52:20.481700 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8c74ffec-12d4-4eff-aba5-1b8d555d3f9e admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:20.483233 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8c74ffec-12d4-4eff-aba5-1b8d555d3f9e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002209 Jun 18 21:52:20.483786 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:20.494930 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:20.543963 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-fa566437-1455-43c7-8b68-d5b2447a34eb admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:20.560916 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-fa566437-1455-43c7-8b68-d5b2447a34eb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070606 Jun 18 21:52:20.561476 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 21:52:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 21:52:21.551669 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8c74ffec-12d4-4eff-aba5-1b8d555d3f9e admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:21.552669 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8c74ffec-12d4-4eff-aba5-1b8d555d3f9e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 18 21:52:21.553056 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:21.855187 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-66258a42-c524-4ca0-8f0b-acd72a029dc0 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:21.861003 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.wsgi [None req-66258a42-c524-4ca0-8f0b-acd72a029dc0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-66258a42-c524-4ca0-8f0b-acd72a029dc0 admin admin] Request method failure captured: Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Accept: application/json Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Accept-Encoding: gzip, deflate Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Connection: keep-alive Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Content-Length: 0 Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Host: 10.222.0.30 Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Openstack-Api-Version: compute 2.90 Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: Openstack-System-Scope: None Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: User-Agent: python-novaclient Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Auth-Token: gAAAAABirkkVgmuzMelVk1f71wqR9g_JIPzEWrUwyEpQModwaw8RXOSUWEHO-SsCg0za5MfQ-XjaIL85KOoj5ejm6OED2wi3XzNh0DUKHir15zZVbPAOy3vakACk1RfwS1TxxEindeuJWT0tjXyLBdioOT2dLDlcqw5Snb-aagxFIKh123hV1Gc Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Domain-Id: None Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Domain-Name: None Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Identity-Status: Confirmed Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Is-Admin-Project: True Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Domain-Id: default Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Domain-Name: Default Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Name: admin Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Role: admin,member,reader Jun 18 21:52:21.876515 ncdv-master-1 devstack@n-api.service[114987]: X-Roles: admin,member,reader Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66f428458e264ccfa7aaee63beb4b0a3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant: admin Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant-Name: admin Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-User: admin Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-User-Domain-Id: default Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-User-Domain-Name: Default Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-User-Id: 4a36d37a77f14439b4a1d892bb4af6b7 Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: X-User-Name: admin Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: method: > Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: exception: Flavor 42 could not be found. Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: action_args: {'id': '42'} Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 21:52:21.878081 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:21.879077 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.880333 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-66258a42-c524-4ca0-8f0b-acd72a029dc0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 21:52:21.881438 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-66258a42-c524-4ca0-8f0b-acd72a029dc0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.076549 Jun 18 21:52:21.881438 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 21:52:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:21.887756 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-bc27c050-2b29-45ce-b779-bcce42a34319 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:21.890724 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:52:21.909372 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-bc27c050-2b29-45ce-b779-bcce42a34319 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025131 Jun 18 21:52:21.909900 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 21:52:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:52:21.919905 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-3fa597ba-e0af-436d-9e9c-4254c12e080c admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:21.941014 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-3fa597ba-e0af-436d-9e9c-4254c12e080c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024685 Jun 18 21:52:21.941577 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 21:52:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:52:21.950869 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-b6e607ec-6482-43b1-8f7d-f27d11c36c49 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:21.957368 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.wsgi [None req-b6e607ec-6482-43b1-8f7d-f27d11c36c49 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-b6e607ec-6482-43b1-8f7d-f27d11c36c49 admin admin] Request method failure captured: Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Accept: application/json Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Accept-Encoding: gzip, deflate Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Connection: keep-alive Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Content-Length: 0 Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Host: 10.222.0.30 Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Openstack-Api-Version: compute 2.90 Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: Openstack-System-Scope: None Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: User-Agent: python-novaclient Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Auth-Token: gAAAAABirkkVgmuzMelVk1f71wqR9g_JIPzEWrUwyEpQModwaw8RXOSUWEHO-SsCg0za5MfQ-XjaIL85KOoj5ejm6OED2wi3XzNh0DUKHir15zZVbPAOy3vakACk1RfwS1TxxEindeuJWT0tjXyLBdioOT2dLDlcqw5Snb-aagxFIKh123hV1Gc Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Domain-Id: None Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Domain-Name: None Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Identity-Status: Confirmed Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Is-Admin-Project: True Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Domain-Id: default Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Domain-Name: Default Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Name: admin Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Role: admin,member,reader Jun 18 21:52:21.960576 ncdv-master-1 devstack@n-api.service[114988]: X-Roles: admin,member,reader Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66f428458e264ccfa7aaee63beb4b0a3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant: admin Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant-Name: admin Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-User: admin Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-User-Domain-Id: default Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-User-Domain-Name: Default Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-User-Id: 4a36d37a77f14439b4a1d892bb4af6b7 Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: X-User-Name: admin Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: method: > Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: exception: Flavor 42 could not be found. Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: action_args: {'id': '42'} Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 21:52:21.962151 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:21.963135 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:21.964175 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-b6e607ec-6482-43b1-8f7d-f27d11c36c49 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 21:52:21.965421 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-b6e607ec-6482-43b1-8f7d-f27d11c36c49 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014601 Jun 18 21:52:21.965421 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 21:52:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 18 21:52:22.797753 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-3fa597ba-e0af-436d-9e9c-4254c12e080c admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:22.798868 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-3fa597ba-e0af-436d-9e9c-4254c12e080c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jun 18 21:52:22.799252 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:23.007353 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-9f9c6be4-8c51-4d0d-b74d-792d26280e20 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:23.012836 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.wsgi [None req-9f9c6be4-8c51-4d0d-b74d-792d26280e20 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-9f9c6be4-8c51-4d0d-b74d-792d26280e20 admin admin] Request method failure captured: Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Accept: application/json Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Accept-Encoding: gzip, deflate Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Connection: keep-alive Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Content-Length: 0 Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Host: 10.222.0.30 Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Openstack-Api-Version: compute 2.90 Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: Openstack-System-Scope: None Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: User-Agent: python-novaclient Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Auth-Token: gAAAAABirkkWjBnhlj8riPbgKVjkAhTVJ9YEER87QYEZXjQNpKNrgd3h5osauHHleIXF6EhXluSdUoaUpY17GWh_ANX4UBvMx03Y811pEAJ7NaywUIqwq8hDhZmue90y6NJa5slXTBtROZiJMPyQRb5ViaTj53isqZnMRFX5-dd7PnHP1tu3cOg Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Domain-Id: None Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Domain-Name: None Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Identity-Status: Confirmed Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Is-Admin-Project: True Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Domain-Id: default Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Domain-Name: Default Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Name: admin Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Role: admin,member,reader Jun 18 21:52:23.014454 ncdv-master-1 devstack@n-api.service[114988]: X-Roles: admin,member,reader Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66f428458e264ccfa7aaee63beb4b0a3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant: admin Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant-Name: admin Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-User: admin Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-User-Domain-Id: default Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-User-Domain-Name: Default Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-User-Id: 4a36d37a77f14439b4a1d892bb4af6b7 Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: X-User-Name: admin Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: method: > Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: exception: Flavor 84 could not be found. Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: action_args: {'id': '84'} Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 21:52:23.015946 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:23.016806 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.017890 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-9f9c6be4-8c51-4d0d-b74d-792d26280e20 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 21:52:23.018906 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-9f9c6be4-8c51-4d0d-b74d-792d26280e20 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068363 Jun 18 21:52:23.018906 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 21:52:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:23.026148 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-c397a6de-7380-4fb2-99cd-669b024bf5fa admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:23.039918 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-c397a6de-7380-4fb2-99cd-669b024bf5fa admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017333 Jun 18 21:52:23.040490 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 21:52:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:52:23.050387 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8cd104ee-37e5-47a9-978b-08a7a71eab98 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:23.064280 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8cd104ee-37e5-47a9-978b-08a7a71eab98 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017502 Jun 18 21:52:23.064789 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 21:52:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:52:23.073908 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-d9e699a9-e426-4855-9273-e8bf82586a61 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:23.079421 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.wsgi [None req-d9e699a9-e426-4855-9273-e8bf82586a61 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-d9e699a9-e426-4855-9273-e8bf82586a61 admin admin] Request method failure captured: Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Accept: application/json Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Accept-Encoding: gzip, deflate Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Connection: keep-alive Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Content-Length: 0 Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Host: 10.222.0.30 Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Openstack-Api-Version: compute 2.90 Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: Openstack-System-Scope: None Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: User-Agent: python-novaclient Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Auth-Token: gAAAAABirkkWjBnhlj8riPbgKVjkAhTVJ9YEER87QYEZXjQNpKNrgd3h5osauHHleIXF6EhXluSdUoaUpY17GWh_ANX4UBvMx03Y811pEAJ7NaywUIqwq8hDhZmue90y6NJa5slXTBtROZiJMPyQRb5ViaTj53isqZnMRFX5-dd7PnHP1tu3cOg Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Domain-Id: None Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Domain-Name: None Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Identity-Status: Confirmed Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Is-Admin-Project: True Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Domain-Id: default Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Domain-Name: Default Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Name: admin Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Role: admin,member,reader Jun 18 21:52:23.080918 ncdv-master-1 devstack@n-api.service[114987]: X-Roles: admin,member,reader Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66f428458e264ccfa7aaee63beb4b0a3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant: admin Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant-Name: admin Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-User: admin Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-User-Domain-Id: default Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-User-Domain-Name: Default Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-User-Id: 4a36d37a77f14439b4a1d892bb4af6b7 Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: X-User-Name: admin Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: method: > Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: exception: Flavor 84 could not be found. Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: action_args: {'id': '84'} Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 21:52:23.082674 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:23.083530 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:23.084597 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-d9e699a9-e426-4855-9273-e8bf82586a61 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 21:52:23.085637 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-d9e699a9-e426-4855-9273-e8bf82586a61 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012289 Jun 18 21:52:23.085637 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 21:52:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:23.913269 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8cd104ee-37e5-47a9-978b-08a7a71eab98 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:23.914277 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8cd104ee-37e5-47a9-978b-08a7a71eab98 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 18 21:52:23.914668 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:24.118221 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-03b82cb0-9328-42d9-b7e5-0b9fc88a24e4 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:24.124347 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.wsgi [None req-03b82cb0-9328-42d9-b7e5-0b9fc88a24e4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-03b82cb0-9328-42d9-b7e5-0b9fc88a24e4 admin admin] Request method failure captured: Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Accept: application/json Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Accept-Encoding: gzip, deflate Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Connection: keep-alive Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Content-Length: 0 Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Host: 10.222.0.30 Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Openstack-Api-Version: compute 2.90 Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: Openstack-System-Scope: None Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: User-Agent: python-novaclient Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Auth-Token: gAAAAABirkkXLtsooc47oU_wFp0ZQuYJZcnFmY4tgPlAwPGVrLggXy7lkDuPr7fd_DRRm-SDqwc35O5p0QJ_lo3GXgzY_3BZ-f0XieJO11B7O6lK6j8mgGpE15wuWslDm4-2rhh3ZYrd7XAzkplNU0ZO4Nv8VEFW3dr1eSJhBtucSLrF1HHtxdc Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Domain-Id: None Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Domain-Name: None Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Identity-Status: Confirmed Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Is-Admin-Project: True Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Domain-Id: default Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Domain-Name: Default Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Project-Name: admin Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Role: admin,member,reader Jun 18 21:52:24.125885 ncdv-master-1 devstack@n-api.service[114987]: X-Roles: admin,member,reader Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66f428458e264ccfa7aaee63beb4b0a3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant: admin Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-Tenant-Name: admin Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-User: admin Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-User-Domain-Id: default Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-User-Domain-Name: Default Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-User-Id: 4a36d37a77f14439b4a1d892bb4af6b7 Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: X-User-Name: admin Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: method: > Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: exception: Flavor 451 could not be found. Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: action_args: {'id': '451'} Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 21:52:24.127286 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:24.129474 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.130785 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-03b82cb0-9328-42d9-b7e5-0b9fc88a24e4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114987) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 21:52:24.131831 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-03b82cb0-9328-42d9-b7e5-0b9fc88a24e4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066155 Jun 18 21:52:24.131831 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 21:52:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:24.137147 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-bf0e7bf0-4f57-48a7-ab65-f72d7b7da83a admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:24.151218 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-bf0e7bf0-4f57-48a7-ab65-f72d7b7da83a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017648 Jun 18 21:52:24.151744 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 21:52:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:52:24.163744 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:24.184190 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025553 Jun 18 21:52:24.184906 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 21:52:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:52:24.194609 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-13d3207d-0b9d-4b6a-ad99-91361bab0e81 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:24.200857 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.wsgi [None req-13d3207d-0b9d-4b6a-ad99-91361bab0e81 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-13d3207d-0b9d-4b6a-ad99-91361bab0e81 admin admin] Request method failure captured: Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Accept: application/json Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Accept-Encoding: gzip, deflate Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Connection: keep-alive Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Content-Length: 0 Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Host: 10.222.0.30 Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Openstack-Api-Version: compute 2.90 Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: Openstack-System-Scope: None Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: User-Agent: python-novaclient Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Auth-Token: gAAAAABirkkXLtsooc47oU_wFp0ZQuYJZcnFmY4tgPlAwPGVrLggXy7lkDuPr7fd_DRRm-SDqwc35O5p0QJ_lo3GXgzY_3BZ-f0XieJO11B7O6lK6j8mgGpE15wuWslDm4-2rhh3ZYrd7XAzkplNU0ZO4Nv8VEFW3dr1eSJhBtucSLrF1HHtxdc Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Domain-Id: None Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Domain-Name: None Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Identity-Status: Confirmed Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Is-Admin-Project: True Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Openstack-Nova-Api-Version: 2.90 Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Domain-Id: default Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Domain-Name: Default Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Project-Name: admin Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Role: admin,member,reader Jun 18 21:52:24.202366 ncdv-master-1 devstack@n-api.service[114988]: X-Roles: admin,member,reader Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66f428458e264ccfa7aaee63beb4b0a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66f428458e264ccfa7aaee63beb4b0a3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant: admin Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant-Id: 66f428458e264ccfa7aaee63beb4b0a3 Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-Tenant-Name: admin Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-User: admin Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-User-Domain-Id: default Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-User-Domain-Name: Default Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-User-Id: 4a36d37a77f14439b4a1d892bb4af6b7 Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: X-User-Name: admin Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: method: > Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: exception: Flavor 451 could not be found. Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: action_args: {'id': '451'} Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 21:52:24.203732 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:24.204859 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: ERROR nova.api.openstack.wsgi Jun 18 21:52:24.206466 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-13d3207d-0b9d-4b6a-ad99-91361bab0e81 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114988) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 21:52:24.207475 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-13d3207d-0b9d-4b6a-ad99-91361bab0e81 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012761 Jun 18 21:52:24.207475 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 21:52:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 18 21:52:25.061348 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:25.062361 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 18 21:52:25.062743 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:25.265563 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-73113c68-d1bc-41b1-8db0-83211ccd3a60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:52:25.291053 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-73113c68-d1bc-41b1-8db0-83211ccd3a60 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081765 Jun 18 21:52:25.291683 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Jun 18 21:52:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:52:26.122178 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:26.123242 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 18 21:52:26.123604 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:26.334853 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8961b486-59aa-42f1-bf96-963e6b35c9ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:52:26.358023 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8961b486-59aa-42f1-bf96-963e6b35c9ad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085376 Jun 18 21:52:26.358484 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Jun 18 21:52:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:52:27.193988 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:27.195023 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 18 21:52:27.195414 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:27.411075 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-da57b862-e017-4677-a244-84b08de6af77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:52:27.429418 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-da57b862-e017-4677-a244-84b08de6af77 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082571 Jun 18 21:52:27.429919 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Jun 18 21:52:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 21:52:28.257821 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:28.258840 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jun 18 21:52:28.259240 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:28.463240 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-5fb54cc0-ec72-4931-b271-39e10fdb889f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 21:52:28.483882 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-5fb54cc0-ec72-4931-b271-39e10fdb889f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076368 Jun 18 21:52:28.484371 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Jun 18 21:52:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 21:52:29.314491 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:29.315521 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 18 21:52:29.315904 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:52:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:52:29.512687 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-e001928b-5a16-4db3-b425-e0172610450d admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:52:29.531685 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-e001928b-5a16-4db3-b425-e0172610450d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070745 Jun 18 21:52:29.532141 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sat Jun 18 21:52:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:53:36.716210 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:53:36.717656 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-caccf2a2-5d3d-4a56-9dc3-9c83f1c70730 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jun 18 21:53:36.718253 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 930 bytes} [Sat Jun 18 21:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:53:36.730115 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:36.793653 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-a509b132-d9e9-4cba-9637-55737fc67c8d admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:53:36.813985 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-a509b132-d9e9-4cba-9637-55737fc67c8d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.086280 Jun 18 21:53:36.814579 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 21:53:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:53:36.836558 ncdv-master-1 devstack@n-api.service[114987]: DEBUG dbcounter [-] [114987] Writing DB stats nova_api:SELECT=14 {{(pid=114987) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:53:36.840566 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-e9805a7d-eb77-45ea-aa21-ccc21bcff761 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:53:36.848464 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-e9805a7d-eb77-45ea-aa21-ccc21bcff761 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013632 Jun 18 21:53:36.848986 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Jun 18 21:53:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 21:53:36.862885 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-8b09d232-647a-480d-b2a7-5d1b34286111 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:53:36.871067 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-8b09d232-647a-480d-b2a7-5d1b34286111 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011933 Jun 18 21:53:36.871581 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Jun 18 21:53:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:53:36.885336 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-dd86c65f-266c-47ad-ab59-25ce242b3824 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:53:36.895347 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-dd86c65f-266c-47ad-ab59-25ce242b3824 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015475 Jun 18 21:53:36.895817 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1285 bytes} [Sat Jun 18 21:53:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 21:53:36.908848 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-58692195-3942-44e4-8488-07bb9c119ac7 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:53:36.916561 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-58692195-3942-44e4-8488-07bb9c119ac7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011171 Jun 18 21:53:36.917081 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1282 bytes} [Sat Jun 18 21:53:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 21:59:33.196265 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-dd86c65f-266c-47ad-ab59-25ce242b3824 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:59:33.197439 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-dd86c65f-266c-47ad-ab59-25ce242b3824 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 18 21:59:33.197880 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:59:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:59:33.349187 ncdv-master-1 devstack@n-api.service[114988]: DEBUG dbcounter [-] [114988] Writing DB stats nova_api:SELECT=6 {{(pid=114988) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 21:59:33.484572 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-c648f408-8c3b-4d9a-939e-3368893cb886 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:59:33.485755 ncdv-master-1 devstack@n-api.service[114988]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:59:33.485755 ncdv-master-1 devstack@n-api.service[114988]: warnings.warn(msg) Jun 18 21:59:33.486960 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-c648f408-8c3b-4d9a-939e-3368893cb886 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:59:33.487402 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-c648f408-8c3b-4d9a-939e-3368893cb886 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:59:33.488233 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-c648f408-8c3b-4d9a-939e-3368893cb886 admin admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:59:33.488652 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-c648f408-8c3b-4d9a-939e-3368893cb886 admin admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:59:33.528670 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-c648f408-8c3b-4d9a-939e-3368893cb886 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.182019 Jun 18 21:59:33.529364 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 21:59:33 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 21:59:34.357807 ncdv-master-1 devstack@n-api.service[114987]: DEBUG nova.api.openstack.wsgi [None req-dd86c65f-266c-47ad-ab59-25ce242b3824 admin admin] Calling method '>' {{(pid=114987) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:59:34.358791 ncdv-master-1 devstack@n-api.service[114987]: INFO nova.api.openstack.requestlog [None req-dd86c65f-266c-47ad-ab59-25ce242b3824 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 18 21:59:34.359527 ncdv-master-1 devstack@n-api.service[114987]: [pid: 114987|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Jun 18 21:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 21:59:34.559184 ncdv-master-1 devstack@n-api.service[114988]: DEBUG nova.api.openstack.wsgi [None req-38abfb08-e91f-4d82-9f5e-ce14f508ac14 admin admin] Calling method '>' {{(pid=114988) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 21:59:34.560422 ncdv-master-1 devstack@n-api.service[114988]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 21:59:34.560422 ncdv-master-1 devstack@n-api.service[114988]: warnings.warn(msg) Jun 18 21:59:34.561634 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-38abfb08-e91f-4d82-9f5e-ce14f508ac14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:59:34.562061 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-38abfb08-e91f-4d82-9f5e-ce14f508ac14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:59:34.562833 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-38abfb08-e91f-4d82-9f5e-ce14f508ac14 admin admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 21:59:34.563314 ncdv-master-1 devstack@n-api.service[114988]: DEBUG oslo_concurrency.lockutils [None req-38abfb08-e91f-4d82-9f5e-ce14f508ac14 admin admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114988) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 21:59:34.586243 ncdv-master-1 devstack@n-api.service[114988]: INFO nova.api.openstack.requestlog [None req-38abfb08-e91f-4d82-9f5e-ce14f508ac14 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.080956 Jun 18 21:59:34.586755 ncdv-master-1 devstack@n-api.service[114988]: [pid: 114988|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 21:59:34 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:00:18.998385 ncdv-master-1 devstack@n-api.service[114986]: Sat Jun 18 22:00:18 2022 - graceful shutdown triggered... Jun 18 22:00:18.998482 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 18 22:00:18.999533 ncdv-master-1 devstack@n-api.service[114987]: Gracefully killing worker 1 (pid: 114987)... Jun 18 22:00:18.999921 ncdv-master-1 devstack@n-api.service[114988]: Gracefully killing worker 2 (pid: 114988)... Jun 18 22:00:19.999823 ncdv-master-1 devstack@n-api.service[114986]: worker 1 buried after 1 seconds Jun 18 22:00:19.999823 ncdv-master-1 devstack@n-api.service[114986]: worker 2 buried after 1 seconds Jun 18 22:00:19.999823 ncdv-master-1 devstack@n-api.service[114986]: goodbye to uWSGI. Jun 18 22:00:20.002004 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jun 18 22:00:20.002708 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 18 22:00:20.006132 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 18 22:00:20.064985 ncdv-master-1 devstack@n-api.service[130891]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 18 22:00:20 2022] *** Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: nodename: ncdv-master-1 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: machine: x86_64 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: clock source: unix Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: pcre jit disabled Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: detected number of CPU cores: 4 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: current working directory: / Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: detected binary path: /usr/bin/uwsgi-core Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: your processes number limit is 47680 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: your memory page size is 4096 bytes Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: detected max file descriptor number: 2048 Jun 18 22:00:20.067675 ncdv-master-1 devstack@n-api.service[130891]: lock engine: pthread robust mutexes Jun 18 22:00:20.069176 ncdv-master-1 devstack@n-api.service[130891]: thunder lock: enabled Jun 18 22:00:20.069176 ncdv-master-1 devstack@n-api.service[130891]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 18 22:00:20.069176 ncdv-master-1 devstack@n-api.service[130891]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 18 22:00:20.116961 ncdv-master-1 devstack@n-api.service[130891]: Python main interpreter initialized at 0x5567b63c89c0 Jun 18 22:00:20.116961 ncdv-master-1 devstack@n-api.service[130891]: python threads support enabled Jun 18 22:00:20.116961 ncdv-master-1 devstack@n-api.service[130891]: your server socket listen backlog is limited to 100 connections Jun 18 22:00:20.116961 ncdv-master-1 devstack@n-api.service[130891]: your mercy for graceful operations on workers is 90 seconds Jun 18 22:00:20.117363 ncdv-master-1 devstack@n-api.service[130891]: mapped 403077 bytes (393 KB) for 2 cores Jun 18 22:00:20.117440 ncdv-master-1 devstack@n-api.service[130891]: *** Operational MODE: preforking *** Jun 18 22:00:20.117645 ncdv-master-1 devstack@n-api.service[130891]: *** uWSGI is running in multiple interpreter mode *** Jun 18 22:00:20.117645 ncdv-master-1 devstack@n-api.service[130891]: spawned uWSGI master process (pid: 130891) Jun 18 22:00:20.117877 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 18 22:00:20.121790 ncdv-master-1 devstack@n-api.service[130891]: spawned uWSGI worker 1 (pid: 130902, cores: 1) Jun 18 22:00:20.121790 ncdv-master-1 devstack@n-api.service[130891]: spawned uWSGI worker 2 (pid: 130903, cores: 1) Jun 18 22:00:20.121790 ncdv-master-1 devstack@n-api.service[130891]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 18 22:00:21.428668 ncdv-master-1 devstack@n-api.service[130902]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 22:00:21.458039 ncdv-master-1 devstack@n-api.service[130903]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 18 22:00:22.177480 ncdv-master-1 devstack@n-api.service[130902]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 22:00:22.177480 ncdv-master-1 devstack@n-api.service[130902]: from cryptography.utils import int_from_bytes Jun 18 22:00:22.177817 ncdv-master-1 devstack@n-api.service[130902]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 22:00:22.177817 ncdv-master-1 devstack@n-api.service[130902]: from cryptography.utils import int_from_bytes Jun 18 22:00:22.210912 ncdv-master-1 devstack@n-api.service[130903]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 22:00:22.210912 ncdv-master-1 devstack@n-api.service[130903]: from cryptography.utils import int_from_bytes Jun 18 22:00:22.211230 ncdv-master-1 devstack@n-api.service[130903]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 18 22:00:22.211230 ncdv-master-1 devstack@n-api.service[130903]: from cryptography.utils import int_from_bytes Jun 18 22:00:24.583402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 22:00:24.584040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 22:00:24.584154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 22:00:24.584544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 22:00:24.584819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 22:00:24.585253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.585574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.585897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.586225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.586566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.586866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.587190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.587508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.587855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.588117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.588491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.588847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.589181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.589472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.589785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.590101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.590403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.590728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.591032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.591532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.591968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.592292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.592596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.592935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.593277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.593588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.593912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.594224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.594548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.594857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.595264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.595559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.595871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.596193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.596612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.596925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.597267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.597591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.597914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.598223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.598559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.598879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.599329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.599664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.599971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.600279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.600595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.600916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.601244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.601551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.601804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.602111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.602433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.602754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.603075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.603327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.603576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.603893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.604213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.604520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.604827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.605158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.605466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.605771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.606075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.606383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.606688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.607008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.607328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.607650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.607959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.608280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.608679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.608931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.609265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.609605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.609924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.610234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.610554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.610938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.611180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.611484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.611792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.612112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.612436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.612742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.612993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.613321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.613628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.613948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.614257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.614563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.614894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.615198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.615508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.615815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.616121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.616425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.616737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.617071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.617378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.617682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.617985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.618305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.618625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.618939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.619250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.619557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.619861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.620182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.620489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.620799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.621147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.621453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.621758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.622074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.622379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.622684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.623002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.623302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.623608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.623923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.624231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.624535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.624837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.625166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.625467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.625771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.626071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.626373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.626669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.626986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.627310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.627616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.627923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.628229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.628548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.628883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.629243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.629589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.629902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.630238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.630673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.630992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.631305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.631620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.631949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.632260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.632575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.632888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.633232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.633551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.633881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.634297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.634625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.635001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.635314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.635629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.635961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.636275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.636585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.636924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.637302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.637616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.637941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.638263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.638574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.638882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.639194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.640519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.640519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.640519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.640519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.641000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.641294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.641437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.641775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.642144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.642484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.642801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.643115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.643426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.643741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.644053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.644362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.644678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.644979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.645322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.645413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 18 22:00:24.645833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.645943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 18 22:00:24.646064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.646197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 18 22:00:24.646343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.646548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.646667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 18 22:00:24.646812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 18 22:00:24.646934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.647169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.647261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.647499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.647591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.647803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.647910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.648111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.648212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.648417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.648513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.648722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.648827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.649025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.649174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.649371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.649463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.649681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.649786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.649985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.650130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.650303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.650403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.650610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.650703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.650913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.651006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.651234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.651344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.651538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.651629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.651841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.651934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.652149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.652296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.652456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.652557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.652765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.652904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.653106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.653307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.653415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.653628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.653775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.653940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.654048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.654257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.654361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.654597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.654732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.654916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.655026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.655228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.655333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.655561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.655656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.655873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.655974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.656190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.656299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.656505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.656607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.656805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.656899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.657141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.657250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.657447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.657555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.657756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.657856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.658067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.658256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.658369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.658572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.658665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.658886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.658978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.659213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.659350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.659537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.659670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.659889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.660022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.660168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.660309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.660439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.660535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.660746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.660838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.661078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.661190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.661410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.661508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.661779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.661880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.662097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.662255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.662424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.662576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.662733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.662904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.663086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.663256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.663360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.663546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.663665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.663867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.663978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.664180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.664282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.664491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.664616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.664794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.664890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.665088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.665203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.665362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.665460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.665689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.665791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.666001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.666108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.666318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.666430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.666630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.666745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.666942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.667041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.667268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.667524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.667695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.667821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.667916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.668134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.668248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.668443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.668538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.668767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.668865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.669112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.669272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.669440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.669572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.669751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.669893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.670104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.670230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.670461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.670595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.670717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.670829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.671014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.671155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.671358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.671461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.671672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.671764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.671984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.672077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.672292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.672397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.672610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.672756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.672917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.673010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.673254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.673634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.673769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.673882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.674001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.674114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.674232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.674446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.674569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.674724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.674853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.675028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.675174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.675343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.675475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.675672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.675836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.675974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.676125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.676288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.676597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.676706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.676904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.677017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.677266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.677552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.677684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.677873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.678108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.678240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.678384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.678521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.678648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.678782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.678940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.679082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.679285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.679425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.679621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.679760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.679959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.680112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.680315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.680448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.680586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.680714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.680879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.681025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.681194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.681498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.681645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.681818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.681956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.682128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.682279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.682442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.682589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.682769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.682909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.683077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.683208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.683385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.683526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.683704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.683845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.684016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.684170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.684379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.684554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.684691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.684832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.684961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.685208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.685354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.685557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.685687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.685866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.685998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.686173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.686316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.686480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.686629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.686791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.686936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.687096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.687237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.687402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.687542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.687708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.687848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.688014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.688159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.688315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.688460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.688637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.688770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.688965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.689129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.689304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.689446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.689618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.689751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.689928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.690061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.690252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 18 22:00:24.690475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.690610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.690739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.690921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.691055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.691299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.691451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.691588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.691731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.691911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.692061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.692238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.692378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.692559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.693160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.693339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.693663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.693788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.694894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.695096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.695241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.695427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.695559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.695769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.695901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.696109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.696249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.696460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.696598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.696774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.696914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.697110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.697257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.697432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.697566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.697766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.697899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.698992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.699120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.699313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.699454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.699629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.699760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.699940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.700072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.700253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.700399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.700614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.700747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.700874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.701937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.702137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.702279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.702454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.702594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.702766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.702904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.703075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.703217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.703387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.703524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.703700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.703839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.704976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.705149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.705377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.705504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.705694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.705836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.706919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.707968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.708163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.708290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.708521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.708653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.708835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.708955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.709192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.709312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.709503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.709635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.709815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.709947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.710128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.710253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.710435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.710552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.710757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.710884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.711964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.712996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.713191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.713318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.713504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.713688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.713872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.714965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.715113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.715278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.715422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.715565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.715706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.715870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.716023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.716166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.716316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.716485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.716708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.716857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.717982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.718151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.718296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.718439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.718590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.718742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.718900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.719059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.719226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.719386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.719542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.719694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.719866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.720997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.721201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.721356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.721507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.721669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.721886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.722088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.722241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.722409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.722570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.722723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.722866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.723968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.724220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.724378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.724522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.724691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.724843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.724997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.725181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.725327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.725507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.725662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.725828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.725983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.726135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.726289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.726434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.726599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.726838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.726997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.727186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.727393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.727558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.727724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.727880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.728932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.729950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.730872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.731968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.732121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.732300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.732409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.732609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.732763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.732909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.733086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.733237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.733379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.733522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.733758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.733912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.734056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.734198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.734421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.734585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.734752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.734910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.735966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.736108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.736249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.736399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.736542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.736684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.736951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.737105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.737309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.737470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.737600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.737707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.737944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.738095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.738204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.738298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.738541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.738679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.738859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.739896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.740127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.740285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.740455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.740593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.740734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.740844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.741066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.741390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.741701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.742012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.742330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.742643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.742967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.743273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.743596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.743866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.743972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.744217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.744321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.744522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.744617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.744826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.744932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.745168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.745358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.745476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.745660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.745811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.745988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.746100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.746342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.746445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.746667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.746762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.747960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.748054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.748287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.748500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.748595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.748831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.748940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.749180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.749411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.749506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.749606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.749825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.749933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.750583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.750730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.750853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.750970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.751891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.752002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.752109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.752216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.752376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.752784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.753882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.754072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.754187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.754374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.754482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.754706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.754800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.755034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.755127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.755514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.755634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.755739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.755825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.756986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.758954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.759972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.760065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.760278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.760371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.760587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.760690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.760907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.761002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.761246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.761390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.761520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.761710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.761830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.762030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.762151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.762502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.762624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.762741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.762847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.763204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.763316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.763411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.763507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.763592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.763741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.764969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.765083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.765304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.765399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.765600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.765729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.765930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.766948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.767165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.767316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.767475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.767570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.767787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.767896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.768088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.768189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.768399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.768493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.768704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.768812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.769970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.770084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.770282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.770376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.770592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.770748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.770917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.771933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.772150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.772246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.772458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.772550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.772764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.772854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.773097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.773435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.773552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.773647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.773793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.773886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.774928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.775049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.775237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.775378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.775543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.775720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.775855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.776027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.776147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.776354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.776454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.776683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.776781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.777980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.778079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.778290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.778388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.778598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.778698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.778903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.779168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.779258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.779498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.779597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.779806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.779897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.780111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.780209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.780436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.780539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.780747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.780846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.781118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.781227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.781379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.781477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.781683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.781781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.782988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.783086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.783382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.783532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.783621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.783713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.783931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.784031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.784364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.784499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.784627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.784815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.784934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.785151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.785333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.785472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.785662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.785786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.785980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.786101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.786310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.786432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.786688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.786815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.787988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.788103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.788310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.788432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.788628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.788751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.788936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.789080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.789276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.789401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.789591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.789707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.789902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.790950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.791148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.791244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.791462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.791561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.791774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.792988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.793259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.793490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.793793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.794127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.794470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.794789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.795106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.795429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.795748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.796107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.796396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.796717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.797052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.797370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.797483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.797688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.797799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.798103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.798242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.798442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.798602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.798781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.798935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.799114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.799271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.799448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.799613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.799776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.799939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.800232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.800338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.800562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.800674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.800891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.801002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.801218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.801453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.801566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.801783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.801881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.802127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.802228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.802461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.802570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.802785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.802882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.803098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.803203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.803406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.803518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.803816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.803947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.804034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.804273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.804382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.804644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.804762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.804960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.805177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.805436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.805550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.805761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.805858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.806077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.806190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.806398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.806502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.806713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.806805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.807967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.808071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.808288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.808395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.808607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.808712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.808921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.809019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.809265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.809511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.809636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.809831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.810899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.811125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.811222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.811494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.811595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.811786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.811880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.812064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.812167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.812387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.812484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.812717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.812825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.813051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.813369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.813473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.813713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.814620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.814721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.814809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.814886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.814968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.815957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.816989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.817337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.817993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.818995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.819099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.819331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.819436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.819657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.819765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.819979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.820077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.820297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.820404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.820617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.820724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.820935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.821165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.821272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.821358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.821670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.821779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.822259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.822584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.822901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.823213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.823545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.823987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.824324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.824689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.825079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.825568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.825853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.826186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.826522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.827448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.827448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.827448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.827843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.828079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.828410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.828762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.829211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.829448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.829777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.830235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.830479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.830810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.831146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.831455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.831843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.832076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.832393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.832618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.832721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.832992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.833202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.833455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.833658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.834166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.834320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.835019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.835019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.835337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.835746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.835951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.836243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.836546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.836748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.836907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.837163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.837338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.837508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.837905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.837905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.838217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.838382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.838533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.838699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.838857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.839014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.839164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.839327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.839490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.839709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.840028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.840353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.840677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.840863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.841012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.841409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.841617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.841782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.841983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.842163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.842318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.842486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.842677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.842838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.843004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.843169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.843343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.843495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.843719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.844022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.844382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.844382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.844708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.844835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.844948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.845294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.845439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.845968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.846154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.846154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.846581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.846785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.846953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.847104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.847104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.847401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.847556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.847901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.848206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.849233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.849233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.849577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.849758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.849925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.850124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.851590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.851590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.851590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.852049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.852201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.852201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.852503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.853241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.853437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.853630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.853788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.853938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.854105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.854309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.854625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.854783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.854783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.854783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.856529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.856724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.856724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.856724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.857408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.857663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.857864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.858188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.858348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.858502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.858658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.858658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.858957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.859117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.859288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.859439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.859589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.859739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.859931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.860088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.860262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.860413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.860564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.861113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.861295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.861295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.861615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.861854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.862960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.863122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.863281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.863430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.863580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.863739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.863897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.864097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.864256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.864414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.864624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.864922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.865098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.865098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.865578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.865752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.865913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.865913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.866224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.866375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.866739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.866898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.867048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.867201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.867378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.867530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.867695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.867847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.868034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.868356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.868527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.868680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.868838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.868998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.869256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.869813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.869984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.869984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.870295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.870444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.870593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.870593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.870906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.871067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.871226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.871376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.871533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.871694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.871870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.872144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.872310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.872461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.872619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.872875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.873089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.873261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.873414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.873563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.873563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.873868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.874029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.874179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.874341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.874491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.874648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.874798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.875111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.875272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.875423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.875423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.875423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.876192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.876356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.876517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.876860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.876860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.877288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.877454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.877612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.877771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.877929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.878088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.878269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.878603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.878762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.878925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.879101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.879364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.879536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.879686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.879836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.879992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.880159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.880391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.880556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.880725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.880930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.881921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.882323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.882487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.882638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.882788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.882945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130902) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.883262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.884457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.886112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.887955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.889978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.890372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.890552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.890704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.891027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.891366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.891697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.892029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.892382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.892640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.892946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.893328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.893653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.893964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.894358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.894667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.894978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.895356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.895584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.896062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.896347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.896659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.897026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.897313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.897620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.897925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.898268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.898557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.898877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.899166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.899471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.899776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.900079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.900463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.900710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.901128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.901385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.901714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.902025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.902351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.902660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.902983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.903308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.903629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.903937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.904271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.904582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.904895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.905244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.905576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.905886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.906285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.906511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.906838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.907174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.907465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.907785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.908105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.908449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.908732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.909083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.909395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.909705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.910019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.910329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.910640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.910956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.911271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.911708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.912048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.912362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.912694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.913023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.913409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.913723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.914107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.914402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.914709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.915022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.915330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 18 22:00:24.915659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 18 22:00:24.948819 ncdv-master-1 devstack@n-api.service[130902]: INFO dbcounter [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Registered counter for database nova_api Jun 18 22:00:24.971427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_db.sqlalchemy.engines [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:24.978696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writer thread running {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:24.983483 ncdv-master-1 devstack@n-api.service[130903]: INFO dbcounter [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Registered counter for database nova_api Jun 18 22:00:25.004033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_db.sqlalchemy.engines [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.011425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writer thread running {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.039666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.context [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=130902) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 22:00:25.044462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:00:25.046091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:00:25.046928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:00:25.048995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:00:25.051063 ncdv-master-1 devstack@n-api.service[130902]: INFO dbcounter [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Registered counter for database nova_cell0 Jun 18 22:00:25.055549 ncdv-master-1 devstack@n-api.service[130902]: INFO dbcounter [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Registered counter for database nova_cell1 Jun 18 22:00:25.063380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_db.sqlalchemy.engines [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.065779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_db.sqlalchemy.engines [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.070860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writer thread running {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.072857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.context [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=130903) load_cells /opt/stack/nova/nova/context.py:464}} Jun 18 22:00:25.077081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:00:25.078685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:00:25.079515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:00:25.081612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:00:25.083696 ncdv-master-1 devstack@n-api.service[130903]: INFO dbcounter [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Registered counter for database nova_cell0 Jun 18 22:00:25.087798 ncdv-master-1 devstack@n-api.service[130903]: INFO dbcounter [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Registered counter for database nova_cell1 Jun 18 22:00:25.094864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_db.sqlalchemy.engines [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.096619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_db.sqlalchemy.engines [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.102445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writer thread running {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.105078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writer thread running {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.213614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writer thread running {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.224646 ncdv-master-1 devstack@n-api.service[130902]: INFO dbcounter [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Registered counter for database nova_cell0 Jun 18 22:00:25.231808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_db.sqlalchemy.engines [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130902) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.236638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writer thread running {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.253746 ncdv-master-1 devstack@n-api.service[130903]: INFO dbcounter [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Registered counter for database nova_cell0 Jun 18 22:00:25.262816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_db.sqlalchemy.engines [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 18 22:00:25.267587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writer thread running {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 18 22:00:25.693864 ncdv-master-1 devstack@n-api.service[130902]: WARNING keystonemiddleware.auth_token [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 22:00:25.701384 ncdv-master-1 devstack@n-api.service[130902]: WARNING keystonemiddleware.auth_token [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 22:00:25.720338 ncdv-master-1 devstack@n-api.service[130903]: WARNING keystonemiddleware.auth_token [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 22:00:25.727685 ncdv-master-1 devstack@n-api.service[130903]: WARNING keystonemiddleware.auth_token [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 22:00:25.926908 ncdv-master-1 devstack@n-api.service[130902]: WARNING keystonemiddleware.auth_token [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 22:00:25.933099 ncdv-master-1 devstack@n-api.service[130902]: WARNING keystonemiddleware.auth_token [None req-93e7bb17-ae43-4127-8529-0694d83ca21c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 22:00:25.938495 ncdv-master-1 devstack@n-api.service[130902]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5567b63c89c0 pid: 130902 (default app) Jun 18 22:00:25.948883 ncdv-master-1 devstack@n-api.service[130903]: WARNING keystonemiddleware.auth_token [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 18 22:00:25.954958 ncdv-master-1 devstack@n-api.service[130903]: WARNING keystonemiddleware.auth_token [None req-22c007f2-99a6-4a0b-b701-ab2469c4c80c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 18 22:00:25.960310 ncdv-master-1 devstack@n-api.service[130903]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5567b63c89c0 pid: 130903 (default app) Jun 18 22:01:12.512205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.513617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.513796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:12.514493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:13.846212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Calling method '.version_select at 0x7fea16d77dc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:13.849324 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:13.849324 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:13.856806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=130902) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 18 22:01:13.858251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:13.858946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:13.897291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:13.897998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:13.913970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:13.917269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:13.924485 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c7df8b0-7577-4339-bfbb-a45420447b94 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.417883 Jun 18 22:01:13.925780 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1207 bytes} [Sat Jun 18 22:01:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:01:14.206250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-592c3a90-b5bd-4951-b157-e522bad34240 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1050193549"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:14.236533 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:14.236533 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:14.237860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-592c3a90-b5bd-4951-b157-e522bad34240 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Generated uuid 85d71ecf-334c-4930-8f22-35fd4faecb36 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:14.247627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.248858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.250043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.250991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:14.361132 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-592c3a90-b5bd-4951-b157-e522bad34240 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.421807 Jun 18 22:01:14.362518 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1/2] 10.222.0.30 () {62 vars in 1204 bytes} [Sat Jun 18 22:01:13 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:14.617337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-488865cf-62e6-4f58-864a-18280237becd tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:14.619325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-488865cf-62e6-4f58-864a-18280237becd tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:14.619916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-488865cf-62e6-4f58-864a-18280237becd tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:14.621013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-488865cf-62e6-4f58-864a-18280237becd tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:14.621624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-488865cf-62e6-4f58-864a-18280237becd tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:14.673789 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-488865cf-62e6-4f58-864a-18280237becd tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.668633 Jun 18 22:01:14.682878 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Jun 18 22:01:14 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:01:14.682878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f51cb7a-8a34-4e9a-a7a6-c3ecd8d53f5a tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1234199770"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:14.760984 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:14.760984 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:14.870544 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f51cb7a-8a34-4e9a-a7a6-c3ecd8d53f5a tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.192024 Jun 18 22:01:14.871631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3/4] 10.222.0.30 () {62 vars in 1209 bytes} [Sat Jun 18 22:01:14 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:15.221643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eea1ffe3-9f97-4682-95d0-17a9c3b1f7bc tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1999312649", "ram": 512, "vcpus": 1, "disk": 10, "id": 993647802, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:15.255242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '.version_select at 0x7fea16ca8c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:15.256084 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:15.256084 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:15.259251 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:15.259251 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:15.267321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=130903) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 18 22:01:15.272795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.273304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.322433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eea1ffe3-9f97-4682-95d0-17a9c3b1f7bc tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.442055 Jun 18 22:01:15.323866 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 4/5] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:14 2022] POST /compute/v2.1/flavors => generated 413 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:15.334821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.335669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df81f914-5fc8-4a9c-9336-2b1a34699b69 tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:15.336628 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:15.336628 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:15.338082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df81f914-5fc8-4a9c-9336-2b1a34699b69 tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.338565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df81f914-5fc8-4a9c-9336-2b1a34699b69 tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.339478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df81f914-5fc8-4a9c-9336-2b1a34699b69 tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.339988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df81f914-5fc8-4a9c-9336-2b1a34699b69 tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.345776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.362358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.363653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.377186 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a256746-205a-4722-9c85-ed5d05f38913 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.013231 Jun 18 22:01:15.378278 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2/6] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:01:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:15.390944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6ab53453-9be3-44fc-8467-d67eb4a9cb47 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:15.391786 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:15.391786 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:15.408089 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df81f914-5fc8-4a9c-9336-2b1a34699b69 tempest-AZAdminV2TestJSON-1153166385 tempest-AZAdminV2TestJSON-1153166385-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.083001 Jun 18 22:01:15.409438 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 5/7] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:01:15 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:15.447729 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6ab53453-9be3-44fc-8467-d67eb4a9cb47 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.068078 Jun 18 22:01:15.449275 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3/8] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Jun 18 22:01:15 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:15.855066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Calling method '.version_select at 0x7fea163a6a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:15.856565 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:15.856565 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:15.858228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.858716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.898863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.899502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:15.960867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-515000598", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:15.991063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:15.991525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:16.015756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:16.019216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:16.074270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:16.075540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:16.088748 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18445a7d-ab57-4935-bb51-dd4f88a8576b tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.677540 Jun 18 22:01:16.089973 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 6/9] 10.222.0.30 () {60 vars in 1242 bytes} [Sat Jun 18 22:01:15 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:01:16.409783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f14172e-afb2-4a80-a1c8-8e7d88d4ba25 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:16.461637 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-9f14172e-afb2-4a80-a1c8-8e7d88d4ba25 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] HTTP exception thrown: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f14172e-afb2-4a80-a1c8-8e7d88d4ba25 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Request method failure captured: Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/flavors/993647802/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksn6KwmZa5IEVktPMKYFjDxSFtnZ9qEZoMm_ZhET4fqgs_0LKEIgBcqj5HKTjjru3DHJwVLwsY8tZnRCYV0NjEOIEqm7HIMGLq6Mwbh1wsmFh2w_fUhVFdGnkCz1XGa92HKxArCwqN5BOSmZ0CK_jgeu6SpPi_zLGgH4deGkYBXBHA Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:16.471625 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_33e8de4c73e54b0a8df321b3b3b65c28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65d884def116435eb153d424395308d2 Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:16.472751 ncdv-master-1 devstack@n-api.service[130902]: exception: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'flavor_id': '993647802', 'id': 'hw:cpu_thread_policy'} Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:16.473457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:16.474477 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:16.475801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f14172e-afb2-4a80-a1c8-8e7d88d4ba25 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Returning 404 to user: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:16.478011 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f14172e-afb2-4a80-a1c8-8e7d88d4ba25 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] 10.222.0.30 "GET /compute/v2.1/flavors/993647802/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.386142 Jun 18 22:01:16.481264 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 7/10] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:01:16 2022] GET /compute/v2.1/flavors/993647802/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:16.491820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1852cf3-3c4d-413b-b58a-74a89270be4d tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:16.495855 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:16.495855 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:16.513461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1852cf3-3c4d-413b-b58a-74a89270be4d tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:16.516837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1852cf3-3c4d-413b-b58a-74a89270be4d tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:16.731098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:01:17.370637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:01:17.371318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:01:17.371929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:01:17.372470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:01:17.373046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:01:17.395437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.396150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.397177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.397748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.492648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Getting quotas for project d9f244c1df9c4ca19ec5fa57b7d94bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:01:17.504229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Getting quotas for user c9ae6d217f7344408eed23388dd337b7 and project d9f244c1df9c4ca19ec5fa57b7d94bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:01:17.523082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1852cf3-3c4d-413b-b58a-74a89270be4d tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.41 time: 1.040255 Jun 18 22:01:17.524339 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 8/11] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Jun 18 22:01:16 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:17.531727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Calling method '.version_select at 0x7fea152fe820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:17.533806 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:17.533806 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:17.535084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.535530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.555173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:01:17.559323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:01:17.572579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.572857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.603634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.607665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.634842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.635317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.658412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.659386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.667652 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d56dedbd-45dd-4450-83ac-6639b9171a8f tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.141793 Jun 18 22:01:17.668421 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 9/12] 10.222.0.30 () {60 vars in 1221 bytes} [Sat Jun 18 22:01:17 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:17.674157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2eb32e62-4f9d-41b5-b8f2-fdda93affe0e tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:17.676159 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:17.676159 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:17.679935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa5003fa-c022-493b-813e-b654a31e99ae tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227845 Jun 18 22:01:17.682613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2eb32e62-4f9d-41b5-b8f2-fdda93affe0e tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '65d884def116435eb153d424395308d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e8de4c73e54b0a8df321b3b3b65c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2eb32e62-4f9d-41b5-b8f2-fdda93affe0e tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Request method failure captured: Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/flavors/993647802/os-extra_specs HTTP/1.1 Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 66 Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksn6KwmZa5IEVktPMKYFjDxSFtnZ9qEZoMm_ZhET4fqgs_0LKEIgBcqj5HKTjjru3DHJwVLwsY8tZnRCYV0NjEOIEqm7HIMGLq6Mwbh1wsmFh2w_fUhVFdGnkCz1XGa92HKxArCwqN5BOSmZ0CK_jgeu6SpPi_zLGgH4deGkYBXBHA Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:17.685818 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_33e8de4c73e54b0a8df321b3b3b65c28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65d884def116435eb153d424395308d2 Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 18 22:01:17.686841 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'flavor_id': '993647802', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:17.687407 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 18 22:01:17.688362 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:17.689327 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 4/13] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:01:17.692507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2eb32e62-4f9d-41b5-b8f2-fdda93affe0e tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:17.693808 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2eb32e62-4f9d-41b5-b8f2-fdda93affe0e tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] 10.222.0.30 "POST /compute/v2.1/flavors/993647802/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.024089 Jun 18 22:01:17.701720 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 10/14] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Jun 18 22:01:17 2022] POST /compute/v2.1/flavors/993647802/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:17.707384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-162c328a-b9eb-48e4-8443-3c1efc7327e9 tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Calling method '.version_select at 0x7fea1527e790>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:17.710212 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:17.710212 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:17.712886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162c328a-b9eb-48e4-8443-3c1efc7327e9 tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.713783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162c328a-b9eb-48e4-8443-3c1efc7327e9 tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.714981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cda8d661-dcdd-40c2-a62e-8265938116c8 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:17.723237 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:17.723237 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:17.738053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162c328a-b9eb-48e4-8443-3c1efc7327e9 tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.738819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cda8d661-dcdd-40c2-a62e-8265938116c8 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:17.739284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cda8d661-dcdd-40c2-a62e-8265938116c8 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.739501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162c328a-b9eb-48e4-8443-3c1efc7327e9 tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:17.748574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-162c328a-b9eb-48e4-8443-3c1efc7327e9 tempest-HypervisorAdminV253TestBase-1514894081 tempest-HypervisorAdminV253TestBase-1514894081-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2cae7e79-dec4-4908-be4e-472333a8d5ed" status: 200 len: 791 microversion: 2.53 time: 0.045462 Jun 18 22:01:17.750645 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 11/15] 10.222.0.30 () {60 vars in 1297 bytes} [Sat Jun 18 22:01:17 2022] GET /compute/v2.1/os-hypervisors/2cae7e79-dec4-4908-be4e-472333a8d5ed => generated 791 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:17.759493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7db8fb6f-0694-45d5-b5fd-91864db5dbc8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:17.760585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7db8fb6f-0694-45d5-b5fd-91864db5dbc8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:19.082925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7db8fb6f-0694-45d5-b5fd-91864db5dbc8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:19.103934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7db8fb6f-0694-45d5-b5fd-91864db5dbc8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1219 microversion: 2.1 time: 1.351815 Jun 18 22:01:19.104857 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 12/16] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:17 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1219 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:19.109612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c6ac2b0-2d3e-4df5-a704-442f24457301 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.110989 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.110989 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:19.196560 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c6ac2b0-2d3e-4df5-a704-442f24457301 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/993647802/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089294 Jun 18 22:01:19.201297 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 13/17] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Jun 18 22:01:19 2022] POST /compute/v2.1/flavors/993647802/os-extra_specs => generated 66 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:19.212033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df838504-15cf-4fb3-bb0c-bda7d5dbcb35 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:19.213767 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.213767 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:19.215250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-df838504-15cf-4fb3-bb0c-bda7d5dbcb35 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '65d884def116435eb153d424395308d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e8de4c73e54b0a8df321b3b3b65c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df838504-15cf-4fb3-bb0c-bda7d5dbcb35 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Request method failure captured: Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksn6KwmZa5IEVktPMKYFjDxSFtnZ9qEZoMm_ZhET4fqgs_0LKEIgBcqj5HKTjjru3DHJwVLwsY8tZnRCYV0NjEOIEqm7HIMGLq6Mwbh1wsmFh2w_fUhVFdGnkCz1XGa92HKxArCwqN5BOSmZ0CK_jgeu6SpPi_zLGgH4deGkYBXBHA Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:19.217247 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_33e8de4c73e54b0a8df321b3b3b65c28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65d884def116435eb153d424395308d2 Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:19.218313 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'flavor_id': '993647802', 'id': 'hw:numa_nodes'} Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:19.218920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 18 22:01:19.219843 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.221384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df838504-15cf-4fb3-bb0c-bda7d5dbcb35 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:19.223591 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df838504-15cf-4fb3-bb0c-bda7d5dbcb35 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016797 Jun 18 22:01:19.226425 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 14/18] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:01:19 2022] DELETE /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:01:19.239658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83f1a60b-f11a-42c1-b08a-17a117ac30a6 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.259023 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cda8d661-dcdd-40c2-a62e-8265938116c8 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 1.568461 Jun 18 22:01:19.265847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 5/19] 10.222.0.30 () {62 vars in 1231 bytes} [Sat Jun 18 22:01:17 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:19.273872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-edf3c07f-a126-4d44-ae93-a831f4c188b3 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:19.274878 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.274878 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:19.295545 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83f1a60b-f11a-42c1-b08a-17a117ac30a6 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/993647802/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061283 Jun 18 22:01:19.296495 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 15/20] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Jun 18 22:01:19 2022] POST /compute/v2.1/flavors/993647802/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:19.305849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37350224-e748-41d8-a279-b35f3fb455a9 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.307061 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.307061 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:19.308214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37350224-e748-41d8-a279-b35f3fb455a9 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '65d884def116435eb153d424395308d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e8de4c73e54b0a8df321b3b3b65c28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37350224-e748-41d8-a279-b35f3fb455a9 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Request method failure captured: Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 22 Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksn6KwmZa5IEVktPMKYFjDxSFtnZ9qEZoMm_ZhET4fqgs_0LKEIgBcqj5HKTjjru3DHJwVLwsY8tZnRCYV0NjEOIEqm7HIMGLq6Mwbh1wsmFh2w_fUhVFdGnkCz1XGa92HKxArCwqN5BOSmZ0CK_jgeu6SpPi_zLGgH4deGkYBXBHA Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:19.310872 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/33e8de4c73e54b0a8df321b3b3b65c28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_33e8de4c73e54b0a8df321b3b3b65c28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 33e8de4c73e54b0a8df321b3b3b65c28 Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65d884def116435eb153d424395308d2 Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: {"hw:numa_nodes": "1"} Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:19.312432 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'flavor_id': '993647802', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:19.313254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 18 22:01:19.314171 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.315145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37350224-e748-41d8-a279-b35f3fb455a9 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:19.317554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37350224-e748-41d8-a279-b35f3fb455a9 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458 tempest-FlavorsExtraSpecsNegativeTestJSON-2052051458-project] 10.222.0.30 "PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015247 Jun 18 22:01:19.317932 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-edf3c07f-a126-4d44-ae93-a831f4c188b3 tempest-AggregatesAdminTestV241-1752830827 tempest-AggregatesAdminTestV241-1752830827-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.047967 Jun 18 22:01:19.324084 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 6/21] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Jun 18 22:01:19 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:19.324159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 16/22] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:01:19 2022] PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:01:19.340575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b756ae50-6c2e-454d-8210-890b6cf0d3ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:19.341950 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.341950 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:19.357770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c146522-4712-457e-9178-f467f916ff09 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1654992085", "name": "tempest-test_aggregate-827103089"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.377289 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b756ae50-6c2e-454d-8210-890b6cf0d3ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] HTTP exception thrown: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b756ae50-6c2e-454d-8210-890b6cf0d3ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Request method failure captured: Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/flavors/993647802/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksqIZj2NhbLcIO-lRCEKgSlR7t4PSOPxlxWhj8Ba3TuiLtIXfnIq9x48LemkqIfXJjxT8mpW8R-Ovg3xW7ZFyZiKEB9IJ4O_MKANlvWbs_Uh1SdF5ED2mNKkkoCXwTJ18wHtHp6lUcWqF2gr6iWOS8D20uRqSTAW1d-h2L_LWLFxvU Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: ac397ade516d46dba09aa7a5376de6e6 Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:19.382392 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac397ade516d46dba09aa7a5376de6e6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: ac397ade516d46dba09aa7a5376de6e6 Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cb1d29b5d2a94c1d9fda6d089d9270ee Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:19.383490 ncdv-master-1 devstack@n-api.service[130903]: exception: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'flavor_id': '993647802', 'id': 'hw:cpu_thread_policy'} Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.384053 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b756ae50-6c2e-454d-8210-890b6cf0d3ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Returning 404 to user: Flavor 993647802 has no extra specs with key hw:cpu_thread_policy. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:19.385125 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b756ae50-6c2e-454d-8210-890b6cf0d3ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/993647802/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.059944 Jun 18 22:01:19.391729 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.391729 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:19.393608 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 7/23] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:01:19 2022] DELETE /compute/v2.1/flavors/993647802/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:19.397511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-2c146522-4712-457e-9178-f467f916ff09 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid 8c1f75e8-4336-4c7c-9053-5f18fd65bd66 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:19.407454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18bc786a-1991-4d44-ba70-caa95737e19a tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.414112 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.414112 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:19.418274 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-18bc786a-1991-4d44-ba70-caa95737e19a tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18bc786a-1991-4d44-ba70-caa95737e19a tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Request method failure captured: Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 27 Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksqIZj2NhbLcIO-lRCEKgSlR7t4PSOPxlxWhj8Ba3TuiLtIXfnIq9x48LemkqIfXJjxT8mpW8R-Ovg3xW7ZFyZiKEB9IJ4O_MKANlvWbs_Uh1SdF5ED2mNKkkoCXwTJ18wHtHp6lUcWqF2gr6iWOS8D20uRqSTAW1d-h2L_LWLFxvU Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: ac397ade516d46dba09aa7a5376de6e6 Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:19.419967 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac397ade516d46dba09aa7a5376de6e6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: ac397ade516d46dba09aa7a5376de6e6 Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cb1d29b5d2a94c1d9fda6d089d9270ee Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: {"hw:cpu_policy": "shared"} Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:19.421244 ncdv-master-1 devstack@n-api.service[130903]: exception: Request body and URI mismatch Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'flavor_id': '993647802', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.422117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.423164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:19.423164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:19.423164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 18 22:01:19.423164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.426532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18bc786a-1991-4d44-ba70-caa95737e19a tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:19.430873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-18bc786a-1991-4d44-ba70-caa95737e19a tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.034397 Jun 18 22:01:19.437689 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 8/24] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:01:19 2022] PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes => generated 73 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:19.447511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-700ca445-997b-43da-a9a6-152345cb6447 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-700ca445-997b-43da-a9a6-152345cb6447 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Request method failure captured: Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 49 Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksqIZj2NhbLcIO-lRCEKgSlR7t4PSOPxlxWhj8Ba3TuiLtIXfnIq9x48LemkqIfXJjxT8mpW8R-Ovg3xW7ZFyZiKEB9IJ4O_MKANlvWbs_Uh1SdF5ED2mNKkkoCXwTJ18wHtHp6lUcWqF2gr6iWOS8D20uRqSTAW1d-h2L_LWLFxvU Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: ac397ade516d46dba09aa7a5376de6e6 Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:19.473943 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac397ade516d46dba09aa7a5376de6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac397ade516d46dba09aa7a5376de6e6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: ac397ade516d46dba09aa7a5376de6e6 Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cb1d29b5d2a94c1d9fda6d089d9270ee Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 18 22:01:19.475323 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'flavor_id': '993647802', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance: Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 18 22:01:19.476075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.477432 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:19.479304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-700ca445-997b-43da-a9a6-152345cb6447 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:19.481925 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-700ca445-997b-43da-a9a6-152345cb6447 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.042068 Jun 18 22:01:19.487756 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 9/25] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:01:19 2022] PUT /compute/v2.1/flavors/993647802/os-extra_specs/hw:numa_nodes => generated 117 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:01:19.497171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-05155a40-42d4-4cac-b84d-066b7bb45dd0 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:19.499077 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.499077 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:19.540262 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c146522-4712-457e-9178-f467f916ff09 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.189559 Jun 18 22:01:19.550696 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 17/26] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Jun 18 22:01:19 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:19.570372 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-05155a40-42d4-4cac-b84d-066b7bb45dd0 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/993647802" status: 202 len: 0 microversion: 2.1 time: 0.080418 Jun 18 22:01:19.572771 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 10/27] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:19 2022] DELETE /compute/v2.1/flavors/993647802 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:19.578607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2cec064-c953-4d90-a08c-2e7cb54216a3 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:19.580608 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.580608 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:19.583571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-123b0cf7-6db7-4efa-82f0-0a21324604ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:19.618439 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d2cec064-c953-4d90-a08c-2e7cb54216a3 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.066183 Jun 18 22:01:19.626837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 18/28] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:01:19 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:19.636097 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-123b0cf7-6db7-4efa-82f0-0a21324604ca tempest-FlavorsExtraSpecsNegativeTestJSON-179068737 tempest-FlavorsExtraSpecsNegativeTestJSON-179068737-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059194 Jun 18 22:01:19.637458 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 11/29] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:19.638300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51eefd10-39b6-4d4e-b747-79421fc0ef3f tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:19.642212 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:19.642212 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:19.659936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51eefd10-39b6-4d4e-b747-79421fc0ef3f tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:19.660417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51eefd10-39b6-4d4e-b747-79421fc0ef3f tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:19.876698 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-51eefd10-39b6-4d4e-b747-79421fc0ef3f tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.247356 Jun 18 22:01:19.878445 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 19/30] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:19 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:20.121868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:20.123714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:20.126380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:20.131115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:20.131944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:20.133102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:20.133783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:20.535584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:20.548895 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-364eb6b8-3800-4fe6-bdb2-bd01552409be tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1293 microversion: 2.1 time: 0.431012 Jun 18 22:01:20.550346 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 20/31] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:20 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1293 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:20.722031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73c8dafe-ece0-4e01-b8a7-1a793084f697 tempest-AZAdminNegativeTestJSON-1847897950 tempest-AZAdminNegativeTestJSON-1847897950-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:20.722858 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:20.722858 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:20.723976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-73c8dafe-ece0-4e01-b8a7-1a793084f697 tempest-AZAdminNegativeTestJSON-1847897950 tempest-AZAdminNegativeTestJSON-1847897950-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'bac09fe1a2be41cfb3e214c6bea1d3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1268d05cf7c4cd09ffbb60c4bb7901e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73c8dafe-ece0-4e01-b8a7-1a793084f697 tempest-AZAdminNegativeTestJSON-1847897950 tempest-AZAdminNegativeTestJSON-1847897950-project] Request method failure captured: Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkstR54qM6v6MKFhT7HlBKlqZ7v3ui7JXWyOT2j8PrYtDIb6yHyzIcZdLpS9EwZU5DElTDmLX6IxHZAakJ2qDv6DwLG_loRb7yP5GCKqjk36F3ZW4bVoIJqF6ZUZ6VOIkYd3TXM8mDr9BXe4LeQ904vK-vO7XaOuuHMbOBkCQBB6f6s Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: f1268d05cf7c4cd09ffbb60c4bb7901e Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1847897950 Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:01:20.726812 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f1268d05cf7c4cd09ffbb60c4bb7901e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f1268d05cf7c4cd09ffbb60c4bb7901e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f1268d05cf7c4cd09ffbb60c4bb7901e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f1268d05cf7c4cd09ffbb60c4bb7901e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AZAdminNegativeTestJSON-1847897950 Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: f1268d05cf7c4cd09ffbb60c4bb7901e Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1847897950 Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AZAdminNegativeTestJSON-1847897950-project Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: bac09fe1a2be41cfb3e214c6bea1d3b9 Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AZAdminNegativeTestJSON-1847897950-project Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 18 22:01:20.727912 ncdv-master-1 devstack@n-api.service[130903]: action_args: {} Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:20.728527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:20.729993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73c8dafe-ece0-4e01-b8a7-1a793084f697 tempest-AZAdminNegativeTestJSON-1847897950 tempest-AZAdminNegativeTestJSON-1847897950-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:20.730876 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73c8dafe-ece0-4e01-b8a7-1a793084f697 tempest-AZAdminNegativeTestJSON-1847897950 tempest-AZAdminNegativeTestJSON-1847897950-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.662513 Jun 18 22:01:20.741395 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 12/32] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:01:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 678 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:21.302935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1032472136", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "availability_zone": "tempest-test_az-1654992085"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:21.338472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:21.342285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:21.346282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:21.346590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:21.461916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:01:21.567949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:21.568768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:21.603315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:21.603772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:21.604633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:21.605149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:21.813357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:01:21.814090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:01:21.814715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:01:21.815346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:01:21.816622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:01:21.834377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:21.835192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:21.836426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:21.837018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:21.878824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Getting quotas for project 454d2ab18dd84eaf8bbd1e2808159df7. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:01:21.888766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Getting quotas for user 75df001919794fd7a2e79cdfbd87cfd6 and project 454d2ab18dd84eaf8bbd1e2808159df7. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:01:21.937332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:01:21.944889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:01:21.970630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:21.996591 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2bde896-48c1-4e96-bea3-fc848558913e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1299 microversion: 2.1 time: 0.433517 Jun 18 22:01:21.998287 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 13/33] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:21 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1299 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:22.059067 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f5cf3700-ae47-441b-95f5-bdcff000bb57 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507375 Jun 18 22:01:22.060523 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 21/34] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:01:22.071806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bdc8e193-073b-47a0-b55c-f5c71bbc3e7c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:22.072817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bdc8e193-073b-47a0-b55c-f5c71bbc3e7c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:22.219158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bdc8e193-073b-47a0-b55c-f5c71bbc3e7c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:22.255305 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bdc8e193-073b-47a0-b55c-f5c71bbc3e7c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1243 microversion: 2.1 time: 0.187262 Jun 18 22:01:22.269331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 14/35] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:22 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1243 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:23.015053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:23.016083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:23.037575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:23.052789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:23.055608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:23.063098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:23.276969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-170ad353-6629-4414-a198-c0d437b3d38f tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:23.278870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-170ad353-6629-4414-a198-c0d437b3d38f tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:23.345558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:23.363753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ee04952-feb7-4882-b937-8e756bba64af tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1299 microversion: 2.1 time: 0.349427 Jun 18 22:01:23.366614 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 22/36] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:23 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1299 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:23.411450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-170ad353-6629-4414-a198-c0d437b3d38f tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:23.423671 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-170ad353-6629-4414-a198-c0d437b3d38f tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1243 microversion: 2.1 time: 0.152811 Jun 18 22:01:23.432939 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 15/37] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:23 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1243 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:24.386045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:24.386822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:24.394092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:24.404144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:24.405766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:24.415176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:24.446442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:24.447049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:24.456605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:24.457085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:24.457887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:24.458336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:24.978782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:24.998105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e5c58fd3-28f2-4b77-b741-6d4095002ef1 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1291 microversion: 2.1 time: 0.555387 Jun 18 22:01:25.005373 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 16/38] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:24 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1291 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:25.091308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:25.107582 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b70630f4-ba2f-4d8a-bb69-1996d91804bd tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.725132 Jun 18 22:01:25.108341 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 23/39] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:24 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:26.021869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:26.022947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:26.046213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:26.046813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:26.051924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:26.053682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:26.125370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:26.126204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:26.143073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:26.143542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:26.144380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:26.157387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:26.327731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:26.336212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a6580c4b-00e8-42cc-a0b1-8bf01fc56676 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1297 microversion: 2.1 time: 0.319494 Jun 18 22:01:26.357070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 17/40] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:26 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1297 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:26.570121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:26.581537 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8823534-fd57-4adb-a4e8-d4ec24be3a11 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.460041 Jun 18 22:01:26.583787 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 24/41] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:26 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:27.353180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:27.353823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:27.371859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:27.372373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:27.374057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:27.390654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:27.469398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:27.609129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:27.611074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:27.622203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:27.623050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:27.628594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:27.650452 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7d8b366-d84c-4d50-9394-c234cffc7e26 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1297 microversion: 2.1 time: 0.291455 Jun 18 22:01:27.650940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:27.653068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:27.670136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 18/42] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:27 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1297 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:28.297345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:28.329734 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-84a0ade9-f98a-4413-8e53-e9eb80b01be2 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.732285 Jun 18 22:01:28.331936 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 25/43] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:27 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:28.668835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:28.670523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:28.691659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:28.692830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:28.694913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:28.697176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:29.325525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d1192b5-a2d5-4379-aacc-e1c87f655b7e tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1135954247", "id": 566563785, "os-flavor-access:is_public": "False"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:29.327935 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:29.327935 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:29.381556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d1192b5-a2d5-4379-aacc-e1c87f655b7e tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.904820 Jun 18 22:01:29.396817 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 19/44] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:28 2022] POST /compute/v2.1/flavors => generated 436 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:29.409199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:29.410021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:29.433656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:29.442130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:29.443099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:29.443580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:29.890743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:29.912753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d9a7569-a89c-44fc-b059-74b5603db6c3 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 1.248630 Jun 18 22:01:29.927016 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 26/45] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:28 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:29.946393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3468ec31-cec1-4934-a1f3-7024e15980eb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:29.948243 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:29.948243 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:30.375101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:30.387932 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7857bcb4-46f2-4261-9abd-76fc2339364c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.989643 Jun 18 22:01:30.391950 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 20/46] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:29 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:31.258053 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3468ec31-cec1-4934-a1f3-7024e15980eb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/566563785/action" status: 200 len: 96 microversion: 2.1 time: 1.325016 Jun 18 22:01:31.260125 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 27/47] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Jun 18 22:01:29 2022] POST /compute/v2.1/flavors/566563785/action => generated 96 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:31.282812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:31.285255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:31.321633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:31.325828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:31.327003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:31.328321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:31.384879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3e3e974-7115-40b9-abfc-ab038ec5484a tempest-InstanceUsageAuditLogTestJSON-157935996 tempest-InstanceUsageAuditLogTestJSON-157935996-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:31.387096 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:31.387096 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:31.501214 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3e3e974-7115-40b9-abfc-ab038ec5484a tempest-InstanceUsageAuditLogTestJSON-157935996 tempest-InstanceUsageAuditLogTestJSON-157935996-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-18 22:01:29" status: 200 len: 318 microversion: 2.1 time: 1.107850 Jun 18 22:01:31.510487 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 21/48] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:01:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-18%2022%3A01%3A29 => generated 318 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:31.530919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9a6fd96-ccce-4d3d-b192-005cba85a787 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:31.533814 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:31.533814 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:31.856464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:31.909726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:32.703683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:32.712036 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fedba8ec-1db7-4316-bf9c-bc7ffc57c25e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 1.448863 Jun 18 22:01:32.712619 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 28/49] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:31 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:32.721858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:32.736775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:32.758859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:32.759325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:32.760114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:32.760552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:32.826362 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a9a6fd96-ccce-4d3d-b192-005cba85a787 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 690879bad3004282a01b8f3ccb72c60e combination. Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9a6fd96-ccce-4d3d-b192-005cba85a787 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Request method failure captured: Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/flavors/566563785/action HTTP/1.1 Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 67 Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirks2j88i7atfz4uLDAbbcf68FrJ9Wriqgq_QRZUeDp5DU62utlBD-ejmbTuGgFw4_XnZffSGdFEQ-QrQ8Oo9o3ghv9J1gfDkkb5ozjpHHC-WyG9eomgdtI3zjJCGfW8B5PR8EEAUl0sowzLk5PY_OKKN_07-ji1eUJVZ17wAlkKfXZA Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 6b0fc8e04b60468abb6ae87d02b5426d Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:32.893798 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b0fc8e04b60468abb6ae87d02b5426d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 6b0fc8e04b60468abb6ae87d02b5426d Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 50c195ac4cc240f6a1aff4753a974be0 Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: {"addTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} Jun 18 22:01:32.895091 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: exception: Flavor access already exists for flavor 16 and project 690879bad3004282a01b8f3ccb72c60e combination. Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '566563785', 'body': {'addTenantAccess': {'tenant': '690879bad3004282a01b8f3ccb72c60e'}}} Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result.read() Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:01:32.895859 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-690879bad3004282a01b8f3ccb72c60e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi session.flush() Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 22:01:32.897153 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 22:01:32.898394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:01:32.899718 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result.read() Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-690879bad3004282a01b8f3ccb72c60e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 18, 22, 1, 32, 804341), 'updated_at': None, 'flavor_id': 16, 'project_id': '690879bad3004282a01b8f3ccb72c60e'}] Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:32.900832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 690879bad3004282a01b8f3ccb72c60e combination. Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:32.902772 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 690879bad3004282a01b8f3ccb72c60e combination. Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:32.907029 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:32.909597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 690879bad3004282a01b8f3ccb72c60e combination. Jun 18 22:01:32.909597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:32.909597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9a6fd96-ccce-4d3d-b192-005cba85a787 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 690879bad3004282a01b8f3ccb72c60e combination. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:32.909597 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9a6fd96-ccce-4d3d-b192-005cba85a787 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/566563785/action" status: 409 len: 152 microversion: 2.1 time: 1.383724 Jun 18 22:01:32.909597 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 22/50] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Jun 18 22:01:31 2022] POST /compute/v2.1/flavors/566563785/action => generated 152 bytes in 1394 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:01:32.913565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20049e68-c816-43db-ab2c-3ff96cc22474 tempest-InstanceUsageAuditLogTestJSON-157935996 tempest-InstanceUsageAuditLogTestJSON-157935996-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:32.914324 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:32.914324 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:32.973087 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20049e68-c816-43db-ab2c-3ff96cc22474 tempest-InstanceUsageAuditLogTestJSON-157935996 tempest-InstanceUsageAuditLogTestJSON-157935996-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.064754 Jun 18 22:01:32.982267 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 23/51] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:01:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:32.993253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af579598-c61c-4b1d-904f-ccb41500a14c tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:33.001441 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:33.001441 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:33.408196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:33.425612 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6aba70da-a7b2-487c-ba2d-d9fe19a237a6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.707460 Jun 18 22:01:33.427731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 29/52] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:32 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:34.140215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-378bdb2b-6b17-4a19-8923-b63ccba74de6 req-8291517b-0671-4a4a-b6a6-66408a574dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db721dc8-8646-4360-b87a-5a5d13f7f723", "tag": "f9b92243-836f-452e-ae84-1121b20d12c2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:34.187855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-378bdb2b-6b17-4a19-8923-b63ccba74de6 req-8291517b-0671-4a4a-b6a6-66408a574dae service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:34.200570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-378bdb2b-6b17-4a19-8923-b63ccba74de6 req-8291517b-0671-4a4a-b6a6-66408a574dae service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:34.328910 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-378bdb2b-6b17-4a19-8923-b63ccba74de6 req-8291517b-0671-4a4a-b6a6-66408a574dae service nova] Creating event network-changed:f9b92243-836f-452e-ae84-1121b20d12c2 for instance db721dc8-8646-4360-b87a-5a5d13f7f723 on nch2-master-1 Jun 18 22:01:34.343723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-378bdb2b-6b17-4a19-8923-b63ccba74de6 req-8291517b-0671-4a4a-b6a6-66408a574dae service nova] Acquired lock "compute-rpcapi-router" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:01:34.345118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:34.349691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:34.362786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:34.363804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:34.423037 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.rpcapi [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 18 22:01:34.428878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] Releasing lock "compute-rpcapi-router" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:01:34.429105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af579598-c61c-4b1d-904f-ccb41500a14c tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/566563785/action" status: 200 len: 21 microversion: 2.1 time: 1.445842 Jun 18 22:01:34.441813 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 24/53] 10.222.0.30 () {60 vars in 1196 bytes} [Sat Jun 18 22:01:32 2022] POST /compute/v2.1/flavors/566563785/action => generated 21 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:34.514698 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-53f966b4-2ab7-4504-b357-6e96a1c71e44 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.085288 Jun 18 22:01:34.516392 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 30/54] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:34.523266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:34.526016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:34.545283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:34.547863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:34.549085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:34.550422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:34.619675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:35.065900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bffaeb63-7377-4614-a017-9adc96aad5ef tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-152429505", "ram": 512, "vcpus": 1, "disk": 10, "id": 755754520, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:35.067960 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:35.067960 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:35.109237 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bffaeb63-7377-4614-a017-9adc96aad5ef tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.662424 Jun 18 22:01:35.119271 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 25/55] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:34 2022] POST /compute/v2.1/flavors => generated 412 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:35.154402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5659595b-5a36-41c3-a8c8-f4f2bdf63841 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:35.158499 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:35.158499 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:35.215135 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5659595b-5a36-41c3-a8c8-f4f2bdf63841 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/566563785" status: 202 len: 0 microversion: 2.1 time: 0.092014 Jun 18 22:01:35.215993 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 26/56] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:35 2022] DELETE /compute/v2.1/flavors/566563785 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:35.230848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:35.231586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:35.265801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:35.293893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:35.296113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:35.296980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:35.297470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:35.558134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:35.580768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f1c89d4f-8f69-423e-9ea1-8368f143b2b0 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 1.056482 Jun 18 22:01:35.581663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 31/57] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:34 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:35.599224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d4415c9-a39a-495e-8345-c65b3e96fb2d tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:35.603214 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:35.603214 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:35.682120 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d4415c9-a39a-495e-8345-c65b3e96fb2d tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.098043 Jun 18 22:01:35.685815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 32/58] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Jun 18 22:01:35 2022] POST /compute/v2.1/flavors/755754520/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:35.701329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8bcb0ead-f7ce-4606-9323-de464a439a91 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:35.764966 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8bcb0ead-f7ce-4606-9323-de464a439a91 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.077066 Jun 18 22:01:35.768077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 33/59] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:35 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:36.062493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:36.076374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e675ed5-79f3-4c38-a018-aaccf266f0e3 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.854151 Jun 18 22:01:36.077378 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 27/60] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:35 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:36.249653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-940aaef3-0154-49d3-a632-67447eff00c1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea151e9dc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.253373 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:36.253373 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:36.258620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940aaef3-0154-49d3-a632-67447eff00c1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.260157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940aaef3-0154-49d3-a632-67447eff00c1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.267540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940aaef3-0154-49d3-a632-67447eff00c1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.270356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940aaef3-0154-49d3-a632-67447eff00c1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.382930 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-940aaef3-0154-49d3-a632-67447eff00c1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.611693 Jun 18 22:01:36.386319 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 34/61] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:01:35 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:36.401440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f9ef8e8-a5fb-41d1-b860-dd69ac8f3683 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1255158664", "id": 1512892517, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:36.411661 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:36.411661 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:36.448874 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f9ef8e8-a5fb-41d1-b860-dd69ac8f3683 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.061273 Jun 18 22:01:36.453780 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 35/62] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:36 2022] POST /compute/v2.1/flavors => generated 438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:36.462635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ad48ad1-893d-429b-b6e9-c2b19f847cf1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea151e9ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.464974 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:36.464974 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:36.469717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad48ad1-893d-429b-b6e9-c2b19f847cf1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.471511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad48ad1-893d-429b-b6e9-c2b19f847cf1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.472576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad48ad1-893d-429b-b6e9-c2b19f847cf1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.473509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad48ad1-893d-429b-b6e9-c2b19f847cf1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.526238 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ad48ad1-893d-429b-b6e9-c2b19f847cf1 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.070840 Jun 18 22:01:36.528404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 36/63] 10.222.0.30 () {58 vars in 1138 bytes} [Sat Jun 18 22:01:36 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:36.549418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b174f39b-91d8-4165-8828-b43c265fd8fb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.554177 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:36.554177 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:36.576915 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b174f39b-91d8-4165-8828-b43c265fd8fb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b174f39b-91d8-4165-8828-b43c265fd8fb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Request method failure captured: Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/flavors/1512892517/os-flavor-access HTTP/1.1 Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirks2j88i7atfz4uLDAbbcf68FrJ9Wriqgq_QRZUeDp5DU62utlBD-ejmbTuGgFw4_XnZffSGdFEQ-QrQ8Oo9o3ghv9J1gfDkkb5ozjpHHC-WyG9eomgdtI3zjJCGfW8B5PR8EEAUl0sowzLk5PY_OKKN_07-ji1eUJVZ17wAlkKfXZA Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6b0fc8e04b60468abb6ae87d02b5426d Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:01:36.606914 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b0fc8e04b60468abb6ae87d02b5426d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6b0fc8e04b60468abb6ae87d02b5426d Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 50c195ac4cc240f6a1aff4753a974be0 Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: exception: Access list not available for public flavors. Jun 18 22:01:36.608461 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'flavor_id': '1512892517'} Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 18 22:01:36.609345 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:36.612497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b174f39b-91d8-4165-8828-b43c265fd8fb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:36.613922 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b174f39b-91d8-4165-8828-b43c265fd8fb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1512892517/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.073916 Jun 18 22:01:36.626921 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 37/64] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:01:36 2022] GET /compute/v2.1/flavors/1512892517/os-flavor-access => generated 91 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:01:36.643651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce6c6372-8f73-41f5-899e-51949c2a5720 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea15167af0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.654165 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:36.654165 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:36.674649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce6c6372-8f73-41f5-899e-51949c2a5720 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.676008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce6c6372-8f73-41f5-899e-51949c2a5720 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.678267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce6c6372-8f73-41f5-899e-51949c2a5720 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.682153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce6c6372-8f73-41f5-899e-51949c2a5720 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.755825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce6c6372-8f73-41f5-899e-51949c2a5720 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.126854 Jun 18 22:01:36.757256 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 38/65] 10.222.0.30 () {58 vars in 1144 bytes} [Sat Jun 18 22:01:36 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:36.767639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.768612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:36.786951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.787632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.789116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:36.797842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:36.813816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc1cef64-bd57-4a18-9e53-2f4646d6e57e tempest-FlavorsExtraSpecsTestJSON-1127703724 tempest-FlavorsExtraSpecsTestJSON-1127703724-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.842085 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc1cef64-bd57-4a18-9e53-2f4646d6e57e tempest-FlavorsExtraSpecsTestJSON-1127703724 tempest-FlavorsExtraSpecsTestJSON-1127703724-project] 10.222.0.30 "GET /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.763347 Jun 18 22:01:36.857461 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 28/66] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Jun 18 22:01:36 2022] GET /compute/v2.1/flavors/755754520/os-extra_specs => generated 66 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:36.863903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd4578a8-2c37-40fc-b2f1-266ab0cf19ce tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:36.868789 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:36.868789 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:36.903500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd4578a8-2c37-40fc-b2f1-266ab0cf19ce tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1512892517" status: 202 len: 0 microversion: 2.1 time: 0.040865 Jun 18 22:01:36.907256 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 29/67] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:36 2022] DELETE /compute/v2.1/flavors/1512892517 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:37.182239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b077b63c-10ef-4e6e-83ce-e636112a1283 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1206069993", "id": 1482238926, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:37.184448 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:37.184448 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:37.235835 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b077b63c-10ef-4e6e-83ce-e636112a1283 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.329559 Jun 18 22:01:37.248222 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 30/68] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:36 2022] POST /compute/v2.1/flavors => generated 430 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:37.257154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b2226628-1561-4179-93de-e73d91e973ac req-69e7bad3-7a22-4bb3-aaf1-a595c2c2efa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dbae906-f67e-410e-ab66-e23bdc980bf0", "tag": "b92b2ed1-1078-430d-9e4b-871cc584c575"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:37.273732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b2226628-1561-4179-93de-e73d91e973ac req-69e7bad3-7a22-4bb3-aaf1-a595c2c2efa6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:37.274437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b2226628-1561-4179-93de-e73d91e973ac req-69e7bad3-7a22-4bb3-aaf1-a595c2c2efa6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:37.328749 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b2226628-1561-4179-93de-e73d91e973ac req-69e7bad3-7a22-4bb3-aaf1-a595c2c2efa6 service nova] Creating event network-changed:b92b2ed1-1078-430d-9e4b-871cc584c575 for instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 on nch2-master-1 Jun 18 22:01:37.330152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b2226628-1561-4179-93de-e73d91e973ac req-69e7bad3-7a22-4bb3-aaf1-a595c2c2efa6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:01:37.332404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:37.333217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:37.334357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:37.334949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:37.357470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:37.359426 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.rpcapi [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 18 22:01:37.361178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:01:37.368415 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-323f4785-ffa4-467e-acbb-766423280188 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.609817 Jun 18 22:01:37.369522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 39/69] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:36 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:37.383448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eff99a74-f50a-4f05-b034-ed67e6c79cb7 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:37.388815 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:37.388815 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:37.408124 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e18bda5-ba8a-4a7b-9cbf-6e2b536047c4 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156998 Jun 18 22:01:37.410050 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 31/70] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:37.421362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-868b086d-2d71-4794-8199-d5b50a4ca23b tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:37.474307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:37.482710 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-868b086d-2d71-4794-8199-d5b50a4ca23b tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.070012 Jun 18 22:01:37.484768 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 32/71] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:37 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:37.494208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:37.500231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:37.507779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:37.509098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:37.510109 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eff99a74-f50a-4f05-b034-ed67e6c79cb7 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.137170 Jun 18 22:01:37.512494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:37.514707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:37.515303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 40/72] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Jun 18 22:01:37 2022] POST /compute/v2.1/flavors/755754520/os-extra_specs => generated 66 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:37.529834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57dc1243-2138-4d06-a036-b6655f6688ff tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:37.531067 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:37.531067 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:37.611815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57dc1243-2138-4d06-a036-b6655f6688ff tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1482238926" status: 202 len: 0 microversion: 2.1 time: 0.094886 Jun 18 22:01:37.613590 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 41/73] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:37 2022] DELETE /compute/v2.1/flavors/1482238926 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:37.951737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-03473f2a-9896-4f8e-8d12-f9cb09b83b8b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:37.963207 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-03473f2a-9896-4f8e-8d12-f9cb09b83b8b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.348302 Jun 18 22:01:37.968971 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 42/74] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:01:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:37.977318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fd08964-7e9a-4f22-8a62-6f89ccf20ce2 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-520161642", "id": 1335328595, "os-flavor-access:is_public": "False"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:37.978837 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:37.978837 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:38.001115 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fd08964-7e9a-4f22-8a62-6f89ccf20ce2 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.030208 Jun 18 22:01:38.001416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 43/75] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:37 2022] POST /compute/v2.1/flavors => generated 438 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.008330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15866184-8fdc-443d-9845-173b7423b2f7 tempest-FlavorsExtraSpecsTestJSON-1127703724 tempest-FlavorsExtraSpecsTestJSON-1127703724-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.011258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:38.018746 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15866184-8fdc-443d-9845-173b7423b2f7 tempest-FlavorsExtraSpecsTestJSON-1127703724 tempest-FlavorsExtraSpecsTestJSON-1127703724-project] 10.222.0.30 "GET /compute/v2.1/flavors/755754520/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016231 Jun 18 22:01:38.020789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff53b3b7-5867-47f3-b970-f0b06527b426 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.534338 Jun 18 22:01:38.024586 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 44/76] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/755754520/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.031502 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 33/77] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:37 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:38.036789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2208a94c-b4e2-4270-a179-5a986daad260 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.080263 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2208a94c-b4e2-4270-a179-5a986daad260 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.047242 Jun 18 22:01:38.081821 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 34/78] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:38.379120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-56c7a214-ae2f-4e09-8f9c-efb6ff0d8057 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1982333320", "id": 1789190926, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.428642 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-56c7a214-ae2f-4e09-8f9c-efb6ff0d8057 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.391520 Jun 18 22:01:38.434573 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 45/79] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors => generated 425 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.434752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39dab0bb-013d-4dc7-8144-6b14060d8700 tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.434752 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.434752 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:38.435408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39dab0bb-013d-4dc7-8144-6b14060d8700 tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8c8e9dbec8df4c4ea0ffbb1e9904dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690879bad3004282a01b8f3ccb72c60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:38.437225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46cf5199-881e-4960-8dd4-3bfc8bf89af6 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39dab0bb-013d-4dc7-8144-6b14060d8700 tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Request method failure captured: Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/flavors/1335328595/action HTTP/1.1 Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 67 Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkszDJoVpqiTbJ9nRHI23s6OJutnEeRM0lCCcbmIUdzwNSZj7AVAnbNfP8uCy_ZPQFYYxtwJ5A96775WFp6kzDgBsAjPA3MvnwCrdZJQjMIBHynYQUAe80Pg-QqvkySQjzPV25itpbwukdNWdRgck3C8G7d42R4MtS74-gL8rk4pHjA Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 690879bad3004282a01b8f3ccb72c60e Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1048088481 Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:01:38.437372 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/690879bad3004282a01b8f3ccb72c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/690879bad3004282a01b8f3ccb72c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/690879bad3004282a01b8f3ccb72c60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_690879bad3004282a01b8f3ccb72c60e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1048088481 Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 690879bad3004282a01b8f3ccb72c60e Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1048088481 Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsAccessNegativeTestJSON-1048088481-project Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8c8e9dbec8df4c4ea0ffbb1e9904dab3 Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1048088481-project Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: {"addTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} Jun 18 22:01:38.438694 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1335328595', 'body': {'addTenantAccess': {'tenant': '690879bad3004282a01b8f3ccb72c60e'}}} Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:38.439530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 18 22:01:38.441086 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:38.442391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39dab0bb-013d-4dc7-8144-6b14060d8700 tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:38.442475 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39dab0bb-013d-4dc7-8144-6b14060d8700 tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] 10.222.0.30 "POST /compute/v2.1/flavors/1335328595/action" status: 403 len: 130 microversion: 2.1 time: 0.354489 Jun 18 22:01:38.447105 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 35/80] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors/1335328595/action => generated 130 bytes in 363 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:38.452457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-364acdde-0e31-4f06-b535-39466cb390df tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1474417486", "id": 2054623809, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.454222 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.454222 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:38.480679 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46cf5199-881e-4960-8dd4-3bfc8bf89af6 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047286 Jun 18 22:01:38.481332 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 46/81] 10.222.0.30 () {60 vars in 1220 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors/755754520/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.490714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.493133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:38.502908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:38.503609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:38.504565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:38.505461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:38.508715 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-364acdde-0e31-4f06-b535-39466cb390df tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.058806 Jun 18 22:01:38.518326 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 36/82] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors => generated 417 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.527450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d800e0b1-8a84-4415-b0cd-4aa21f284c16 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.540683 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d800e0b1-8a84-4415-b0cd-4aa21f284c16 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021007 Jun 18 22:01:38.541657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 37/83] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.551048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c7678c8-9fd4-46a1-9bd1-b46bef427f11 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.552152 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.552152 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:38.594805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c7678c8-9fd4-46a1-9bd1-b46bef427f11 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1335328595" status: 202 len: 0 microversion: 2.1 time: 0.051768 Jun 18 22:01:38.595459 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 38/84] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:38 2022] DELETE /compute/v2.1/flavors/1335328595 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:38.600701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c0205bb-2efe-4ccb-a3c5-7b057b58ac85 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.612486 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c0205bb-2efe-4ccb-a3c5-7b057b58ac85 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014462 Jun 18 22:01:38.617528 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 39/85] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/755754520/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.625998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8da752db-6c2f-4a9b-be13-a5ecaf054d47 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.652110 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8da752db-6c2f-4a9b-be13-a5ecaf054d47 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6215 microversion: 2.1 time: 0.031298 Jun 18 22:01:38.652853 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 40/86] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/detail => generated 6215 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:38.657964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b952abc9-493f-45f5-bb7c-5ea415d09dd4 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1417754962", "id": 1498649338, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.685396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b952abc9-493f-45f5-bb7c-5ea415d09dd4 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.031125 Jun 18 22:01:38.686967 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 41/87] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors => generated 425 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.692764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e4f682e7-4f91-4762-a9e5-a64a1567521d tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.708048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:38.716591 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e4f682e7-4f91-4762-a9e5-a64a1567521d tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6630 microversion: 2.1 time: 0.028332 Jun 18 22:01:38.717236 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 42/88] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/detail => generated 6630 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:38.720588 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-82268b29-3f16-45f9-9414-14887057422e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.237989 Jun 18 22:01:38.721392 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 47/89] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:38.726269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a9c5febb-51fd-4f2d-910a-f3fafac54135 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.727260 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.727260 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:38.730296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-01743617-a763-445a-9400-61e4845bbe8b tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.731624 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.731624 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:38.764035 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a9c5febb-51fd-4f2d-910a-f3fafac54135 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2054623809" status: 202 len: 0 microversion: 2.1 time: 0.041313 Jun 18 22:01:38.768334 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 48/90] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:38 2022] DELETE /compute/v2.1/flavors/2054623809 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:38.773616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9da49710-5f39-46d4-a300-88fcfc7ef9cd tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.788075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-01743617-a763-445a-9400-61e4845bbe8b tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/755754520/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.069531 Jun 18 22:01:38.790737 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9da49710-5f39-46d4-a300-88fcfc7ef9cd tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021164 Jun 18 22:01:38.795625 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 43/91] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:01:38 2022] PUT /compute/v2.1/flavors/755754520/os-extra_specs/hw:numa_nodes => generated 22 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.798873 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 49/92] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.804034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a0e4dd16-bb9f-4b85-b546-a8fb09f08043 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-259780522", "id": 1769407494, "os-flavor-access:is_public": "False"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.807106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9e6cc73-1a74-43ee-8690-df71a856feb2 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.836919 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9e6cc73-1a74-43ee-8690-df71a856feb2 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.036519 Jun 18 22:01:38.846571 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a0e4dd16-bb9f-4b85-b546-a8fb09f08043 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.047474 Jun 18 22:01:38.849543 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 50/94] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:38.849699 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 44/94] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors => generated 438 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.854969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-84bea7ce-806b-40e3-b54d-b86c102f6fce tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.862894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a203c39-ce80-44e8-b79d-89afef2b8697 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Action: 'create', calling method: .version_select at 0x7fea14ef0820>, body: {"keypair": {"name": "tempest-keypair-528000322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX5IuXK/I/6UoDYpK3tW0KZC7OunNfQVad+e7/8qxESxo/O1ZnFxyVYXwSV9gw/3uV1m428HfpcppLOBh/5MwWO+IpauD4G551z1HgbytLz2lMBlxHL1Djx88IcXMtQVQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.864868 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-84bea7ce-806b-40e3-b54d-b86c102f6fce tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013800 Jun 18 22:01:38.870251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 51/95] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Jun 18 22:01:38 2022] GET /compute/v2.1/flavors/755754520/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:38.877569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-40e3964a-0131-42b1-8069-6aabfcd7d27b tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-531117379", "id": 1683775780, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.879511 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.879511 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:38.910549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-8a203c39-ce80-44e8-b79d-89afef2b8697 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Getting quotas for project dad7b33b97ba48a6a4989ff35985a4ca. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:01:38.912240 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-40e3964a-0131-42b1-8069-6aabfcd7d27b tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.040431 Jun 18 22:01:38.913076 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 52/96] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors => generated 428 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.917364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-8a203c39-ce80-44e8-b79d-89afef2b8697 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Getting quotas for user 79c12f29545c40ec955650696bb91a65 and project dad7b33b97ba48a6a4989ff35985a4ca. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:01:38.932715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22f9e661-7fcc-4034-80fc-c55ba59d7592 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:38.934894 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.934894 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:38.948092 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a203c39-ce80-44e8-b79d-89afef2b8697 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096397 Jun 18 22:01:38.949562 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 45/97] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:38.974439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f7457b0-9d9d-4f46-8f33-b8c8b158a95a tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:38.975544 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:38.975544 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:39.046895 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f7457b0-9d9d-4f46-8f33-b8c8b158a95a tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/755754520/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.092525 Jun 18 22:01:39.048465 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 46/98] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:01:38 2022] DELETE /compute/v2.1/flavors/755754520/os-extra_specs/hw:numa_nodes => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:01:39.055513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2df3c43-72f1-4810-8714-242ee128175c tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.099882 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c2df3c43-72f1-4810-8714-242ee128175c tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1683775780" status: 202 len: 0 microversion: 2.1 time: 0.046748 Jun 18 22:01:39.101221 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 47/99] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:39 2022] DELETE /compute/v2.1/flavors/1683775780 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:39.106310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.107101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:39.120758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:39.120758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:39.124560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:39.125229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:39.365515 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22f9e661-7fcc-4034-80fc-c55ba59d7592 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1769407494/action" status: 200 len: 97 microversion: 2.1 time: 0.450625 Jun 18 22:01:39.366658 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 53/100] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:01:38 2022] POST /compute/v2.1/flavors/1769407494/action => generated 97 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:39.374312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:39.376991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3cbe86ad-2226-4e34-b604-753c3f02704a tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.379286 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:39.379286 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:39.389776 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1f148c8-0ea1-4e3e-872e-443376f60d7b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.287474 Jun 18 22:01:39.390393 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 48/101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:39 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:39.395544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fc06fa5-176f-4a68-97a6-eab12db0cb3a tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.412439 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3cbe86ad-2226-4e34-b604-753c3f02704a tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/755754520/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.043881 Jun 18 22:01:39.417551 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 54/102] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:01:39 2022] DELETE /compute/v2.1/flavors/755754520/os-extra_specs/hw:cpu_policy => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:01:39.427002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b9a8a291-ebea-4c34-aa8c-17de52feaf3d tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:39.428720 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:39.428720 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:39.430136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b9a8a291-ebea-4c34-aa8c-17de52feaf3d tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8c8e9dbec8df4c4ea0ffbb1e9904dab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '690879bad3004282a01b8f3ccb72c60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b9a8a291-ebea-4c34-aa8c-17de52feaf3d tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Request method failure captured: Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/flavors/1769407494/action HTTP/1.1 Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 70 Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkszDJoVpqiTbJ9nRHI23s6OJutnEeRM0lCCcbmIUdzwNSZj7AVAnbNfP8uCy_ZPQFYYxtwJ5A96775WFp6kzDgBsAjPA3MvnwCrdZJQjMIBHynYQUAe80Pg-QqvkySQjzPV25itpbwukdNWdRgck3C8G7d42R4MtS74-gL8rk4pHjA Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 690879bad3004282a01b8f3ccb72c60e Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1048088481 Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:39.431836 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/690879bad3004282a01b8f3ccb72c60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/690879bad3004282a01b8f3ccb72c60e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/690879bad3004282a01b8f3ccb72c60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_690879bad3004282a01b8f3ccb72c60e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1048088481 Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 690879bad3004282a01b8f3ccb72c60e Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1048088481 Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FlavorsAccessNegativeTestJSON-1048088481-project Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8c8e9dbec8df4c4ea0ffbb1e9904dab3 Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1048088481-project Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: {"removeTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} Jun 18 22:01:39.433197 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '1769407494', 'body': {'removeTenantAccess': {'tenant': '690879bad3004282a01b8f3ccb72c60e'}}} Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can( Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:39.434107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 18 22:01:39.435339 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:39.436491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b9a8a291-ebea-4c34-aa8c-17de52feaf3d tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:39.436491 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b9a8a291-ebea-4c34-aa8c-17de52feaf3d tempest-FlavorsAccessNegativeTestJSON-1048088481 tempest-FlavorsAccessNegativeTestJSON-1048088481-project] 10.222.0.30 "POST /compute/v2.1/flavors/1769407494/action" status: 403 len: 133 microversion: 2.1 time: 0.013705 Jun 18 22:01:39.436491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 55/103] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:01:39 2022] POST /compute/v2.1/flavors/1769407494/action => generated 133 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:39.443675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b55468bc-636b-4d78-a4c5-945419c6b0be tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.454039 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b55468bc-636b-4d78-a4c5-945419c6b0be tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/755754520/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019004 Jun 18 22:01:39.454692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 56/104] 10.222.0.30 () {58 vars in 1199 bytes} [Sat Jun 18 22:01:39 2022] GET /compute/v2.1/flavors/755754520/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:39.460643 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fc06fa5-176f-4a68-97a6-eab12db0cb3a tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.066272 Jun 18 22:01:39.467161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97dd9570-23b3-4d1b-87f2-3d74e1027cfb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "690879bad3004282a01b8f3ccb72c60e"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:39.472811 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 49/105] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:39 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:39.478835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-14d83fd2-130a-46d9-aa67-a142d8539860 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.479923 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:39.479923 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:39.483402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=10,nova_api:INSERT=5,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:39.512281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-14d83fd2-130a-46d9-aa67-a142d8539860 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/755754520" status: 202 len: 0 microversion: 2.1 time: 0.038224 Jun 18 22:01:39.516799 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 50/106] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:39 2022] DELETE /compute/v2.1/flavors/755754520 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:39.522511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2de10d3-82bb-44d7-b972-e121ec4a7fc6 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1995688353", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:39.524443 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:39.524443 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:39.564311 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2de10d3-82bb-44d7-b972-e121ec4a7fc6 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.045993 Jun 18 22:01:39.565317 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 51/107] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:39 2022] POST /compute/v2.1/flavors => generated 507 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:39.581487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2713287-e3ad-4603-8a08-9469850b4d45 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.620175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2713287-e3ad-4603-8a08-9469850b4d45 tempest-FlavorsExtraSpecsTestJSON-416381706 tempest-FlavorsExtraSpecsTestJSON-416381706-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6318 microversion: 2.1 time: 0.052388 Jun 18 22:01:39.631623 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 52/108] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:39 2022] GET /compute/v2.1/flavors/detail => generated 6318 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:39.636604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4e71897-f360-4726-9386-a04a9a86d53f tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.675609 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4e71897-f360-4726-9386-a04a9a86d53f tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/a89726c8-f61f-4630-b1ba-db24d9c6632c" status: 202 len: 0 microversion: 2.1 time: 0.042095 Jun 18 22:01:39.676868 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 53/109] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:01:39 2022] DELETE /compute/v2.1/flavors/a89726c8-f61f-4630-b1ba-db24d9c6632c => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:39.684996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32d61d59-59e9-49c8-a47e-acf5b22ad813 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.717773 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32d61d59-59e9-49c8-a47e-acf5b22ad813 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.036439 Jun 18 22:01:39.719046 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 54/110] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:39 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:39.738027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c843ef10-51bc-4719-ac5b-40427d3da5f9 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-756284814", "id": "d2b3ac16-a4cf-43cd-a6a4-0af8ef320e21", "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:39.775154 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c843ef10-51bc-4719-ac5b-40427d3da5f9 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.044029 Jun 18 22:01:39.776321 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 55/111] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:39 2022] POST /compute/v2.1/flavors => generated 506 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:39.783674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.784797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:39.792292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:39.793173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:39.794183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:39.794805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:39.884082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97dd9570-23b3-4d1b-87f2-3d74e1027cfb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1769407494/action" status: 200 len: 21 microversion: 2.1 time: 0.422063 Jun 18 22:01:39.884704 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 57/112] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:01:39 2022] POST /compute/v2.1/flavors/1769407494/action => generated 21 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:01:39.893289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f699e94-dae4-415b-b4c4-587db114d123 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.931164 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f699e94-dae4-415b-b4c4-587db114d123 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/d2b3ac16-a4cf-43cd-a6a4-0af8ef320e21" status: 202 len: 0 microversion: 2.1 time: 0.045267 Jun 18 22:01:39.934106 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 58/113] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:01:39 2022] DELETE /compute/v2.1/flavors/d2b3ac16-a4cf-43cd-a6a4-0af8ef320e21 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:39.947360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e241745-7746-49a5-b116-6e09652c855f tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:39.993382 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e241745-7746-49a5-b116-6e09652c855f tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1769407494" status: 202 len: 0 microversion: 2.1 time: 0.055859 Jun 18 22:01:40.002277 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 59/114] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:39 2022] DELETE /compute/v2.1/flavors/1769407494 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:40.015285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-29af179d-595f-42e5-bf44-1cded9e17d54 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.062465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:40.063499 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-29af179d-595f-42e5-bf44-1cded9e17d54 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.058908 Jun 18 22:01:40.064162 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 60/115] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:40.071323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-643650e0-2963-4cb0-b2be-a4679c0c50b5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.073511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b023dc7-9b74-4a99-9ccf-1b43d35ca6c7 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.295294 Jun 18 22:01:40.075266 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 56/116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:39 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:40.081442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2f64087-d4ca-4cfe-b619-66ea09584e50 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-730361671", "id": 1320870932, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:40.083562 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:40.083562 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:40.101640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-643650e0-2963-4cb0-b2be-a4679c0c50b5 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.036371 Jun 18 22:01:40.102248 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 61/117] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:40.108436 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2f64087-d4ca-4cfe-b619-66ea09584e50 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.031209 Jun 18 22:01:40.109577 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 57/118] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:40 2022] POST /compute/v2.1/flavors => generated 413 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:40.123703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec888a2f-c950-4c16-8544-1b3a41350a8d tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.124439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3fd093d7-8dcc-4632-9e42-762972f07b71 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1409729295", "id": 1867758601, "os-flavor-access:is_public": "False"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:40.131686 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec888a2f-c950-4c16-8544-1b3a41350a8d tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1320870932" status: 200 len: 413 microversion: 2.1 time: 0.011925 Jun 18 22:01:40.132491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 62/119] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/flavors/1320870932 => generated 413 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:40.150613 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3fd093d7-8dcc-4632-9e42-762972f07b71 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.030699 Jun 18 22:01:40.157236 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 58/120] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:40 2022] POST /compute/v2.1/flavors => generated 439 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:40.166906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0560236b-4e57-43bd-a48b-733a75b9c115 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1eaef672917e400b8359d0e28fd5e2aa"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:40.168793 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:40.168793 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:40.528247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fba762f0-46bd-4cad-a8ce-1c346b32a1da tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.612849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fba762f0-46bd-4cad-a8ce-1c346b32a1da tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6224 microversion: 2.1 time: 0.473340 Jun 18 22:01:40.613498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 63/121] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/flavors/detail => generated 6224 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:40.633272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.633657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:40.640181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:40.640626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:40.641431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:40.645320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:40.864267 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0560236b-4e57-43bd-a48b-733a75b9c115 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] HTTP exception thrown: Flavor access not found for 29 / 1eaef672917e400b8359d0e28fd5e2aa combination. Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0560236b-4e57-43bd-a48b-733a75b9c115 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Request method failure captured: Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/flavors/1867758601/action HTTP/1.1 Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 70 Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirks2j88i7atfz4uLDAbbcf68FrJ9Wriqgq_QRZUeDp5DU62utlBD-ejmbTuGgFw4_XnZffSGdFEQ-QrQ8Oo9o3ghv9J1gfDkkb5ozjpHHC-WyG9eomgdtI3zjJCGfW8B5PR8EEAUl0sowzLk5PY_OKKN_07-ji1eUJVZ17wAlkKfXZA Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 6b0fc8e04b60468abb6ae87d02b5426d Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:40.867856 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6b0fc8e04b60468abb6ae87d02b5426d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6b0fc8e04b60468abb6ae87d02b5426d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 6b0fc8e04b60468abb6ae87d02b5426d Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-107984585 Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 50c195ac4cc240f6a1aff4753a974be0 Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: {"removeTenantAccess": {"tenant": "1eaef672917e400b8359d0e28fd5e2aa"}} Jun 18 22:01:40.869254 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: exception: Flavor access not found for 29 / 1eaef672917e400b8359d0e28fd5e2aa combination. Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1867758601', 'body': {'removeTenantAccess': {'tenant': '1eaef672917e400b8359d0e28fd5e2aa'}}} Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 18 22:01:40.870034 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 29 / 1eaef672917e400b8359d0e28fd5e2aa combination. Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 29 / 1eaef672917e400b8359d0e28fd5e2aa combination. Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:40.871162 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 29 / 1eaef672917e400b8359d0e28fd5e2aa combination. Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0560236b-4e57-43bd-a48b-733a75b9c115 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Returning 404 to user: Flavor access not found for 29 / 1eaef672917e400b8359d0e28fd5e2aa combination. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0560236b-4e57-43bd-a48b-733a75b9c115 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1867758601/action" status: 404 len: 124 microversion: 2.1 time: 0.709312 Jun 18 22:01:40.872384 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 59/122] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:01:40 2022] POST /compute/v2.1/flavors/1867758601/action => generated 124 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:40.874708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-26ef7f03-b14a-472d-b019-a6b72ce6e75d tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.876044 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:40.876044 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:40.901936 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-26ef7f03-b14a-472d-b019-a6b72ce6e75d tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1320870932" status: 202 len: 0 microversion: 2.1 time: 0.030785 Jun 18 22:01:40.903175 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 60/123] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:40 2022] DELETE /compute/v2.1/flavors/1320870932 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:40.914244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c88ba0c8-f804-4e8a-a5b9-68c5811a1cb0 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.941651 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c88ba0c8-f804-4e8a-a5b9-68c5811a1cb0 tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1867758601" status: 202 len: 0 microversion: 2.1 time: 0.036959 Jun 18 22:01:40.942721 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 61/124] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:40 2022] DELETE /compute/v2.1/flavors/1867758601 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:40.953513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6d76c89-c5c8-4a66-9223-77ac2c04c4a3 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:40.955085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:40.967343 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-faf74624-fd30-4470-8ee2-3b7b715aca27 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.352652 Jun 18 22:01:40.978149 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 64/125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:40.987277 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6d76c89-c5c8-4a66-9223-77ac2c04c4a3 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.042793 Jun 18 22:01:40.989629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fea8a01-a338-4b15-908d-78c1d6cc0fcb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.000505 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 62/126] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.008496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28c43c09-b841-46cf-9f90-d7b82a76df9f tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1733669167", "id": 159241075, "os-flavor-access:is_public": "False"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:41.035448 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28c43c09-b841-46cf-9f90-d7b82a76df9f tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.031527 Jun 18 22:01:41.045568 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 63/127] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:41 2022] POST /compute/v2.1/flavors => generated 427 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:41.046849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2fea8a01-a338-4b15-908d-78c1d6cc0fcb tempest-FlavorsAccessNegativeTestJSON-107984585 tempest-FlavorsAccessNegativeTestJSON-107984585-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.067544 Jun 18 22:01:41.047688 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 65/128] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:40 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.052432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8613aea-9c72-47fa-953a-e07743c6c7a6 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "159241075"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:41.067804 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d8613aea-9c72-47fa-953a-e07743c6c7a6 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] HTTP exception thrown: Flavor 159241075 could not be found. Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8613aea-9c72-47fa-953a-e07743c6c7a6 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] Request method failure captured: Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 106 Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirks__qnGkx3e8SFbVKpiPyv53gwmcptTkUTq7jnsfUql32sOMn62Cso8kk5hxgz8CGwUS4eyK7awEGU5u-gQSVJDOoIcA8nR6M9aUdCTfx1pHtq35-KGLBHAsJcu-JaQ_xcO2wkwfnGzon2cDw7EGMrfLx_10Az8BqZ5PfEqL_a9hVI Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 19c65c1d6e44456da7eb18d05951f8b0 Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsAdminTestJSON-1318777515 Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:01:41.070912 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/19c65c1d6e44456da7eb18d05951f8b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/19c65c1d6e44456da7eb18d05951f8b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/19c65c1d6e44456da7eb18d05951f8b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_19c65c1d6e44456da7eb18d05951f8b0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsAdminTestJSON-1318777515 Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 19c65c1d6e44456da7eb18d05951f8b0 Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1318777515 Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsAdminTestJSON-1318777515-project Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4fd4e2ebd7394448a308605cd990b761 Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsAdminTestJSON-1318777515-project Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "test", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "159241075"}} Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:41.072228 ncdv-master-1 devstack@n-api.service[130903]: exception: Flavor 159241075 could not be found. Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '159241075'}}} Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 159241075 could not be found. Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:41.073171 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 159241075 could not be found. Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:41.074345 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:41.075625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:41.075625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:41.075625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:41.075625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 159241075 could not be found. Jun 18 22:01:41.075625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:41.076599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8613aea-9c72-47fa-953a-e07743c6c7a6 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] Returning 400 to user: Flavor 159241075 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:41.077694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d8613aea-9c72-47fa-953a-e07743c6c7a6 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.030375 Jun 18 22:01:41.078429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 64/129] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:41 2022] POST /compute/v2.1/servers => generated 80 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:01:41.089515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-207181cc-11da-4344-9f77-759e627a50e5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.090388 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:41.090388 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:41.095393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.102025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:41.108761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=16,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:41.120105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:41.120864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:41.123562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:41.124059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:41.128139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-207181cc-11da-4344-9f77-759e627a50e5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/159241075" status: 202 len: 0 microversion: 2.1 time: 0.044333 Jun 18 22:01:41.129305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 66/130] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:41 2022] DELETE /compute/v2.1/flavors/159241075 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:41.151193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6110867b-dc28-4005-9e9d-2271efab2868 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.191753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6110867b-dc28-4005-9e9d-2271efab2868 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.051886 Jun 18 22:01:41.192558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 67/131] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.211805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b88cb2d-b19e-45ee-8e5a-272981647b9b tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1104761083", "id": 196771593, "os-flavor-access:is_public": "False"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:41.214033 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:41.214033 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:41.250486 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b88cb2d-b19e-45ee-8e5a-272981647b9b tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.043011 Jun 18 22:01:41.260303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 68/132] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:41 2022] POST /compute/v2.1/flavors => generated 412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:41.271987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b19d046-2d3b-4ed6-a162-6580ad73719a tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-822285684", "id": 376713632, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:41.310885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b19d046-2d3b-4ed6-a162-6580ad73719a tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.049220 Jun 18 22:01:41.312289 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 69/133] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:41 2022] POST /compute/v2.1/flavors => generated 410 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:41.329790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b84cddd-e2a7-4a4a-bff2-93d9d3a9bb6f tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.361647 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b84cddd-e2a7-4a4a-bff2-93d9d3a9bb6f tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.042637 Jun 18 22:01:41.362676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 70/134] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:41.377305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c437babc-a7a4-4429-a3d3-e3a7b40380f5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.394115 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c437babc-a7a4-4429-a3d3-e3a7b40380f5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.022435 Jun 18 22:01:41.397452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 71/135] 10.222.0.30 () {58 vars in 1176 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:41.415822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d6bff884-c31d-4018-b20f-4180b9404d5e tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.433876 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d6bff884-c31d-4018-b20f-4180b9404d5e tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.025437 Jun 18 22:01:41.443430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:41.443996 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 72/136] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:41.452607 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7474b761-753f-4fca-a222-4eb1b7129640 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.362093 Jun 18 22:01:41.453406 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 65/137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.473511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0cb46f4e-2eb6-4080-bf9f-01d3e25894df tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.490857 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0cb46f4e-2eb6-4080-bf9f-01d3e25894df tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.045033 Jun 18 22:01:41.498851 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 73/138] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:41.508159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1af48217-70d7-4778-a998-3e3a077184cf tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.566094 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1af48217-70d7-4778-a998-3e3a077184cf tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6221 microversion: 2.1 time: 0.065185 Jun 18 22:01:41.568121 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 66/139] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.585566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f0657b84-3557-40f9-a161-4d7c54160e9c tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.629960 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f0657b84-3557-40f9-a161-4d7c54160e9c tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6221 microversion: 2.1 time: 0.044002 Jun 18 22:01:41.630789 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 74/140] 10.222.0.30 () {58 vars in 1174 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6221 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:41.650453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d74e8b6-de2c-4ec1-9b8c-16b2b618f0ba tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.700604 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d74e8b6-de2c-4ec1-9b8c-16b2b618f0ba tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6221 microversion: 2.1 time: 0.056905 Jun 18 22:01:41.709547 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 67/141] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.722477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-76447ec5-6bd0-4b92-91fb-5a28756136c5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.806118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-76447ec5-6bd0-4b92-91fb-5a28756136c5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6221 microversion: 2.1 time: 0.092636 Jun 18 22:01:41.810815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 75/142] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:41.831399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8775b3a6-da4d-45ad-8a61-8079e57fb14d tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.834867 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:41.834867 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:41.880247 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8775b3a6-da4d-45ad-8a61-8079e57fb14d tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/376713632" status: 202 len: 0 microversion: 2.1 time: 0.057317 Jun 18 22:01:41.881634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 68/143] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:41 2022] DELETE /compute/v2.1/flavors/376713632 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:41.895447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46a9a257-755a-4de9-a44e-0f03ac393583 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.951175 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46a9a257-755a-4de9-a44e-0f03ac393583 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.064170 Jun 18 22:01:41.953840 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 76/144] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:41.970044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6c1dd6c-91bb-4e5e-b5bb-6e57fc659558 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.987826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:41.989902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:41.998186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:41.999009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:42.000013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:42.001529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:42.007190 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6c1dd6c-91bb-4e5e-b5bb-6e57fc659558 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/196771593" status: 202 len: 0 microversion: 2.1 time: 0.041244 Jun 18 22:01:42.010436 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 69/145] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:41 2022] DELETE /compute/v2.1/flavors/196771593 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:42.025310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7a672d3-c9b2-47e8-ba8c-328d5de07fe7 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:42.066114 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7a672d3-c9b2-47e8-ba8c-328d5de07fe7 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.051586 Jun 18 22:01:42.068070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 70/146] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:42.096024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-778f9259-7f0f-4eeb-ad5d-6e4514ef54e5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1075373501", "id": 600402663, "os-flavor-access:is_public": "False"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:42.099698 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:42.099698 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:42.139531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-778f9259-7f0f-4eeb-ad5d-6e4514ef54e5 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.052581 Jun 18 22:01:42.140202 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 71/147] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:42 2022] POST /compute/v2.1/flavors => generated 412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:42.159347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-735676015", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "1498649338", "adminPass": "***", "networks": [{"uuid": "b6fa8c18-e27f-42b6-b347-f25f64afe705"}], "security_groups": [{"name": "tempest-securitygroup--1637522356"}], "key_name": "tempest-keypair-528000322", "user_data": "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:42.408520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:42.416654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cab54f27-3cdd-4b09-bb58-a8b5776b6624 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.435919 Jun 18 22:01:42.417383 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 77/148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:41 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:42.423303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e01ce1f6-80c9-4ad5-a728-ce8f349a39d9 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:42.431991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] validate_networks() for [('b6fa8c18-e27f-42b6-b347-f25f64afe705', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:01:42.454350 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e01ce1f6-80c9-4ad5-a728-ce8f349a39d9 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.034850 Jun 18 22:01:42.455696 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 78/149] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:42.470414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6fbc7deb-116e-499c-ba17-32b41c1c7978 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:42.522457 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6fbc7deb-116e-499c-ba17-32b41c1c7978 tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.056089 Jun 18 22:01:42.523184 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 79/150] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:42.542562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:42.548223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:42.563469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:42.565908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:42.568681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:42.569917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:42.930957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:42.939176 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-125ecac9-e331-4642-b416-ffac368324de tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.400716 Jun 18 22:01:42.940155 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 80/151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:42 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:42.954071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4ff72c3-38b1-4998-8d26-7185f1d89568 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:42.955157 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:42.955157 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:42.981008 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4ff72c3-38b1-4998-8d26-7185f1d89568 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/600402663" status: 202 len: 0 microversion: 2.1 time: 0.030496 Jun 18 22:01:42.982105 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 81/152] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:01:42 2022] DELETE /compute/v2.1/flavors/600402663 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:43.005259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61d4bf3b-fb5d-437d-b8b5-6ce99f8576cc tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:43.026654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61d4bf3b-fb5d-437d-b8b5-6ce99f8576cc tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.037985 Jun 18 22:01:43.027853 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 82/153] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:42 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:43.045953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ebaf515-7793-4652-b5c1-3134fc710adb tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1967197223", "id": 1749774300, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:43.047550 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:43.047550 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:43.078253 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ebaf515-7793-4652-b5c1-3134fc710adb tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.037158 Jun 18 22:01:43.078985 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 83/154] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:43 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:43.091856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f316bbef-f05e-4088-9490-ddd9d909282a tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:43.115966 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f316bbef-f05e-4088-9490-ddd9d909282a tempest-FlavorsAdminTestJSON-1318777515 tempest-FlavorsAdminTestJSON-1318777515-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6225 microversion: 2.1 time: 0.029468 Jun 18 22:01:43.116690 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 84/155] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:43 2022] GET /compute/v2.1/flavors/detail => generated 6225 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:43.131975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc76846d-e738-46c4-9373-9a0790f1b2d3 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:43.162565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc76846d-e738-46c4-9373-9a0790f1b2d3 tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1749774300" status: 202 len: 0 microversion: 2.1 time: 0.034194 Jun 18 22:01:43.163713 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 85/156] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:01:43 2022] DELETE /compute/v2.1/flavors/1749774300 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:43.174580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-160b4535-687f-4356-8b86-a8409e09886c tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:43.205766 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-160b4535-687f-4356-8b86-a8409e09886c tempest-FlavorsAdminTestJSON-1538614126 tempest-FlavorsAdminTestJSON-1538614126-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.037503 Jun 18 22:01:43.206777 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 86/157] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:43 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:43.438188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:43.438188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:43.442982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:43.443444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:43.444215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:43.444694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:43.662794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:43.675667 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-98328cad-4152-4eae-8902-3a2be246510a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.243775 Jun 18 22:01:43.677432 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 87/158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:43 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:43.958022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:43.958805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:43.979266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:43.980829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:43.983724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:43.986214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:44.298154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:01:44.298154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:01:44.298154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:01:44.298154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:01:44.298154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:01:44.310775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=23 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:44.312430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:44.312880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:44.313806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:44.314243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:44.350018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=77 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:44.381886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Getting quotas for project dad7b33b97ba48a6a4989ff35985a4ca. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:01:44.383008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:44.395691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Getting quotas for user 79c12f29545c40ec955650696bb91a65 and project dad7b33b97ba48a6a4989ff35985a4ca. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:01:44.398150 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f32f046a-3123-48c9-b7a8-e3d05031d67d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.445239 Jun 18 22:01:44.401270 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 88/159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:43 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:44.418078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=19,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:44.426073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:01:44.430141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:01:44.515898 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-153f6f7b-7748-4313-9f14-58972dcdad06 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.373617 Jun 18 22:01:44.519896 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 72/160] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:01:44.528653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e86cddac-030d-4ea2-98a0-e4683b68da29 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:44.529530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e86cddac-030d-4ea2-98a0-e4683b68da29 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:44.694722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:44.696285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:44.710845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:44.711783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:44.714345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:44.715553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:44.716836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e86cddac-030d-4ea2-98a0-e4683b68da29 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:44.734750 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e86cddac-030d-4ea2-98a0-e4683b68da29 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1263 microversion: 2.1 time: 0.210335 Jun 18 22:01:44.735436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 89/161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:44 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1263 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:45.018859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:45.027220 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12bf9d09-cd01-4c75-9469-a7c36ae49cdc tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.336609 Jun 18 22:01:45.048069 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 73/162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:44 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:45.170412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5ecabf96-996b-4f03-94fa-b3819ccbcbb6 req-ce8dd541-217c-4bee-bd83-667ed8c720d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db721dc8-8646-4360-b87a-5a5d13f7f723", "name": "network-vif-plugged", "status": "completed", "tag": "f9b92243-836f-452e-ae84-1121b20d12c2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:45.184296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5ecabf96-996b-4f03-94fa-b3819ccbcbb6 req-ce8dd541-217c-4bee-bd83-667ed8c720d9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:45.184977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5ecabf96-996b-4f03-94fa-b3819ccbcbb6 req-ce8dd541-217c-4bee-bd83-667ed8c720d9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:45.201424 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5ecabf96-996b-4f03-94fa-b3819ccbcbb6 req-ce8dd541-217c-4bee-bd83-667ed8c720d9 service nova] Creating event network-vif-plugged:f9b92243-836f-452e-ae84-1121b20d12c2 for instance db721dc8-8646-4360-b87a-5a5d13f7f723 on nch2-master-1 Jun 18 22:01:45.208297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5ecabf96-996b-4f03-94fa-b3819ccbcbb6 req-ce8dd541-217c-4bee-bd83-667ed8c720d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.369446 Jun 18 22:01:45.209605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 90/163] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:45.416917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:45.417584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:45.426849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:45.428590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:45.429470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:45.430109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:45.663299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:45.674760 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67b500cf-a2e5-4d02-b2ee-930087e71d15 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.262186 Jun 18 22:01:45.676465 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 74/164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:45 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:45.754256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:45.755609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:45.770298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:45.770847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:45.771662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:45.772108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.030726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:46.043702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:46.044239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:46.054967 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-481b0551-da9e-491f-bff4-9ae4c836711c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1315 microversion: 2.1 time: 0.305504 Jun 18 22:01:46.054967 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 91/165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:45 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:46.066267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.066994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.067966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.068576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.461283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:46.474788 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9b6f907b-6489-4daa-8b67-96d37a255ea6 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1341 microversion: 2.1 time: 0.434767 Jun 18 22:01:46.475848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 75/166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:46 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1341 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:46.581461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Calling method '.version_select at 0x7fea150ca700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:46.581461 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:46.581461 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:46.586921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.587619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.609283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.609731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.626224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.626664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.634293 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c95560f4-3284-416b-b11e-af89dca1c294 tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.364008 Jun 18 22:01:46.634891 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 92/167] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:01:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:46.644932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49e691c4-84f4-40cc-a6b9-57b8e91e5b3c tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Calling method '.version_select at 0x7fea14e47790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:46.645985 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:46.645985 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:46.647221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49e691c4-84f4-40cc-a6b9-57b8e91e5b3c tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.647664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49e691c4-84f4-40cc-a6b9-57b8e91e5b3c tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.667346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49e691c4-84f4-40cc-a6b9-57b8e91e5b3c tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.668122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49e691c4-84f4-40cc-a6b9-57b8e91e5b3c tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.675429 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49e691c4-84f4-40cc-a6b9-57b8e91e5b3c tempest-HypervisorAdminV228Test-1092281123 tempest-HypervisorAdminV228Test-1092281123-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.034377 Jun 18 22:01:46.676445 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 76/168] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Jun 18 22:01:46 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:01:46.694790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:46.695945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:46.704209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:46.707773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.708562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.709553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:46.710124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:46.879716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:46.888103 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8980657a-ecdb-4cc3-8949-39f9c7e1b51d tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.200267 Jun 18 22:01:46.889050 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 93/169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:46 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:47.073859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:47.074594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:47.085307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.086170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:47.086957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.087565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:47.171763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:47.183466 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c07b5b9-c33e-4c98-81c1-db8da119038c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.115535 Jun 18 22:01:47.193973 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 77/170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:47 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:47.229774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-42928792-8598-4ac3-9f90-c3560fa512b3 req-366da683-1196-4454-b3e5-65fd7ebc8f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbae906-f67e-410e-ab66-e23bdc980bf0", "name": "network-vif-plugged", "status": "completed", "tag": "b92b2ed1-1078-430d-9e4b-871cc584c575"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:47.245690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-42928792-8598-4ac3-9f90-c3560fa512b3 req-366da683-1196-4454-b3e5-65fd7ebc8f66 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.246133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-42928792-8598-4ac3-9f90-c3560fa512b3 req-366da683-1196-4454-b3e5-65fd7ebc8f66 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:47.257985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-42928792-8598-4ac3-9f90-c3560fa512b3 req-366da683-1196-4454-b3e5-65fd7ebc8f66 service nova] Creating event network-vif-plugged:b92b2ed1-1078-430d-9e4b-871cc584c575 for instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 on nch2-master-1 Jun 18 22:01:47.264334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-42928792-8598-4ac3-9f90-c3560fa512b3 req-366da683-1196-4454-b3e5-65fd7ebc8f66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042339 Jun 18 22:01:47.297127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 94/171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:47.506580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:47.508834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:47.535977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.541234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:47.545226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.545970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:47.818447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:47.827270 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed85c558-2e7d-4290-953c-6303e5070b95 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1490 microversion: 2.1 time: 0.337826 Jun 18 22:01:47.831096 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 78/172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:47 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1490 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:47.905933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:47.906824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:47.914573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.915245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:47.916023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:47.916601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.069664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:48.078712 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ccb95d7b-0577-4da3-b632-4b7d0d881923 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.176852 Jun 18 22:01:48.079513 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 79/173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:47 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:48.184927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:48.185695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:48.194161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:48.194684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.195539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:48.196218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.271188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:01:48.419821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-067eb23a-1c4c-4a4d-9530-1aa64b30ce02 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 204 len: 0 microversion: 2.1 time: 0.573465 Jun 18 22:01:48.420787 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 95/174] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:01:47 2022] DELETE /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:01:48.426766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:48.427770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:48.434445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:48.434876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.435829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:48.436267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.507522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:48.509655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2e312ba5-8868-4a5f-b217-c4255bf7c1e7 tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] Action: 'create', calling method: .version_select at 0x7fea14e3e040>, body: {"security_group": {"name": "tempest-securitygroup-54058461", "description": "tempest-description-263495162"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:48.522200 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-04fa735e-d621-45bf-ac41-cb71949f3bb6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.099742 Jun 18 22:01:48.523527 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 96/175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:48 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:48.539985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:48.541613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:48.551311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:48.551655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.553876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:48.554677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:48.576026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:48.832081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:48.843368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e937e049-674d-4642-b70d-45cb3c3e453a tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1496 microversion: 2.1 time: 0.318567 Jun 18 22:01:48.844494 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 97/176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:48 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1496 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:48.995125 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2e312ba5-8868-4a5f-b217-c4255bf7c1e7 tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.870997 Jun 18 22:01:48.996403 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 80/177] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:01:48 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:49.007501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5069699a-e546-4b58-8484-02b6c156ae7f tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] Action: 'create', calling method: .version_select at 0x7fea14fe48b0>, body: {"security_group": {"name": "tempest-securitygroup-185150213", "description": "tempest-description-164727422"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:49.096702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:49.097675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:49.105285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:49.105739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:49.106511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:49.106942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:49.291592 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5069699a-e546-4b58-8484-02b6c156ae7f tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.288140 Jun 18 22:01:49.292549 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 98/178] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:01:49 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:49.352339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:49.361118 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24d7f0da-e8ff-40a5-9c7c-e026b4865194 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1339 microversion: 2.1 time: 0.268132 Jun 18 22:01:49.362060 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 81/179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:49 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:49.542006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:49.543128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:49.549935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:49.550668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:49.551834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:49.552469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:49.626771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:49.634777 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6adfdcb0-afdf-4d94-b5fd-519cabd0882d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.097612 Jun 18 22:01:49.635442 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 82/180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:49 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:49.701376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8541665-5d16-44c5-8f71-6179b1181313 tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] Action: 'create', calling method: .version_select at 0x7fea14fe4550>, body: {"security_group": {"name": "tempest-securitygroup-804723104", "description": "tempest-description-1587068661"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:49.866029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:49.866656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:49.873794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:49.874240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:49.875408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:49.876068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.127514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:50.153597 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a91be09-f6cb-464b-b9a9-451cd318e96c tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 200 len: 1496 microversion: 2.1 time: 0.295257 Jun 18 22:01:50.165139 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 83/181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:49 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 1496 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:50.249803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8541665-5d16-44c5-8f71-6179b1181313 tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.950379 Jun 18 22:01:50.250469 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 99/182] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:01:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:50.262688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b93bf88-f70a-4e46-ad34-2384a7a4c74b tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] Action: 'create', calling method: .version_select at 0x7fea14f649d0>, body: {"security_group": {"name": "tempest-securitygroup-2123430704", "description": "tempest-description-1090162386"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:50.444593 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b93bf88-f70a-4e46-ad34-2384a7a4c74b tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.186661 Jun 18 22:01:50.446025 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 100/183] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:01:50 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:50.547984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea14edeca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:50.549345 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:50.549345 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:50.550830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.551488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.599491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.600181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.628672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.629531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.638612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d05ad9b2-75bb-4a24-a80b-9b4811957e34 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.472051 Jun 18 22:01:50.639960 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 84/184] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:50.646419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:50.649242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:50.661469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.662192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.663277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.664035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.684941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-463c875d-6cef-4c70-aa54-059a4793063a tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1938120522", "id": 1976200142, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:50.691177 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:50.691177 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:50.716655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:50.720587 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-463c875d-6cef-4c70-aa54-059a4793063a tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.273141 Jun 18 22:01:50.722897 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 101/185] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:01:50 2022] POST /compute/v2.1/flavors => generated 449 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:50.728368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f8f7280-dda8-42f7-b54f-3da770e63557 tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] Calling method '.version_select at 0x7fea1503d550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:50.933368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:50.942195 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c23acdf0-19e9-426d-910f-34fa6538ed00 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1489 microversion: 2.1 time: 0.300815 Jun 18 22:01:50.943456 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 85/186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:50 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1489 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:50.948132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f6545e5c-3833-408e-a5e1-cf49d4b2f25d req-303f036a-7dc9-4765-8fd2-fb2ce45f71a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db721dc8-8646-4360-b87a-5a5d13f7f723", "name": "network-vif-deleted", "tag": "f9b92243-836f-452e-ae84-1121b20d12c2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:50.956316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f6545e5c-3833-408e-a5e1-cf49d4b2f25d req-303f036a-7dc9-4765-8fd2-fb2ce45f71a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.956644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f6545e5c-3833-408e-a5e1-cf49d4b2f25d req-303f036a-7dc9-4765-8fd2-fb2ce45f71a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:50.978263 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f6545e5c-3833-408e-a5e1-cf49d4b2f25d req-303f036a-7dc9-4765-8fd2-fb2ce45f71a0 service nova] Creating event network-vif-deleted:f9b92243-836f-452e-ae84-1121b20d12c2 for instance db721dc8-8646-4360-b87a-5a5d13f7f723 on nch2-master-1 Jun 18 22:01:50.983344 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f6545e5c-3833-408e-a5e1-cf49d4b2f25d req-303f036a-7dc9-4765-8fd2-fb2ce45f71a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038638 Jun 18 22:01:50.983962 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 86/187] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:50.989526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea1529f670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:50.990442 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:50.990442 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:50.991725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:50.992174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:51.010810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:51.011359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:51.042093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:51.042622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:51.050332 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-639ca093-413b-405e-a3ed-4e5e00fd5c2c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.065068 Jun 18 22:01:51.051486 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 87/188] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:01:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:51.064165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:51.065476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:51.072703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:51.073172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:51.074293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:51.074892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:51.164597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:51.183514 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d6d6b91-1ff5-4aa8-a065-7517b64665b4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.122509 Jun 18 22:01:51.184700 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 88/189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:51 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:51.539892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80a8965b-21ff-4297-a1b9-73c22bdc079b tempest-FlavorsV255TestJSON-276569705 tempest-FlavorsV255TestJSON-276569705-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:51.549279 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80a8965b-21ff-4297-a1b9-73c22bdc079b tempest-FlavorsV255TestJSON-276569705 tempest-FlavorsV255TestJSON-276569705-project] 10.222.0.30 "GET /compute/v2.1/flavors/1976200142" status: 200 len: 449 microversion: 2.55 time: 0.361501 Jun 18 22:01:51.549892 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 89/190] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Jun 18 22:01:51 2022] GET /compute/v2.1/flavors/1976200142 => generated 449 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:51.560763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:51.561464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:51.568965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:51.569529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:51.570520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:51.571300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.000681 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ca87b7c-ec9f-4662-9830-230ed75c7b8d tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1640 microversion: 2.1 time: 0.443576 Jun 18 22:01:52.001803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 90/191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:51 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1640 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:52.008210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea14e228b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.009046 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:52.009046 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:52.010234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.010678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.026373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.026804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.038364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.038707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.044612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d3084b92-38fd-4f48-bf65-abb000939084 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040780 Jun 18 22:01:52.045199 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 91/192] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:52.049736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.050641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:52.056513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.056959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.057748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.058151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.071530 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] HTTP exception thrown: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Request method failure captured: Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 HTTP/1.1 Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksneNbuOhp2lO6zn0dzNBLn6fs0TQkyUvr2grU6gpdZqoy8ENC18BjtM_4DE3u7Pbza5a6GSHiipQEi4Tbu8Lv9Lu1d2oFVDrhZ9iVx1v0gkTWv-hlr9QA8ldET6-LLpJS5MC_vVRt1oI3sdXkd2A_8vFkgyfQsXzf3KxNnGZtYbNo Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:01:52.075584 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9f244c1df9c4ca19ec5fa57b7d94bc6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c9ae6d217f7344408eed23388dd337b7 Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:01:52.077092 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'db721dc8-8646-4360-b87a-5a5d13f7f723'} Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:52.078028 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:01:52.079357 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.080531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Returning 404 to user: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:52.080531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-767a31b9-4948-49ac-a2a2-40153150cdec tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 404 len: 111 microversion: 2.1 time: 0.030836 Jun 18 22:01:52.080531 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 92/193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:52.082046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee123a20-526b-4d3d-b897-8d2c10528373 tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] Action: 'update', calling method: .version_select at 0x7fea171391f0>, body: {"flavor": {"description": "new"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:52.092142 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:52.092142 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:52.124821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee123a20-526b-4d3d-b897-8d2c10528373 tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1976200142" status: 200 len: 450 microversion: 2.55 time: 0.046098 Jun 18 22:01:52.126031 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 93/194] 10.222.0.30 () {62 vars in 1218 bytes} [Sat Jun 18 22:01:52 2022] PUT /compute/v2.1/flavors/1976200142 => generated 450 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:01:52.179312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f8f7280-dda8-42f7-b54f-3da770e63557 tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7622 microversion: 2.1 time: 1.454730 Jun 18 22:01:52.180077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 102/195] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Jun 18 22:01:50 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7622 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:52.184703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.189730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:52.198719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.199170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.199934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.200361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.225865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:01:52.317935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf6ad134-bc04-4270-b51b-9283cb76c4f9 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Calling method '.version_select at 0x7fea14d14670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.318846 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:52.318846 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:52.320392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cf6ad134-bc04-4270-b51b-9283cb76c4f9 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6ea800942817425794e2f4b8b5aa9288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f58887253437e8a2f9157e23244d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf6ad134-bc04-4270-b51b-9283cb76c4f9 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Request method failure captured: Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktOjvbzoSoxlcTRu6JaFNAa2KniPrsPpMPJX_q5A04-y_hWAzqqbMaZuNcd9dWZz19HDlmDLCouGbG40rVogbnK-rmCTDL2FMh_rsmnA8nYcdfJZw9DiymIAM7YsuVex9OGwZVtF3SXLfUMRx9V8XKwDsk-q1zx61MRWcvAS4Cfdig Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:01:52.322997 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f83f58887253437e8a2f9157e23244d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 6ea800942817425794e2f4b8b5aa9288 Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: action_args: {} Jun 18 22:01:52.324452 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:52.325394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 18 22:01:52.326825 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.327913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf6ad134-bc04-4270-b51b-9283cb76c4f9 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:52.327913 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf6ad134-bc04-4270-b51b-9283cb76c4f9 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.197108 Jun 18 22:01:52.327913 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 94/196] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 198 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:52.333300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1367d63a-d6d6-4f98-bd12-25b485d369a7 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea14cc4310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.334065 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:52.334065 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:52.335869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1367d63a-d6d6-4f98-bd12-25b485d369a7 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.336484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1367d63a-d6d6-4f98-bd12-25b485d369a7 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.342067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:52.349825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35754019-e4a7-4760-9095-d6475efdd63e tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 204 len: 0 microversion: 2.1 time: 0.168501 Jun 18 22:01:52.350838 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 103/197] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:01:52 2022] DELETE /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:01:52.355311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1367d63a-d6d6-4f98-bd12-25b485d369a7 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.356218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1367d63a-d6d6-4f98-bd12-25b485d369a7 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.356322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-738ce8a3-4c65-4a89-8a41-27d97df2a49a tempest-FlavorsV255TestJSON-276569705 tempest-FlavorsV255TestJSON-276569705-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.364334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1367d63a-d6d6-4f98-bd12-25b485d369a7 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.037187 Jun 18 22:01:52.364334 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 95/198] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:52.368157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-668585925", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:52.379868 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-738ce8a3-4c65-4a89-8a41-27d97df2a49a tempest-FlavorsV255TestJSON-276569705 tempest-FlavorsV255TestJSON-276569705-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6597 microversion: 2.55 time: 0.027936 Jun 18 22:01:52.380414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 104/199] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/flavors/detail => generated 6597 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:01:52.386368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.387069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:52.393972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.394494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.395336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.395846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.422920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:01:52.494196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:52.502353 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5371b3be-0e56-4b96-b638-8e99f2c12d3c tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.120122 Jun 18 22:01:52.510776 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 105/200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:52.510776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5b7eae9-3c24-44a4-8834-38e13fda190b tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] Calling method '.version_select at 0x7fea15087a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.712240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:01:52.712736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:01:52.713153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:01:52.713561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:01:52.713949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:01:52.723438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.723875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.724672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.725141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.742931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Getting quotas for project d9f244c1df9c4ca19ec5fa57b7d94bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:01:52.747068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Getting quotas for user c9ae6d217f7344408eed23388dd337b7 and project d9f244c1df9c4ca19ec5fa57b7d94bc6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:01:52.758323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:01:52.760671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:01:52.775332 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5b7eae9-3c24-44a4-8834-38e13fda190b tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1108 microversion: 2.1 time: 0.270731 Jun 18 22:01:52.776297 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 106/201] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1108 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:52.780933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd0b0adc-4b06-44d0-9946-b0bbb9ed5e27 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Calling method '.version_select at 0x7fea151105e0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.781999 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:52.781999 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:52.783088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cd0b0adc-4b06-44d0-9946-b0bbb9ed5e27 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6ea800942817425794e2f4b8b5aa9288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f58887253437e8a2f9157e23244d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd0b0adc-4b06-44d0-9946-b0bbb9ed5e27 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Request method failure captured: Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktOjvbzoSoxlcTRu6JaFNAa2KniPrsPpMPJX_q5A04-y_hWAzqqbMaZuNcd9dWZz19HDlmDLCouGbG40rVogbnK-rmCTDL2FMh_rsmnA8nYcdfJZw9DiymIAM7YsuVex9OGwZVtF3SXLfUMRx9V8XKwDsk-q1zx61MRWcvAS4Cfdig Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:52.786391 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f83f58887253437e8a2f9157e23244d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 6ea800942817425794e2f4b8b5aa9288 Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:01:52.787679 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:52.788377 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 18 22:01:52.789425 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:52.792117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd0b0adc-4b06-44d0-9946-b0bbb9ed5e27 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:52.792117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cd0b0adc-4b06-44d0-9946-b0bbb9ed5e27 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010519 Jun 18 22:01:52.792117 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 107/202] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:52.798582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.799220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:52.806155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.806597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.807356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.807784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.813836 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f908d3db-1275-444d-9437-ddb2cd3d6ccb tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.448459 Jun 18 22:01:52.814873 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 96/203] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:01:52.821687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-475b45b2-9187-463a-9d35-9e15c6d6bb7c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea14e22670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.822522 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:52.822522 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:52.823646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-475b45b2-9187-463a-9d35-9e15c6d6bb7c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:52.824102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-475b45b2-9187-463a-9d35-9e15c6d6bb7c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:52.843539 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-475b45b2-9187-463a-9d35-9e15c6d6bb7c tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.025188 Jun 18 22:01:52.844323 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 97/204] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:52.854034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93b19927-c25b-467d-97d4-2dd1bbbdc660 tempest-FlavorsV255TestJSON-276569705 tempest-FlavorsV255TestJSON-276569705-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.884615 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93b19927-c25b-467d-97d4-2dd1bbbdc660 tempest-FlavorsV255TestJSON-276569705 tempest-FlavorsV255TestJSON-276569705-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3687 microversion: 2.55 time: 0.034612 Jun 18 22:01:52.885526 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 98/205] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/flavors => generated 3687 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:01:52.895558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56ea34df-2b92-4167-8b56-71c67e12db24 tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] Calling method '.version_select at 0x7fea14d14e50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:52.990771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:52.999515 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e15e64a8-2499-4a7c-9ab5-36f2235ab844 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1495 microversion: 2.1 time: 0.210303 Jun 18 22:01:53.009155 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 108/206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:52 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1495 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:53.014016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed825ecc-0a78-47b9-9229-571992c00ebe tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Calling method '.version_select at 0x7fea15167e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.014803 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.014803 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.015879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed825ecc-0a78-47b9-9229-571992c00ebe tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6ea800942817425794e2f4b8b5aa9288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f58887253437e8a2f9157e23244d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed825ecc-0a78-47b9-9229-571992c00ebe tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Request method failure captured: Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktOjvbzoSoxlcTRu6JaFNAa2KniPrsPpMPJX_q5A04-y_hWAzqqbMaZuNcd9dWZz19HDlmDLCouGbG40rVogbnK-rmCTDL2FMh_rsmnA8nYcdfJZw9DiymIAM7YsuVex9OGwZVtF3SXLfUMRx9V8XKwDsk-q1zx61MRWcvAS4Cfdig Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:53.017526 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f83f58887253437e8a2f9157e23244d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 6ea800942817425794e2f4b8b5aa9288 Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:01:53.018859 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:53.019690 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 18 22:01:53.021104 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.022258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed825ecc-0a78-47b9-9229-571992c00ebe tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:53.022258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed825ecc-0a78-47b9-9229-571992c00ebe tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.008576 Jun 18 22:01:53.035809 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 109/207] 10.222.0.30 () {58 vars in 1178 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:53.041998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-216981f0-95a8-41da-a78f-a2b19b2a8981 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.042854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-216981f0-95a8-41da-a78f-a2b19b2a8981 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:53.111323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-216981f0-95a8-41da-a78f-a2b19b2a8981 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:53.118816 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-216981f0-95a8-41da-a78f-a2b19b2a8981 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1219 microversion: 2.1 time: 0.081673 Jun 18 22:01:53.119390 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 110/208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:53.123974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea150ca670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.124775 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.124775 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.126850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.127349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.150487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.150919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.163471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.163926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.169877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56ea34df-2b92-4167-8b56-71c67e12db24 tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ab84d4d9-ddf9-40f8-b943-e68169fe7257" status: 202 len: 0 microversion: 2.1 time: 0.279613 Jun 18 22:01:53.173804 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 99/209] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:01:52 2022] DELETE /compute/v2.1/os-security-groups/ab84d4d9-ddf9-40f8-b943-e68169fe7257 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:53.173936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-613f8c69-6672-498b-bf07-f367d7aa3826 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.050715 Jun 18 22:01:53.173936 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 111/210] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:53.174850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75f5fa90-f6b2-4aae-9417-55b22ffb32a1 tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.175564 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.175564 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:53.211975 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75f5fa90-f6b2-4aae-9417-55b22ffb32a1 tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1976200142" status: 202 len: 0 microversion: 2.55 time: 0.040079 Jun 18 22:01:53.212640 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 100/211] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Jun 18 22:01:53 2022] DELETE /compute/v2.1/flavors/1976200142 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:01:53.221414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4baf9193-3816-4449-b756-d0e85528cfed tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] Calling method '.version_select at 0x7fea14d14700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.241490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Calling method '.version_select at 0x7fea151101f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.242289 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.242289 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.243576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.244017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.260050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.260451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.272295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.272753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.278823 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18c97a17-ba09-41ef-8e00-430a59dffe90 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.105596 Jun 18 22:01:53.279414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 112/212] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:53.283999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18921b58-8846-4c51-8bc2-860143723440 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea150ca1f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.285146 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.285146 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.286275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18921b58-8846-4c51-8bc2-860143723440 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.286721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18921b58-8846-4c51-8bc2-860143723440 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.301974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18921b58-8846-4c51-8bc2-860143723440 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.302463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18921b58-8846-4c51-8bc2-860143723440 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.314304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18921b58-8846-4c51-8bc2-860143723440 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033649 Jun 18 22:01:53.315209 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 113/213] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:53.320151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b8c506e-9e93-485f-b410-8b0bc7b1c177 tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.340738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b8c506e-9e93-485f-b410-8b0bc7b1c177 tempest-FlavorsV255TestJSON-2082995132 tempest-FlavorsV255TestJSON-2082995132-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6157 microversion: 2.55 time: 0.024416 Jun 18 22:01:53.341454 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 114/214] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/flavors/detail => generated 6157 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:01:53.356207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38022ede-263e-4373-b0f9-3d6f8bdb50a0 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Calling method '.version_select at 0x7fea14f6edc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.357016 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.357016 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.358586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38022ede-263e-4373-b0f9-3d6f8bdb50a0 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6ea800942817425794e2f4b8b5aa9288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f58887253437e8a2f9157e23244d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38022ede-263e-4373-b0f9-3d6f8bdb50a0 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Request method failure captured: Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktOjvbzoSoxlcTRu6JaFNAa2KniPrsPpMPJX_q5A04-y_hWAzqqbMaZuNcd9dWZz19HDlmDLCouGbG40rVogbnK-rmCTDL2FMh_rsmnA8nYcdfJZw9DiymIAM7YsuVex9OGwZVtF3SXLfUMRx9V8XKwDsk-q1zx61MRWcvAS4Cfdig Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:53.361305 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f83f58887253437e8a2f9157e23244d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 6ea800942817425794e2f4b8b5aa9288 Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '1'} Jun 18 22:01:53.362500 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:53.363232 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 18 22:01:53.364657 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.365707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38022ede-263e-4373-b0f9-3d6f8bdb50a0 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:53.365707 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38022ede-263e-4373-b0f9-3d6f8bdb50a0 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012638 Jun 18 22:01:53.365707 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 115/215] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:53.369885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f56273da-72ff-4751-8be7-98cfe5debd2b tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea15110700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.370465 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.370465 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.372140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56273da-72ff-4751-8be7-98cfe5debd2b tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.372828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56273da-72ff-4751-8be7-98cfe5debd2b tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.390408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56273da-72ff-4751-8be7-98cfe5debd2b tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.390896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56273da-72ff-4751-8be7-98cfe5debd2b tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.401381 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f56273da-72ff-4751-8be7-98cfe5debd2b tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.036471 Jun 18 22:01:53.402512 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 116/216] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:53.408058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fdaa6ad-fd7a-42c1-a7af-54687d0b79c5 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Calling method '.version_select at 0x7fea150cac10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.409108 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.409108 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.410981 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2fdaa6ad-fd7a-42c1-a7af-54687d0b79c5 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] HTTP exception thrown: Hypervisor with ID 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518' could not be found. Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fdaa6ad-fd7a-42c1-a7af-54687d0b79c5 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Request method failure captured: Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/f6c3742b-e04d-4d5e-80f9-29fa4c7f1518/uptime HTTP/1.1 Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktPP8ntXUA2hl4IIin6QsvJT9yhLC7-f1HBUYfN5CYyQwvo_X_d8Dbqr9ABtx0gmoxX4nCE4jrpyMdPJaet7DV4U4s2mINoiVoU1EdVfpbVQizSokdM6IA80mSDMjkseOOoJs0Oc0qtt_S7Umns11IScKyo1hvk4ams5j5a1KWORD4 Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 785513ceec0f48f99e27d8d7e7bc5aca Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926274320 Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:01:53.422706 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/785513ceec0f48f99e27d8d7e7bc5aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/785513ceec0f48f99e27d8d7e7bc5aca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/785513ceec0f48f99e27d8d7e7bc5aca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_785513ceec0f48f99e27d8d7e7bc5aca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926274320 Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 785513ceec0f48f99e27d8d7e7bc5aca Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926274320 Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 0803acbbfac946d19f661e007b4fbda4 Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: exception: Hypervisor with ID 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518' could not be found. Jun 18 22:01:53.424639 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518'} Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518' Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 18 22:01:53.425715 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518' could not be found. Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.427404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518' could not be found. Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fdaa6ad-fd7a-42c1-a7af-54687d0b79c5 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Returning 404 to user: Hypervisor with ID 'f6c3742b-e04d-4d5e-80f9-29fa4c7f1518' could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2fdaa6ad-fd7a-42c1-a7af-54687d0b79c5 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/f6c3742b-e04d-4d5e-80f9-29fa4c7f1518/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020674 Jun 18 22:01:53.428899 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 117/217] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/f6c3742b-e04d-4d5e-80f9-29fa4c7f1518/uptime => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:53.435912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Calling method '.version_select at 0x7fea15087940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.437948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.438635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.445085 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4baf9193-3816-4449-b756-d0e85528cfed tempest-SecurityGroupsTestAdminJSON-2034610501 tempest-SecurityGroupsTestAdminJSON-2034610501-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cadf553f-1262-4e46-8a87-603f2e551a4a" status: 202 len: 0 microversion: 2.1 time: 0.227583 Jun 18 22:01:53.446464 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 101/218] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:01:53 2022] DELETE /compute/v2.1/os-security-groups/cadf553f-1262-4e46-8a87-603f2e551a4a => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:53.452213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Calling method '.version_select at 0x7fea14cc4a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.453494 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.453494 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:53.455656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.457668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.457922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.458121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.474907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.475359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.480901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.481507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.486172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.486828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.494894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-33f04aac-6af8-42db-8192-c596d7eb30b9 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.047254 Jun 18 22:01:53.500231 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 102/219] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:53.504922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c3fb13f-49a9-485e-add2-dd98d65ddc68 tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] Calling method '.version_select at 0x7fea14d14ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.519012 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86443660-cc78-4dcb-8798-010aff22f2d6 tempest-HypervisorAdminTestJSON-1269492614 tempest-HypervisorAdminTestJSON-1269492614-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.086984 Jun 18 22:01:53.519871 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 118/220] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:53.528759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0c4ecbd-a958-45f3-aa21-9b745cd50921 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Calling method '.version_select at 0x7fea14e34040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.530594 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.530594 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.532144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b0c4ecbd-a958-45f3-aa21-9b745cd50921 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6ea800942817425794e2f4b8b5aa9288', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83f58887253437e8a2f9157e23244d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0c4ecbd-a958-45f3-aa21-9b745cd50921 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Request method failure captured: Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktOjvbzoSoxlcTRu6JaFNAa2KniPrsPpMPJX_q5A04-y_hWAzqqbMaZuNcd9dWZz19HDlmDLCouGbG40rVogbnK-rmCTDL2FMh_rsmnA8nYcdfJZw9DiymIAM7YsuVex9OGwZVtF3SXLfUMRx9V8XKwDsk-q1zx61MRWcvAS4Cfdig Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:53.535380 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f83f58887253437e8a2f9157e23244d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f83f58887253437e8a2f9157e23244d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: f83f58887253437e8a2f9157e23244d4 Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711 Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 6ea800942817425794e2f4b8b5aa9288 Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1000703711-project Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '1'} Jun 18 22:01:53.536804 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:53.538032 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 18 22:01:53.539429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.540389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0c4ecbd-a958-45f3-aa21-9b745cd50921 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:53.540389 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b0c4ecbd-a958-45f3-aa21-9b745cd50921 tempest-HypervisorAdminNegativeTestJSON-1000703711 tempest-HypervisorAdminNegativeTestJSON-1000703711-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014334 Jun 18 22:01:53.540389 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 119/221] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:53.545339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.549488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:53.567690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.568211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.569016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:53.569517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:53.691080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:53.707798 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05f270d0-6076-4c17-bf7d-e36e20d662e3 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.167691 Jun 18 22:01:53.709229 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 120/222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:53.721177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3368b8c-ff1a-4d46-b190-0482639e8286 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Calling method '.version_select at 0x7fea14ee8e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:53.722032 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:53.722032 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:53.722903 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b3368b8c-ff1a-4d46-b190-0482639e8286 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] HTTP exception thrown: Hypervisor with ID '76ca1a13-64f0-42db-8824-8ea9791fb844' could not be found. Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3368b8c-ff1a-4d46-b190-0482639e8286 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Request method failure captured: Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/76ca1a13-64f0-42db-8824-8ea9791fb844 HTTP/1.1 Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktPP8ntXUA2hl4IIin6QsvJT9yhLC7-f1HBUYfN5CYyQwvo_X_d8Dbqr9ABtx0gmoxX4nCE4jrpyMdPJaet7DV4U4s2mINoiVoU1EdVfpbVQizSokdM6IA80mSDMjkseOOoJs0Oc0qtt_S7Umns11IScKyo1hvk4ams5j5a1KWORD4 Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 785513ceec0f48f99e27d8d7e7bc5aca Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-926274320 Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:01:53.724573 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/785513ceec0f48f99e27d8d7e7bc5aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/785513ceec0f48f99e27d8d7e7bc5aca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/785513ceec0f48f99e27d8d7e7bc5aca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_785513ceec0f48f99e27d8d7e7bc5aca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-926274320 Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 785513ceec0f48f99e27d8d7e7bc5aca Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-926274320 Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 0803acbbfac946d19f661e007b4fbda4 Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: exception: Hypervisor with ID '76ca1a13-64f0-42db-8824-8ea9791fb844' could not be found. Jun 18 22:01:53.725976 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '76ca1a13-64f0-42db-8824-8ea9791fb844'} Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '76ca1a13-64f0-42db-8824-8ea9791fb844' Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 18 22:01:53.726869 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:01:53.728238 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '76ca1a13-64f0-42db-8824-8ea9791fb844' could not be found. Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '76ca1a13-64f0-42db-8824-8ea9791fb844' could not be found. Jun 18 22:01:53.729604 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:53.738566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3368b8c-ff1a-4d46-b190-0482639e8286 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] Returning 404 to user: Hypervisor with ID '76ca1a13-64f0-42db-8824-8ea9791fb844' could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:53.739690 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3368b8c-ff1a-4d46-b190-0482639e8286 tempest-HypervisorAdminNegativeTestJSON-926274320 tempest-HypervisorAdminNegativeTestJSON-926274320-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/76ca1a13-64f0-42db-8824-8ea9791fb844" status: 404 len: 123 microversion: 2.1 time: 0.029525 Jun 18 22:01:53.746975 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 121/223] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:01:53 2022] GET /compute/v2.1/os-hypervisors/76ca1a13-64f0-42db-8824-8ea9791fb844 => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:53.796810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c3fb13f-49a9-485e-add2-dd98d65ddc68 tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cc19e5ee-252a-48f9-a7b1-4a700842d0ca" status: 202 len: 0 microversion: 2.1 time: 0.295390 Jun 18 22:01:53.797470 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 103/224] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:01:53 2022] DELETE /compute/v2.1/os-security-groups/cc19e5ee-252a-48f9-a7b1-4a700842d0ca => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:53.806870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4959f6d-8ab5-41da-b534-a11cf4caf96c tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] Calling method '.version_select at 0x7fea14e348b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:54.019006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:54.020092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:54.042441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:54.047145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:54.050472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:54.051156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:54.370069 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c4959f6d-8ab5-41da-b534-a11cf4caf96c tempest-SecurityGroupsTestAdminJSON-1386587282 tempest-SecurityGroupsTestAdminJSON-1386587282-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/f7d01083-56d8-4c16-b722-98658bf4aad7" status: 202 len: 0 microversion: 2.1 time: 0.567831 Jun 18 22:01:54.371489 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 122/225] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:01:53 2022] DELETE /compute/v2.1/os-security-groups/f7d01083-56d8-4c16-b722-98658bf4aad7 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:01:54.378984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:54.379803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:54.388931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:54.390283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:54.391323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:54.392546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:54.435572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:54.472092 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b452f45-a02b-40dd-9092-135d1d8f9b66 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1495 microversion: 2.1 time: 0.458190 Jun 18 22:01:54.473897 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 104/226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:54 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1495 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:54.525531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:54.537528 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4baa5b8a-5a94-4463-9b48-ae5eb8656671 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1299 microversion: 2.1 time: 0.161863 Jun 18 22:01:54.538481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 123/227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:54 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:54.725952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:54.726636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:54.732812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:54.733335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:54.734114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:54.734518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:54.803355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:54.814184 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1ce2a31-3052-4a80-b70b-eef5fa72334d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.092047 Jun 18 22:01:54.815317 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 105/228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:54 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:55.357787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8531f2a0-bdee-40fb-9515-53d691f3be0b req-39faaa87-9009-454d-abbf-33d99b26c4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dbae906-f67e-410e-ab66-e23bdc980bf0", "name": "network-vif-deleted", "tag": "b92b2ed1-1078-430d-9e4b-871cc584c575"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:55.380685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8531f2a0-bdee-40fb-9515-53d691f3be0b req-39faaa87-9009-454d-abbf-33d99b26c4d4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.394443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8531f2a0-bdee-40fb-9515-53d691f3be0b req-39faaa87-9009-454d-abbf-33d99b26c4d4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:55.428956 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8531f2a0-bdee-40fb-9515-53d691f3be0b req-39faaa87-9009-454d-abbf-33d99b26c4d4 service nova] Creating event network-vif-deleted:b92b2ed1-1078-430d-9e4b-871cc584c575 for instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 on nch2-master-1 Jun 18 22:01:55.440623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8531f2a0-bdee-40fb-9515-53d691f3be0b req-39faaa87-9009-454d-abbf-33d99b26c4d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087427 Jun 18 22:01:55.443390 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 124/229] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:55.494483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:55.495804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:55.501306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:55.516992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.517838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:55.518800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.519389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:55.560261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:55.561922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:55.576883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.582336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:55.583377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.586094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:55.663162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75df001919794fd7a2e79cdfbd87cfd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454d2ab18dd84eaf8bbd1e2808159df7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:55.676395 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9184848-e492-45cb-8dc4-d0340b5659eb tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 200 len: 1324 microversion: 2.1 time: 0.187765 Jun 18 22:01:55.679225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 106/230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:55 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:55.707394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:55.718105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d082788-ee85-4aa1-8049-c63eb8a18ad4 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1299 microversion: 2.1 time: 0.165414 Jun 18 22:01:55.721870 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 125/231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:55 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1299 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:55.839458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:55.845647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:55.872121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.873689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:55.874863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:55.875524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:56.084048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:56.097624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1ed5791-4149-4bb3-8543-4f0b3a7668a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1321 microversion: 2.1 time: 0.263690 Jun 18 22:01:56.098264 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 107/232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:55 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:56.694670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:56.696025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:56.704500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:56.708585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:56.710680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:56.711486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:56.736156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:56.737449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:56.759930 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] HTTP exception thrown: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Request method failure captured: Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 HTTP/1.1 Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksn_y7G8u06AA8lemhmW9btBdlJwBLULA1Wgnb5WtIlQ24ShqLhPebQxVj_EoZizwcQFTDwSF-GrGy8js8R5gtUHM5dJ8p1vYNCtXdZy2NGTfcWAuPzGukp4BDN4lSFHy8WoMXasErS5cRhDIyJc7w3TdGSxlovJykKe981LCft__I Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 454d2ab18dd84eaf8bbd1e2808159df7 Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:01:56.769997 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_454d2ab18dd84eaf8bbd1e2808159df7", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 454d2ab18dd84eaf8bbd1e2808159df7 Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminTestJSON-262479970-project Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 75df001919794fd7a2e79cdfbd87cfd6 Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminTestJSON-262479970-project Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:01:56.771683 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3dbae906-f67e-410e-ab66-e23bdc980bf0'} Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:56.772459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:01:56.773739 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:56.781358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Returning 404 to user: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:56.782314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:56.783142 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-513ca68d-a952-4197-869c-fd586fd1d002 tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 404 len: 111 microversion: 2.1 time: 0.092995 Jun 18 22:01:56.784051 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 126/233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:56 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:01:56.785616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:56.786682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:56.788103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:56.794990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8c62569-958d-4606-9d39-e96b1c9ab397 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:56.797279 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:56.797279 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:56.815081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8c62569-958d-4606-9d39-e96b1c9ab397 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:56.816030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8c62569-958d-4606-9d39-e96b1c9ab397 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:57.042895 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8c62569-958d-4606-9d39-e96b1c9ab397 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.250906 Jun 18 22:01:57.047268 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 127/234] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:57.064805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5de9e434-39d7-4b11-abe8-c806bea3b7be tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:57.067145 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.067145 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:57.082023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:57.095119 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5aed84b9-e081-40bf-bf65-9cf683d071e8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1341 microversion: 2.1 time: 0.363469 Jun 18 22:01:57.098208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 108/235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:56 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1341 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:57.115112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:57.115963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:57.118922 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5de9e434-39d7-4b11-abe8-c806bea3b7be tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.068447 Jun 18 22:01:57.119751 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 128/236] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:57 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:01:57.126004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:57.126543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:57.127954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:57.128595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:57.139957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-194bd084-fe7f-43c5-a9b1-2f78214edc20 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1350821541"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:57.141889 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.141889 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:57.143062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-194bd084-fe7f-43c5-a9b1-2f78214edc20 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid fd12d123-9b08-483d-b155-b24feebb639c for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:57.175473 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-194bd084-fe7f-43c5-a9b1-2f78214edc20 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039184 Jun 18 22:01:57.176375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 129/237] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:01:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:57.190814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02e55f54-3dd4-4107-8c4b-5ecd3dd95c21 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:57.193072 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.193072 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:57.207216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02e55f54-3dd4-4107-8c4b-5ecd3dd95c21 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:57.208275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02e55f54-3dd4-4107-8c4b-5ecd3dd95c21 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:57.370259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:57.380367 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d18388f4-eac0-4629-8167-a5450fa5a4f5 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.268471 Jun 18 22:01:57.381980 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 109/238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:57 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:01:57.400574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02e55f54-3dd4-4107-8c4b-5ecd3dd95c21 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.217064 Jun 18 22:01:57.401334 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 130/239] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:57.411275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-471f6a11-8b2e-473c-94b1-bc1434d68f53 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:57.413580 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.413580 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:57.428079 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-471f6a11-8b2e-473c-94b1-bc1434d68f53 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.017738 Jun 18 22:01:57.428777 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 110/240] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:01:57 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:57.440130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec869571-f774-4198-9fcb-d311ca3a7816 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:57.442967 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.442967 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:57.457090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec869571-f774-4198-9fcb-d311ca3a7816 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:57.457532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec869571-f774-4198-9fcb-d311ca3a7816 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:57.664707 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec869571-f774-4198-9fcb-d311ca3a7816 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.228782 Jun 18 22:01:57.665686 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 131/241] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:57.678778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28806913-d585-412c-95be-9ffbe0426198 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:57.679951 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.679951 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:57.738072 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28806913-d585-412c-95be-9ffbe0426198 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.062205 Jun 18 22:01:57.739132 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 111/242] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 18 22:01:57.752216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe3802b9-e54d-40dd-a76c-d2e7c8b70b0c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1680294914"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:57.754085 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.754085 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:57.754973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-fe3802b9-e54d-40dd-a76c-d2e7c8b70b0c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid 0bd2f5da-4025-4053-b929-b3267a5fde73 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:57.805615 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe3802b9-e54d-40dd-a76c-d2e7c8b70b0c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057266 Jun 18 22:01:57.811038 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 132/243] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:01:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:57.821782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2a88ab4-29c2-4195-aa84-ed89de1f205a tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:57.823455 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:57.823455 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:57.836432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2a88ab4-29c2-4195-aa84-ed89de1f205a tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:57.836890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2a88ab4-29c2-4195-aa84-ed89de1f205a tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.012064 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2a88ab4-29c2-4195-aa84-ed89de1f205a tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.198540 Jun 18 22:01:58.018482 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 112/244] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:58.022459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-56ebb28c-d941-4059-a5b4-ed0ced819558 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:58.023213 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.023213 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:58.039635 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-56ebb28c-d941-4059-a5b4-ed0ced819558 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.020757 Jun 18 22:01:58.040577 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 133/245] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:01:58 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:58.051268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93b0ae80-dc83-4f27-9afd-f2f3d0329d93 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:58.052487 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.052487 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:58.065429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93b0ae80-dc83-4f27-9afd-f2f3d0329d93 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.065883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93b0ae80-dc83-4f27-9afd-f2f3d0329d93 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.121614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:58.122237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:58.135580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.138251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.139054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.140440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.245502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93b0ae80-dc83-4f27-9afd-f2f3d0329d93 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.197836 Jun 18 22:01:58.254005 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 113/246] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:58 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:58.260389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc839c05-8075-4255-b434-aa05480262a8 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:58.261517 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.261517 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:58.298370 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc839c05-8075-4255-b434-aa05480262a8 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.041750 Jun 18 22:01:58.312510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 114/247] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:58 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:01:58.323824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-085ff7d5-4cc3-4358-b815-f7409e7b6fa6 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-930423025"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:58.331142 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.331142 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:58.332603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-085ff7d5-4cc3-4358-b815-f7409e7b6fa6 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid 2eecb6c8-8321-44e2-928b-99e55e48fb36 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:58.360031 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-085ff7d5-4cc3-4358-b815-f7409e7b6fa6 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042615 Jun 18 22:01:58.367646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 115/248] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:01:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:58.373710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-facb9d00-5fbe-40dc-99e2-9d04030f6361 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:58.375490 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.375490 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:58.386419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-facb9d00-5fbe-40dc-99e2-9d04030f6361 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.386807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:58.387640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-facb9d00-5fbe-40dc-99e2-9d04030f6361 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.395965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2e24652e-54a8-43c0-b1d6-ff695843373f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.283877 Jun 18 22:01:58.397881 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 134/249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:58 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:58.403062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:58.403825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:58.412785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.413267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.414072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.414600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.438821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:58.614045 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-facb9d00-5fbe-40dc-99e2-9d04030f6361 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.244779 Jun 18 22:01:58.615086 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 116/250] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:58.624886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b08dc736-3149-4b44-b06b-a903694f7d5b req-96aa34b0-83e5-4433-bef6-16b7e08186d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5615e2b-109a-4c94-b891-9016ad5eb69f", "tag": "3d298962-5afd-4ee8-b730-1b6e06470353"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:58.649726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:01:58.658739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b08dc736-3149-4b44-b06b-a903694f7d5b req-96aa34b0-83e5-4433-bef6-16b7e08186d5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.659322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b08dc736-3149-4b44-b06b-a903694f7d5b req-96aa34b0-83e5-4433-bef6-16b7e08186d5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.660285 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-54746606-b782-4ff7-af1b-8a7d3677e637 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.261029 Jun 18 22:01:58.661321 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 135/251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:58 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:01:58.691496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a810f56c-503a-4734-9964-d8a40821a794 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:58.699730 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.699730 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:58.701659 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b08dc736-3149-4b44-b06b-a903694f7d5b req-96aa34b0-83e5-4433-bef6-16b7e08186d5 service nova] Creating event network-changed:3d298962-5afd-4ee8-b730-1b6e06470353 for instance c5615e2b-109a-4c94-b891-9016ad5eb69f on nch2-master-1 Jun 18 22:01:58.715965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b08dc736-3149-4b44-b06b-a903694f7d5b req-96aa34b0-83e5-4433-bef6-16b7e08186d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099421 Jun 18 22:01:58.717357 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 117/252] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:58.717893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a810f56c-503a-4734-9964-d8a40821a794 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.718643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a810f56c-503a-4734-9964-d8a40821a794 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.865670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:58.882619 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a810f56c-503a-4734-9964-d8a40821a794 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.210060 Jun 18 22:01:58.886461 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 136/253] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:58 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:58.898992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9429d56a-81aa-430c-af2b-aca85b241ae9 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:58.899941 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.899941 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:58.950360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9429d56a-81aa-430c-af2b-aca85b241ae9 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.056499 Jun 18 22:01:58.953174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 118/254] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:58 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:01:58.964730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05870a95-4998-4c7f-9cca-fb74dd559e1c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-465936797"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:58.966299 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.966299 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:58.967506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-05870a95-4998-4c7f-9cca-fb74dd559e1c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid 52e9755f-8de3-4e0c-9349-fb141677e049 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:58.968741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee3029f0-b902-4260-b3c9-971b29ce1820 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea14cc4dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:58.971709 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:58.971709 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:58.974763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3029f0-b902-4260-b3c9-971b29ce1820 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.977544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3029f0-b902-4260-b3c9-971b29ce1820 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:58.981440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3029f0-b902-4260-b3c9-971b29ce1820 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:58.986854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3029f0-b902-4260-b3c9-971b29ce1820 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.012963 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05870a95-4998-4c7f-9cca-fb74dd559e1c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053408 Jun 18 22:01:59.016757 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 137/255] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:01:58 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.026996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a1859d2-7070-4cb4-b070-396e0d2df6f3 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.027580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:01:59.028980 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.028980 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.065421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee3029f0-b902-4260-b3c9-971b29ce1820 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.097388 Jun 18 22:01:59.067316 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 119/256] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:01:58 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.074848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a1859d2-7070-4cb4-b070-396e0d2df6f3 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.053818 Jun 18 22:01:59.075899 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 138/257] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 18 22:01:59.086462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a3afa52-697e-4830-819f-a54bc1d249af tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.087327 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.087327 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.097543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65111afb-564f-4064-b814-a252bb21135e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea14ca59d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.099436 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3a3afa52-697e-4830-819f-a54bc1d249af tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jun 18 22:01:59.100037 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.100037 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:59.101479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65111afb-564f-4064-b814-a252bb21135e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.101983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65111afb-564f-4064-b814-a252bb21135e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.102991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65111afb-564f-4064-b814-a252bb21135e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.103374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65111afb-564f-4064-b814-a252bb21135e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a3afa52-697e-4830-819f-a54bc1d249af tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Request method failure captured: Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksqrU0qn1OPhRP5-XygLBjPer6d2CRIHG4zHIbgTSh_-TH-3V81mwo0B7ztki02-xJ38B2azw7VVe9sUp4cRNcsRK03x-uanueq077aE-ZLWh16U27GUO2Jl-kXqOtf7q7Ip3zhEPkNfr4wumVccu1mXya0s9AeTk_nG9D7W18siq0 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:01:59.104979 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_144bae0b8f7a4d6ba5d1b6e4b41742a5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 273d597843e74bf9a174ff58f2d27647 Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: exception: Aggregate 6 could not be found. Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '6'} Jun 18 22:01:59.106219 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.106938 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jun 18 22:01:59.107957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.111173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a3afa52-697e-4830-819f-a54bc1d249af tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:59.112414 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a3afa52-697e-4830-819f-a54bc1d249af tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.030266 Jun 18 22:01:59.113407 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 139/258] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:01:59.123259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44b2dad2-6d13-4867-a8a5-2d858529fd4c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.124388 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.124388 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.156975 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-44b2dad2-6d13-4867-a8a5-2d858529fd4c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44b2dad2-6d13-4867-a8a5-2d858529fd4c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Request method failure captured: Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksqrU0qn1OPhRP5-XygLBjPer6d2CRIHG4zHIbgTSh_-TH-3V81mwo0B7ztki02-xJ38B2azw7VVe9sUp4cRNcsRK03x-uanueq077aE-ZLWh16U27GUO2Jl-kXqOtf7q7Ip3zhEPkNfr4wumVccu1mXya0s9AeTk_nG9D7W18siq0 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:01:59.159349 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_144bae0b8f7a4d6ba5d1b6e4b41742a5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 273d597843e74bf9a174ff58f2d27647 Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: exception: Aggregate 6 could not be found. Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '6'} Jun 18 22:01:59.160862 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:01:59.162092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.163518 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.164874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.164874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:59.164874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:59.164874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jun 18 22:01:59.164874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.167267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44b2dad2-6d13-4867-a8a5-2d858529fd4c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:59.168116 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65111afb-564f-4064-b814-a252bb21135e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.076625 Jun 18 22:01:59.169370 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44b2dad2-6d13-4867-a8a5-2d858529fd4c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.050843 Jun 18 22:01:59.170195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 140/259] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:59 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:01:59.181232 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 120/260] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.183377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da1969e0-8c76-46c0-be48-2df9af66d9ff tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea14da7c10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.184886 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.184886 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.186103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a2a8424-172f-43d6-acbd-20b3f4abbf53 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-277733228", "name": "tempest-test_aggregate-761151579"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:59.187247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da1969e0-8c76-46c0-be48-2df9af66d9ff tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.187970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da1969e0-8c76-46c0-be48-2df9af66d9ff tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.189571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da1969e0-8c76-46c0-be48-2df9af66d9ff tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.190371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da1969e0-8c76-46c0-be48-2df9af66d9ff tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.209613 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.209613 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:59.211144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-9a2a8424-172f-43d6-acbd-20b3f4abbf53 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid 5b9050ef-b00f-46e5-af7f-da0775c6b47f for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:59.240776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da1969e0-8c76-46c0-be48-2df9af66d9ff tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.061193 Jun 18 22:01:59.242267 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 141/261] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.258914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a927f645-27a6-4fe1-ae5c-e1db42e9ac9e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea14ee81f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.259988 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.259988 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.271775 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a2a8424-172f-43d6-acbd-20b3f4abbf53 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.089375 Jun 18 22:01:59.281185 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 121/262] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Jun 18 22:01:59 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.284230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a927f645-27a6-4fe1-ae5c-e1db42e9ac9e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.289568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a927f645-27a6-4fe1-ae5c-e1db42e9ac9e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.292125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d6b7728-eaad-4a0c-be87-3e4b218247b4 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.293011 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.293011 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:59.310647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a927f645-27a6-4fe1-ae5c-e1db42e9ac9e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.311104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a927f645-27a6-4fe1-ae5c-e1db42e9ac9e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.337829 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d6b7728-eaad-4a0c-be87-3e4b218247b4 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.055354 Jun 18 22:01:59.342335 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 122/263] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:01:59.359835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c5771ad-ea51-4749-8ee3-809208211bce tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.360738 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.360738 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:59.361307 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a927f645-27a6-4fe1-ae5c-e1db42e9ac9e tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.106416 Jun 18 22:01:59.364265 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 142/264] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.375308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb79e49f-3e72-4ddb-8fdc-9f07ecdc9b62 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Calling method '.version_select at 0x7fea14d9d3a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.377108 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-9c5771ad-ea51-4749-8ee3-809208211bce tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jun 18 22:01:59.378606 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.378606 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c5771ad-ea51-4749-8ee3-809208211bce tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Request method failure captured: Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksqrU0qn1OPhRP5-XygLBjPer6d2CRIHG4zHIbgTSh_-TH-3V81mwo0B7ztki02-xJ38B2azw7VVe9sUp4cRNcsRK03x-uanueq077aE-ZLWh16U27GUO2Jl-kXqOtf7q7Ip3zhEPkNfr4wumVccu1mXya0s9AeTk_nG9D7W18siq0 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:59.385083 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_144bae0b8f7a4d6ba5d1b6e4b41742a5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 273d597843e74bf9a174ff58f2d27647 Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: exception: Aggregate 7 could not be found. Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7'} Jun 18 22:01:59.386550 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.387561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jun 18 22:01:59.388800 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.390365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c5771ad-ea51-4749-8ee3-809208211bce tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:59.392355 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9c5771ad-ea51-4749-8ee3-809208211bce tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.049013 Jun 18 22:01:59.393337 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 123/265] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:01:59.401020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb79e49f-3e72-4ddb-8fdc-9f07ecdc9b62 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.401490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb79e49f-3e72-4ddb-8fdc-9f07ecdc9b62 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.401841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95967069-153f-47a7-a2f6-a404ddc79a15 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.402783 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.402783 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:01:59.432590 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-95967069-153f-47a7-a2f6-a404ddc79a15 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jun 18 22:01:59.433718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb79e49f-3e72-4ddb-8fdc-9f07ecdc9b62 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.434169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb79e49f-3e72-4ddb-8fdc-9f07ecdc9b62 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95967069-153f-47a7-a2f6-a404ddc79a15 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Request method failure captured: Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksqrU0qn1OPhRP5-XygLBjPer6d2CRIHG4zHIbgTSh_-TH-3V81mwo0B7ztki02-xJ38B2azw7VVe9sUp4cRNcsRK03x-uanueq077aE-ZLWh16U27GUO2Jl-kXqOtf7q7Ip3zhEPkNfr4wumVccu1mXya0s9AeTk_nG9D7W18siq0 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:01:59.435052 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/144bae0b8f7a4d6ba5d1b6e4b41742a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_144bae0b8f7a4d6ba5d1b6e4b41742a5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 144bae0b8f7a4d6ba5d1b6e4b41742a5 Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1275172767 Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 273d597843e74bf9a174ff58f2d27647 Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminTestJSON-1275172767-project-admin Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: exception: Aggregate 7 could not be found. Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7'} Jun 18 22:01:59.436472 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:01:59.437364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:01:59.438891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:01:59.440518 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:01:59.440518 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:01:59.440518 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:01:59.440518 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jun 18 22:01:59.440518 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:01:59.440922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95967069-153f-47a7-a2f6-a404ddc79a15 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:01:59.442455 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95967069-153f-47a7-a2f6-a404ddc79a15 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.045097 Jun 18 22:01:59.443595 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 124/266] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:01:59 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:01:59.448717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.450137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:59.458964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.460150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.461103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.462448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.476189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb79e49f-3e72-4ddb-8fdc-9f07ecdc9b62 tempest-HostsAdminTestJSON-139463069 tempest-HostsAdminTestJSON-139463069-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.107971 Jun 18 22:01:59.477363 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 143/267] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:59.491006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9c6f4135-3fda-4666-8d7d-2d13f4d07ef5 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-335397638"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:59.494036 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.494036 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.494989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-9c6f4135-3fda-4666-8d7d-2d13f4d07ef5 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid 89257218-fe0e-4fdd-be70-0b2ffffc63e6 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:01:59.559475 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9c6f4135-3fda-4666-8d7d-2d13f4d07ef5 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.078808 Jun 18 22:01:59.562562 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 144/268] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:01:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.575326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16ba0ee2-e77a-4d6d-a5b7-8aa4f6631742 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.577156 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.577156 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.590625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16ba0ee2-e77a-4d6d-a5b7-8aa4f6631742 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.022756 Jun 18 22:01:59.591861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 145/269] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:59.609300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-375885f3-5b7e-47f3-881e-16be1805765c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:01:59.611223 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.611223 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.660944 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-375885f3-5b7e-47f3-881e-16be1805765c tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.059901 Jun 18 22:01:59.661918 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 146/270] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Jun 18 22:01:59 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:01:59.672058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52e96be9-9a7c-4b84-bb38-eaa6238b12da tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.673138 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:01:59.673138 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:01:59.683562 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52e96be9-9a7c-4b84-bb38-eaa6238b12da tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.015261 Jun 18 22:01:59.684151 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 147/271] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:01:59.694244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:01:59.695910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:01:59.703140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.703639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.704459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:01:59.705379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:01:59.989979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:00.000603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-36a928db-a357-4501-a78b-acda51de927d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.315229 Jun 18 22:02:00.000792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:00.002534 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 148/272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:00.008499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d5fe50d-8485-4df1-9b95-fbabfc49beb8 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.009524 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.009524 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:00.012467 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2e588d4-1c14-4eee-91f1-d666e28bcc7e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.567403 Jun 18 22:02:00.013618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 125/273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:01:59 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:00.058972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d5fe50d-8485-4df1-9b95-fbabfc49beb8 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.054497 Jun 18 22:02:00.060058 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 149/274] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:02:00 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:00.071498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73424495-63ba-4d0b-9d78-e4cdea91ec02 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1482535589", "availability_zone": "tempest-test_az-2034749889"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:00.073161 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.073161 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:00.074701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-73424495-63ba-4d0b-9d78-e4cdea91ec02 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid ea933941-07ad-497e-9aee-0c06f5ed4172 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:00.114911 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73424495-63ba-4d0b-9d78-e4cdea91ec02 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.048068 Jun 18 22:02:00.116254 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 126/275] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Jun 18 22:02:00 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:02:00.127814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f9ba967c-71c2-4175-af37-1f0e2302fcfd tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1482535589_new", "availability_zone": "tempest-test_az-2034749889_new"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:00.129819 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.129819 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:00.171750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9ba967c-71c2-4175-af37-1f0e2302fcfd tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.172410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9ba967c-71c2-4175-af37-1f0e2302fcfd tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.219172 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f9ba967c-71c2-4175-af37-1f0e2302fcfd tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.096107 Jun 18 22:02:00.221071 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 150/276] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:02:00 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:00.231343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f72cf7e4-9e8b-4417-b9fe-ec1ca731d73e tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.232317 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.232317 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:00.246293 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f72cf7e4-9e8b-4417-b9fe-ec1ca731d73e tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.018432 Jun 18 22:02:00.256911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9fcfc897-3c46-4a50-868e-1cc0b838a129 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.257703 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.257703 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:00.261359 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 127/277] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:02:00 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:00.287539 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9fcfc897-3c46-4a50-868e-1cc0b838a129 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.034152 Jun 18 22:02:00.293290 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 151/278] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:02:00 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:00.298953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5610a33-9743-48d6-8895-4ceeec446985 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-972234768"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:00.300936 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.300936 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:00.301861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-f5610a33-9743-48d6-8895-4ceeec446985 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Generated uuid d63e616e-32b6-4bab-89d2-2ee4264de48d for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:00.341131 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5610a33-9743-48d6-8895-4ceeec446985 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046973 Jun 18 22:02:00.353169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fba5b4c8-d0cb-4f2b-92d8-315adaa04076 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.353934 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.353934 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:00.354220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 128/279] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:00 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:00.362937 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fba5b4c8-d0cb-4f2b-92d8-315adaa04076 tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.014824 Jun 18 22:02:00.370054 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 152/280] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:02:00 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:00.375355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c921fd72-9155-46c9-8ed7-abd67bdc29db tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.376154 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.376154 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:00.397567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:00.428426 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c921fd72-9155-46c9-8ed7-abd67bdc29db tempest-AggregatesAdminTestJSON-1275172767 tempest-AggregatesAdminTestJSON-1275172767-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.056185 Jun 18 22:02:00.431300 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 129/281] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:00 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:00.441125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.441751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:00.452876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.455876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.458263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.459480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.491867 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] HTTP exception thrown: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Request method failure captured: Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 HTTP/1.1 Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksn_y7G8u06AA8lemhmW9btBdlJwBLULA1Wgnb5WtIlQ24ShqLhPebQxVj_EoZizwcQFTDwSF-GrGy8js8R5gtUHM5dJ8p1vYNCtXdZy2NGTfcWAuPzGukp4BDN4lSFHy8WoMXasErS5cRhDIyJc7w3TdGSxlovJykKe981LCft__I Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 454d2ab18dd84eaf8bbd1e2808159df7 Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:00.495893 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_454d2ab18dd84eaf8bbd1e2808159df7", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 454d2ab18dd84eaf8bbd1e2808159df7 Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminTestJSON-262479970-project Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 75df001919794fd7a2e79cdfbd87cfd6 Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminTestJSON-262479970-project Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.497334 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3dbae906-f67e-410e-ab66-e23bdc980bf0'} Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:00.498142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.499507 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.502452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Returning 404 to user: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:00.504396 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4110d1a-d2c4-4865-a118-a7e1f4021cba tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 404 len: 111 microversion: 2.1 time: 0.067581 Jun 18 22:02:00.505233 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 153/282] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:02:00 2022] DELETE /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:00.517783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.518594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] [instance: 3dbae906-f67e-410e-ab66-e23bdc980bf0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:00.526211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.527103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.528217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.528804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.547561 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] HTTP exception thrown: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Request method failure captured: Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 HTTP/1.1 Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksn_y7G8u06AA8lemhmW9btBdlJwBLULA1Wgnb5WtIlQ24ShqLhPebQxVj_EoZizwcQFTDwSF-GrGy8js8R5gtUHM5dJ8p1vYNCtXdZy2NGTfcWAuPzGukp4BDN4lSFHy8WoMXasErS5cRhDIyJc7w3TdGSxlovJykKe981LCft__I Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 454d2ab18dd84eaf8bbd1e2808159df7 Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:00.551135 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/454d2ab18dd84eaf8bbd1e2808159df7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_454d2ab18dd84eaf8bbd1e2808159df7", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 454d2ab18dd84eaf8bbd1e2808159df7 Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-262479970 Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminTestJSON-262479970-project Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 75df001919794fd7a2e79cdfbd87cfd6 Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminTestJSON-262479970-project Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.552558 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3dbae906-f67e-410e-ab66-e23bdc980bf0'} Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:00.553388 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. Jun 18 22:02:00.554700 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:00.557686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] Returning 404 to user: Instance 3dbae906-f67e-410e-ab66-e23bdc980bf0 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:00.560793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4dcabbfb-d986-4b0a-947a-ea0e8aca195c tempest-AggregatesAdminTestJSON-262479970 tempest-AggregatesAdminTestJSON-262479970-project] 10.222.0.30 "GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0" status: 404 len: 111 microversion: 2.1 time: 0.051501 Jun 18 22:02:00.562074 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 130/283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:00 2022] GET /compute/v2.1/servers/3dbae906-f67e-410e-ab66-e23bdc980bf0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:00.745420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9a68e87f-0b8d-44b4-95b4-17df780e26f2 req-bfefb356-ca3d-42dd-abc3-6e431d3b46e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf95372-e587-4ff1-b0ad-168c53b2732a", "tag": "da0dbb4c-1902-431d-bf2a-102b1b5e2ad3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:00.756748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9a68e87f-0b8d-44b4-95b4-17df780e26f2 req-bfefb356-ca3d-42dd-abc3-6e431d3b46e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.757926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9a68e87f-0b8d-44b4-95b4-17df780e26f2 req-bfefb356-ca3d-42dd-abc3-6e431d3b46e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.776464 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9a68e87f-0b8d-44b4-95b4-17df780e26f2 req-bfefb356-ca3d-42dd-abc3-6e431d3b46e9 service nova] Creating event network-changed:da0dbb4c-1902-431d-bf2a-102b1b5e2ad3 for instance adf95372-e587-4ff1-b0ad-168c53b2732a on nch1-master-1 Jun 18 22:02:00.783231 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9a68e87f-0b8d-44b4-95b4-17df780e26f2 req-bfefb356-ca3d-42dd-abc3-6e431d3b46e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042244 Jun 18 22:02:00.784313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 131/284] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:00.995106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93087545-466c-4210-bb69-17cf8f07cf85 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Calling method '.version_select at 0x7fea151e9ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:00.996335 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:00.996335 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:00.997505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93087545-466c-4210-bb69-17cf8f07cf85 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.998158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93087545-466c-4210-bb69-17cf8f07cf85 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:00.999329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93087545-466c-4210-bb69-17cf8f07cf85 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:00.999964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93087545-466c-4210-bb69-17cf8f07cf85 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:01.020065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:01.021132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:01.030056 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93087545-466c-4210-bb69-17cf8f07cf85 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.384715 Jun 18 22:02:01.031258 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 154/285] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:02:00 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:01.032895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:01.035882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:01.036774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:01.038426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:01.040709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:01.041540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:01.051244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:01.052179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:01.053353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:01.054081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:01.410581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:01.420892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba993e37-c8bb-4f26-a696-33fb06566790 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.388418 Jun 18 22:02:01.421510 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 155/286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:01 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:01.437537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:01.446547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75197b47-dd65-4801-9436-5b2ad81333a4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.431210 Jun 18 22:02:01.452701 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 132/287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:01 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:02.004780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-defaa8cd-7034-4712-b7e8-b1af3e7fa36b tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Calling method '.version_select at 0x7fea14cbc310>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.007172 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.007172 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:02.008921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-defaa8cd-7034-4712-b7e8-b1af3e7fa36b tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '1d04016fb35f4b49a3fdd38c84bd9f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e294453c68674ed8baea6d79c6a87e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-defaa8cd-7034-4712-b7e8-b1af3e7fa36b tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Request method failure captured: Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktWLBUbEAqpvRBq9yPqhqECjhLnYeZAgPUOBPL7X_J1Q59Qzi586oEBe-evMJjd2nnzBPsPwwsOs0MbPrhl8YU7YlyAlQGNQ58vtNUiioSv67ZZ9bPq9aUv_wDMg83D4_Ghb5hKlRUpS8tVY8u_14DaqYgc4WJzyvHxoXk5APGvdpA Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:02.013883 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e294453c68674ed8baea6d79c6a87e78", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1d04016fb35f4b49a3fdd38c84bd9f77 Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:02:02.015300 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.016292 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 18 22:02:02.017597 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.020685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-defaa8cd-7034-4712-b7e8-b1af3e7fa36b tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.030798 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-defaa8cd-7034-4712-b7e8-b1af3e7fa36b tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.597806 Jun 18 22:02:02.038445 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 156/288] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:02:01 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 616 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:02.048925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-115eba51-466f-47d6-b56e-7a377088baf5 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Calling method '.version_select at 0x7fea14c8d8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.049983 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.049983 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:02.051372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-115eba51-466f-47d6-b56e-7a377088baf5 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '1d04016fb35f4b49a3fdd38c84bd9f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e294453c68674ed8baea6d79c6a87e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-115eba51-466f-47d6-b56e-7a377088baf5 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Request method failure captured: Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktWLBUbEAqpvRBq9yPqhqECjhLnYeZAgPUOBPL7X_J1Q59Qzi586oEBe-evMJjd2nnzBPsPwwsOs0MbPrhl8YU7YlyAlQGNQ58vtNUiioSv67ZZ9bPq9aUv_wDMg83D4_Ghb5hKlRUpS8tVY8u_14DaqYgc4WJzyvHxoXk5APGvdpA Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:02.053919 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e294453c68674ed8baea6d79c6a87e78", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1d04016fb35f4b49a3fdd38c84bd9f77 Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ncdv-master-1'} Jun 18 22:02:02.055356 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.056222 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 18 22:02:02.057480 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.060857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-115eba51-466f-47d6-b56e-7a377088baf5 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.063436 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-115eba51-466f-47d6-b56e-7a377088baf5 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019166 Jun 18 22:02:02.070253 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 133/289] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:02.074304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06a3c892-bb23-4291-b597-f453f54d0dd8 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Calling method '.version_select at 0x7fea14da73a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.075094 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.075094 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:02.084570 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-06a3c892-bb23-4291-b597-f453f54d0dd8 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06a3c892-bb23-4291-b597-f453f54d0dd8 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:02.087604 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'nonexistent_hostname'} Jun 18 22:02:02.089187 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:02.090429 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 18 22:02:02.091730 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.093326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.095920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06a3c892-bb23-4291-b597-f453f54d0dd8 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.096342 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06a3c892-bb23-4291-b597-f453f54d0dd8 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.025407 Jun 18 22:02:02.097353 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 157/290] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:02.107836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1fcfd6e-cbbc-47d4-804c-37c680d493c7 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Calling method '.version_select at 0x7fea14ca54c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.109349 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.109349 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:02.110789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1fcfd6e-cbbc-47d4-804c-37c680d493c7 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '1d04016fb35f4b49a3fdd38c84bd9f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e294453c68674ed8baea6d79c6a87e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1fcfd6e-cbbc-47d4-804c-37c680d493c7 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Request method failure captured: Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktWLBUbEAqpvRBq9yPqhqECjhLnYeZAgPUOBPL7X_J1Q59Qzi586oEBe-evMJjd2nnzBPsPwwsOs0MbPrhl8YU7YlyAlQGNQ58vtNUiioSv67ZZ9bPq9aUv_wDMg83D4_Ghb5hKlRUpS8tVY8u_14DaqYgc4WJzyvHxoXk5APGvdpA Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:02.113406 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e294453c68674ed8baea6d79c6a87e78", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1d04016fb35f4b49a3fdd38c84bd9f77 Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ncdv-master-1'} Jun 18 22:02:02.114593 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.115337 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 18 22:02:02.116365 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.119851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1fcfd6e-cbbc-47d4-804c-37c680d493c7 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.120698 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1fcfd6e-cbbc-47d4-804c-37c680d493c7 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.017536 Jun 18 22:02:02.132534 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 134/291] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:02.133828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-99494fee-aaa4-4541-babf-d0fd13e7f688 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Calling method '.version_select at 0x7fea14cbce50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.135218 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.135218 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:02.145269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-99494fee-aaa4-4541-babf-d0fd13e7f688 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-99494fee-aaa4-4541-babf-d0fd13e7f688 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:02.147326 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'nonexistent_hostname'} Jun 18 22:02:02.148835 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.149765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.151204 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.152529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-99494fee-aaa4-4541-babf-d0fd13e7f688 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.152529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-99494fee-aaa4-4541-babf-d0fd13e7f688 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020140 Jun 18 22:02:02.152529 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 158/292] 10.222.0.30 () {58 vars in 1190 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:02.160818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64a07902-942f-410a-b38c-61963f613991 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Calling method '.version_select at 0x7fea14cc40d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.161809 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.161809 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:02.164150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64a07902-942f-410a-b38c-61963f613991 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '1d04016fb35f4b49a3fdd38c84bd9f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e294453c68674ed8baea6d79c6a87e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64a07902-942f-410a-b38c-61963f613991 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Request method failure captured: Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktWLBUbEAqpvRBq9yPqhqECjhLnYeZAgPUOBPL7X_J1Q59Qzi586oEBe-evMJjd2nnzBPsPwwsOs0MbPrhl8YU7YlyAlQGNQ58vtNUiioSv67ZZ9bPq9aUv_wDMg83D4_Ghb5hKlRUpS8tVY8u_14DaqYgc4WJzyvHxoXk5APGvdpA Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:02.166943 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e294453c68674ed8baea6d79c6a87e78", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1d04016fb35f4b49a3fdd38c84bd9f77 Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ncdv-master-1'} Jun 18 22:02:02.168398 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.169249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 18 22:02:02.170475 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.173614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64a07902-942f-410a-b38c-61963f613991 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.174947 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64a07902-942f-410a-b38c-61963f613991 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.018861 Jun 18 22:02:02.175976 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 135/293] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:02.187219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f005245-1a06-4da6-96ed-a0eec8e69de7 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Calling method '.version_select at 0x7fea14cbc940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.188303 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.188303 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:02.202860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1f005245-1a06-4da6-96ed-a0eec8e69de7 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f005245-1a06-4da6-96ed-a0eec8e69de7 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:02.209457 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'nonexistent_hostname'} Jun 18 22:02:02.210877 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:02.211594 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 18 22:02:02.212617 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f005245-1a06-4da6-96ed-a0eec8e69de7 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f005245-1a06-4da6-96ed-a0eec8e69de7 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.030559 Jun 18 22:02:02.215096 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 159/294] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:02.224945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f51d6c6-6c40-49db-bcce-c71e4dfcff13 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Calling method '.version_select at 0x7fea14cc45e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.225802 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.225802 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:02.227350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f51d6c6-6c40-49db-bcce-c71e4dfcff13 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '1d04016fb35f4b49a3fdd38c84bd9f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e294453c68674ed8baea6d79c6a87e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f51d6c6-6c40-49db-bcce-c71e4dfcff13 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Request method failure captured: Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktWLBUbEAqpvRBq9yPqhqECjhLnYeZAgPUOBPL7X_J1Q59Qzi586oEBe-evMJjd2nnzBPsPwwsOs0MbPrhl8YU7YlyAlQGNQ58vtNUiioSv67ZZ9bPq9aUv_wDMg83D4_Ghb5hKlRUpS8tVY8u_14DaqYgc4WJzyvHxoXk5APGvdpA Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:02.229205 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e294453c68674ed8baea6d79c6a87e78", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1d04016fb35f4b49a3fdd38c84bd9f77 Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ncdv-master-1'} Jun 18 22:02:02.230366 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.231045 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 18 22:02:02.232103 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.234445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f51d6c6-6c40-49db-bcce-c71e4dfcff13 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.235297 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f51d6c6-6c40-49db-bcce-c71e4dfcff13 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.014949 Jun 18 22:02:02.240020 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 136/295] 10.222.0.30 () {58 vars in 1193 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:02.246548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-699e0a93-7c24-4c9b-9d01-e7cd1624e437 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Calling method '.version_select at 0x7fea14e85f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.247701 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.247701 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:02.259977 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-699e0a93-7c24-4c9b-9d01-e7cd1624e437 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-699e0a93-7c24-4c9b-9d01-e7cd1624e437 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:02.262346 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'nonexistent_hostname'} Jun 18 22:02:02.263517 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:02.264205 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 18 22:02:02.265310 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.266380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-699e0a93-7c24-4c9b-9d01-e7cd1624e437 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.267149 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-699e0a93-7c24-4c9b-9d01-e7cd1624e437 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.024921 Jun 18 22:02:02.274974 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 160/296] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:02.283398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4618e293-cc34-462a-aa45-473f45d0ca16 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Action: 'update', calling method: .version_select at 0x7fea14d14af0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4618e293-cc34-462a-aa45-473f45d0ca16 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 51 Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:02.286379 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: {"status": "enable", "maintenance_mode": "invalid"} Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.287545 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'disable', Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'Enable', Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'Disable', Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance: Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'invalid' Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.288249 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.291994 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4618e293-cc34-462a-aa45-473f45d0ca16 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4618e293-cc34-462a-aa45-473f45d0ca16 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.011234 Jun 18 22:02:02.293020 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 137/297] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Jun 18 22:02:02 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:02:02.300515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4437f4ac-e189-4258-b561-3a20ce33fc42 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Action: 'update', calling method: .version_select at 0x7fea14ee8430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4437f4ac-e189-4258-b561-3a20ce33fc42 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 51 Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:02.307086 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: {"status": "invalid", "maintenance_mode": "enable"} Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.308695 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'disable', Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'Enable', Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'Disable', Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance: Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'invalid' Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.309631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.311343 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4437f4ac-e189-4258-b561-3a20ce33fc42 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4437f4ac-e189-4258-b561-3a20ce33fc42 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.014149 Jun 18 22:02:02.312998 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 161/298] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Jun 18 22:02:02 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:02:02.328290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e50e83ef-cb94-4d01-9ee6-a61255f4b960 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Action: 'update', calling method: .version_select at 0x7fea14d14820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:02.331378 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:02.331378 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:02.332564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e50e83ef-cb94-4d01-9ee6-a61255f4b960 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '1d04016fb35f4b49a3fdd38c84bd9f77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e294453c68674ed8baea6d79c6a87e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e50e83ef-cb94-4d01-9ee6-a61255f4b960 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Request method failure captured: Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 50 Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktWLBUbEAqpvRBq9yPqhqECjhLnYeZAgPUOBPL7X_J1Q59Qzi586oEBe-evMJjd2nnzBPsPwwsOs0MbPrhl8YU7YlyAlQGNQ58vtNUiioSv67ZZ9bPq9aUv_wDMg83D4_Ghb5hKlRUpS8tVY8u_14DaqYgc4WJzyvHxoXk5APGvdpA Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:02.344580 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e294453c68674ed8baea6d79c6a87e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e294453c68674ed8baea6d79c6a87e78", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e294453c68674ed8baea6d79c6a87e78 Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1870231137 Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1d04016fb35f4b49a3fdd38c84bd9f77 Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1870231137-project Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: {"status": "enable", "maintenance_mode": "enable"} Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 18 22:02:02.348018 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.348873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 18 22:02:02.350167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.357097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e50e83ef-cb94-4d01-9ee6-a61255f4b960 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.360263 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e50e83ef-cb94-4d01-9ee6-a61255f4b960 tempest-HostsAdminNegativeTestJSON-1870231137 tempest-HostsAdminNegativeTestJSON-1870231137-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.039577 Jun 18 22:02:02.363086 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 138/299] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Jun 18 22:02:02 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:02.377706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9faebf48-c5ec-40e6-963a-db014f21c407 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Action: 'update', calling method: .version_select at 0x7fea14e340d0>, body: {"status": null, "maintenance_mode": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9faebf48-c5ec-40e6-963a-db014f21c407 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 42 Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:02.387656 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: {"status": null, "maintenance_mode": null} Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 18 22:02:02.391220 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'disable', Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'Enable', Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'Disable', Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance: Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi None Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.392547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.394688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.395712 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:02:02.395712 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:02:02.395712 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 18 22:02:02.395712 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.398342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9faebf48-c5ec-40e6-963a-db014f21c407 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.400770 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9faebf48-c5ec-40e6-963a-db014f21c407 tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.031376 Jun 18 22:02:02.401745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 162/300] 10.222.0.30 () {60 vars in 1189 bytes} [Sat Jun 18 22:02:02 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:02:02.415023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-925329af-69d4-4a97-a4e6-a2d1067f0a3c tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Action: 'update', calling method: .version_select at 0x7fea14cc4ee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:02.419491 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.hosts [None req-925329af-69d4-4a97-a4e6-a2d1067f0a3c tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Enabling host nonexistent_hostname. Jun 18 22:02:02.440860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.441839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:02.445514 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-925329af-69d4-4a97-a4e6-a2d1067f0a3c tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-925329af-69d4-4a97-a4e6-a2d1067f0a3c tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Request method failure captured: Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 50 Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktYq6M0fxf85VQy-hvsSD2df6usTYklGoCHrdqjacP--oPZgL3bPsv2YM4nb3YReUXNjSjKUhRh8CvWnG4wUfRBMKdZk5qp9xSYAF3Q5NbSGS3jKBns_pD-1Su00XlRLTmoW0OM0Bg925fTUV2pQ7JgwN19teZ3TYZuROo4UzTI7JY Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:02.451361 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/60f4811f948c4076b467dc4690b0c9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_60f4811f948c4076b467dc4690b0c9d4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 60f4811f948c4076b467dc4690b0c9d4 Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2072296094 Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5fa624dbbeb4cf1b887b57be41a0a6d Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2072296094-project-admin Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: {"status": "enable", "maintenance_mode": "enable"} Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.452818 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:02.454198 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:02.455546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 18 22:02:02.456747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:02.462159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-925329af-69d4-4a97-a4e6-a2d1067f0a3c tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:02.465536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-925329af-69d4-4a97-a4e6-a2d1067f0a3c tempest-HostsAdminNegativeTestJSON-2072296094 tempest-HostsAdminNegativeTestJSON-2072296094-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.056794 Jun 18 22:02:02.467235 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 139/301] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 22:02:02 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:02.475075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:02.475814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:02.478668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:02.484921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:02.492865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:02.494237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:02.519178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:02.521195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:02.522918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:02.525719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:02.754438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=11 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:02.977000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:02.994648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e221147a-f4d9-4566-9fa8-ac897e1bfe1b tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.559847 Jun 18 22:02:02.996036 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 163/302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:03.009630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:03.020500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a0411538-cd47-4ab6-a9ba-d9239b86c544 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.549548 Jun 18 22:02:03.021362 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 140/303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:02 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:04.012028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:04.012563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:04.013642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:04.028953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.029445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.037077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.037611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.290987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:04.307743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8dd4997d-e68e-4be9-856b-0dc5e7fcb738 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.297383 Jun 18 22:02:04.323102 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 141/304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:04 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:04.335362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:04.335985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:04.356671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.358153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.360080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.363479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.469377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Calling method '.version_select at 0x7fea14cbc4c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:04.470207 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:04.470207 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:04.471536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.472085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.535040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.536163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.568337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:04.568839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:04.590805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9645ab13-0d8b-42db-90ce-79b78b4ea7d5 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.582171 Jun 18 22:02:04.597375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 164/305] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:04.834448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:04.837581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:04.847236 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d92d24c0-8a56-4994-a2c6-e55368644a5a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.522666 Jun 18 22:02:04.856778 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 142/306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:04 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:05.107289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4931b777-86af-4089-b80d-309129ad99de tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Calling method '.version_select at 0x7fea14cbce50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.108094 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:05.108094 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:05.109743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4931b777-86af-4089-b80d-309129ad99de tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '0f622a1911d44c699caf61401cce34b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7607bd86bd254abf96cba580431bd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4931b777-86af-4089-b80d-309129ad99de tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Request method failure captured: Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktYFyG9nkJeuE3yZW_Rwwqb95AbQk1-GJJf0eyCL4wL4L-9elK0O4cH9UUBfi52x_zjkq6LtAu-n9PvIC46z6ZANkUKV_05pQjcQWKgxrsJbnRsByOjwj_FvEQPmhutricMCyraSQ2RNGro-rL7g-lA8uk8E2im2KbOMAzZBryeTpw Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7607bd86bd254abf96cba580431bd744 Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1702786546 Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:05.115015 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7607bd86bd254abf96cba580431bd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7607bd86bd254abf96cba580431bd744"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7607bd86bd254abf96cba580431bd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7607bd86bd254abf96cba580431bd744", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1702786546 Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7607bd86bd254abf96cba580431bd744 Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1702786546 Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 0f622a1911d44c699caf61401cce34b2 Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 18 22:02:05.116351 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'nch2-master-1'} Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:05.117138 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 18 22:02:05.118272 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.119280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4931b777-86af-4089-b80d-309129ad99de tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:05.119280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4931b777-86af-4089-b80d-309129ad99de tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.520119 Jun 18 22:02:05.128804 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 165/307] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:02:04 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 529 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:05.135302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Calling method '.version_select at 0x7fea14c8d670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.136111 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:05.136111 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:05.137277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.137731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.180728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Request method failure captured: Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktb9544mBBs9_wyQMN8FxGZYHxF5znJWnHy4cx3Tz1AyOeUWuKPmb0wPfKVedpFPu1w794xmw9PfKRUGUWRGXuUaeAC-V7m7FRUzZHT0jF1NIljMJk_qinuQ3RSI0BcSyJ-iQKK_riCF94zBXYusJ1QRnV9VwrvJ19B3xjqYHa6R6Y Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 697cf498c2734046b0108e023378f6d5 Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1496190723 Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:05.182863 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/697cf498c2734046b0108e023378f6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/697cf498c2734046b0108e023378f6d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/697cf498c2734046b0108e023378f6d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_697cf498c2734046b0108e023378f6d5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1496190723 Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 697cf498c2734046b0108e023378f6d5 Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1496190723 Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: a456055974af48a794d0ffddd9837e83 Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 18 22:02:05.184433 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.185528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.186866 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.186866 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:05.186866 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:05.186866 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 18 22:02:05.186866 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.191991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:05.193253 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93841542-fd9e-4191-ab20-e790ca26077e tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.062202 Jun 18 22:02:05.198932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 143/308] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:02:05 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:05.204581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Calling method '.version_select at 0x7fea14cd4940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.205453 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:05.205453 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:05.207344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.207827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.247552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.248043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.267699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.268520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.282011 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-01c9ae9a-e802-417e-9d60-af58f1d14483 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.080140 Jun 18 22:02:05.295581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c493d2b-7801-4a0c-b85a-c0713003f426 tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Calling method '.version_select at 0x7fea14c8d0d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.296884 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:05.296884 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:05.298880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8c493d2b-7801-4a0c-b85a-c0713003f426 tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '0f622a1911d44c699caf61401cce34b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7607bd86bd254abf96cba580431bd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c493d2b-7801-4a0c-b85a-c0713003f426 tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Request method failure captured: Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktYFyG9nkJeuE3yZW_Rwwqb95AbQk1-GJJf0eyCL4wL4L-9elK0O4cH9UUBfi52x_zjkq6LtAu-n9PvIC46z6ZANkUKV_05pQjcQWKgxrsJbnRsByOjwj_FvEQPmhutricMCyraSQ2RNGro-rL7g-lA8uk8E2im2KbOMAzZBryeTpw Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7607bd86bd254abf96cba580431bd744 Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1702786546 Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:05.301480 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7607bd86bd254abf96cba580431bd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7607bd86bd254abf96cba580431bd744"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7607bd86bd254abf96cba580431bd744"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7607bd86bd254abf96cba580431bd744", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1702786546 Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7607bd86bd254abf96cba580431bd744 Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1702786546 Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 0f622a1911d44c699caf61401cce34b2 Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 18 22:02:05.303103 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1'} Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:05.303891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 18 22:02:05.305579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.308637 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 166/309] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:05.309130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c493d2b-7801-4a0c-b85a-c0713003f426 tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:05.310142 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8c493d2b-7801-4a0c-b85a-c0713003f426 tempest-HypervisorAdminNegativeUnderV252Test-1702786546 tempest-HypervisorAdminNegativeUnderV252Test-1702786546-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019052 Jun 18 22:02:05.313372 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 144/310] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:02:05 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:05.332368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Calling method '.version_select at 0x7fea14cd4f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.339165 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:05.339165 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:05.340702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.341825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.342669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:05.344816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.367483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.374768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.376114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.377512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.381456 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] HTTP exception thrown: No hypervisor matching '82b80d2c-08aa-48d3-ad55-f13af8463c4b' could be found. Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Request method failure captured: Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-hypervisors/82b80d2c-08aa-48d3-ad55-f13af8463c4b/servers HTTP/1.1 Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktb9544mBBs9_wyQMN8FxGZYHxF5znJWnHy4cx3Tz1AyOeUWuKPmb0wPfKVedpFPu1w794xmw9PfKRUGUWRGXuUaeAC-V7m7FRUzZHT0jF1NIljMJk_qinuQ3RSI0BcSyJ-iQKK_riCF94zBXYusJ1QRnV9VwrvJ19B3xjqYHa6R6Y Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 697cf498c2734046b0108e023378f6d5 Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1496190723 Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:05.388835 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/697cf498c2734046b0108e023378f6d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/697cf498c2734046b0108e023378f6d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/697cf498c2734046b0108e023378f6d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_697cf498c2734046b0108e023378f6d5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1496190723 Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 697cf498c2734046b0108e023378f6d5 Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1496190723 Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a456055974af48a794d0ffddd9837e83 Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: exception: No hypervisor matching '82b80d2c-08aa-48d3-ad55-f13af8463c4b' could be found. Jun 18 22:02:05.390347 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82b80d2c-08aa-48d3-ad55-f13af8463c4b'} Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '82b80d2c-08aa-48d3-ad55-f13af8463c4b' could be found. Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.391149 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:05.392372 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:05.392372 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:05.392372 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:05.392372 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:05.392372 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '82b80d2c-08aa-48d3-ad55-f13af8463c4b' could be found. Jun 18 22:02:05.392372 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:05.393810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] Returning 404 to user: No hypervisor matching '82b80d2c-08aa-48d3-ad55-f13af8463c4b' could be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:05.395723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-77204296-adef-4311-ac6a-494709cc0152 tempest-HypervisorAdminNegativeUnderV252Test-1496190723 tempest-HypervisorAdminNegativeUnderV252Test-1496190723-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/82b80d2c-08aa-48d3-ad55-f13af8463c4b/servers" status: 404 len: 123 microversion: 2.1 time: 0.076313 Jun 18 22:02:05.398473 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 167/311] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Jun 18 22:02:05 2022] GET /compute/v2.1/os-hypervisors/82b80d2c-08aa-48d3-ad55-f13af8463c4b/servers => generated 123 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:05.685447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:05.701129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b628cc76-25ae-448b-9d38-29203952d31f tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.377557 Jun 18 22:02:05.705979 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 145/312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:05 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:05.865212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:05.866176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:05.881575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.884536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:05.886565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:05.887566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:06.145851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:06.162715 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-822eec51-4437-4ee0-9c96-b4c77943d20d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.299997 Jun 18 22:02:06.174079 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 146/313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:05 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:06.333938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9224b39f-41fe-46a8-a2bd-a8524ef5f8e0 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Action: 'update', calling method: .version_select at 0x7fea14d618b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:06.724229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:06.725092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:06.740087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:06.742658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:06.746534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:06.748433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:07.123670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:07.133856 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d76af3ea-6815-489a-9cf5-8b0758331134 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.416764 Jun 18 22:02:07.135815 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 147/314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:06 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:07.180773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:07.181483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:07.196587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:07.197261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:07.199133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:07.199457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:07.236372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9224b39f-41fe-46a8-a2bd-a8524ef5f8e0 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:07.239630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9224b39f-41fe-46a8-a2bd-a8524ef5f8e0 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:07.243577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9224b39f-41fe-46a8-a2bd-a8524ef5f8e0 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:07.244547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9224b39f-41fe-46a8-a2bd-a8524ef5f8e0 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:07.275749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:07.373742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9224b39f-41fe-46a8-a2bd-a8524ef5f8e0 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393" status: 200 len: 148 microversion: 2.57 time: 1.944599 Jun 18 22:02:07.376451 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 168/315] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Jun 18 22:02:05 2022] PUT /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393 => generated 148 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:02:07.385600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c611d429-41ca-4960-9f81-f789511b1d66 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Calling method '.version_select at 0x7fea15087ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:07.493386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:07.505450 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c62f2aa1-a5bc-4378-beee-fe5e960a4058 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.328487 Jun 18 22:02:07.517166 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 148/316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:07 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:07.942460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0a85a744-6f59-4e4e-ad48-b57e5e27b1d8 req-f9dcf3d7-2b3d-41e2-89d1-17ccfef55cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5615e2b-109a-4c94-b891-9016ad5eb69f", "name": "network-vif-plugged", "status": "completed", "tag": "3d298962-5afd-4ee8-b730-1b6e06470353"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:07.956174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0a85a744-6f59-4e4e-ad48-b57e5e27b1d8 req-f9dcf3d7-2b3d-41e2-89d1-17ccfef55cee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:07.959753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0a85a744-6f59-4e4e-ad48-b57e5e27b1d8 req-f9dcf3d7-2b3d-41e2-89d1-17ccfef55cee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:07.992082 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0a85a744-6f59-4e4e-ad48-b57e5e27b1d8 req-f9dcf3d7-2b3d-41e2-89d1-17ccfef55cee service nova] Creating event network-vif-plugged:3d298962-5afd-4ee8-b730-1b6e06470353 for instance c5615e2b-109a-4c94-b891-9016ad5eb69f on nch2-master-1 Jun 18 22:02:08.015809 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0a85a744-6f59-4e4e-ad48-b57e5e27b1d8 req-f9dcf3d7-2b3d-41e2-89d1-17ccfef55cee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076747 Jun 18 22:02:08.017590 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 149/317] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:08.154595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:08.155720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:08.166272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c611d429-41ca-4960-9f81-f789511b1d66 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:08.166721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c611d429-41ca-4960-9f81-f789511b1d66 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:08.169052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c611d429-41ca-4960-9f81-f789511b1d66 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:08.169491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c611d429-41ca-4960-9f81-f789511b1d66 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:08.174373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:08.174838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:08.178850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:08.178850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:08.215541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c611d429-41ca-4960-9f81-f789511b1d66 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393/detail" status: 200 len: 463 microversion: 2.57 time: 0.834349 Jun 18 22:02:08.216404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 169/318] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Jun 18 22:02:07 2022] GET /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393/detail => generated 463 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:02:08.360084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:08.368718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c52735b3-04ce-4d7a-8ec8-4159f99f6f89 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1319 microversion: 2.1 time: 0.220574 Jun 18 22:02:08.369422 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 150/319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:08 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:08.522880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:08.523824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:08.530801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:08.534614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:08.538371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:08.539097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:08.720351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:08.733982 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2180674c-f629-4caf-8bc9-e950d4d4b153 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.214422 Jun 18 22:02:08.734858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 151/320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:08 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:08.814467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1740095580", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e17875e3-e111-45e6-a0c0-c6b1e856376c"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:08.910391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] validate_networks() for [('e17875e3-e111-45e6-a0c0-c6b1e856376c', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:09.392738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:09.397322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:09.399700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:09.408230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:09.408690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:09.409542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:09.414979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:09.607165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:09.614961 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10cfebf7-a1de-4c53-b4d7-6d219a9e8739 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1467 microversion: 2.1 time: 0.232763 Jun 18 22:02:09.617319 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 152/321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:09 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1467 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:09.635379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:09.636407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:09.643366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:09.644325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:09.645325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:09.645960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:09.805393 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c559246-efcf-4bf9-8fa7-f5dedff63f90 tempest-DeleteServersAdminTestJSON-1234861286 tempest-DeleteServersAdminTestJSON-1234861286-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f/action" status: 202 len: 0 microversion: 2.1 time: 0.174336 Jun 18 22:02:09.809224 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 153/322] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:02:09 2022] POST /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:02:09.816769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Action: 'update', calling method: .version_select at 0x7fea14c8d3a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:10.135710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:10.136139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:10.136960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:10.137923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:10.138344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:10.153860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.154555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.155734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.156405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.196316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Getting quotas for project 7b63c52467494445b437e444a52e075e. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:10.204134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Getting quotas for user 58c3911cbbdf4e35ae8df9eb8b23f22d and project 7b63c52467494445b437e444a52e075e. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:10.224042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:10.227455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:10.323886 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9eef1e06-75d8-4dfb-8418-04fcce256b69 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901691 Jun 18 22:02:10.326119 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 170/323] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:02:10.343586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:10.345475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:10.355420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.357488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.358547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.362129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.590172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:10.606206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e750bfbf-6306-4bd0-b986-0de4f8a07d0d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.276042 Jun 18 22:02:10.616375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 171/324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:10 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:10.622219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:10.622998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:10.632476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.632922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.633722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.633863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.634879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.635882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.638661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.639169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.697787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.698847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.706615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lazy-loading 'fault' on Instance uuid c5615e2b-109a-4c94-b891-9016ad5eb69f {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:02:10.773699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.774897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.775885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.777050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.877332 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-341193f1-7ff5-47b8-aee3-ec8a22063bc6 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393?user_id=f482897e21254e588949fd62ac5d146f" status: 200 len: 148 microversion: 2.57 time: 1.065804 Jun 18 22:02:10.883862 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 154/325] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Jun 18 22:02:09 2022] PUT /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393?user_id=f482897e21254e588949fd62ac5d146f => generated 148 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:10.890224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8e6e5f05-e1b6-476c-96cc-6f00a3fe89ab req-dc2c876e-d7e2-405d-b620-7eb94b4392b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf95372-e587-4ff1-b0ad-168c53b2732a", "name": "network-vif-plugged", "status": "completed", "tag": "da0dbb4c-1902-431d-bf2a-102b1b5e2ad3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:10.902745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8e6e5f05-e1b6-476c-96cc-6f00a3fe89ab req-dc2c876e-d7e2-405d-b620-7eb94b4392b5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:10.903747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8e6e5f05-e1b6-476c-96cc-6f00a3fe89ab req-dc2c876e-d7e2-405d-b620-7eb94b4392b5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:10.937435 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8e6e5f05-e1b6-476c-96cc-6f00a3fe89ab req-dc2c876e-d7e2-405d-b620-7eb94b4392b5 service nova] Creating event network-vif-plugged:da0dbb4c-1902-431d-bf2a-102b1b5e2ad3 for instance adf95372-e587-4ff1-b0ad-168c53b2732a on nch1-master-1 Jun 18 22:02:10.952301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8e6e5f05-e1b6-476c-96cc-6f00a3fe89ab req-dc2c876e-d7e2-405d-b620-7eb94b4392b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064334 Jun 18 22:02:10.955548 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 155/326] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:11.067396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:11.081877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a70078a3-255a-4fae-91de-3cbad52e3108 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1450 microversion: 2.1 time: 0.459844 Jun 18 22:02:11.084003 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 172/327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:10 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1450 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:11.097252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb3cd28b-3fb3-4ce9-81a1-3078a725a928 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:11.098362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb3cd28b-3fb3-4ce9-81a1-3078a725a928 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:11.175561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb3cd28b-3fb3-4ce9-81a1-3078a725a928 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:11.188275 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb3cd28b-3fb3-4ce9-81a1-3078a725a928 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1224 microversion: 2.1 time: 0.102860 Jun 18 22:02:11.199674 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 173/328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:11 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:11.354941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2372537-1ff7-4f45-a687-350c087b310d tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:11.357122 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:11.357122 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:11.358367 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b2372537-1ff7-4f45-a687-350c087b310d tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2372537-1ff7-4f45-a687-350c087b310d tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin] Request method failure captured: Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkth-U2z0dT5TeS5VfBgUW5EK2O8Kds7-9AdkUMhlwYeX7pidgNJuCFAjJC_-lR5KibhWZy6S0LodA7oGy6nJElCK5Xf5JfpjtAHaHqU4S4-H8RgZ1PBOLCC-QfTWs-gx5YgTeLmdrM16Mi0JnyFLFKScwczP7Q8qZYu2EIgQ6zTWWg Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 67785e8d0d06450697c89092ece4dcc7 Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:11.367286 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/67785e8d0d06450697c89092ece4dcc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67785e8d0d06450697c89092ece4dcc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/67785e8d0d06450697c89092ece4dcc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_67785e8d0d06450697c89092ece4dcc7", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 67785e8d0d06450697c89092ece4dcc7 Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: fd3ffd9bcd8c4569899332930691b953 Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid timestamp for date invalid_time Jun 18 22:02:11.368570 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'invalid_time'} Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:11.369291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 18 22:02:11.370344 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:11.373242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2372537-1ff7-4f45-a687-350c087b310d tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:11.374273 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2372537-1ff7-4f45-a687-350c087b310d tempest-InstanceUsageAuditLogNegativeTestJSON-446886093 tempest-InstanceUsageAuditLogNegativeTestJSON-446886093-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.417157 Jun 18 22:02:11.375552 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 156/329] 10.222.0.30 () {58 vars in 1223 bytes} [Sat Jun 18 22:02:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:11.389134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3561e3db-c053-4a8e-a306-32414e282031 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] Calling method '.version_select at 0x7fea14b5b1f0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:11.620354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b0ed420-b04c-4765-9a1b-9b1ad3129ebc tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:11.623003 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:11.623003 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:11.625567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0ed420-b04c-4765-9a1b-9b1ad3129ebc tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:11.626214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0ed420-b04c-4765-9a1b-9b1ad3129ebc tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:11.628282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0ed420-b04c-4765-9a1b-9b1ad3129ebc tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:11.633103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0ed420-b04c-4765-9a1b-9b1ad3129ebc tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:11.689452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b0ed420-b04c-4765-9a1b-9b1ad3129ebc tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.486914 Jun 18 22:02:11.692590 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 174/330] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:02:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:11.703133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:11.705239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:11.721634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:11.727661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:11.728961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:11.730081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:11.775074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:02:11.902862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3561e3db-c053-4a8e-a306-32414e282031 tempest-QuotasAdminTestV257-821110175 tempest-QuotasAdminTestV257-821110175-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393?user_id=f482897e21254e588949fd62ac5d146f" status: 200 len: 190 microversion: 2.57 time: 0.525780 Jun 18 22:02:11.903609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c8ab94dd-5dac-4867-8d55-0a118dc0d855 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 204 len: 0 microversion: 2.1 time: 0.209347 Jun 18 22:02:11.904426 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 175/331] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:02:11 2022] DELETE /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:02:11.905105 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 157/332] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Jun 18 22:02:11 2022] GET /compute/v2.1/os-quota-sets/dff3bf4d1e2544be9d0d68dcdc0a4393?user_id=f482897e21254e588949fd62ac5d146f => generated 190 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:11.912337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:11.913333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:11.920349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:11.921264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:11.922632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:11.923302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.108029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b783a9f-8990-4aeb-b0bb-46d0714bfb03 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:12.108960 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:12.108960 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:12.111098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b783a9f-8990-4aeb-b0bb-46d0714bfb03 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'dfa9abf56586438ba2855e3b7e494213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9917e8c21314e5eb0a3fe51d198fb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b783a9f-8990-4aeb-b0bb-46d0714bfb03 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Request method failure captured: Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktfUl7RrAWDjAsWRYs3OUQa14muFi2uv5gmMGI7jDp5PAyVjSPM76t4C3HpkdyoGz2oO7i5AlqQuR1hO3E4B7trg6eAVISJw5RgmqobTHxufxkxc7Uawl5a8LaNAPxCjqpi84SrmYoDiQLD9fj3h09OLVfVZQfhKvBf4Qs-7J4zEJs Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a9917e8c21314e5eb0a3fe51d198fb5d Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:12.113173 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9917e8c21314e5eb0a3fe51d198fb5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9917e8c21314e5eb0a3fe51d198fb5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9917e8c21314e5eb0a3fe51d198fb5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9917e8c21314e5eb0a3fe51d198fb5d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a9917e8c21314e5eb0a3fe51d198fb5d Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: dfa9abf56586438ba2855e3b7e494213 Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:12.114478 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:12.115203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:12.117178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b783a9f-8990-4aeb-b0bb-46d0714bfb03 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:12.118837 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b783a9f-8990-4aeb-b0bb-46d0714bfb03 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.209279 Jun 18 22:02:12.118837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 176/333] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:02:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:12.124751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-25d4d036-c259-472a-b94e-9e639c90e02f tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2125948172"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:12.126988 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:12.126988 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:12.128200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-25d4d036-c259-472a-b94e-9e639c90e02f tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid 893e3995-439c-420f-b81c-4d841d4f6088 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:12.171577 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-25d4d036-c259-472a-b94e-9e639c90e02f tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.051667 Jun 18 22:02:12.177791 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 177/334] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:12.202993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:12.203761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:12.224235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.224691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.225522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.225959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.289715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:12.315617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.318572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.319252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lazy-loading 'fault' on Instance uuid c5615e2b-109a-4c94-b891-9016ad5eb69f {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:02:12.638414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:12.646519 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2ae61be-e2a2-41a9-a9d8-8eb3c7f7df28 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1389 microversion: 2.1 time: 0.740021 Jun 18 22:02:12.647169 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 158/335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:11 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1389 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:12.660974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-290db7ba-3778-490e-bfc7-34893bd8f842 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:12.662151 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:12.662151 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:12.663593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-290db7ba-3778-490e-bfc7-34893bd8f842 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'dfa9abf56586438ba2855e3b7e494213', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9917e8c21314e5eb0a3fe51d198fb5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-290db7ba-3778-490e-bfc7-34893bd8f842 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Request method failure captured: Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-18%2022:02:12 HTTP/1.1 Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktfUl7RrAWDjAsWRYs3OUQa14muFi2uv5gmMGI7jDp5PAyVjSPM76t4C3HpkdyoGz2oO7i5AlqQuR1hO3E4B7trg6eAVISJw5RgmqobTHxufxkxc7Uawl5a8LaNAPxCjqpi84SrmYoDiQLD9fj3h09OLVfVZQfhKvBf4Qs-7J4zEJs Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a9917e8c21314e5eb0a3fe51d198fb5d Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:12.667140 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9917e8c21314e5eb0a3fe51d198fb5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9917e8c21314e5eb0a3fe51d198fb5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9917e8c21314e5eb0a3fe51d198fb5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9917e8c21314e5eb0a3fe51d198fb5d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a9917e8c21314e5eb0a3fe51d198fb5d Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: dfa9abf56586438ba2855e3b7e494213 Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:12.668509 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2022-06-18 22:02:12'} Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:12.669133 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 18 22:02:12.670294 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:12.678468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-290db7ba-3778-490e-bfc7-34893bd8f842 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:12.679692 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-290db7ba-3778-490e-bfc7-34893bd8f842 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461 tempest-InstanceUsageAuditLogNegativeTestJSON-1789486461-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-18 22:02:12" status: 403 len: 128 microversion: 2.1 time: 0.031384 Jun 18 22:02:12.681263 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 159/336] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:02:12 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-18%2022%3A02%3A12 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:12.689468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a06cf4c-a5a5-4cb8-af69-2943ac187512 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:12.694352 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:12.694352 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:12.728390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a06cf4c-a5a5-4cb8-af69-2943ac187512 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.729803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a06cf4c-a5a5-4cb8-af69-2943ac187512 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.784235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:12.798263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bf51e91-2aa5-4670-bf2d-97ea934289f8 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1456 microversion: 2.1 time: 0.616340 Jun 18 22:02:12.799560 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 178/337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:12 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1456 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:12.809298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:12.810047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:12.825653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.826120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.830061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.832605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:12.908834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a06cf4c-a5a5-4cb8-af69-2943ac187512 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.225801 Jun 18 22:02:12.914893 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 160/338] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:12.920420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:12.921825 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:12.921825 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:12.950239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:12.950630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.003951 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] HTTP exception thrown: Aggregate 11 already has host nch2-master-1. Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 39 Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:13.007471 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: {"add_host": {"host": "nch2-master-1"}} Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:13.008803 ncdv-master-1 devstack@n-api.service[130903]: exception: Aggregate 11 already has host nch2-master-1. Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result.read() Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:02:13.009608 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi session.flush() Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 22:02:13.010639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 22:02:13.011736 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:02:13.014588 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result.read() Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 18, 22, 2, 12, 981401), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 11}] Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.018015 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host nch2-master-1. Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.023214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host nch2-master-1. Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:13.026689 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:13.029496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host nch2-master-1. Jun 18 22:02:13.029496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.029496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 409 to user: Aggregate 11 already has host nch2-master-1. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:13.029496 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-832e33c7-a022-4e4d-b886-4b659f7c1bf8 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.092832 Jun 18 22:02:13.029496 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 161/339] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 18 22:02:13.029496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e22d2ae-3f65-444c-b08d-2a0409f76dd6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:13.046254 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:13.046254 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:13.060738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:13.065015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e22d2ae-3f65-444c-b08d-2a0409f76dd6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:13.065826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e22d2ae-3f65-444c-b08d-2a0409f76dd6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.141360 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43a7038a-07c5-403e-b224-cc34c6b83fa3 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1284 microversion: 2.1 time: 0.338604 Jun 18 22:02:13.155948 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 179/340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:12 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1284 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:13.296458 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e22d2ae-3f65-444c-b08d-2a0409f76dd6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.278990 Jun 18 22:02:13.300748 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 162/341] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:13 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:13.313558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3a9d141-4310-47a5-801f-64e2ec4c33ab tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:13.315728 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:13.315728 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:13.396153 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3a9d141-4310-47a5-801f-64e2ec4c33ab tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.088580 Jun 18 22:02:13.402721 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 180/342] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:13 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:13.407878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-beaa3c72-1283-4994-9cc3-874497b0dea6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-544280931"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:13.409264 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:13.409264 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:13.410139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-beaa3c72-1283-4994-9cc3-874497b0dea6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid 3d352ae3-e567-4a05-9831-96199988cb45 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:13.431566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:13.473556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-beaa3c72-1283-4994-9cc3-874497b0dea6 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061036 Jun 18 22:02:13.480457 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 163/343] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:13.663636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:13.664506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:13.683409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:13.683870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.684669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:13.685195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.808538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bae0f72f-7141-4424-825b-bd9fcede0121 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:13.818434 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:13.818434 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:13.820295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bae0f72f-7141-4424-825b-bd9fcede0121 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '631f8b600f144677ae9831f5772407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5bb60da6c748069709e3c9e5bacbff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bae0f72f-7141-4424-825b-bd9fcede0121 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Request method failure captured: Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 39 Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktf8BFDGXgiYen28uHIZj-K82ednmY0SQBnBDoycn15ghaY-zk5cBbVV8vQMyZL7lRSFj2vzV6OYvjt7PzcKP5mRVGrYnn2uJ_aB_0mU4XtMrhMnI5kiAng8FJbGznNlcH35IfG_8FvNmapNJDcxL5qeM3Rpw6JgkOF_Vneuz8HMbI Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:13.823760 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d5bb60da6c748069709e3c9e5bacbff", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 631f8b600f144677ae9831f5772407ec Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: {"add_host": {"host": "nch2-master-1"}} Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:13.825532 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '12', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:13.826683 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 18 22:02:13.828118 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:13.836826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bae0f72f-7141-4424-825b-bd9fcede0121 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:13.839211 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bae0f72f-7141-4424-825b-bd9fcede0121 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.357260 Jun 18 22:02:13.841414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 181/344] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:13 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 360 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:13.857325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:13.860307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:13.869008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:13.869795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.871237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:13.875574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.951593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:13.952103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:13.952712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lazy-loading 'fault' on Instance uuid c5615e2b-109a-4c94-b891-9016ad5eb69f {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:02:14.184057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:14.193309 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b214873-6c6e-4fb9-a7a9-200eb4106810 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1589 microversion: 2.1 time: 0.533979 Jun 18 22:02:14.205824 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 164/345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:13 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1589 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:14.211156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4568dc71-41ea-4748-a853-5a13ee29fc04 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:14.212123 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.212123 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:14.236929 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4568dc71-41ea-4748-a853-5a13ee29fc04 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.029580 Jun 18 22:02:14.245179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 165/346] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:14 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:14.251425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:14.252333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:14.259698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:14.261013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:14.262075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:14.262756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:14.447870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:14.448844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:14.465908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20c2964f-daba-48da-b1d4-f92d0830ec1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1282 microversion: 2.1 time: 0.219046 Jun 18 22:02:14.475489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 166/347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:14 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:14.478525 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-286a17db-9d48-4e01-bdd9-fad718749bd0 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1456 microversion: 2.1 time: 0.635403 Jun 18 22:02:14.479680 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 182/348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:13 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1456 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:14.487414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:14.488298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:14.493430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce8bc08e-c7e4-42a0-a287-193ae5ed144d tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-448149235"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.494799 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.494799 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:14.495468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:14.496501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-ce8bc08e-c7e4-42a0-a287-193ae5ed144d tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid 5fa5e67a-5327-4500-b6bc-3762d3a6731e for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:14.498986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:14.502094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:14.502478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:14.547587 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce8bc08e-c7e4-42a0-a287-193ae5ed144d tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066100 Jun 18 22:02:14.549159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 183/349] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:14.569619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-761318981"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.573006 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.573006 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:14.599680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:14.602630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:14.612558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:14.613198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:14.623225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:14.627071 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-761318981 could not be found. Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 57 Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:14.629538 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: {"add_host": {"host": "tempest-nonexist_host-761318981"}} Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:14.630953 ncdv-master-1 devstack@n-api.service[130902]: exception: Compute host tempest-nonexist_host-761318981 could not be found. Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-761318981'}}} Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-761318981' is not mapped to any cell Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.631833 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 18 22:02:14.633132 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-761318981 could not be found. Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-761318981 could not be found. Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.634442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-761318981 could not be found. Jun 18 22:02:14.636091 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.646715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-761318981 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:14.648047 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7c4624cb-8c4c-4a88-b7e1-7407af77cd85 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.088349 Jun 18 22:02:14.654335 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 184/350] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:14.700174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a083baa-d25b-4ccb-927e-196c41864666 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:14.717951 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.717951 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:14.780691 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a083baa-d25b-4ccb-927e-196c41864666 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.107595 Jun 18 22:02:14.782154 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 185/351] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:14 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:14.797524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b906b3b-8ae0-461c-b927-77aff3e914fa tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.319183 Jun 18 22:02:14.798138 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 167/352] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:02:14 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:14.804335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86f6a50c-55aa-4f0d-a7be-6c3fe68b00f3 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86f6a50c-55aa-4f0d-a7be-6c3fe68b00f3 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 283 Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:14.817657 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:14.819013 ncdv-master-1 devstack@n-api.service[130902]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:02:14.819636 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:02:14.820390 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:02:14.821482 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:02:14.822221 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:02:14.822221 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.826301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86f6a50c-55aa-4f0d-a7be-6c3fe68b00f3 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:14.827509 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86f6a50c-55aa-4f0d-a7be-6c3fe68b00f3 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.038184 Jun 18 22:02:14.831184 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 186/353] 10.222.0.30 () {60 vars in 1164 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:02:14.841088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a15b0bc6-0a6a-4a5c-b504-c4cd80b6a430 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a15b0bc6-0a6a-4a5c-b504-c4cd80b6a430 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 27 Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:14.844049 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: {"aggregate": {"name": ""}} Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:14.845306 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi '' Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:14.851423 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:02:14.853573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.856301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a15b0bc6-0a6a-4a5c-b504-c4cd80b6a430 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:14.856301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a15b0bc6-0a6a-4a5c-b504-c4cd80b6a430 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008304 Jun 18 22:02:14.856467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ed4bd7c-cea6-46fe-83ce-866c25f04d62 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1177305948"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.857398 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 168/354] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:02:14.860067 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.860067 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:14.861158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ed4bd7c-cea6-46fe-83ce-866c25f04d62 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '631f8b600f144677ae9831f5772407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5bb60da6c748069709e3c9e5bacbff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ed4bd7c-cea6-46fe-83ce-866c25f04d62 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Request method failure captured: Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 60 Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktf8BFDGXgiYen28uHIZj-K82ednmY0SQBnBDoycn15ghaY-zk5cBbVV8vQMyZL7lRSFj2vzV6OYvjt7PzcKP5mRVGrYnn2uJ_aB_0mU4XtMrhMnI5kiAng8FJbGznNlcH35IfG_8FvNmapNJDcxL5qeM3Rpw6JgkOF_Vneuz8HMbI Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:14.862815 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d5bb60da6c748069709e3c9e5bacbff", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 631f8b600f144677ae9831f5772407ec Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: {"aggregate": {"name": "tempest-test_aggregate-1177305948"}} Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:14.864040 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1177305948'}}} Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:14.867619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:14.868691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 18 22:02:14.870442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.870442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ed4bd7c-cea6-46fe-83ce-866c25f04d62 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:14.870442 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ed4bd7c-cea6-46fe-83ce-866c25f04d62 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012432 Jun 18 22:02:14.870442 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 187/355] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:14.875145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90fe7b5a-334c-4321-bbf5-af7a442a8f7b tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1686824543"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.876617 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.876617 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:14.877677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-90fe7b5a-334c-4321-bbf5-af7a442a8f7b tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid a4d57620-93db-4684-959e-f67d89d563a6 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:14.912238 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90fe7b5a-334c-4321-bbf5-af7a442a8f7b tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041189 Jun 18 22:02:14.914859 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 169/356] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:14.924217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c64f2110-b0bb-4ede-b0eb-297e2fa276e0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1686824543"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:14.926874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-c64f2110-b0bb-4ede-b0eb-297e2fa276e0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid 70bcaa4c-c60d-4c25-91b0-dec322d1dcdd for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:14.949372 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c64f2110-b0bb-4ede-b0eb-297e2fa276e0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1686824543 already exists. Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c64f2110-b0bb-4ede-b0eb-297e2fa276e0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 60 Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:14.951291 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: {"aggregate": {"name": "tempest-test_aggregate-1686824543"}} Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:14.952784 ncdv-master-1 devstack@n-api.service[130902]: exception: Aggregate tempest-test_aggregate-1686824543 already exists. Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1686824543'}}} Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 18 22:02:14.953596 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1686824543 already exists. Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:14.954623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1686824543 already exists. Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1686824543 already exists. Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c64f2110-b0bb-4ede-b0eb-297e2fa276e0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1686824543 already exists. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:14.955771 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c64f2110-b0bb-4ede-b0eb-297e2fa276e0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.033455 Jun 18 22:02:14.956567 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 188/357] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:14 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:14.963024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0add8b0-f655-40ed-8072-fca09f3460c2 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:14.964082 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:14.964082 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:15.002785 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c0add8b0-f655-40ed-8072-fca09f3460c2 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.043964 Jun 18 22:02:15.003767 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 170/358] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:15.018485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4cb71ea1-8ecb-4f76-963a-f23357bce952 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1999595510"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:15.020421 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.020421 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:15.022067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-4cb71ea1-8ecb-4f76-963a-f23357bce952 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid a876d395-d244-4bb3-a10d-9f864a771360 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:15.058587 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4cb71ea1-8ecb-4f76-963a-f23357bce952 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048285 Jun 18 22:02:15.061158 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 189/359] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:15.071547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f189fb3-0249-43c2-beed-fb7f70b83e1a tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.073078 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.073078 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:15.074894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f189fb3-0249-43c2-beed-fb7f70b83e1a tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '631f8b600f144677ae9831f5772407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5bb60da6c748069709e3c9e5bacbff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f189fb3-0249-43c2-beed-fb7f70b83e1a tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Request method failure captured: Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktf8BFDGXgiYen28uHIZj-K82ednmY0SQBnBDoycn15ghaY-zk5cBbVV8vQMyZL7lRSFj2vzV6OYvjt7PzcKP5mRVGrYnn2uJ_aB_0mU4XtMrhMnI5kiAng8FJbGznNlcH35IfG_8FvNmapNJDcxL5qeM3Rpw6JgkOF_Vneuz8HMbI Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:15.076848 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d5bb60da6c748069709e3c9e5bacbff", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 631f8b600f144677ae9831f5772407ec Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 18 22:02:15.078318 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '15'} Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:15.079070 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 18 22:02:15.080394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.081843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f189fb3-0249-43c2-beed-fb7f70b83e1a tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:15.083200 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f189fb3-0249-43c2-beed-fb7f70b83e1a tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.016234 Jun 18 22:02:15.084767 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 171/360] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:15 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:15.094653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa050c12-63a9-44a8-b729-9ce1d845a6d3 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.096217 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.096217 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:15.103154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:15.123592 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa050c12-63a9-44a8-b729-9ce1d845a6d3 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.033993 Jun 18 22:02:15.125315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 190/361] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:15 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:15.134965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb8754fa-9883-40dc-a9a4-dac699dc6d76 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.148480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-cb8754fa-9883-40dc-a9a4-dac699dc6d76 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb8754fa-9883-40dc-a9a4-dac699dc6d76 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:15.151052 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: exception: Aggregate -1 could not be found. Jun 18 22:02:15.152261 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '-1'} Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 18 22:02:15.152946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.154214 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.155409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb8754fa-9883-40dc-a9a4-dac699dc6d76 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:15.161205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb8754fa-9883-40dc-a9a4-dac699dc6d76 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.026060 Jun 18 22:02:15.162517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 172/362] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:15 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:15.173781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-617a9b43-b2e8-4d5b-afb4-a84bcea1b681 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-616943491"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:15.175658 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.175658 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:15.177157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.aggregate [None req-617a9b43-b2e8-4d5b-afb4-a84bcea1b681 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid faa55cbd-8732-48b5-8509-9afba21478d4 for aggregate {{(pid=130902) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:15.208939 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-617a9b43-b2e8-4d5b-afb4-a84bcea1b681 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039500 Jun 18 22:02:15.210901 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 191/363] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:15.223763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-204e3934-4ee0-40d3-99e1-250a6425772c tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.225174 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.225174 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:15.226031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-204e3934-4ee0-40d3-99e1-250a6425772c tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '631f8b600f144677ae9831f5772407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5bb60da6c748069709e3c9e5bacbff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-204e3934-4ee0-40d3-99e1-250a6425772c tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Request method failure captured: Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktf8BFDGXgiYen28uHIZj-K82ednmY0SQBnBDoycn15ghaY-zk5cBbVV8vQMyZL7lRSFj2vzV6OYvjt7PzcKP5mRVGrYnn2uJ_aB_0mU4XtMrhMnI5kiAng8FJbGznNlcH35IfG_8FvNmapNJDcxL5qeM3Rpw6JgkOF_Vneuz8HMbI Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:15.227710 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d5bb60da6c748069709e3c9e5bacbff", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 631f8b600f144677ae9831f5772407ec Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 18 22:02:15.228935 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '16'} Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:15.230050 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.231093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-204e3934-4ee0-40d3-99e1-250a6425772c tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:15.232864 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-204e3934-4ee0-40d3-99e1-250a6425772c tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.014288 Jun 18 22:02:15.233570 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 173/364] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:02:15 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:02:15.244045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97c128f2-09a7-4f7f-8953-1f3819fbd2d7 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.244801 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.244801 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:15.273416 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97c128f2-09a7-4f7f-8953-1f3819fbd2d7 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.034999 Jun 18 22:02:15.274964 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 192/365] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:15 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 18 22:02:15.288531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0753b8d-9535-48bb-99b5-72cd3e356a30 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.299570 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e0753b8d-9535-48bb-99b5-72cd3e356a30 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0753b8d-9535-48bb-99b5-72cd3e356a30 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:15.301758 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: exception: Aggregate -1 could not be found. Jun 18 22:02:15.303047 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '-1'} Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.303729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 18 22:02:15.304823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.307772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0753b8d-9535-48bb-99b5-72cd3e356a30 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:15.308910 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0753b8d-9535-48bb-99b5-72cd3e356a30 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.028837 Jun 18 22:02:15.310164 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 174/366] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:02:15 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:15.320494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2b6a732-d92c-4559-a5fe-61061d394fd8 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.321847 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.321847 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:15.322762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2b6a732-d92c-4559-a5fe-61061d394fd8 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '631f8b600f144677ae9831f5772407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5bb60da6c748069709e3c9e5bacbff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2b6a732-d92c-4559-a5fe-61061d394fd8 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Request method failure captured: Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktf8BFDGXgiYen28uHIZj-K82ednmY0SQBnBDoycn15ghaY-zk5cBbVV8vQMyZL7lRSFj2vzV6OYvjt7PzcKP5mRVGrYnn2uJ_aB_0mU4XtMrhMnI5kiAng8FJbGznNlcH35IfG_8FvNmapNJDcxL5qeM3Rpw6JgkOF_Vneuz8HMbI Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:15.324935 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d5bb60da6c748069709e3c9e5bacbff", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 631f8b600f144677ae9831f5772407ec Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 18 22:02:15.326849 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:15.327670 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.328680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2b6a732-d92c-4559-a5fe-61061d394fd8 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:15.330948 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b2b6a732-d92c-4559-a5fe-61061d394fd8 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010358 Jun 18 22:02:15.333561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 193/367] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:02:15 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:02:15.344589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-84585bbc-0027-465c-8e5f-9077d721ad0a tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1720026917"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:15.348558 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.348558 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:15.354022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-84585bbc-0027-465c-8e5f-9077d721ad0a tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid 8c77b17d-39e0-4870-8bbb-c8ad194bddc8 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:15.407302 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-84585bbc-0027-465c-8e5f-9077d721ad0a tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.068054 Jun 18 22:02:15.408405 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 175/368] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:15.440908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-781a350a-7042-49b8-8554-daedfc991414 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:15.444518 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.444518 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:15.480587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-781a350a-7042-49b8-8554-daedfc991414 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.481569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-781a350a-7042-49b8-8554-daedfc991414 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.488132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.491584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:15.507242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.509112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.510202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.513550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.730358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:15.739417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-781a350a-7042-49b8-8554-daedfc991414 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.322022 Jun 18 22:02:15.740416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 194/369] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:15.747326 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c2c5d2e4-f7a5-4ddb-a93f-10ce90b1adbf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1282 microversion: 2.1 time: 0.268329 Jun 18 22:02:15.752366 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 176/370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:15 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1282 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:15.759276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f9301b8-8001-41dd-8f4a-003594a5b278 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:15.760467 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:15.760467 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:15.761337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4f9301b8-8001-41dd-8f4a-003594a5b278 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '631f8b600f144677ae9831f5772407ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5bb60da6c748069709e3c9e5bacbff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f9301b8-8001-41dd-8f4a-003594a5b278 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Request method failure captured: Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 42 Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktf8BFDGXgiYen28uHIZj-K82ednmY0SQBnBDoycn15ghaY-zk5cBbVV8vQMyZL7lRSFj2vzV6OYvjt7PzcKP5mRVGrYnn2uJ_aB_0mU4XtMrhMnI5kiAng8FJbGznNlcH35IfG_8FvNmapNJDcxL5qeM3Rpw6JgkOF_Vneuz8HMbI Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:15.770907 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8d5bb60da6c748069709e3c9e5bacbff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8d5bb60da6c748069709e3c9e5bacbff", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8d5bb60da6c748069709e3c9e5bacbff Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-363731088 Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 631f8b600f144677ae9831f5772407ec Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-363731088-project Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: {"remove_host": {"host": "nch2-master-1"}} Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:15.772434 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:15.773366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 18 22:02:15.774741 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:15.775987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:15.775987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:15.777886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f9301b8-8001-41dd-8f4a-003594a5b278 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:15.782245 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4f9301b8-8001-41dd-8f4a-003594a5b278 tempest-AggregatesAdminNegativeTestJSON-363731088 tempest-AggregatesAdminNegativeTestJSON-363731088-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.026495 Jun 18 22:02:15.786618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 177/371] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:15.794823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.796341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.800123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.806482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.816349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-136882fd-7405-46d5-a393-8435311a0966 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:15.835660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-136882fd-7405-46d5-a393-8435311a0966 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.837125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-136882fd-7405-46d5-a393-8435311a0966 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.945874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:15.946322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:15.946957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lazy-loading 'fault' on Instance uuid c5615e2b-109a-4c94-b891-9016ad5eb69f {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:02:16.058855 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-136882fd-7405-46d5-a393-8435311a0966 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.270209 Jun 18 22:02:16.065463 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 178/372] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:16.070326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0ecaa070-129c-4fe0-bc8a-20aaa4de1c3a req-70797100-0888-4b4f-a638-c5c08449b368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5615e2b-109a-4c94-b891-9016ad5eb69f", "name": "network-vif-deleted", "tag": "3d298962-5afd-4ee8-b730-1b6e06470353"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:16.085928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0ecaa070-129c-4fe0-bc8a-20aaa4de1c3a req-70797100-0888-4b4f-a638-c5c08449b368 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:16.086374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0ecaa070-129c-4fe0-bc8a-20aaa4de1c3a req-70797100-0888-4b4f-a638-c5c08449b368 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:16.108940 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0ecaa070-129c-4fe0-bc8a-20aaa4de1c3a req-70797100-0888-4b4f-a638-c5c08449b368 service nova] Creating event network-vif-deleted:3d298962-5afd-4ee8-b730-1b6e06470353 for instance c5615e2b-109a-4c94-b891-9016ad5eb69f on nch2-master-1 Jun 18 22:02:16.114746 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0ecaa070-129c-4fe0-bc8a-20aaa4de1c3a req-70797100-0888-4b4f-a638-c5c08449b368 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047894 Jun 18 22:02:16.115982 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 179/373] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:16.123047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-783256d3-af0f-4fcf-89de-c25a89d5001b tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:16.124428 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:16.124428 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:16.150883 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-783256d3-af0f-4fcf-89de-c25a89d5001b tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.033229 Jun 18 22:02:16.152558 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 180/374] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:16 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:16.167011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5002737a-dbff-448f-8c72-23a48207c2c0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1444428826"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:16.170006 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:16.170006 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:16.171144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-5002737a-dbff-448f-8c72-23a48207c2c0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Generated uuid 95ca9793-b04b-45d1-ba68-597dbbee8514 for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:02:16.202993 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5002737a-dbff-448f-8c72-23a48207c2c0 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.041607 Jun 18 22:02:16.203618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 181/375] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:02:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:16.219614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:16.221319 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:16.221319 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:16.232416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:16.234018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:16.250136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:16.250812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:16.271997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.compute.aggregates [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 18 22:02:16.277102 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Request method failure captured: Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 42 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktiDOXCuMbJAGuHm3dwke7QGNWlLQjnMihMVpEqzuxpuOtEn8XqxPk2o3RgaNAu9IzEAKCbxQhF1AjpvYFpWz8TQzAfNMK0z8nJukHNv_pl632SBzwAcmtStai89_UIW01juvS3Avtoh6HGHBlm9L6_xT1Jz40bDLsjTBEzZRjhf34 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:16.281378 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4bdd63e71f4849a6863acf098904960f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4bdd63e71f4849a6863acf098904960f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4bdd63e71f4849a6863acf098904960f Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784 Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 91afdba04a224a359e43f0a18defd2c3 Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: {"remove_host": {"host": "nonexist_host"}} Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:16.282698 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot remove host nonexist_host in aggregate 18 Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 18 22:02:16.288117 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 18 22:02:16.291543 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.292626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd5ce17b-40c1-46b7-a260-4cc3466a0800 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.070241 Jun 18 22:02:16.296751 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 182/376] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:02:16 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:02:16.299502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd75ce01-4302-47d7-a0b1-8ee3195585a7 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:16.300281 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:16.300281 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:16.316971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae6d217f7344408eed23388dd337b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9f244c1df9c4ca19ec5fa57b7d94bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:16.332505 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-385f5e1d-4c9a-4447-ad89-da3c9e6dd7a7 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 200 len: 1287 microversion: 2.1 time: 0.591058 Jun 18 22:02:16.333566 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 195/377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:15 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 1287 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:16.401381 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd75ce01-4302-47d7-a0b1-8ee3195585a7 tempest-AggregatesAdminNegativeTestJSON-1798459784 tempest-AggregatesAdminNegativeTestJSON-1798459784-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.108496 Jun 18 22:02:16.411587 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 183/378] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:02:16 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:02:16.769548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:16.770212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:16.780878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:16.781918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:16.784729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:16.786761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:16.999413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:17.007880 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0dbfc0f0-4de3-493b-9a7b-da1303f5adaf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1282 microversion: 2.1 time: 0.243128 Jun 18 22:02:17.009437 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 196/379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:16 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:17.349500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:17.350972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:17.361131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.361585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.362382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.362817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.397288 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] HTTP exception thrown: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Request method failure captured: Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f HTTP/1.1 Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksneNbuOhp2lO6zn0dzNBLn6fs0TQkyUvr2grU6gpdZqoy8ENC18BjtM_4DE3u7Pbza5a6GSHiipQEi4Tbu8Lv9Lu1d2oFVDrhZ9iVx1v0gkTWv-hlr9QA8ldET6-LLpJS5MC_vVRt1oI3sdXkd2A_8vFkgyfQsXzf3KxNnGZtYbNo Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:17.398936 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9f244c1df9c4ca19ec5fa57b7d94bc6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c9ae6d217f7344408eed23388dd337b7 Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.400177 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c5615e2b-109a-4c94-b891-9016ad5eb69f'} Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:17.400867 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.402298 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.409921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Returning 404 to user: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:17.411047 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59e37e03-517f-4d3a-9f04-e5e832be3566 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 404 len: 111 microversion: 2.1 time: 0.065525 Jun 18 22:02:17.411784 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 184/380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:17 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:17.427817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:17.428351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:17.443664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.443766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.446806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.448710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.482780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] HTTP exception thrown: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Request method failure captured: Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f HTTP/1.1 Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksneNbuOhp2lO6zn0dzNBLn6fs0TQkyUvr2grU6gpdZqoy8ENC18BjtM_4DE3u7Pbza5a6GSHiipQEi4Tbu8Lv9Lu1d2oFVDrhZ9iVx1v0gkTWv-hlr9QA8ldET6-LLpJS5MC_vVRt1oI3sdXkd2A_8vFkgyfQsXzf3KxNnGZtYbNo Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:17.484430 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9f244c1df9c4ca19ec5fa57b7d94bc6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: c9ae6d217f7344408eed23388dd337b7 Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.486151 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'c5615e2b-109a-4c94-b891-9016ad5eb69f'} Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:17.487063 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.488386 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.490386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Returning 404 to user: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:17.491250 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9902f1f-6084-4cca-bcae-f8dfd2330616 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 404 len: 111 microversion: 2.1 time: 0.068604 Jun 18 22:02:17.495295 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 197/381] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:02:17 2022] DELETE /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:17.500429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:17.501222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: c5615e2b-109a-4c94-b891-9016ad5eb69f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:17.518652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.519250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.520133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.522217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.568470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] HTTP exception thrown: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Request method failure captured: Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f HTTP/1.1 Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksneNbuOhp2lO6zn0dzNBLn6fs0TQkyUvr2grU6gpdZqoy8ENC18BjtM_4DE3u7Pbza5a6GSHiipQEi4Tbu8Lv9Lu1d2oFVDrhZ9iVx1v0gkTWv-hlr9QA8ldET6-LLpJS5MC_vVRt1oI3sdXkd2A_8vFkgyfQsXzf3KxNnGZtYbNo Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:17.575466 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9f244c1df9c4ca19ec5fa57b7d94bc6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c9ae6d217f7344408eed23388dd337b7 Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.576930 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c5615e2b-109a-4c94-b891-9016ad5eb69f'} Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:17.577870 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. Jun 18 22:02:17.579184 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.583019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Returning 404 to user: Instance c5615e2b-109a-4c94-b891-9016ad5eb69f could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:17.589007 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fc2acfe7-7981-46a1-b6ac-ddd39304278e tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f" status: 404 len: 111 microversion: 2.1 time: 0.092581 Jun 18 22:02:17.591939 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 185/382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:17 2022] GET /compute/v2.1/servers/c5615e2b-109a-4c94-b891-9016ad5eb69f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:17.599530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:17.600061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:17.615469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.616174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.617144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.617721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.656951 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] HTTP exception thrown: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Request method failure captured: Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 HTTP/1.1 Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksneNbuOhp2lO6zn0dzNBLn6fs0TQkyUvr2grU6gpdZqoy8ENC18BjtM_4DE3u7Pbza5a6GSHiipQEi4Tbu8Lv9Lu1d2oFVDrhZ9iVx1v0gkTWv-hlr9QA8ldET6-LLpJS5MC_vVRt1oI3sdXkd2A_8vFkgyfQsXzf3KxNnGZtYbNo Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:02:17.661767 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9f244c1df9c4ca19ec5fa57b7d94bc6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: c9ae6d217f7344408eed23388dd337b7 Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.663272 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'db721dc8-8646-4360-b87a-5a5d13f7f723'} Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:17.664089 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.665308 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.666602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Returning 404 to user: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:17.666602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5bcc1c1-adfe-41c3-8800-870276666b54 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "DELETE /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 404 len: 111 microversion: 2.1 time: 0.068336 Jun 18 22:02:17.672208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:17.672829 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 198/383] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:02:17 2022] DELETE /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:17.675181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] [instance: db721dc8-8646-4360-b87a-5a5d13f7f723] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:17.695240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.696375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.699028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:17.711531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:17.752031 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] HTTP exception thrown: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Request method failure captured: Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 HTTP/1.1 Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksneNbuOhp2lO6zn0dzNBLn6fs0TQkyUvr2grU6gpdZqoy8ENC18BjtM_4DE3u7Pbza5a6GSHiipQEi4Tbu8Lv9Lu1d2oFVDrhZ9iVx1v0gkTWv-hlr9QA8ldET6-LLpJS5MC_vVRt1oI3sdXkd2A_8vFkgyfQsXzf3KxNnGZtYbNo Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:17.755868 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d9f244c1df9c4ca19ec5fa57b7d94bc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d9f244c1df9c4ca19ec5fa57b7d94bc6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d9f244c1df9c4ca19ec5fa57b7d94bc6 Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-49644586 Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c9ae6d217f7344408eed23388dd337b7 Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersAdminTestJSON-49644586-project Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.757442 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'db721dc8-8646-4360-b87a-5a5d13f7f723'} Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:17.758418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. Jun 18 22:02:17.759833 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:17.767161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] Returning 404 to user: Instance db721dc8-8646-4360-b87a-5a5d13f7f723 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:17.772628 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b932bb89-2b2a-4f25-96ab-835da44fcf19 tempest-DeleteServersAdminTestJSON-49644586 tempest-DeleteServersAdminTestJSON-49644586-project] 10.222.0.30 "GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723" status: 404 len: 111 microversion: 2.1 time: 0.104345 Jun 18 22:02:17.773730 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 186/384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:17 2022] GET /compute/v2.1/servers/db721dc8-8646-4360-b87a-5a5d13f7f723 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:18.025999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:18.027872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:18.042500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:18.042975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:18.046218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:18.046897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:18.881046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:18.889104 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6022d449-e4fd-4aca-b6ba-1dce4bdb1b36 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.868553 Jun 18 22:02:18.893409 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 199/385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:18 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:19.812567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:19.813683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:19.824409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:19.824863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:19.825676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:19.826116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:19.866911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a8231ac6-097b-4bad-ad25-ceb4c442a48b req-b4a9b7d5-c2b0-4ce0-8b48-6cae840d5968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf95372-e587-4ff1-b0ad-168c53b2732a", "tag": "da0dbb4c-1902-431d-bf2a-102b1b5e2ad3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:19.891098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a8231ac6-097b-4bad-ad25-ceb4c442a48b req-b4a9b7d5-c2b0-4ce0-8b48-6cae840d5968 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:19.891537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a8231ac6-097b-4bad-ad25-ceb4c442a48b req-b4a9b7d5-c2b0-4ce0-8b48-6cae840d5968 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:19.929369 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a8231ac6-097b-4bad-ad25-ceb4c442a48b req-b4a9b7d5-c2b0-4ce0-8b48-6cae840d5968 service nova] Creating event network-changed:da0dbb4c-1902-431d-bf2a-102b1b5e2ad3 for instance adf95372-e587-4ff1-b0ad-168c53b2732a on nch1-master-1 Jun 18 22:02:19.955870 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a8231ac6-097b-4bad-ad25-ceb4c442a48b req-b4a9b7d5-c2b0-4ce0-8b48-6cae840d5968 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090227 Jun 18 22:02:19.957223 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 200/386] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:02:19.977128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:19.979271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:19.993487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:20.000420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:20.001635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:20.002258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:21.158795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:21.169483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c09395e-f4f7-4254-bfa2-788b2274d6f9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 200 len: 1589 microversion: 2.1 time: 1.364055 Jun 18 22:02:21.182775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 187/387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:19 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 1589 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:21.195918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=18 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:21.278865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:21.287430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ce91941-972f-40c7-a3fc-3d80a8509d35 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 1.320419 Jun 18 22:02:21.297153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 201/388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:19 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:22.305700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:22.307323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:22.318594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:22.322612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:22.323650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:22.328422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:22.330823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:22.732511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:22.741723 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb909fe8-5b4f-4cc5-8b19-c935b4709975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.441107 Jun 18 22:02:22.747425 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 188/389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:22 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:23.048044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1dbc1305-ef9f-48a7-a13f-e9084be7b6d0 req-0e4938a9-30e7-43a4-b289-577eaacbfbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:23.058390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1dbc1305-ef9f-48a7-a13f-e9084be7b6d0 req-0e4938a9-30e7-43a4-b289-577eaacbfbb6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:23.059214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1dbc1305-ef9f-48a7-a13f-e9084be7b6d0 req-0e4938a9-30e7-43a4-b289-577eaacbfbb6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:23.075526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1dbc1305-ef9f-48a7-a13f-e9084be7b6d0 req-0e4938a9-30e7-43a4-b289-577eaacbfbb6 service nova] Creating event network-changed:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:02:23.095199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1dbc1305-ef9f-48a7-a13f-e9084be7b6d0 req-0e4938a9-30e7-43a4-b289-577eaacbfbb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056663 Jun 18 22:02:23.096180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 202/390] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:24.116366 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-820da828-66d8-4a0f-a861-5373470ba8fa tempest-TenantUsagesNegativeTestJSON-202773593 tempest-TenantUsagesNegativeTestJSON-202773593-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-17T22%3A02%3A23.558697&end=2022-06-19T22%3A02%3A23.558697" status: 404 len: 112 microversion: - time: 0.553866 Jun 18 22:02:24.117952 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 189/391] 10.222.0.30 () {58 vars in 1315 bytes} [Sat Jun 18 22:02:23 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-17T22%3A02%3A23.558697&end=2022-06-19T22%3A02%3A23.558697 => generated 112 bytes in 556 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 22:02:24.126829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:24.127439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:24.144178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:24.144697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:24.150508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:24.151045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:24.204984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1982049426", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:24.285082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:24.471296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:24.483436 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9dbee265-cd48-49b2-8dfa-2d9b903ad61a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.364475 Jun 18 22:02:24.487715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 190/392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:24 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:24.505511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bc280b7-9706-41a8-884a-cd2383bb76fc tempest-TenantUsagesNegativeTestJSON-202773593 tempest-TenantUsagesNegativeTestJSON-202773593-project-admin] Calling method '.version_select at 0x7fea14b3da60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:24.520774 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3bc280b7-9706-41a8-884a-cd2383bb76fc tempest-TenantUsagesNegativeTestJSON-202773593 tempest-TenantUsagesNegativeTestJSON-202773593-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bc280b7-9706-41a8-884a-cd2383bb76fc tempest-TenantUsagesNegativeTestJSON-202773593 tempest-TenantUsagesNegativeTestJSON-202773593-project-admin] Request method failure captured: Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-simple-tenant-usage/83b48069cb8e4096b3832bcb6418e322?start=2022-06-19T22%3A02%3A23.558697&end=2022-06-17T22%3A02%3A23.558697 HTTP/1.1 Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktvOeBLUugWbSzEqIALAbqBs_XtRJquMigKdvlN3HhLu45HNfETp_r3fTXg3eRYjFpcnKA08o-46e06n0hi3rl-uM4hmkMSytZ1A7R8enJhIQnmzNMGhyx7L_khOG1b6ijcdxHbreVk_81ZG6821rynNKOQHgD1Fr0Nizo9UgXwqxI Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e33f3ce9021643ac99ea26b034d319d0 Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-202773593 Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:02:24.523535 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e33f3ce9021643ac99ea26b034d319d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e33f3ce9021643ac99ea26b034d319d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e33f3ce9021643ac99ea26b034d319d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e33f3ce9021643ac99ea26b034d319d0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-202773593 Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e33f3ce9021643ac99ea26b034d319d0 Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-202773593 Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TenantUsagesNegativeTestJSON-202773593-project-admin Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 9350658ba89742da93fe72a8795fd8e9 Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-202773593-project-admin Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid start time. The start time cannot occur after the end time. Jun 18 22:02:24.525226 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '83b48069cb8e4096b3832bcb6418e322'} Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 18 22:02:24.526106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 18 22:02:24.527381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:24.532874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bc280b7-9706-41a8-884a-cd2383bb76fc tempest-TenantUsagesNegativeTestJSON-202773593 tempest-TenantUsagesNegativeTestJSON-202773593-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:24.534052 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3bc280b7-9706-41a8-884a-cd2383bb76fc tempest-TenantUsagesNegativeTestJSON-202773593 tempest-TenantUsagesNegativeTestJSON-202773593-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/83b48069cb8e4096b3832bcb6418e322?start=2022-06-19T22%3A02%3A23.558697&end=2022-06-17T22%3A02%3A23.558697" status: 400 len: 111 microversion: 2.1 time: 0.042809 Jun 18 22:02:24.534968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 191/393] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Jun 18 22:02:24 2022] GET /compute/v2.1/os-simple-tenant-usage/83b48069cb8e4096b3832bcb6418e322?start=2022-06-19T22%3A02%3A23.558697&end=2022-06-17T22%3A02%3A23.558697 => generated 111 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:02:24.612471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=14 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:25.168592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24bda181-7cee-49f8-bcf6-238d7872cf8a tempest-TenantUsagesNegativeTestJSON-2006668234 tempest-TenantUsagesNegativeTestJSON-2006668234-project] Calling method '.version_select at 0x7fea14b5b160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:25.172413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24bda181-7cee-49f8-bcf6-238d7872cf8a tempest-TenantUsagesNegativeTestJSON-2006668234 tempest-TenantUsagesNegativeTestJSON-2006668234-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '46a9ee6642b4477d9f96934e9d91cc47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b48069cb8e4096b3832bcb6418e322', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24bda181-7cee-49f8-bcf6-238d7872cf8a tempest-TenantUsagesNegativeTestJSON-2006668234 tempest-TenantUsagesNegativeTestJSON-2006668234-project] Request method failure captured: Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-17T22%3A02%3A23.558697&end=2022-06-19T22%3A02%3A23.558697&detailed=1 HTTP/1.1 Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkttzJnuBgUKFOqpm2faTCj-3ht8Qp6L44lsKYgaHB9zwYM3hMuWDUP2UJkfGeo2xdoQHhJq2TgAgfxhE8OzLLAaw_n3lEWdSHV-AtXk3p8W-VKkQTA0QVqGYgDivCz1NQcmQB_HtxI79mp3snETDo6ngHICKiTGC8-wqMLvlz0IGGU Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 83b48069cb8e4096b3832bcb6418e322 Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2006668234 Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:02:25.175524 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/83b48069cb8e4096b3832bcb6418e322"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/83b48069cb8e4096b3832bcb6418e322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/83b48069cb8e4096b3832bcb6418e322"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_83b48069cb8e4096b3832bcb6418e322", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2006668234 Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 83b48069cb8e4096b3832bcb6418e322 Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2006668234 Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TenantUsagesNegativeTestJSON-2006668234-project Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 46a9ee6642b4477d9f96934e9d91cc47 Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2006668234-project Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: action_args: {} Jun 18 22:02:25.176822 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:02:25.177593 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:02:25.178618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:02:25.181404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 18 22:02:25.181404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:02:25.181404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24bda181-7cee-49f8-bcf6-238d7872cf8a tempest-TenantUsagesNegativeTestJSON-2006668234 tempest-TenantUsagesNegativeTestJSON-2006668234-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:25.181404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24bda181-7cee-49f8-bcf6-238d7872cf8a tempest-TenantUsagesNegativeTestJSON-2006668234 tempest-TenantUsagesNegativeTestJSON-2006668234-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-17T22%3A02%3A23.558697&end=2022-06-19T22%3A02%3A23.558697&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.633716 Jun 18 22:02:25.185442 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 192/394] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Jun 18 22:02:24 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-17T22%3A02%3A23.558697&end=2022-06-19T22%3A02%3A23.558697&detailed=1 => generated 123 bytes in 645 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:02:25.216989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:25.217939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:25.218508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:25.218987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:25.219472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:25.239839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:25.242000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:25.244712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:25.245789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:25.277671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Getting quotas for project 8a610355b4324f8f8bac4b1673685d44. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:25.283430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Getting quotas for user 02a8362ef1d14be9b41ba2e6c904807f and project 8a610355b4324f8f8bac4b1673685d44. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:25.299890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:25.304243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:25.394531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0116bc0e-49f6-43bc-ab31-061e06bec513 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.739904 Jun 18 22:02:25.395667 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 203/395] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:02:25.409722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2a8f626-965b-4df5-87d4-f2d550ed2515 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:25.410610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2a8f626-965b-4df5-87d4-f2d550ed2515 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:25.509162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:25.511322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:25.523893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:25.527695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:25.530765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:25.531217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:25.693569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2a8f626-965b-4df5-87d4-f2d550ed2515 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:25.701888 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2a8f626-965b-4df5-87d4-f2d550ed2515 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1219 microversion: 2.1 time: 0.299165 Jun 18 22:02:25.711465 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 193/396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:25 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:26.113982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:26.127226 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a6d16d5a-d96e-4283-a376-c4e94a9de56f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.626820 Jun 18 22:02:26.138821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 204/397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:25 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:26.720593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:26.722869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:26.734588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:26.740270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:26.742400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:26.744075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:26.746495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:27.147327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:27.147949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:27.170641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:27.171098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:27.171904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:27.172333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:27.236644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:27.250497 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c997cf7-8d4b-41ae-9003-558fa1c71ec9 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1215 microversion: 2.1 time: 0.535422 Jun 18 22:02:27.256928 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 194/398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:26 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1215 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:27.979246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:27.991939 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d231c9a7-7d3b-434a-ac52-07ac02d0a3a9 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.849563 Jun 18 22:02:28.008210 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 205/399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:27 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:28.422081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a549c3fd-c3db-4c76-a44e-408f8c1ff700 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-160617548", "id": 568854051, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:28.429156 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:28.429156 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:28.450463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d5cd80b-5c38-41ad-a018-0556f4bb591b tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-852416510", "id": 1005005686, "os-flavor-access:is_public": "False"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:28.452359 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:28.452359 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:28.458131 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a549c3fd-c3db-4c76-a44e-408f8c1ff700 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.454190 Jun 18 22:02:28.461154 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 195/400] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:02:28 2022] POST /compute/v2.1/flavors => generated 464 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:02:28.467536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:28.468498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:28.497360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:28.498066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:28.498995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:28.503326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:28.530890 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d5cd80b-5c38-41ad-a018-0556f4bb591b tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.459918 Jun 18 22:02:28.533827 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 206/401] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:28 2022] POST /compute/v2.1/flavors => generated 430 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:02:28.700305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:28.712235 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1002a91d-7a94-4e43-8117-ceca7c865720 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1277 microversion: 2.1 time: 0.249853 Jun 18 22:02:28.717394 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 196/402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:28 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:28.729638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e4fd76d4-675e-4c12-b453-f2178a6934e3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a73f88f132ef42e791a97ee1e21ca4e2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:28.740419 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:28.740419 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:28.793246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b8136600-b956-47d9-9bd7-8dce996cc967 tempest-FlavorsV261TestJSON-701491080 tempest-FlavorsV261TestJSON-701491080-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:28.808334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b8136600-b956-47d9-9bd7-8dce996cc967 tempest-FlavorsV261TestJSON-701491080 tempest-FlavorsV261TestJSON-701491080-project] 10.222.0.30 "GET /compute/v2.1/flavors/568854051" status: 200 len: 464 microversion: 2.61 time: 0.270544 Jun 18 22:02:28.813466 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 207/403] 10.222.0.30 () {60 vars in 1195 bytes} [Sat Jun 18 22:02:28 2022] GET /compute/v2.1/flavors/568854051 => generated 464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:28.820967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-664432db-50a0-4fcb-a427-0bf5b0e54438 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] Action: 'update', calling method: .version_select at 0x7fea171381f0>, body: {"flavor": {"description": "new"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:28.855547 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:28.855547 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:28.909501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e4fd76d4-675e-4c12-b453-f2178a6934e3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1005005686/action" status: 200 len: 97 microversion: 2.1 time: 0.188589 Jun 18 22:02:28.912679 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 197/404] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:02:28 2022] POST /compute/v2.1/flavors/1005005686/action => generated 97 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:28.945061 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-664432db-50a0-4fcb-a427-0bf5b0e54438 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/568854051" status: 200 len: 465 microversion: 2.61 time: 0.127926 Jun 18 22:02:28.956220 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 208/405] 10.222.0.30 () {62 vars in 1215 bytes} [Sat Jun 18 22:02:28 2022] PUT /compute/v2.1/flavors/568854051 => generated 465 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:28.965781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d01718ae-aee7-4565-8fbe-9b027db5aed5 tempest-FlavorsV261TestJSON-701491080 tempest-FlavorsV261TestJSON-701491080-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.057153 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d01718ae-aee7-4565-8fbe-9b027db5aed5 tempest-FlavorsV261TestJSON-701491080 tempest-FlavorsV261TestJSON-701491080-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.099532 Jun 18 22:02:29.058250 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 209/406] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:02:28 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:29.064710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.065377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:29.072099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:29.072820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:29.073789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:29.074376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:29.219442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24ee9beb-927e-467d-816a-23d1bedb7786 tempest-FlavorsAccessTestJSON-1071337740 tempest-FlavorsAccessTestJSON-1071337740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.270968 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24ee9beb-927e-467d-816a-23d1bedb7786 tempest-FlavorsAccessTestJSON-1071337740 tempest-FlavorsAccessTestJSON-1071337740-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6655 microversion: 2.1 time: 0.352035 Jun 18 22:02:29.272426 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 198/407] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:28 2022] GET /compute/v2.1/flavors/detail => generated 6655 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:29.280503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79f70517-c66a-42da-a423-372e6abb6542 tempest-FlavorsV261TestJSON-701491080 tempest-FlavorsV261TestJSON-701491080-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.306018 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79f70517-c66a-42da-a423-372e6abb6542 tempest-FlavorsV261TestJSON-701491080 tempest-FlavorsV261TestJSON-701491080-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.032121 Jun 18 22:02:29.307648 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 199/408] 10.222.0.30 () {60 vars in 1165 bytes} [Sat Jun 18 22:02:29 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:29.314196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ef27246-d2d3-4e0f-ac1e-0230cc6f1dc8 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a73f88f132ef42e791a97ee1e21ca4e2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:29.315783 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:29.315783 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:29.348427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:29.359618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-743bde71-e060-4a80-90bc-76b0193fcc1f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.299976 Jun 18 22:02:29.361185 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 210/409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:29 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:29.366366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-42a4caa0-bc17-473d-b7a2-b969b40bd7c3 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.367429 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:29.367429 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:29.388478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-42a4caa0-bc17-473d-b7a2-b969b40bd7c3 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/568854051" status: 202 len: 0 microversion: 2.61 time: 0.025805 Jun 18 22:02:29.393745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 211/410] 10.222.0.30 () {60 vars in 1198 bytes} [Sat Jun 18 22:02:29 2022] DELETE /compute/v2.1/flavors/568854051 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:02:29.406738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f383d05-7eb5-4ae9-a334-f229b75fd497 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.454050 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f383d05-7eb5-4ae9-a334-f229b75fd497 tempest-FlavorsV261TestJSON-546414691 tempest-FlavorsV261TestJSON-546414691-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6701 microversion: 2.61 time: 0.058784 Jun 18 22:02:29.465199 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 212/411] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:02:29 2022] GET /compute/v2.1/flavors/detail => generated 6701 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:29.732261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:29.732951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:29.744289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:29.744756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:29.749798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:29.750294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:29.904633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:29.923202 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9eb9d8c6-eabb-477c-b134-73fa3a3e7754 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1277 microversion: 2.1 time: 0.193102 Jun 18 22:02:29.925266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 213/412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:29 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:30.142160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:30.149877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ef27246-d2d3-4e0f-ac1e-0230cc6f1dc8 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1005005686/action" status: 200 len: 21 microversion: 2.1 time: 0.840230 Jun 18 22:02:30.150510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 200/413] 10.222.0.30 () {60 vars in 1199 bytes} [Sat Jun 18 22:02:29 2022] POST /compute/v2.1/flavors/1005005686/action => generated 21 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:30.164060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d77db3f-304f-4c07-8b9b-93bcb9a975c2 tempest-FlavorsAccessTestJSON-1071337740 tempest-FlavorsAccessTestJSON-1071337740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.240672 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d77db3f-304f-4c07-8b9b-93bcb9a975c2 tempest-FlavorsAccessTestJSON-1071337740 tempest-FlavorsAccessTestJSON-1071337740-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.083112 Jun 18 22:02:30.256434 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 214/414] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:30.262236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a707d8fc-c549-498a-a555-3c7b261fcdba tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.263830 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:30.263830 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:30.298678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a707d8fc-c549-498a-a555-3c7b261fcdba tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1005005686" status: 202 len: 0 microversion: 2.1 time: 0.044289 Jun 18 22:02:30.301922 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 201/415] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:02:30 2022] DELETE /compute/v2.1/flavors/1005005686 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:02:30.310350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-984d9ba2-01a6-4ae1-9e1c-d1b4b5c3350d tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.378140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.378792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:30.379534 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-984d9ba2-01a6-4ae1-9e1c-d1b4b5c3350d tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.073186 Jun 18 22:02:30.391097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:30.391828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:30.394627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:30.396203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:30.398830 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 215/416] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:30.439507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de66a00b-c5bf-44ee-ae03-9bd30f39fdb7 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-165866857", "id": 1268439478, "os-flavor-access:is_public": "False"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:30.452348 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:30.452348 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:30.500248 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de66a00b-c5bf-44ee-ae03-9bd30f39fdb7 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.100233 Jun 18 22:02:30.523567 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 216/417] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:30 2022] POST /compute/v2.1/flavors => generated 430 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:30.544210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f7216885-0811-4f2c-826e-cd80413be3c3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.545417 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:30.545417 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:30.557408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=7,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:30.574788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f7216885-0811-4f2c-826e-cd80413be3c3 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1268439478/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.049688 Jun 18 22:02:30.582623 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 217/418] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:02:30 2022] GET /compute/v2.1/flavors/1268439478/os-flavor-access => generated 21 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:30.602216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3cff2b66-da97-447a-810a-9508263214f6 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.605628 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:30.605628 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:30.664255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3cff2b66-da97-447a-810a-9508263214f6 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1268439478" status: 202 len: 0 microversion: 2.1 time: 0.079164 Jun 18 22:02:30.666556 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 218/419] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:02:30 2022] DELETE /compute/v2.1/flavors/1268439478 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:02:30.682338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0724926-2166-4320-8585-f8384a665e81 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.733738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0724926-2166-4320-8585-f8384a665e81 tempest-FlavorsAccessTestJSON-1082764519 tempest-FlavorsAccessTestJSON-1082764519-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.057721 Jun 18 22:02:30.735805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 219/420] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:30 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:30.945454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:30.946583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:30.957005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:30.958633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:30.969202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:30.969947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:31.144890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:31.158564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da6ac543-f5ca-402e-a0eb-71fd68569303 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1277 microversion: 2.1 time: 0.218811 Jun 18 22:02:31.159153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 220/421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:30 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:31.200690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:31.214347 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-acb83e67-cd3b-48de-8e3e-9fa946f72db5 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.841420 Jun 18 22:02:31.216175 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 202/422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:30 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:32.176889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:32.177408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:32.188292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:32.188648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:32.189449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:32.189881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:32.231790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:32.232423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:32.240300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:32.240760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:32.241573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:32.242001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:32.705593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:32.713293 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-776669dc-6c2e-4344-b873-7e4b36bfccdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 0.540972 Jun 18 22:02:32.715198 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 221/423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:32 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:32.735841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:32.744216 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dec633a1-56ef-486e-b789-f0803b5f9321 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.516300 Jun 18 22:02:32.756111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 203/424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:32 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:33.183874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3eb6f67b-a87d-4a64-8258-24e778f7fdf9 req-5b259487-2488-4670-baba-26dc37d85b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "name": "network-vif-plugged", "status": "completed", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:33.207183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3eb6f67b-a87d-4a64-8258-24e778f7fdf9 req-5b259487-2488-4670-baba-26dc37d85b87 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:33.207719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3eb6f67b-a87d-4a64-8258-24e778f7fdf9 req-5b259487-2488-4670-baba-26dc37d85b87 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:33.234432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3eb6f67b-a87d-4a64-8258-24e778f7fdf9 req-5b259487-2488-4670-baba-26dc37d85b87 service nova] Creating event network-vif-plugged:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:02:33.243602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3eb6f67b-a87d-4a64-8258-24e778f7fdf9 req-5b259487-2488-4670-baba-26dc37d85b87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063275 Jun 18 22:02:33.244786 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 222/425] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:33.732666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:33.734149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:33.749173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:33.750157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:33.752813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:33.754925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:33.763884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:33.764755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:33.772847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:33.782614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:33.783759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:33.784444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:33.804932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:34.409304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:34.421596 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-81d0bdee-94aa-4138-995d-65eb37a49e39 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1324 microversion: 2.1 time: 0.662046 Jun 18 22:02:34.444275 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 223/426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:33 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:34.650944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a61e0182-91e6-45c7-ad41-ba50bc2a0839 req-8bfeb896-3972-4e57-9ea8-de5fa2817f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d039b9-d9c8-4691-b4ad-f293cd66d34e", "tag": "927caece-c695-4502-92bf-7789cee05a54"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:34.664980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a61e0182-91e6-45c7-ad41-ba50bc2a0839 req-8bfeb896-3972-4e57-9ea8-de5fa2817f65 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:34.667653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a61e0182-91e6-45c7-ad41-ba50bc2a0839 req-8bfeb896-3972-4e57-9ea8-de5fa2817f65 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:34.695260 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a61e0182-91e6-45c7-ad41-ba50bc2a0839 req-8bfeb896-3972-4e57-9ea8-de5fa2817f65 service nova] Creating event network-changed:927caece-c695-4502-92bf-7789cee05a54 for instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e on nch2-master-1 Jun 18 22:02:34.716372 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a61e0182-91e6-45c7-ad41-ba50bc2a0839 req-8bfeb896-3972-4e57-9ea8-de5fa2817f65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069838 Jun 18 22:02:34.717613 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 224/427] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:34.757143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:34.790419 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0dfbbeac-cf2e-4e2b-acaa-917ea9781782 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 1.062629 Jun 18 22:02:34.797765 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 204/428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:33 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:35.094428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69119b50-08af-492e-a8d0-710641ae63cc tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14cd4e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:35.195625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69119b50-08af-492e-a8d0-710641ae63cc tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d" status: 200 len: 635 microversion: 2.1 time: 0.106261 Jun 18 22:02:35.196208 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 225/429] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:02:35 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d => generated 635 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:35.210577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56973d47-3b90-48de-9fc1-8919f1a083cc tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14acad30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:35.325402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-56973d47-3b90-48de-9fc1-8919f1a083cc tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:35.339075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-56973d47-3b90-48de-9fc1-8919f1a083cc tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:35.459011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:35.462859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:35.484326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:35.489465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:35.523840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:35.524307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:35.527856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:35.528319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:35.922063 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56973d47-3b90-48de-9fc1-8919f1a083cc tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.715382 Jun 18 22:02:35.930731 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 205/430] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:35 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:35.944126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:35.945340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:35.978088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:35.980729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:35.990140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:35.993576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:36.320739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:36.343924 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d05e5527-4503-4470-8871-9ce34b423182 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1520 microversion: 2.1 time: 0.882085 Jun 18 22:02:36.344962 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 226/431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:35 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1520 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:36.368044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d82129b2-4d8b-40ea-b904-13bc627477f4 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14c1d4c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:36.714673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:36.730924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08467fc5-f5c4-4d69-9e1c-d8e2a5ee7350 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 0.797271 Jun 18 22:02:36.734935 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 206/432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:35 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:36.745466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-778036cb-ed55-4579-aca9-1b36a9bc3a84 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'create', calling method: .version_select at 0x7fea14b6f700>, body: {"pool": null} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:37.155711 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d82129b2-4d8b-40ea-b904-13bc627477f4 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "DELETE /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.808200 Jun 18 22:02:37.156482 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 227/433] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Jun 18 22:02:36 2022] DELETE /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata/os_version => generated 0 bytes in 810 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:02:37.165151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-024dfe76-f7f9-46c8-9e13-6ee9d1f03abf tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14d9d1f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:37.239186 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-024dfe76-f7f9-46c8-9e13-6ee9d1f03abf tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.077994 Jun 18 22:02:37.241287 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 228/434] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:02:37 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 37 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:02:37.274053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f657841d-62dc-4712-bdfb-6ccac5682845 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14bf6280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:37.365988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f657841d-62dc-4712-bdfb-6ccac5682845 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:37.370868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f657841d-62dc-4712-bdfb-6ccac5682845 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:37.936909 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f657841d-62dc-4712-bdfb-6ccac5682845 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.688665 Jun 18 22:02:37.938458 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 229/435] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:37 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:38.528719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1256051703", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:38.644432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:39.591200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:39.592563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:39.593255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:39.593881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:39.596925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:39.615066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:39.615521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:39.616904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:39.617382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:39.646649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Getting quotas for project c5ee47070e2e4d1da7f730e525068554. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:39.651526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Getting quotas for user dcba179f9ae842e0a47dbe13e661f042 and project c5ee47070e2e4d1da7f730e525068554. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:39.667637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:39.670364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:39.741105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0829158-bfd0-4b97-9011-5c861b7e676c tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800667 Jun 18 22:02:39.742164 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 230/436] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:02:39.748483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:39.750166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:39.763340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:39.764247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:39.765591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:39.766210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:40.423673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:40.437116 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc50e357-2970-4077-9c73-4fd0d7fc529f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 0.693323 Jun 18 22:02:40.439192 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 231/437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:39 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:40.444504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45bc44bc-a547-45aa-a8b7-c9d1595e261f tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14c1df70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:40.520376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45bc44bc-a547-45aa-a8b7-c9d1595e261f tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.079099 Jun 18 22:02:40.521600 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 232/438] 10.222.0.30 () {58 vars in 1289 bytes} [Sat Jun 18 22:02:40 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata/os_distro => generated 33 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:40.523348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45bc44bc-a547-45aa-a8b7-c9d1595e261f tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:40.528501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45bc44bc-a547-45aa-a8b7-c9d1595e261f tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003690 Jun 18 22:02:40.529260 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 233/439] 10.222.0.30 () {56 vars in 885 bytes} [Sat Jun 18 22:02:40 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 18 22:02:40.556804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:40.557932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:40.571718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:40.572946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:40.574833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:40.575473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:40.720325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:40.735936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-073f0999-d323-4e55-a008-30f8b0bbf60d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1219 microversion: 2.1 time: 0.203020 Jun 18 22:02:40.737315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 234/440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:40 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1219 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:40.743947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a5fe295-7de8-402e-8e2a-7a24ca42bfd6 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14c15ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:40.843802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a5fe295-7de8-402e-8e2a-7a24ca42bfd6 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:40.853618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a5fe295-7de8-402e-8e2a-7a24ca42bfd6 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:41.529794 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a5fe295-7de8-402e-8e2a-7a24ca42bfd6 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.790761 Jun 18 22:02:41.530916 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 235/441] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:40 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:41.544475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:41.546311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:41.554083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:41.554875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:41.556696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:41.557545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:41.997776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:42.005924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-778036cb-ed55-4579-aca9-1b36a9bc3a84 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.267584 Jun 18 22:02:42.010377 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 207/442] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:02:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:42.034341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eed23fb8-9c39-4004-be37-25fd500d223c tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14a809d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:42.049754 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7e40bcb6-a2af-4f90-a6cc-c1d316130553 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 0.508801 Jun 18 22:02:42.052011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 236/443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:41 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:42.073863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:42.078417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:42.092145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:42.092829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:42.094506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:42.095309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:42.125374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eed23fb8-9c39-4004-be37-25fd500d223c tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.113423 Jun 18 22:02:42.128951 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 208/444] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:02:42 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:42.146486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81ca95bf-caf9-4ef1-a60b-79de7490eb9a tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14aca9d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:42.236082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-81ca95bf-caf9-4ef1-a60b-79de7490eb9a tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:42.255493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-81ca95bf-caf9-4ef1-a60b-79de7490eb9a tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:42.418389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:42.427119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f86a6a74-3819-4a78-98d0-e000adfafa44 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1281 microversion: 2.1 time: 0.372589 Jun 18 22:02:42.445098 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 237/445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:42 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1281 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:42.450265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-519689506", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e17875e3-e111-45e6-a0c0-c6b1e856376c"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:42.523396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] validate_networks() for [('e17875e3-e111-45e6-a0c0-c6b1e856376c', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:42.695955 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81ca95bf-caf9-4ef1-a60b-79de7490eb9a tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.558801 Jun 18 22:02:42.702236 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 209/446] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:42 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:42.919191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-185328341", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "739254b4-0b9e-4570-96ec-dfd475b9db29"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:43.006688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] validate_networks() for [('739254b4-0b9e-4570-96ec-dfd475b9db29', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:43.281666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:43.283308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:43.284133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:43.284755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:43.285366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:43.305861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:43.306648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:43.307681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:43.308361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:43.346066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Getting quotas for project 7b63c52467494445b437e444a52e075e. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:43.356233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Getting quotas for user 58c3911cbbdf4e35ae8df9eb8b23f22d and project 7b63c52467494445b437e444a52e075e. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:43.394373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:43.406518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:43.487742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b8e84ba5-f97d-4e22-b4f1-eb3b1bb39f86 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041233 Jun 18 22:02:43.494243 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 238/447] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:02:43.501054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-738b40d9-1477-436f-8c03-c5dc4307d0b2 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14cd4b80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:43.594513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-738b40d9-1477-436f-8c03-c5dc4307d0b2 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:43.602403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-738b40d9-1477-436f-8c03-c5dc4307d0b2 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:44.041269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:44.041673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:44.042359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:44.042776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:44.043196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:44.064878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.065637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:44.066613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.071967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:44.121127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:44.135713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for user 681cfb0e560145b4abef98dbd417f3e0 and project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:44.166155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:44.168498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:44.289526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-850717ad-91bb-4873-a0f1-db83302510ba tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585426 Jun 18 22:02:44.295487 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 210/448] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:02:44.316199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-50191e4f-ec42-4b50-a641-08bbfbf7927e req-21dd29e0-0c0f-44ad-a734-a07849da93c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d039b9-d9c8-4691-b4ad-f293cd66d34e", "name": "network-vif-plugged", "status": "completed", "tag": "927caece-c695-4502-92bf-7789cee05a54"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:44.339913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-50191e4f-ec42-4b50-a641-08bbfbf7927e req-21dd29e0-0c0f-44ad-a734-a07849da93c3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.341917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-50191e4f-ec42-4b50-a641-08bbfbf7927e req-21dd29e0-0c0f-44ad-a734-a07849da93c3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:44.385262 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-50191e4f-ec42-4b50-a641-08bbfbf7927e req-21dd29e0-0c0f-44ad-a734-a07849da93c3 service nova] Creating event network-vif-plugged:927caece-c695-4502-92bf-7789cee05a54 for instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e on nch2-master-1 Jun 18 22:02:44.396493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-50191e4f-ec42-4b50-a641-08bbfbf7927e req-21dd29e0-0c0f-44ad-a734-a07849da93c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099584 Jun 18 22:02:44.400159 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 211/449] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:44.420227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:44.422470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:44.464447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.468475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:44.470470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.473079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:44.480711 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-738b40d9-1477-436f-8c03-c5dc4307d0b2 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.984835 Jun 18 22:02:44.481527 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 239/450] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:43 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 64 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:44.492991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:44.493662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:44.542017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.544038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:44.545680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:44.550063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:45.281786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:45.291654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:45.293308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=84 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:45.301509 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b916196-102a-4427-9aa4-30725bebebdb tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 0.898459 Jun 18 22:02:45.302171 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 212/451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:44 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:45.318408 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-402cca9d-49c0-48ed-9cb5-8c8d191f98ca tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.831169 Jun 18 22:02:45.331935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:45.338034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:45.370600 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 240/452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:44 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:45.390589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:45.391477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:45.393127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:45.395797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:45.405844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:45.406677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:45.448883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:45.452666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:45.469379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:45.470277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:45.674056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:45.677746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:45.689297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce372f84-1e81-430e-bf63-52b1bcd7717c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1214 microversion: 2.1 time: 0.317162 Jun 18 22:02:45.697272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4c1d99b-c593-4c3d-850e-10eaf71f8c09 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1275 microversion: 2.1 time: 0.393187 Jun 18 22:02:45.697796 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 241/453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:45 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:45.698627 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 213/454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:45 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1275 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:45.725785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54460c2d-088c-4ad7-af2f-0ae48887bc43 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14cc2790>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:45.817520 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-54460c2d-088c-4ad7-af2f-0ae48887bc43 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.105339 Jun 18 22:02:45.818659 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 242/455] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:02:45 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 64 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:45.828960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9bd9fbf-1cca-4e48-ad86-bcf52a2407b4 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14b6f4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:45.939853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a9bd9fbf-1cca-4e48-ad86-bcf52a2407b4 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:45.947979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a9bd9fbf-1cca-4e48-ad86-bcf52a2407b4 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:46.319534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:46.320156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:46.336186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:46.336655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:46.337486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:46.351404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:46.535138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9bd9fbf-1cca-4e48-ad86-bcf52a2407b4 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.710074 Jun 18 22:02:46.535846 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 214/456] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:45 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:46.541017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:46.542045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:46.552790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:46.553625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:46.554620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:46.556328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:46.704964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:46.734057 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ff234e7-309d-4840-9f81-4e6899eaa70d tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1319 microversion: 2.1 time: 0.418422 Jun 18 22:02:46.734655 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 243/457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:46 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:46.749503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f7e086a-7ef6-4d35-babe-c8e74fe12c9e tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update', calling method: .version_select at 0x7fea14c15940>, body: {"meta": {"os_version": "alt"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:46.845113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:46.880135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7f7e086a-7ef6-4d35-babe-c8e74fe12c9e tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:46.883678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-773a9b14-7260-49e7-9f62-40f699f529ec tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.344338 Jun 18 22:02:46.884570 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 215/458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:46 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:46.895145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:46.895370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7f7e086a-7ef6-4d35-babe-c8e74fe12c9e tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:46.895850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:46.909800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:46.915076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:46.915540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:46.916336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:46.917190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:47.140643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:47.154003 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5e79a301-4d10-42c1-ad00-dc374b874da8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1270 microversion: 2.1 time: 0.265327 Jun 18 22:02:47.154871 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 216/459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:46 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:47.168050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:47.169336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:47.192899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:47.193559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:47.195310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:47.198484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:47.325445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:47.334819 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1914d67-9c9a-4b8e-b0be-f4850d302855 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1281 microversion: 2.1 time: 0.178000 Jun 18 22:02:47.335416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 217/460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:47 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:47.503447 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f7e086a-7ef6-4d35-babe-c8e74fe12c9e tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.764377 Jun 18 22:02:47.504640 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 244/461] 10.222.0.30 () {60 vars in 1312 bytes} [Sat Jun 18 22:02:46 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata/os_version => generated 31 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:47.514862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d70bcd9-1f25-455c-ba0f-922110c6ee06 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14a80700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:47.578914 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d70bcd9-1f25-455c-ba0f-922110c6ee06 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.068409 Jun 18 22:02:47.579586 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 218/462] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:02:47 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 58 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:47.591097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-91aa4837-9b56-4989-818b-887bf9fae0c5 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'update_all', calling method: .version_select at 0x7fea14b84dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:47.673022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-91aa4837-9b56-4989-818b-887bf9fae0c5 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:47.684202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-91aa4837-9b56-4989-818b-887bf9fae0c5 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:47.752954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:47.753671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:47.762698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:47.763218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:47.764494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:47.765210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:47.998537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:48.010665 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a360ecff-3344-4ad4-af17-39115de167c3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1469 microversion: 2.1 time: 0.262465 Jun 18 22:02:48.023786 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 219/463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:47 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:48.219155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-91aa4837-9b56-4989-818b-887bf9fae0c5 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.633332 Jun 18 22:02:48.225175 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 245/464] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:02:47 2022] PUT /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 61 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:48.231015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:48.231802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:48.252132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:48.252998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:48.254033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:48.255255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:48.429017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1154674907", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "39432198-5051-484b-846b-d7e8994b5707"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:48.450774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:48.463552 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-662176d4-47b3-4d45-9aa5-688a92207154 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.237012 Jun 18 22:02:48.464532 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 246/465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:48 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:48.527366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] validate_networks() for [('39432198-5051-484b-846b-d7e8994b5707', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:48.743870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-659025313", "block_migration": true, "disk_over_commit": false}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:48.745349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:48.791374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:48.792211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:48.796073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:48.796744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.005356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lazy-loading 'flavor' on Instance uuid 90d039b9-d9c8-4691-b4ad-f293cd66d34e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:02:49.126989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Going to try to live migrate instance to tempest-host-659025313 {{(pid=130902) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:02:49.142758 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] HTTP exception thrown: Compute host tempest-host-659025313 could not be found. Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Request method failure captured: Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e/action HTTP/1.1 Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 106 Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktv6nWDrIt9PlkJ0oEn7ZCgs-TUt13O6-6pZdLwl_SCQ3m_d01Pnye-wjP3-t_hUpoMDWT67E59rPcyisO3EefVjjVRcELoPPsCFWrfPQQao3g9Pq7ChV-LpvNsHecTantjgid3xy1kX71HtgWaLHXkWfm8pEkrt4pk_-ZX3NSK8yw Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 5faaae9647da4088a0abfba5c48320b2 Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-LiveMigrationNegativeTest-756821475 Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:02:49.151543 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5faaae9647da4088a0abfba5c48320b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5faaae9647da4088a0abfba5c48320b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5faaae9647da4088a0abfba5c48320b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5faaae9647da4088a0abfba5c48320b2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-LiveMigrationNegativeTest-756821475 Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 5faaae9647da4088a0abfba5c48320b2 Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-756821475 Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-LiveMigrationNegativeTest-756821475-project-admin Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d23a12015c6e436786b575431bc643d2 Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-LiveMigrationNegativeTest-756821475-project-admin Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: {"os-migrateLive": {"host": "tempest-host-659025313", "block_migration": true, "disk_over_commit": false}} Jun 18 22:02:49.153107 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: exception: Compute host tempest-host-659025313 could not be found. Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '90d039b9-d9c8-4691-b4ad-f293cd66d34e', 'body': {'os-migrateLive': {'host': 'tempest-host-659025313', 'block_migration': True, 'disk_over_commit': False}}} Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:02:49.154134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-659025313 could not be found. Jun 18 22:02:49.155448 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-659025313 could not be found. Jun 18 22:02:49.156835 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-659025313 could not be found. Jun 18 22:02:49.158306 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:02:49.162616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Returning 400 to user: Compute host tempest-host-659025313 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:02:49.163671 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3e22a0d-001d-484e-a2a5-76c6df07b59a tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e/action" status: 400 len: 99 microversion: 2.1 time: 0.698019 Jun 18 22:02:49.164424 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 247/466] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Jun 18 22:02:48 2022] POST /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e/action => generated 99 bytes in 699 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:02:49.175551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:49.176460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:49.188949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.189490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.190612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.191607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.263619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:49.264258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:49.264943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:49.265598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:49.266015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:49.286179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.286965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.287794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.290651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.315431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:49.319719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:49.321376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for user 76897f7be7494bb589de747493240449 and project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:49.329533 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed26a4b0-cb35-419f-b00a-635c7b4f7e7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1268 microversion: 2.1 time: 0.157924 Jun 18 22:02:49.330266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 248/467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:49 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:49.335296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-862ded72-c2ad-4093-aa80-c9360f92a9c0 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Action: 'create', calling method: .version_select at 0x7fea14cd4a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:49.345349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:49.355421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:49.400362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-862ded72-c2ad-4093-aa80-c9360f92a9c0 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:49.406246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-862ded72-c2ad-4093-aa80-c9360f92a9c0 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Getting quotas for user 0895b43c4cbd40eab2dde002397519b3 and project c980b8607bd240b29a63759634333154. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:49.468060 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15e8ef72-11b4-44e0-9f69-b27dac7c2e0c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.447326 Jun 18 22:02:49.469247 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 220/468] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:02:49.507115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:49.509469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:49.546749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.549232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.551670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.554184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.804186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:49.813605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6fca93af-ae47-4491-b9d0-d961a9c0b1df tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.342683 Jun 18 22:02:49.816550 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 221/469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:49 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:49.914766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Calling method '.version_select at 0x7fea14a800d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:49.916817 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:49.916817 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:49.918864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.919768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.938696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.939113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.950776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.951294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.958556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4bfd45e-daba-44a5-849f-f024f26e5746 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.141143 Jun 18 22:02:49.961178 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 222/470] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:49.962293 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-862ded72-c2ad-4093-aa80-c9360f92a9c0 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "POST /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.630798 Jun 18 22:02:49.963360 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 249/471] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Jun 18 22:02:49 2022] POST /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 85 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:49.969067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b7bcb415-0dfa-424b-a271-49a379b9d2e7 req-c98f4a6c-6783-48ae-9e2f-f1f24295ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18208f8b-fcd2-4fff-87e2-93eb7611a506", "tag": "dfb9ce66-d624-41ec-8929-8a7cedf9db36"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:49.969655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:49.970285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:49.978715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b7bcb415-0dfa-424b-a271-49a379b9d2e7 req-c98f4a6c-6783-48ae-9e2f-f1f24295ee73 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.979063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b7bcb415-0dfa-424b-a271-49a379b9d2e7 req-c98f4a6c-6783-48ae-9e2f-f1f24295ee73 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.987190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.987896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.989048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:49.989995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:49.993189 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b7bcb415-0dfa-424b-a271-49a379b9d2e7 req-c98f4a6c-6783-48ae-9e2f-f1f24295ee73 service nova] Creating event network-changed:dfb9ce66-d624-41ec-8929-8a7cedf9db36 for instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 on nch1-master-1 Jun 18 22:02:49.999901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b7bcb415-0dfa-424b-a271-49a379b9d2e7 req-c98f4a6c-6783-48ae-9e2f-f1f24295ee73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036491 Jun 18 22:02:50.000276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 223/472] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:50.009194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.010255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:50.018579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.019229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.020206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.020790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.268788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:50.279289 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d25acdf5-5f08-46a4-b781-2a0c3cf4367a tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.276733 Jun 18 22:02:50.280726 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 224/473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:50.287186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.291541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:50.304056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:50.309686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.310141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.310938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.315277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9d52da7b-3b50-4c1a-a35a-4a63970b9483 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1469 microversion: 2.1 time: 0.350400 Jun 18 22:02:50.316027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.330289 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 250/474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:49 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1469 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:50.352729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Calling method '.version_select at 0x7fea14c32af0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.354677 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:50.354677 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:50.356230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.356916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.391886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.392416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.488736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:50.490019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.490485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.500347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:50.506496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:50.509122 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a17e0837-db2f-4005-a601-806c961cbeb6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1266 microversion: 2.25 time: 0.225453 Jun 18 22:02:50.510977 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 225/475] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:50.531827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c11de0a-90dd-4d81-8b79-1859f29c2c83 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 433 microversion: 2.1 time: 0.184205 Jun 18 22:02:50.532909 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 251/476] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 433 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:50.538269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.541968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa2f62a3-fdcc-471d-ad67-624adba6c831 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] Calling method '.version_select at 0x7fea14a80f70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.548284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:50.570334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.570803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.572014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.572614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.628141 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa2f62a3-fdcc-471d-ad67-624adba6c831 tempest-ImagesMetadataTestJSON-1617699265 tempest-ImagesMetadataTestJSON-1617699265-project] 10.222.0.30 "GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.100474 Jun 18 22:02:50.629197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 226/477] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/images/b560cecd-38c1-42a9-baeb-f509b73f244d/metadata => generated 85 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:02:50.640607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Calling method '.version_select at 0x7fea14b6f8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.642548 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:50.642548 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:50.643901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.644418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.693571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.694286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.706245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:50.714839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.715314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.732358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90325dc2-0063-4d9e-909a-dbf9b8af87a8 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.101273 Jun 18 22:02:50.733842 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 227/478] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:50.747820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-741784976", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:50.875167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:02:50.929070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:50.939340 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-061ab98d-4aa0-41b7-b2b2-a4ee5136f2c3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.405030 Jun 18 22:02:50.944273 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 252/479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:50.953939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-584b46f0-3705-4611-b859-4149b3bba3f1 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Calling method '.version_select at 0x7fea14d9d670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:50.969226 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:50.969226 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:50.970744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-584b46f0-3705-4611-b859-4149b3bba3f1 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:50.971203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-584b46f0-3705-4611-b859-4149b3bba3f1 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:50.983673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:51.023307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-584b46f0-3705-4611-b859-4149b3bba3f1 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.024144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-584b46f0-3705-4611-b859-4149b3bba3f1 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.037692 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-584b46f0-3705-4611-b859-4149b3bba3f1 tempest-HypervisorAdminUnderV252Test-884002764 tempest-HypervisorAdminUnderV252Test-884002764-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.090713 Jun 18 22:02:51.046760 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 253/480] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:02:50 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:51.059014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:51.063549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:51.081907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.082808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.086120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.089250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.453539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:02:51.454081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:02:51.454566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:02:51.454984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:02:51.455402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:02:51.479111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.491376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.492641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.493240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.545999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Getting quotas for project 8a610355b4324f8f8bac4b1673685d44. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:02:51.561221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Getting quotas for user 02a8362ef1d14be9b41ba2e6c904807f and project 8a610355b4324f8f8bac4b1673685d44. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:02:51.587989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:02:51.592167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:02:51.620321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:51.636515 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58070d89-35d1-4e70-baca-0e07a9eb288b tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.587100 Jun 18 22:02:51.640038 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 254/481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:51 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:51.654074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:51.655288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:51.684635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.687790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.693789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.694220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.740153 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2024f178-1cd4-4678-8707-377a6b42bf35 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004790 Jun 18 22:02:51.746318 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 228/482] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:02:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:02:51.766034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:51.766724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:51.782160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.782616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:51.783411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:51.783843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:52.152888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:52.164041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:52.172312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:52.173627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8cf43bd3-da3e-4ea7-a528-67e011c2ef7c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1314 microversion: 2.25 time: 0.426135 Jun 18 22:02:52.174202 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 229/483] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:51 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:52.189346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-89ab3b48-7478-4b2c-810a-a88fbda05345 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:52.190466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-89ab3b48-7478-4b2c-810a-a88fbda05345 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:52.345604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-89ab3b48-7478-4b2c-810a-a88fbda05345 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:52.353779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=33 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:52.362111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-89ab3b48-7478-4b2c-810a-a88fbda05345 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1218 microversion: 2.1 time: 0.186783 Jun 18 22:02:52.363596 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 230/484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:52 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:52.373760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:52.387650 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ded666ec-f5da-45c3-9528-8d60f5578299 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.743297 Jun 18 22:02:52.390152 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 255/485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:51 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:52.390294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:52.391331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:52.404342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-daca988b-bb32-49b7-8ea1-2b426322bac9 req-f2e349ad-65f7-41e1-9f47-c1ce8e910f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895ce88e-d460-48c8-8725-ce256689c9cb", "tag": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:52.434038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:52.434832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:52.436173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:52.436805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:52.438151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-daca988b-bb32-49b7-8ea1-2b426322bac9 req-f2e349ad-65f7-41e1-9f47-c1ce8e910f31 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:52.447371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-daca988b-bb32-49b7-8ea1-2b426322bac9 req-f2e349ad-65f7-41e1-9f47-c1ce8e910f31 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:52.505459 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-daca988b-bb32-49b7-8ea1-2b426322bac9 req-f2e349ad-65f7-41e1-9f47-c1ce8e910f31 service nova] Creating event network-changed:ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e for instance 895ce88e-d460-48c8-8725-ce256689c9cb on nch2-master-1 Jun 18 22:02:52.533235 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-daca988b-bb32-49b7-8ea1-2b426322bac9 req-f2e349ad-65f7-41e1-9f47-c1ce8e910f31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135765 Jun 18 22:02:52.534302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 256/486] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:52.655940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:52.656792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:52.672006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:52.673009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:52.678187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:52.680852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.126207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.138365 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-847c8027-5963-4746-98a4-a6e45acacaad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.770277 Jun 18 22:02:53.168013 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 231/487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:52 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:53.196316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:53.197415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:53.212126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:53.212945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.214559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:53.216790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.251060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.272065 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e2972479-0416-45ba-896e-b8c8219e0c8a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.619450 Jun 18 22:02:53.274902 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 257/488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:52 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:53.373362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.380178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:53.381334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:53.384457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.385220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:53.391044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.393077 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-17071f7f-ce69-4bc9-ba18-1ab8f7403902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1332 microversion: 2.25 time: 0.202592 Jun 18 22:02:53.395177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:53.395871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.397204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:53.397794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.408618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 232/489] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:53 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1332 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:53.424743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:53.425570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:53.435528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:53.435976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.436993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:53.437993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:53.513587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.549920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b27a93e5-7bc3-4043-9f5d-8ac21389e1a1 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1270 microversion: 2.1 time: 0.166831 Jun 18 22:02:53.550674 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 258/490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:53 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:53.616861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:53.629861 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5dedfbd-ca46-497b-8075-d97b503edc31 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.218107 Jun 18 22:02:53.631289 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 233/491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:53 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:54.159266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:54.160625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:54.168810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.169444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.173869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.174398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.292613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:54.293274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:54.302334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.303108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.303900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.304336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.623286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:54.635839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44ae009d-8943-4bc1-868a-915d872e4a76 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.479964 Jun 18 22:02:54.648094 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 259/492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:54 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:54.655669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:54.656654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:54.665198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.666136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.667458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.668328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.693134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:54.710105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-444412c2-4efe-4920-b2f3-0ffab0c21987 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.421990 Jun 18 22:02:54.711288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 234/493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:54 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:02:54.718724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:54.719660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:54.730323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.730987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.733246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.733923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.757544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:54.787219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:54.797250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:54.799091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:54.801129 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6ba3dc76-0c56-4ccc-a7e1-cc8d343e94b9 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1320 microversion: 2.25 time: 0.151045 Jun 18 22:02:54.802385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 260/494] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:54 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:54.808359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3d2020b6-2e47-4ec0-b604-1365f2034aa1 req-07975662-4c9a-438a-9c05-f97ac709c9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a20c148-622e-4917-8183-cd467bf2a83b", "tag": "b627e490-670e-4ea0-8156-cc7b8534fc17"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:54.819911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3d2020b6-2e47-4ec0-b604-1365f2034aa1 req-07975662-4c9a-438a-9c05-f97ac709c9e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.821150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3d2020b6-2e47-4ec0-b604-1365f2034aa1 req-07975662-4c9a-438a-9c05-f97ac709c9e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.834928 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3d2020b6-2e47-4ec0-b604-1365f2034aa1 req-07975662-4c9a-438a-9c05-f97ac709c9e6 service nova] Creating event network-changed:b627e490-670e-4ea0-8156-cc7b8534fc17 for instance 6a20c148-622e-4917-8183-cd467bf2a83b on nch2-master-1 Jun 18 22:02:54.840962 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3d2020b6-2e47-4ec0-b604-1365f2034aa1 req-07975662-4c9a-438a-9c05-f97ac709c9e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036782 Jun 18 22:02:54.842284 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 261/495] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:54.858828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:54.860321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:54.879402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.881563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.884501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:54.885215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:54.903480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:54.923410 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8e304803-93fd-4e7c-83d8-514ac714b283 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1276 microversion: 2.1 time: 0.210718 Jun 18 22:02:54.927601 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 235/496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:54 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:55.655680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:55.656507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:55.668248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:55.669373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:55.670207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:55.670652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:55.934880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:55.950232 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b56d4f8e-24ab-4112-97f9-6ab3660e55f7 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 1.097916 Jun 18 22:02:55.954738 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 262/497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:54 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:55.968285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:55.969303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:55.985819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:55.986874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:55.993735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:55.994600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:56.211222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:56.224618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc92d074-2d82-4104-9f19-650397f12e03 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.571237 Jun 18 22:02:56.235755 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 236/498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:55 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:56.248261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:56.252913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:56.272865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:56.273574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:56.278204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:56.279263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:56.564132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:56.572801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1171f21b-6546-4f54-839b-f1c40d829727 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.616690 Jun 18 22:02:56.573801 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 263/499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:55 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:56.589004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:56.590550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:56.598857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:56.599299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:56.604209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:56.604569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:56.672807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:56.682079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:56.692438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:56.694463 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0bfbb28-a255-46f8-9a7e-cb74ef6a4ad3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.457251 Jun 18 22:02:56.695176 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 237/500] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:56 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:56.971254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:56.972225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:56.978751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:56.979513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:56.980511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:56.981239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:57.323484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:57.342615 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0303b96f-7ee1-4a61-aaef-0f2ca94b9cbc tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.755610 Jun 18 22:02:57.344501 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 264/501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:56 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:57.493339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf6543c8-b244-4aee-bf71-3cd24b2c6229 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] Calling method '.version_select at 0x7fea14c8ac10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:57.496389 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:57.496389 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:57.523465 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf6543c8-b244-4aee-bf71-3cd24b2c6229 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.176486 Jun 18 22:02:57.524843 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 265/502] 10.222.0.30 () {60 vars in 1225 bytes} [Sat Jun 18 22:02:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:57.531332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:57.532199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:57.542800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:57.545374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:57.546722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:57.547320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:57.600267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:57.610461 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8216d91c-1f7e-4c07-a5dc-e6467ea90f75 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.642836 Jun 18 22:02:57.621833 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 238/503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:56 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:57.631814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c219ab00-b5bf-45cd-8d76-e4d80c21612f req-bb43f38a-ae37-4602-ba40-0aa00f0f3cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18208f8b-fcd2-4fff-87e2-93eb7611a506", "name": "network-vif-plugged", "status": "completed", "tag": "dfb9ce66-d624-41ec-8929-8a7cedf9db36"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:57.643476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c219ab00-b5bf-45cd-8d76-e4d80c21612f req-bb43f38a-ae37-4602-ba40-0aa00f0f3cab service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:57.644275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c219ab00-b5bf-45cd-8d76-e4d80c21612f req-bb43f38a-ae37-4602-ba40-0aa00f0f3cab service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:57.666921 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c219ab00-b5bf-45cd-8d76-e4d80c21612f req-bb43f38a-ae37-4602-ba40-0aa00f0f3cab service nova] Creating event network-vif-plugged:dfb9ce66-d624-41ec-8929-8a7cedf9db36 for instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 on nch1-master-1 Jun 18 22:02:57.676203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c219ab00-b5bf-45cd-8d76-e4d80c21612f req-bb43f38a-ae37-4602-ba40-0aa00f0f3cab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052918 Jun 18 22:02:57.677446 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 239/504] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:57.689293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4fca094a-e245-4499-97ec-c7157b7e42a1 req-9cd259b1-ee95-4d19-b693-db46f3c6c494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb0ac13-8caa-4624-a0d1-bbc8e938f068", "tag": "3ffec254-22f3-4483-b4ed-5f41380ce50c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:57.744362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4fca094a-e245-4499-97ec-c7157b7e42a1 req-9cd259b1-ee95-4d19-b693-db46f3c6c494 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:57.745769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4fca094a-e245-4499-97ec-c7157b7e42a1 req-9cd259b1-ee95-4d19-b693-db46f3c6c494 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:57.788200 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4fca094a-e245-4499-97ec-c7157b7e42a1 req-9cd259b1-ee95-4d19-b693-db46f3c6c494 service nova] Creating event network-changed:3ffec254-22f3-4483-b4ed-5f41380ce50c for instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 on nch1-master-1 Jun 18 22:02:57.815225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4fca094a-e245-4499-97ec-c7157b7e42a1 req-9cd259b1-ee95-4d19-b693-db46f3c6c494 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134819 Jun 18 22:02:57.816352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 240/505] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:57.839395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-144e1c85-7af7-45f6-927d-d5752fc86ee5 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] Action: 'update', calling method: .version_select at 0x7fea14b6f9d0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:57.842249 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:57.842249 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:57.979980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:58.009603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-78124951-f9ae-410a-a0a5-90f38d1897b8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.480313 Jun 18 22:02:58.013415 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 266/506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:57 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:58.031070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:58.037815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:58.056717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.057210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.058647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.059197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.171965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-144e1c85-7af7-45f6-927d-d5752fc86ee5 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.349130 Jun 18 22:02:58.172646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 241/507] 10.222.0.30 () {62 vars in 1246 bytes} [Sat Jun 18 22:02:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:58.178106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:58.178887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:58.186527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.187325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.189149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.189646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.667968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:58.683879 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52d25611-2acc-4c97-80c6-d810b5589219 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.663226 Jun 18 22:02:58.699937 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 267/508] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:58 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:58.706875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e2c44f93-6f4e-465e-8062-4933ceda5fe8 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] Calling method '.version_select at 0x7fea14ee8040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:58.707696 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:58.707696 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:02:58.738382 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e2c44f93-6f4e-465e-8062-4933ceda5fe8 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.037143 Jun 18 22:02:58.739848 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 268/509] 10.222.0.30 () {60 vars in 1225 bytes} [Sat Jun 18 22:02:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:58.749605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:58.750549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:58.759736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.760600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.761704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.762422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.826843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:58.835581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:58.837263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:58.838594 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b3473f0-156d-4dbb-8c1d-abf48a5accf0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.664893 Jun 18 22:02:58.839980 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 242/510] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:58 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:02:58.845438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:58.845438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:58.854686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.855155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:58.856192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:58.856620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.036290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:59.048301 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a2c435c-6bb6-4ef7-a741-478cd73420e4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.306061 Jun 18 22:02:59.048908 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 269/511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:58 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:59.135549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3fe257de-9949-4b14-b6fc-c5d6cc4c95eb req-79b49560-2d93-464e-84f7-72015008e27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f7013c-d348-42e9-9f1c-8904d844d7d7", "tag": "28eca057-81a8-4140-bcc6-ddb807338d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:59.138682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:59.144510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3fe257de-9949-4b14-b6fc-c5d6cc4c95eb req-79b49560-2d93-464e-84f7-72015008e27e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.145230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3fe257de-9949-4b14-b6fc-c5d6cc4c95eb req-79b49560-2d93-464e-84f7-72015008e27e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.151378 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7143ff80-0ba2-49a8-9fa1-aa86014049af tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.311077 Jun 18 22:02:59.151972 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 243/512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:58 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:59.161862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-391898ca-630f-4315-bb70-b8399f141141 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] Action: 'update', calling method: .version_select at 0x7fea14b5b8b0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:02:59.165893 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:02:59.165893 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:02:59.166871 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3fe257de-9949-4b14-b6fc-c5d6cc4c95eb req-79b49560-2d93-464e-84f7-72015008e27e service nova] Creating event network-changed:28eca057-81a8-4140-bcc6-ddb807338d2f for instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 on nch1-master-1 Jun 18 22:02:59.172028 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3fe257de-9949-4b14-b6fc-c5d6cc4c95eb req-79b49560-2d93-464e-84f7-72015008e27e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121513 Jun 18 22:02:59.172645 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 270/513] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:02:59.178327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:59.179051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:59.186120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.186780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.188108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.188742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.254209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=10,nova_api:UPDATE=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:02:59.268006 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-391898ca-630f-4315-bb70-b8399f141141 tempest-QuotaClassesAdmin257Test-407573244 tempest-QuotaClassesAdmin257Test-407573244-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.114329 Jun 18 22:02:59.268895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 244/514] 10.222.0.30 () {62 vars in 1246 bytes} [Sat Jun 18 22:02:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:02:59.353154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:59.363803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc9ddbb2-c266-41dc-a9b9-bbeb414ecdf8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.189142 Jun 18 22:02:59.364671 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 271/515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:59 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:02:59.702774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:59.703676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:59.710450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.711112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.712038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.712656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.858206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:02:59.858851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:02:59.875704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.877539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.880348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:02:59.882483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:02:59.890838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:02:59.909646 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16da89ba-9784-4c55-b848-2712e12ae975 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.211675 Jun 18 22:02:59.920183 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 245/516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:02:59 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:00.068914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:00.070047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:00.080789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.081421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.083079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.083679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.175203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:00.185467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:00.189233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:00.190383 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c9425f4-cdf7-4fb9-99d2-6e11b3829d68 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.337754 Jun 18 22:03:00.191102 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 272/517] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:02:59 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:03:00.204724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:00.205366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:00.212426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.212880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.213688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.214294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.475741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:00.481247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:00.484975 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c6c9986-3ff2-410e-a292-7494cc8a109f tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1323 microversion: 2.1 time: 0.292499 Jun 18 22:03:00.486161 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 273/518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:00 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:00.489453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c0cd9468-c9f2-4c41-b206-2b568bee9cac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.427784 Jun 18 22:03:00.491741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:00.492591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:00.505064 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 246/519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:00 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:03:00.517615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.521800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.525290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.525815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.532537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:00.678775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:00.688620 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1266df04-816a-4089-bdfd-9b2c2a5baf61 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.200999 Jun 18 22:03:00.689932 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 274/520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:00 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:00.815520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e234b800-eeb2-4b88-8bc6-4216c6d4a854 req-1eef279a-c000-4d1b-b4dc-a9eb9436d1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a20c148-622e-4917-8183-cd467bf2a83b", "name": "network-vif-plugged", "status": "completed", "tag": "b627e490-670e-4ea0-8156-cc7b8534fc17"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:00.843139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e234b800-eeb2-4b88-8bc6-4216c6d4a854 req-1eef279a-c000-4d1b-b4dc-a9eb9436d1bb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.848533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e234b800-eeb2-4b88-8bc6-4216c6d4a854 req-1eef279a-c000-4d1b-b4dc-a9eb9436d1bb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.879264 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e234b800-eeb2-4b88-8bc6-4216c6d4a854 req-1eef279a-c000-4d1b-b4dc-a9eb9436d1bb service nova] Creating event network-vif-plugged:b627e490-670e-4ea0-8156-cc7b8534fc17 for instance 6a20c148-622e-4917-8183-cd467bf2a83b on nch2-master-1 Jun 18 22:03:00.891629 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e234b800-eeb2-4b88-8bc6-4216c6d4a854 req-1eef279a-c000-4d1b-b4dc-a9eb9436d1bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081517 Jun 18 22:03:00.892620 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 247/521] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:00.928047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:00.928774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:00.957818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.958536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:00.959652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:00.960257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:01.211247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:01.211965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:01.218793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:01.219491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:01.220437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:01.221047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:01.367234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:01.380504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95d42fd6-a878-43c1-9df7-aa35d183b940 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.456823 Jun 18 22:03:01.399596 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 275/522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:00 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:01.506847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:01.509453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:01.521967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:01.523745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:01.524419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:01.525432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:01.526168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.035043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.057003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.060803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.062364 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e375ead9-edb6-4be5-91cc-7adf0e06dc23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.857275 Jun 18 22:03:02.065943 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 248/523] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:01 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:02.071469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:02.072256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:02.079395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.080059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.081062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.081647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.226872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.239133 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-36ddabfa-713b-42db-9f86-a2fa8ed91279 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1473 microversion: 2.1 time: 0.740587 Jun 18 22:03:02.240564 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 276/524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:01 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1473 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:02.246194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:02.247512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:02.255265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.255975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.256906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.257510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.384951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.401222 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7a5f851-6dc1-4407-aeb7-d5250fa987b5 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.332845 Jun 18 22:03:02.401911 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 249/525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:02 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:02.428869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:02.430305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:02.440446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.441207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.442321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.443516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.454412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.469547 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed75dac3-02b4-4f92-b3de-3b97ffb420f8 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1310 microversion: 2.1 time: 0.223447 Jun 18 22:03:02.479439 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 277/526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:02 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1310 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:02.490573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:02.491418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:02.516256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.517600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.518588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.519036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.547727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Request method failure captured: Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506/diagnostics HTTP/1.1 Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkt7tJoosXM4GAhw2iGnF8LrDeX9dT0-USfOGPGtuMgio3Kd1WTyE5uzxdNtSp7UKGl-ulTdr5tw723EEzIQpJxOZ8UcSTqoFk9VZ2MiWtNGtrTifIYnJ_4VDwcLkkDOwc3t6DxHh819vItpFEFzbDonWhyyEig4uaEsLXamv2LXoXc Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5ee47070e2e4d1da7f730e525068554 Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-333941281 Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:03:02.550566 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5ee47070e2e4d1da7f730e525068554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5ee47070e2e4d1da7f730e525068554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5ee47070e2e4d1da7f730e525068554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5ee47070e2e4d1da7f730e525068554", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-333941281 Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5ee47070e2e4d1da7f730e525068554 Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-333941281 Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiagnosticsNegativeTest-333941281-project Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: dcba179f9ae842e0a47dbe13e661f042 Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-333941281-project Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:03:02.552076 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': '18208f8b-fcd2-4fff-87e2-93eb7611a506'} Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:03:02.552890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 18 22:03:02.554350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:02.556319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:02.558948 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c68d7dee-3181-457c-b124-4187ed33817d tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.139573 Jun 18 22:03:02.560031 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 250/527] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:03:02 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506/diagnostics => generated 117 bytes in 145 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:02.570434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:02.571167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:02.579555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.580229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.581304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.581883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.677390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:02.762884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:02.772706 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-227f6f6f-408c-42c9-aa7b-1f127dd46f27 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.296318 Jun 18 22:03:02.773958 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 278/528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:02 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:02.872699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9400b4ea-3885-4e1e-93c9-0019fb4f7a54 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "DELETE /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 204 len: 0 microversion: 2.1 time: 0.306205 Jun 18 22:03:02.874124 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 251/529] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:02 2022] DELETE /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:02.883361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:02.883986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:02.891507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.891954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.892768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.893233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.931266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1ad5260c-d97a-4bee-bc46-5ac77d770d2c req-cbc80035-f60b-439e-ab73-03dd18496b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895ce88e-d460-48c8-8725-ce256689c9cb", "name": "network-vif-plugged", "status": "completed", "tag": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:02.945423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1ad5260c-d97a-4bee-bc46-5ac77d770d2c req-cbc80035-f60b-439e-ab73-03dd18496b28 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:02.948597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1ad5260c-d97a-4bee-bc46-5ac77d770d2c req-cbc80035-f60b-439e-ab73-03dd18496b28 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:02.974797 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1ad5260c-d97a-4bee-bc46-5ac77d770d2c req-cbc80035-f60b-439e-ab73-03dd18496b28 service nova] Creating event network-vif-plugged:ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e for instance 895ce88e-d460-48c8-8725-ce256689c9cb on nch2-master-1 Jun 18 22:03:02.986408 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1ad5260c-d97a-4bee-bc46-5ac77d770d2c req-cbc80035-f60b-439e-ab73-03dd18496b28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060905 Jun 18 22:03:02.988881 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 252/530] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:03:03.084355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:03.086236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:03.108582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.109412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.110482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.111022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.148184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:03.159376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4565d409-00ee-473f-8814-09f2c4905cdd tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1479 microversion: 2.1 time: 0.281074 Jun 18 22:03:03.166202 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 279/531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:02 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1479 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:03.324854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:03.334736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:03.337311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:03.338471 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae627cfd-03c9-45af-a6fc-869c14515737 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.259226 Jun 18 22:03:03.347932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 253/532] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:03 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:03.432923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:03.434300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:03.449241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.449769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.451083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.451536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.487879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:03.488651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:03.503292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.504037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.504984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.505593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.740280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:03.749096 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d3082f8-69c4-47a4-9765-325884e4c36f tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.325596 Jun 18 22:03:03.754676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 280/533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:03 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:03.757553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:03.770269 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fe23810-c018-4254-a8a9-1ef7d18eb3ad tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1493 microversion: 2.1 time: 0.287438 Jun 18 22:03:03.773288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 254/534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:03 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1493 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:03:03.796994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:03.798151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:03.809089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.809899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:03.811121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:03.812164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.124375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:04.133253 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d2fa8c4-9cd4-4622-bb1f-0f539ac39f2e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1323 microversion: 2.1 time: 0.347683 Jun 18 22:03:04.135710 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 281/535] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:03 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:04.179598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:04.180424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:04.189287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.190058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.191250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.191880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.301448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:04.302071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:04.309304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.309754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.310534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.310971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.330183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:04.414813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:04.424211 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72383f4f-e25d-4f87-be0b-e52040528e88 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1479 microversion: 2.1 time: 0.249657 Jun 18 22:03:04.425395 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 282/536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:04 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1479 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:04.440003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:04.441510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:04.448134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.449395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.450450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.451214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.519404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3a0f8ae5-8d1c-4d71-ad45-11ab1fa8ccac tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1644 microversion: 2.1 time: 0.728340 Jun 18 22:03:04.520922 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 255/537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:03 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1644 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:04.540792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:04.541803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:04.556042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.557171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.558842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.559807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.689750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:04.703924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:04.715321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:04.718928 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-630f9b66-324e-4a8a-9c88-fba3129e82b5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.292324 Jun 18 22:03:04.729456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 283/538] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:04 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:04.769549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:04.770337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:04.785314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.785573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.790380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.791266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.804827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af802479-5b3a-4b92-adf4-c0bccfd60000 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1644 microversion: 2.1 time: 0.271809 Jun 18 22:03:04.819501 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 256/539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:04 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1644 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:04.847608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d828f01-7638-4e35-a019-5d9b14b3729e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:04.852928 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:04.852928 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:03:04.856178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d828f01-7638-4e35-a019-5d9b14b3729e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.856649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d828f01-7638-4e35-a019-5d9b14b3729e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.859786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d828f01-7638-4e35-a019-5d9b14b3729e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.860607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d828f01-7638-4e35-a019-5d9b14b3729e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.947149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d828f01-7638-4e35-a019-5d9b14b3729e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.125843 Jun 18 22:03:04.962968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 257/540] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:03:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:04.968478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:04.978780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:04.991780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.992230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:04.993118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:04.993585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:05.029089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:05.039016 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-157dc03b-9618-4dfa-992f-0f6fd0bb88be tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.275459 Jun 18 22:03:05.040251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 284/541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:04 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:05.109561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lazy-loading 'flavor' on Instance uuid 6a20c148-622e-4917-8183-cd467bf2a83b {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:05.153749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:05.154328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:05.166196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:05.166647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:05.167419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:05.168186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:05.192163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Going to try to live migrate instance to nch1-master-1 {{(pid=130903) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:03:05.370866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:05.378781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-befce6cd-51ee-4b1a-b986-e5fc44be1044 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 200 len: 1519 microversion: 2.1 time: 0.230190 Jun 18 22:03:05.379350 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 285/542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:05 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:05.542205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-330d53d4-288d-4bfd-ae1b-b78491c639f3 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] Calling method '.version_select at 0x7fea14cc2b80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:05.543174 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:05.543174 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:03:05.545336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:05.553196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=41 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:05.556743 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-330d53d4-288d-4bfd-ae1b-b78491c639f3 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.176159 Jun 18 22:03:05.557384 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 286/543] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:03:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:05.616594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1584296164", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1a0b7d1f-26de-4ff3-a984-65723c7a5ace"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:05.674649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] validate_networks() for [('1a0b7d1f-26de-4ff3-a984-65723c7a5ace', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:06.084731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:06.085219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:06.085698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:06.086107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:06.086526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:06.095925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:06.096373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:06.097243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:06.097675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:06.114053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:06.118579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for user 4eef98c56e744064b2b5f131c3766c0c and project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:06.130409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:06.132672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:06.186292 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ed4ce40-26e4-44cb-a9d1-1f44fc7031ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618734 Jun 18 22:03:06.193327 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 287/544] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:03:06.205298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'action', calling method: .version_select at 0x7fea16fd3a60>, body: {"addFloatingIp": {"address": "172.35.2.213"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:06.207053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:06.215344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:06.216167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:06.217159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:06.217771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:06.285579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Acquired lock "refresh_cache-78dffd72-8475-4bb2-a66a-7919e902e9df" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:03:08.626256 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80b0a1c6-3f66-4efd-9213-34829a858844 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b/action" status: 202 len: 0 microversion: 2.1 time: 3.659468 Jun 18 22:03:08.628706 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 258/545] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:04 2022] POST /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b/action => generated 0 bytes in 3665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:03:08.641148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:08.644810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:08.665545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:08.668928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:08.670344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:08.673391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:08.847020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcba179f9ae842e0a47dbe13e661f042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ee47070e2e4d1da7f730e525068554', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:08.859834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37d89561-eccd-461c-8220-c6d244779a66 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 200 len: 1437 microversion: 2.1 time: 0.229509 Jun 18 22:03:08.862237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 259/546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:08 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 1437 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:08.873084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-05ff87de-2949-4a2a-ae7d-34bb9311ce03 req-4b3f0367-f1e9-48d2-bebf-aac77356ced2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0ac13-8caa-4624-a0d1-bbc8e938f068", "name": "network-vif-plugged", "status": "completed", "tag": "3ffec254-22f3-4483-b4ed-5f41380ce50c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:08.887938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-05ff87de-2949-4a2a-ae7d-34bb9311ce03 req-4b3f0367-f1e9-48d2-bebf-aac77356ced2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:08.888535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-05ff87de-2949-4a2a-ae7d-34bb9311ce03 req-4b3f0367-f1e9-48d2-bebf-aac77356ced2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:08.900929 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-05ff87de-2949-4a2a-ae7d-34bb9311ce03 req-4b3f0367-f1e9-48d2-bebf-aac77356ced2 service nova] Creating event network-vif-plugged:3ffec254-22f3-4483-b4ed-5f41380ce50c for instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 on nch1-master-1 Jun 18 22:03:08.930982 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-05ff87de-2949-4a2a-ae7d-34bb9311ce03 req-4b3f0367-f1e9-48d2-bebf-aac77356ced2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046968 Jun 18 22:03:08.931686 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 260/547] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:08.941899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4ffbf9e-36d2-4642-8999-2448896ba171 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] Action: 'update', calling method: .version_select at 0x7fea1493f160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:08.943807 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:08.943807 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:03:09.424202 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4ffbf9e-36d2-4642-8999-2448896ba171 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.487109 Jun 18 22:03:09.429107 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 261/548] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Jun 18 22:03:08 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:09.443645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:09.445864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:09.470407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:09.474047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:09.477728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:09.478285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:09.816251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:09.828037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:09.831353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:09.832750 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9242f6e1-fc79-40fc-8d1b-ddd31fa766e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.405317 Jun 18 22:03:09.845261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 262/549] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:09 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:09.851309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:09.851900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:09.860138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:09.860588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:09.861513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:09.861947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:09.927972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Building network info cache for instance {{(pid=130902) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:03:10.191596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:10.202943 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1bbc9dc1-12ba-413a-96dc-92dbc509f927 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.356275 Jun 18 22:03:10.206251 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 263/550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:09 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:10.213906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:10.214856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:10.224786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.225456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.226332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.226858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.539494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:10.548312 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35aa3727-a234-490a-82c4-861af41c60cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 200 len: 1308 microversion: 2.1 time: 0.339275 Jun 18 22:03:10.551213 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 264/551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:10 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 1308 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:10.555903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:10.556505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:10.579693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.580616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.581587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.582634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.856864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:10.872887 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa918dca-a699-46e6-93ab-f33ae21a9631 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.320451 Jun 18 22:03:10.883398 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 265/552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:10 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:10.890964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3bbf3315-525d-46d9-acda-1d64b83af828 req-4aa89246-21f5-40a5-9240-510842fa801e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18208f8b-fcd2-4fff-87e2-93eb7611a506", "name": "network-vif-deleted", "tag": "dfb9ce66-d624-41ec-8929-8a7cedf9db36"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:10.899956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3bbf3315-525d-46d9-acda-1d64b83af828 req-4aa89246-21f5-40a5-9240-510842fa801e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.900740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3bbf3315-525d-46d9-acda-1d64b83af828 req-4aa89246-21f5-40a5-9240-510842fa801e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.916740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Updating instance_info_cache with network_info: [{"id": "43465871-6115-43f5-abc6-7a0d1c2533d4", "address": "fa:16:3e:7c:2e:98", "network": {"id": "e17875e3-e111-45e6-a0c0-c6b1e856376c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1800056884-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b63c52467494445b437e444a52e075e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap43465871-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:03:10.924025 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3bbf3315-525d-46d9-acda-1d64b83af828 req-4aa89246-21f5-40a5-9240-510842fa801e service nova] Creating event network-vif-deleted:dfb9ce66-d624-41ec-8929-8a7cedf9db36 for instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 on nch1-master-1 Jun 18 22:03:10.932243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3bbf3315-525d-46d9-acda-1d64b83af828 req-4aa89246-21f5-40a5-9240-510842fa801e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047136 Jun 18 22:03:10.933497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 266/553] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:10.939164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-92505882-d7f5-40e4-bfb7-1649454086b0 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] Calling method '.version_select at 0x7fea14947a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:10.939976 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:10.939976 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:03:10.942501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=13,nova_api:INSERT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:10.951572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Releasing lock "refresh_cache-78dffd72-8475-4bb2-a66a-7919e902e9df" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:03:10.953711 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-228d3543-2c85-4b70-938c-066362723c75 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action" status: 202 len: 0 microversion: 2.1 time: 4.757859 Jun 18 22:03:10.954156 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 288/554] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:06 2022] POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action => generated 0 bytes in 4760 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:03:10.958171 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-92505882-d7f5-40e4-bfb7-1649454086b0 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023252 Jun 18 22:03:10.959677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:10.960742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] [instance: 18208f8b-fcd2-4fff-87e2-93eb7611a506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:10.964290 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 267/555] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:03:10 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:10.969628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7f6c469a-4583-4807-a83b-45ab21fd31fa req-c2879fc6-e602-4cba-b93b-77622c1d091c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:10.970944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.971799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.973529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.974323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.979432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7f6c469a-4583-4807-a83b-45ab21fd31fa req-c2879fc6-e602-4cba-b93b-77622c1d091c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:10.979878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7f6c469a-4583-4807-a83b-45ab21fd31fa req-c2879fc6-e602-4cba-b93b-77622c1d091c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:10.991699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7f6c469a-4583-4807-a83b-45ab21fd31fa req-c2879fc6-e602-4cba-b93b-77622c1d091c service nova] Creating event network-changed:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:03:10.997278 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7f6c469a-4583-4807-a83b-45ab21fd31fa req-c2879fc6-e602-4cba-b93b-77622c1d091c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031547 Jun 18 22:03:10.997890 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 268/556] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:10.999834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] HTTP exception thrown: Instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 could not be found. Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Request method failure captured: Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 HTTP/1.1 Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkt7tJoosXM4GAhw2iGnF8LrDeX9dT0-USfOGPGtuMgio3Kd1WTyE5uzxdNtSp7UKGl-ulTdr5tw723EEzIQpJxOZ8UcSTqoFk9VZ2MiWtNGtrTifIYnJ_4VDwcLkkDOwc3t6DxHh819vItpFEFzbDonWhyyEig4uaEsLXamv2LXoXc Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5ee47070e2e4d1da7f730e525068554 Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-333941281 Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:03:11.001868 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5ee47070e2e4d1da7f730e525068554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5ee47070e2e4d1da7f730e525068554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5ee47070e2e4d1da7f730e525068554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5ee47070e2e4d1da7f730e525068554", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-333941281 Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5ee47070e2e4d1da7f730e525068554 Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-333941281 Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerDiagnosticsNegativeTest-333941281-project Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: dcba179f9ae842e0a47dbe13e661f042 Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-333941281-project Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 could not be found. Jun 18 22:03:11.003459 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '18208f8b-fcd2-4fff-87e2-93eb7611a506'} Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 could not be found. Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:11.004438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 could not be found. Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 could not be found. Jun 18 22:03:11.005932 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:11.007154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] Returning 404 to user: Instance 18208f8b-fcd2-4fff-87e2-93eb7611a506 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:11.007154 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d2b1654-033e-46f8-be8f-fa54e25f1185 tempest-ServerDiagnosticsNegativeTest-333941281 tempest-ServerDiagnosticsNegativeTest-333941281-project] 10.222.0.30 "GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506" status: 404 len: 111 microversion: 2.1 time: 0.048231 Jun 18 22:03:11.009382 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 289/557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:10 2022] GET /compute/v2.1/servers/18208f8b-fcd2-4fff-87e2-93eb7611a506 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:11.011708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:11.012804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:11.020808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.021911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:11.022919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.023521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:11.026776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.213"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:11.028079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:11.043576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.044109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:11.045215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.045853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:11.082913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Acquired lock "refresh_cache-895ce88e-d460-48c8-8725-ce256689c9cb" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:03:11.464877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:11.474568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:11.476452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:11.477810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-94b865b3-ce3b-45ce-a20a-0c3a9ed2457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1362 microversion: 2.25 time: 0.478696 Jun 18 22:03:11.478891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 269/558] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:10 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:11.484926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-95fe7f93-f59d-48bf-a316-a8c366779852 req-32053dfa-3e25-416a-8774-b9db07610a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f7013c-d348-42e9-9f1c-8904d844d7d7", "name": "network-vif-plugged", "status": "completed", "tag": "28eca057-81a8-4140-bcc6-ddb807338d2f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:11.493299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-95fe7f93-f59d-48bf-a316-a8c366779852 req-32053dfa-3e25-416a-8774-b9db07610a56 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.493744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-95fe7f93-f59d-48bf-a316-a8c366779852 req-32053dfa-3e25-416a-8774-b9db07610a56 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:11.506801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-95fe7f93-f59d-48bf-a316-a8c366779852 req-32053dfa-3e25-416a-8774-b9db07610a56 service nova] Creating event network-vif-plugged:28eca057-81a8-4140-bcc6-ddb807338d2f for instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 on nch1-master-1 Jun 18 22:03:11.512382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-95fe7f93-f59d-48bf-a316-a8c366779852 req-32053dfa-3e25-416a-8774-b9db07610a56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031502 Jun 18 22:03:11.515240 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 270/559] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:11.523524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5145b50b-645a-482c-9784-d8f0a85d1a35 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] Action: 'update', calling method: .version_select at 0x7fea14acaca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:11.525329 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:11.525329 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:03:11.674751 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5145b50b-645a-482c-9784-d8f0a85d1a35 tempest-QuotaClassesAdminTestJSON-291016888 tempest-QuotaClassesAdminTestJSON-291016888-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.155332 Jun 18 22:03:11.677825 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 271/560] 10.222.0.30 () {60 vars in 1205 bytes} [Sat Jun 18 22:03:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:11.683013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:11.684045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:11.718673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.720103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:11.722542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:11.723998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:12.038711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:12.052874 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bb2a834-ac2d-49e8-81c0-1e8ce217a014 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1318 microversion: 2.1 time: 0.371801 Jun 18 22:03:12.053797 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 272/561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:11 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:12.067262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:12.067866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:12.074329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:12.074776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:12.075544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:12.075972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:12.389691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:12.401719 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d044cbd6-0300-46f6-b272-b5e2beeab928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 200 len: 1308 microversion: 2.1 time: 0.338203 Jun 18 22:03:12.404657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 273/562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:12 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:12.439795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:12.443992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:12.467639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:12.468800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:12.471479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:12.472158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:12.973260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:12.983560 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5dda195c-3495-46c5-a253-a3c418a92bea tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.576826 Jun 18 22:03:13.000463 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 274/563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:12 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:13.008662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:13.009294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:13.031690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:13.039869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:13.041373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:13.041806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:13.367011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:13.376136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:13.383245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:13.384841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75e1d02f-d9b9-4980-9ac3-aede5603485f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1557 microversion: 2.25 time: 0.383308 Jun 18 22:03:13.386264 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 275/564] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:13 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1557 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:13.401495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67d33e4-d613-42be-8321-005a5ef130f0", "tag": "358af369-3e3e-422f-bc34-0998011b792c"}, {"server_uuid": "6a20c148-622e-4917-8183-cd467bf2a83b", "name": "network-vif-unplugged", "status": "completed", "tag": "b627e490-670e-4ea0-8156-cc7b8534fc17"}, {"name": "network-changed", "server_uuid": "6a20c148-622e-4917-8183-cd467bf2a83b", "tag": "b627e490-670e-4ea0-8156-cc7b8534fc17"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:13.422420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:13.423165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:13.447077 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] Creating event network-changed:358af369-3e3e-422f-bc34-0998011b792c for instance e67d33e4-d613-42be-8321-005a5ef130f0 on nch2-master-1 Jun 18 22:03:13.447587 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] Creating event network-vif-unplugged:b627e490-670e-4ea0-8156-cc7b8534fc17 for instance 6a20c148-622e-4917-8183-cd467bf2a83b on nch2-master-1 Jun 18 22:03:13.448085 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] Creating event network-changed:b627e490-670e-4ea0-8156-cc7b8534fc17 for instance 6a20c148-622e-4917-8183-cd467bf2a83b on nch2-master-1 Jun 18 22:03:13.464427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-eb4ba856-af75-42e3-ae4e-22407bc5c207 req-4d245d2d-b4c8-48fd-8c1e-9b8d60e199e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.073633 Jun 18 22:03:13.465363 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 276/565] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:13.475806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:13.476516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:13.483618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:13.484069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:13.484864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:13.485360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:13.509576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:13.921759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:13.931972 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11f09ddd-792b-4466-87da-507f74f239b2 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1467 microversion: 2.1 time: 0.464821 Jun 18 22:03:13.933069 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 277/566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:13 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1467 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:14.373800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:14.375086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:14.390200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:14.390982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:14.391957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:14.392540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:14.792185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.neutron [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] re-assign floating IP 172.35.2.213 from instance 78dffd72-8475-4bb2-a66a-7919e902e9df Jun 18 22:03:14.859698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid afb0ac13-8caa-4624-a0d1-bbc8e938f068 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:14.924022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Building network info cache for instance {{(pid=130902) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:03:14.930218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:14.935846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b41e2a0-69b0-4183-a754-966dfe09b1d1 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 2050 microversion: 2.25 time: 1.001204 Jun 18 22:03:14.945873 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 278/567] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:13 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 2050 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:14.966786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:14.968221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:14.986576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:14.987441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:14.990746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:14.991189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.266309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:15.273781 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6783f636-c5dc-4c04-a4b6-8cd831361736 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 200 len: 1308 microversion: 2.1 time: 0.316423 Jun 18 22:03:15.285205 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 279/568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:14 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:15.297312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:15.298294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:15.311968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.312677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.315227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.315841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.361809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lazy-loading 'flavor' on Instance uuid 81f7013c-d348-42e9-9f1c-8904d844d7d7 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:15.460433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd3657da-48ac-413e-9899-2bf823b2f274 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7/action" status: 202 len: 0 microversion: 2.1 time: 0.173533 Jun 18 22:03:15.466038 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 280/569] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:15 2022] POST /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:03:15.473105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:15.474492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:15.494439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.496404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.504490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.505411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.755103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:15.768397 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7863a20b-6d2f-4516-b8ab-1a16bbf7f138 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.298243 Jun 18 22:03:15.777510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 281/570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:15 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:15.802179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ce46e8cb-1fba-42ba-a698-6bf2b5fc585c req-0be816e6-2efe-40cf-ae8e-4a85c482dc34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:15.820640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ce46e8cb-1fba-42ba-a698-6bf2b5fc585c req-0be816e6-2efe-40cf-ae8e-4a85c482dc34 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.823170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ce46e8cb-1fba-42ba-a698-6bf2b5fc585c req-0be816e6-2efe-40cf-ae8e-4a85c482dc34 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.837117 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ce46e8cb-1fba-42ba-a698-6bf2b5fc585c req-0be816e6-2efe-40cf-ae8e-4a85c482dc34 service nova] Creating event network-changed:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:03:15.843148 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ce46e8cb-1fba-42ba-a698-6bf2b5fc585c req-0be816e6-2efe-40cf-ae8e-4a85c482dc34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058972 Jun 18 22:03:15.844926 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 282/571] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:15.851967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:15.853189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:15.862404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.863635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.865244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:15.866109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:15.989993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Updating instance_info_cache with network_info: [{"id": "43465871-6115-43f5-abc6-7a0d1c2533d4", "address": "fa:16:3e:7c:2e:98", "network": {"id": "e17875e3-e111-45e6-a0c0-c6b1e856376c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1800056884-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b63c52467494445b437e444a52e075e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap43465871-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:03:16.008747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Building network info cache for instance {{(pid=130902) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:03:16.012931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:16.109655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:16.124214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid afb0ac13-8caa-4624-a0d1-bbc8e938f068 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:16.125526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=7 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:16.158149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-38492b28-5be1-46aa-b601-b344bad9c71a tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 2050 microversion: 2.25 time: 0.310970 Jun 18 22:03:16.175764 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 283/572] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:15 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 2050 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:16.175764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:16.175764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:16.189023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.192100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.192931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.195741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.516417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:16.529460 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e782922e-bbfe-4ef5-913a-149f647c5398 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1475 microversion: 2.1 time: 0.363616 Jun 18 22:03:16.530959 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 284/573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:16 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1475 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:16.536760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-257fbe1a-085c-4fac-87e7-6a7a88255297 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:16.538838 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:16.538838 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:03:16.540417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-257fbe1a-085c-4fac-87e7-6a7a88255297 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.541376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-257fbe1a-085c-4fac-87e7-6a7a88255297 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.542534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-257fbe1a-085c-4fac-87e7-6a7a88255297 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.543253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-257fbe1a-085c-4fac-87e7-6a7a88255297 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.575820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-257fbe1a-085c-4fac-87e7-6a7a88255297 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043488 Jun 18 22:03:16.576746 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 285/574] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Jun 18 22:03:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:03:16.582505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:16.583446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:16.591265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.591943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.592921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.593539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.815368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:16.824881 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac7fc58a-c9cf-4627-bede-ddde7d939b6d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 200 len: 1308 microversion: 2.1 time: 0.246199 Jun 18 22:03:16.826142 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 286/575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:16 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:16.926088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Updating instance_info_cache with network_info: [{"id": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e", "address": "fa:16:3e:1f:3d:6a", "network": {"id": "e17875e3-e111-45e6-a0c0-c6b1e856376c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1800056884-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b63c52467494445b437e444a52e075e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad1e41b9-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:03:16.946422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Releasing lock "refresh_cache-895ce88e-d460-48c8-8725-ce256689c9cb" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:03:16.947955 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aa367a3e-75ef-40ae-acfb-a792d502342a tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb/action" status: 202 len: 0 microversion: 2.1 time: 5.926745 Jun 18 22:03:16.949006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 290/576] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:11 2022] POST /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb/action => generated 0 bytes in 5939 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:03:16.963509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:16.965168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:16.992690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.993868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.995768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:16.997443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:16.998427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-233579729", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:17.050118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'flavor' on Instance uuid afb0ac13-8caa-4624-a0d1-bbc8e938f068 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:17.069325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Going to try to live migrate instance to nch2-master-1 {{(pid=130902) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:03:17.075872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:17.385287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:17.386867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:17.387466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:17.387907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:17.388479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:17.400625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:17.401119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:17.402000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:17.402437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:17.425466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:17.432403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:17.451521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:17.454401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:17.510443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf38a665-ccdd-4b9a-8716-c451a8f4cd77 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682933 Jun 18 22:03:17.511414 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 287/577] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:03:17.522063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5f93d987-3727-4a92-8839-876163aed936 req-bf370961-c0ca-4608-9d6f-960d768c202d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67d33e4-d613-42be-8321-005a5ef130f0", "name": "network-vif-plugged", "status": "completed", "tag": "358af369-3e3e-422f-bc34-0998011b792c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:17.545537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5f93d987-3727-4a92-8839-876163aed936 req-bf370961-c0ca-4608-9d6f-960d768c202d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:17.546916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5f93d987-3727-4a92-8839-876163aed936 req-bf370961-c0ca-4608-9d6f-960d768c202d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:17.564292 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5f93d987-3727-4a92-8839-876163aed936 req-bf370961-c0ca-4608-9d6f-960d768c202d service nova] Creating event network-vif-plugged:358af369-3e3e-422f-bc34-0998011b792c for instance e67d33e4-d613-42be-8321-005a5ef130f0 on nch2-master-1 Jun 18 22:03:17.572070 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5f93d987-3727-4a92-8839-876163aed936 req-bf370961-c0ca-4608-9d6f-960d768c202d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059369 Jun 18 22:03:17.574120 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 288/578] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:17.581269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:17.582279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:17.591862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:17.592710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:17.594963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:17.595729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:17.913007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:17.931094 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1035bad-ed67-459d-b2dd-b12095dc5fff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.349611 Jun 18 22:03:17.933400 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 289/579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:17 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:17.952438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'action', calling method: .version_select at 0x7fea16fd48b0>, body: {"removeFloatingIp": {"address": "172.35.2.213"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:18.191190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:18.204918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:18.205398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:18.206189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:18.206626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.000672 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] HTTP exception thrown: Floating IP 172.35.2.213 is not associated with instance 78dffd72-8475-4bb2-a66a-7919e902e9df. Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Request method failure captured: Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action HTTP/1.1 Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 49 Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktf4XX-x7SvQKMbsh3S1UoY5f2LFMFmaqt0Dz-WrhJlRUmwvzkxu2tSgAaTxYmnZL69aK-BrAWdf4-UiA1m0ZpT_c3B4s1g6SCWh4FvM9QQ2PBIoJRkOsc-lPcNv6mxWwO72qnYQK7tO29Cv4QLh2w5tS8O0ahWoOEjTMae1x6ef24 Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:03:19.003226 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b63c52467494445b437e444a52e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b63c52467494445b437e444a52e075e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 58c3911cbbdf4e35ae8df9eb8b23f22d Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: {"removeFloatingIp": {"address": "172.35.2.213"}} Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:03:19.004707 ncdv-master-1 devstack@n-api.service[130903]: exception: Floating IP 172.35.2.213 is not associated with instance 78dffd72-8475-4bb2-a66a-7919e902e9df. Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '78dffd72-8475-4bb2-a66a-7919e902e9df', 'body': {'removeFloatingIp': {'address': '172.35.2.213'}}} Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.2.213 is not associated with instance 78dffd72-8475-4bb2-a66a-7919e902e9df. Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:19.005723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:19.007101 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:19.007101 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:19.007101 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:19.007101 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:19.007101 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.2.213 is not associated with instance 78dffd72-8475-4bb2-a66a-7919e902e9df. Jun 18 22:03:19.007101 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:19.008214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Returning 409 to user: Floating IP 172.35.2.213 is not associated with instance 78dffd72-8475-4bb2-a66a-7919e902e9df. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:19.009269 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-52adff6f-50e1-4207-9021-b0d13aedd78e tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action" status: 409 len: 146 microversion: 2.1 time: 1.064727 Jun 18 22:03:19.009992 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 290/580] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:17 2022] POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action => generated 146 bytes in 1076 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:03:19.015428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:19.016071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:19.035052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.035413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.036600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.037541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.128387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:19.137334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ea9c49b-86f0-4f0b-a741-3670e861e253 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1274 microversion: 2.1 time: 0.126030 Jun 18 22:03:19.138127 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 291/581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:19 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1274 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:19.142800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:19.143229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:19.151258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.151956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.153402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.153942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.491845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:19.503060 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6d39bfb-04cf-4c01-a157-2676c02367ac tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1458 microversion: 2.1 time: 0.363919 Jun 18 22:03:19.503700 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 292/582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:19 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1458 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:19.529678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:19.531499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:19.551108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.552018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.553098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.555361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.580048 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68b1841d-6fd5-42f1-9f26-7c02b77bfb84 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068/action" status: 202 len: 0 microversion: 2.25 time: 2.625695 Jun 18 22:03:19.581319 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 291/583] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:03:16 2022] POST /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068/action => generated 0 bytes in 2628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:19.591399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e0a63f6d-a2d3-4b67-8791-7095d5de10a2 req-3721afd9-beac-46a5-bce8-47aa479967d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895ce88e-d460-48c8-8725-ce256689c9cb", "tag": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:19.610390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e0a63f6d-a2d3-4b67-8791-7095d5de10a2 req-3721afd9-beac-46a5-bce8-47aa479967d9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.610837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e0a63f6d-a2d3-4b67-8791-7095d5de10a2 req-3721afd9-beac-46a5-bce8-47aa479967d9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.627800 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e0a63f6d-a2d3-4b67-8791-7095d5de10a2 req-3721afd9-beac-46a5-bce8-47aa479967d9 service nova] Creating event network-changed:ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e for instance 895ce88e-d460-48c8-8725-ce256689c9cb on nch2-master-1 Jun 18 22:03:19.635677 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e0a63f6d-a2d3-4b67-8791-7095d5de10a2 req-3721afd9-beac-46a5-bce8-47aa479967d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050988 Jun 18 22:03:19.637158 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 292/584] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:19.654799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:19.655863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:19.664162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.664851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.665836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:19.666597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:19.831164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:19.846685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e84303a-2c93-41a4-9780-f65ef4299f18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 200 len: 1488 microversion: 2.1 time: 0.332403 Jun 18 22:03:19.848848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 293/585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:19 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 1488 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:19.855802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.213"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:20.116856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:20.128911 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-51a6a6aa-b618-40b3-8558-b8842c12d089 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.479302 Jun 18 22:03:20.129808 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 293/586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:19 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:20.135125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:20.136058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:20.145415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:20.146070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:20.152318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:20.153303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:20.153469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:20.160993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:20.161584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:20.162451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:20.173685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:20.204807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:20.546911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Acquired lock "refresh_cache-895ce88e-d460-48c8-8725-ce256689c9cb" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:03:20.807084 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0d02c4e-6f02-4d50-a65e-eb53abcb6170 tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1609 microversion: 2.1 time: 0.676017 Jun 18 22:03:20.819193 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 294/587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:20 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1609 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:20.826741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:20.827552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:20.869946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:20.870634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:20.875289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:20.875785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:21.481871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:21.491414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:21.493974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:21.495417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23110d3a-4d3e-4741-b8c0-59aeceb9cd23 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.674820 Jun 18 22:03:21.496213 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 295/588] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:20 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:21.511209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:21.512115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:21.520647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:21.521634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:21.522652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:21.523657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:21.612923 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a6aa1647-da87-4b73-a6b0-615698560ee4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0/action" status: 202 len: 0 microversion: 2.1 time: 0.114999 Jun 18 22:03:21.615196 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 296/589] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:21 2022] POST /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:03:21.640308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:21.641789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:21.654219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:21.655029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:21.656329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:21.657093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:21.876101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Building network info cache for instance {{(pid=130903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:03:21.976061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:21.989768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1767746d-69d8-494a-ac3f-b0fc65098eaa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.372880 Jun 18 22:03:22.003689 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 297/590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:21 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:22.008790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ded9a5c2-40df-4207-87d1-53ca889c28dd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:22.010465 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:03:22.010465 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:03:22.012960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded9a5c2-40df-4207-87d1-53ca889c28dd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.013639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded9a5c2-40df-4207-87d1-53ca889c28dd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.014831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded9a5c2-40df-4207-87d1-53ca889c28dd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.016254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded9a5c2-40df-4207-87d1-53ca889c28dd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.104119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ded9a5c2-40df-4207-87d1-53ca889c28dd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.095734 Jun 18 22:03:22.105220 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 298/591] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:03:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:22.117465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:22.121498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:22.138677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.141567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.142603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.143248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.531337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:22.544444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-42dbc225-6e4c-40fc-9cde-f1448725e027 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.437839 Jun 18 22:03:22.557261 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 299/592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:22 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:22.563036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6677dfc5-bf84-469f-8986-8550fc5487e4 req-6ab5e557-0bc2-4d2e-a3d8-d595db23b219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a20c148-622e-4917-8183-cd467bf2a83b", "name": "network-vif-unplugged", "status": "completed", "tag": "b627e490-670e-4ea0-8156-cc7b8534fc17"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:22.589539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6677dfc5-bf84-469f-8986-8550fc5487e4 req-6ab5e557-0bc2-4d2e-a3d8-d595db23b219 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.589993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6677dfc5-bf84-469f-8986-8550fc5487e4 req-6ab5e557-0bc2-4d2e-a3d8-d595db23b219 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.625231 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6677dfc5-bf84-469f-8986-8550fc5487e4 req-6ab5e557-0bc2-4d2e-a3d8-d595db23b219 service nova] Creating event network-vif-unplugged:b627e490-670e-4ea0-8156-cc7b8534fc17 for instance 6a20c148-622e-4917-8183-cd467bf2a83b on nch2-master-1 Jun 18 22:03:22.642702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6677dfc5-bf84-469f-8986-8550fc5487e4 req-6ab5e557-0bc2-4d2e-a3d8-d595db23b219 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083546 Jun 18 22:03:22.643642 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 300/593] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:22.649226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:22.651152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:22.664536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.665723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.669096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:22.669590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:22.991429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:23.007897 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e75e374-5af7-4d55-b839-e351039f187f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 200 len: 1473 microversion: 2.1 time: 0.362930 Jun 18 22:03:23.014489 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 301/594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:22 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 1473 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:23.019362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e84e2b1d-6fca-4cf9-84de-841b515706df req-50bfb4c8-f99d-484a-a3fc-1b0461c4b06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895ce88e-d460-48c8-8725-ce256689c9cb", "tag": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:23.029068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e84e2b1d-6fca-4cf9-84de-841b515706df req-50bfb4c8-f99d-484a-a3fc-1b0461c4b06e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.031917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e84e2b1d-6fca-4cf9-84de-841b515706df req-50bfb4c8-f99d-484a-a3fc-1b0461c4b06e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.054834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e84e2b1d-6fca-4cf9-84de-841b515706df req-50bfb4c8-f99d-484a-a3fc-1b0461c4b06e service nova] Creating event network-changed:ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e for instance 895ce88e-d460-48c8-8725-ce256689c9cb on nch2-master-1 Jun 18 22:03:23.060472 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e84e2b1d-6fca-4cf9-84de-841b515706df req-50bfb4c8-f99d-484a-a3fc-1b0461c4b06e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044650 Jun 18 22:03:23.061946 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 302/595] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:23.067148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:23.081603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:23.092384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.093146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.094791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.095400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.129679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Lazy-loading 'flavor' on Instance uuid 81f7013c-d348-42e9-9f1c-8904d844d7d7 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:23.149717 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 while it is in vm_state suspended Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Request method failure captured: Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7/action HTTP/1.1 Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 97 Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktv6nWDrIt9PlkJ0oEn7ZCgs-TUt13O6-6pZdLwl_SCQ3m_d01Pnye-wjP3-t_hUpoMDWT67E59rPcyisO3EefVjjVRcELoPPsCFWrfPQQao3g9Pq7ChV-LpvNsHecTantjgid3xy1kX71HtgWaLHXkWfm8pEkrt4pk_-ZX3NSK8yw Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 5faaae9647da4088a0abfba5c48320b2 Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-LiveMigrationNegativeTest-756821475 Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:03:23.154282 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5faaae9647da4088a0abfba5c48320b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5faaae9647da4088a0abfba5c48320b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5faaae9647da4088a0abfba5c48320b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5faaae9647da4088a0abfba5c48320b2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-LiveMigrationNegativeTest-756821475 Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 5faaae9647da4088a0abfba5c48320b2 Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-756821475 Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-LiveMigrationNegativeTest-756821475-project-admin Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d23a12015c6e436786b575431bc643d2 Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-LiveMigrationNegativeTest-756821475-project-admin Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Jun 18 22:03:23.155648 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'os-migrateLive' instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 while it is in vm_state suspended Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '81f7013c-d348-42e9-9f1c-8904d844d7d7', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 18 22:03:23.156358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:03:23.157505 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 while it is in vm_state suspended Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 while it is in vm_state suspended Jun 18 22:03:23.158644 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:23.162510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 while it is in vm_state suspended {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:23.162765 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9d20f43-9e83-47b6-9eaf-b1f489476ecd tempest-LiveMigrationNegativeTest-756821475 tempest-LiveMigrationNegativeTest-756821475-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7/action" status: 409 len: 155 microversion: 2.1 time: 0.099676 Jun 18 22:03:23.168535 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 303/596] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:23 2022] POST /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7/action => generated 155 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:03:23.174265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:23.174960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:23.182644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.183694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.184668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.185266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.555292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Updating instance_info_cache with network_info: [{"id": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e", "address": "fa:16:3e:1f:3d:6a", "network": {"id": "e17875e3-e111-45e6-a0c0-c6b1e856376c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1800056884-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b63c52467494445b437e444a52e075e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapad1e41b9-cb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:03:23.585955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Releasing lock "refresh_cache-895ce88e-d460-48c8-8725-ce256689c9cb" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:03:23.587022 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25579f74-2a1a-4477-aa27-0e2815a4e347 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb/action" status: 202 len: 0 microversion: 2.1 time: 3.736707 Jun 18 22:03:23.587858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 294/597] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:19 2022] POST /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb/action => generated 0 bytes in 3738 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:03:23.595574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:23.597878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:23.607919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.608704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.611267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.615488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.676118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:23.687963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:23.690289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:23.692010 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fa4c1f7-d857-4882-a3fe-1d8513fc0672 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.521966 Jun 18 22:03:23.693343 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 304/598] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:23 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:23.698481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1748810010"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:23.700050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:23.710003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.710843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.711946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.712914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.925985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:23.938590 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e03b90fd-e214-4f19-ab0a-02755e92f1a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.347917 Jun 18 22:03:23.940679 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 295/599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:23 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:23.951173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:23.953841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:23.966970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.967429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:23.968245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:23.968663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.007461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:24.110628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:24.125644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=12,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:24.157204 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-27e41f03-3832-47a8-9716-c0e2df9abb91 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 204 len: 0 microversion: 2.1 time: 0.214283 Jun 18 22:03:24.159673 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 296/600] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:23 2022] DELETE /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:24.172175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:24.173689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:24.181714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.183202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.186351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.186980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.191206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc1be8cf-18c7-4d0c-aa5c-48d441bc9beb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0/action" status: 202 len: 0 microversion: 2.1 time: 0.496243 Jun 18 22:03:24.191861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 305/601] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:23 2022] POST /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:03:24.203846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:24.204443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:24.217336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.217798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.219626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.220066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.296694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:24.460351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0889d814-96ca-47f7-9062-a38e0a3163e1 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "DELETE /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 204 len: 0 microversion: 2.1 time: 0.260377 Jun 18 22:03:24.462075 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 306/602] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:24 2022] DELETE /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:24.468386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:24.472243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:24.489263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.493675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.496467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.496595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.647990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:24.660767 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c79e9eac-2052-4c53-a1df-5d2ffe9bc198 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1503 microversion: 2.1 time: 0.496207 Jun 18 22:03:24.663708 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 297/603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:24 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:24.672944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5fe29d0e-d38f-495d-9c49-3cb07f51be18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14859f70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:24.733160 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5fe29d0e-d38f-495d-9c49-3cb07f51be18 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.067463 Jun 18 22:03:24.739008 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 298/604] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:24 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:24.744805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'action', calling method: .version_select at 0x7fea16fd4a60>, body: {"addFloatingIp": {"address": "172.35.2.213"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:24.746144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:24.753549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.754195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.755136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.755726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.788819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Acquired lock "refresh_cache-78dffd72-8475-4bb2-a66a-7919e902e9df" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:03:24.801447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:24.814812 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73abda43-fff1-4648-99c8-90eefcc4f731 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1464 microversion: 2.1 time: 0.351153 Jun 18 22:03:24.822043 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 307/605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:24 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:24.829833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:24.830353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:24.850916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.853481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.855904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:24.856406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:24.924711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:25.043110 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e744712-0037-41f5-864e-bbcddd10903e tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 204 len: 0 microversion: 2.1 time: 0.219726 Jun 18 22:03:25.044012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 308/606] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:24 2022] DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:25.061761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f7eb5665-f797-4f44-9c79-79f09f94d5b1 req-f5a44553-491b-42d7-a0b2-834273b491a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0ac13-8caa-4624-a0d1-bbc8e938f068", "name": "network-vif-unplugged", "status": "completed", "tag": "3ffec254-22f3-4483-b4ed-5f41380ce50c"}, {"name": "network-changed", "server_uuid": "a2cda02d-382a-44e4-99c8-614e7cf17b1d", "tag": "a3e1ef97-77e2-445b-90d4-3c9dfe6c5db1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:25.071979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f7eb5665-f797-4f44-9c79-79f09f94d5b1 req-f5a44553-491b-42d7-a0b2-834273b491a6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:25.072480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f7eb5665-f797-4f44-9c79-79f09f94d5b1 req-f5a44553-491b-42d7-a0b2-834273b491a6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:25.094294 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f7eb5665-f797-4f44-9c79-79f09f94d5b1 req-f5a44553-491b-42d7-a0b2-834273b491a6 service nova] Creating event network-vif-unplugged:3ffec254-22f3-4483-b4ed-5f41380ce50c for instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 on nch1-master-1 Jun 18 22:03:25.095206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f7eb5665-f797-4f44-9c79-79f09f94d5b1 req-f5a44553-491b-42d7-a0b2-834273b491a6 service nova] Creating event network-changed:a3e1ef97-77e2-445b-90d4-3c9dfe6c5db1 for instance a2cda02d-382a-44e4-99c8-614e7cf17b1d on nch1-master-1 Jun 18 22:03:25.102434 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f7eb5665-f797-4f44-9c79-79f09f94d5b1 req-f5a44553-491b-42d7-a0b2-834273b491a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.045668 Jun 18 22:03:25.103406 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 309/607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:25.113053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:25.114537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:25.125255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:25.126366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:25.127581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:25.128228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:25.475071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:25.489923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:25.491439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:25.492602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9cd06bda-fe2e-40a0-99ef-c836e3854a17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.385379 Jun 18 22:03:25.502990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 310/608] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:25 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:25.502990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:25.502990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:25.509514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:25.510012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:25.511166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:25.511310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:26.019848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:26.031985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d846878-f623-4758-83d3-300ff99c9755 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.533213 Jun 18 22:03:26.041717 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 311/609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:25 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:26.049207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-487492067", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "1789190926", "adminPass": "***", "networks": [{"uuid": "b6fa8c18-e27f-42b6-b347-f25f64afe705"}], "security_groups": [{"name": "tempest-securitygroup--1637522356"}], "key_name": "tempest-keypair-528000322", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:26.237275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] validate_networks() for [('b6fa8c18-e27f-42b6-b347-f25f64afe705', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:26.997986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Building network info cache for instance {{(pid=130903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:03:27.237857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:27.238453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:27.238743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:27.239418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:27.240012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:27.254369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:27.257936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:27.259095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:27.261828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:27.307624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Getting quotas for project dad7b33b97ba48a6a4989ff35985a4ca. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:27.323779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Getting quotas for user 79c12f29545c40ec955650696bb91a65 and project dad7b33b97ba48a6a4989ff35985a4ca. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:27.338778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:27.343288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:27.414925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:27.426214 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ea695112-ca00-43ba-82f7-ef8c5829fe80 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.383075 Jun 18 22:03:27.428315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 312/610] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:03:27.441689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:27.444054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:27.446006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=59,nova_cell0:UPDATE=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:27.454118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:27.455932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:27.456575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:27.457707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:27.458347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:28.210677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:28.222706 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-03285725-12c6-4e2e-bf70-338b4e54664b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1493 microversion: 2.1 time: 0.789948 Jun 18 22:03:28.236761 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 313/611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:27 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1493 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:28.243199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d025616d-8c24-44e9-911b-df8fa617bade tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14902430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:28.353781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d025616d-8c24-44e9-911b-df8fa617bade tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.115042 Jun 18 22:03:28.354813 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 314/612] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:28 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:28.360240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:28.361166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:28.368744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:28.369573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:28.370748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:28.371585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:29.023179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Updating instance_info_cache with network_info: [{"id": "43465871-6115-43f5-abc6-7a0d1c2533d4", "address": "fa:16:3e:7c:2e:98", "network": {"id": "e17875e3-e111-45e6-a0c0-c6b1e856376c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1800056884-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b63c52467494445b437e444a52e075e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap43465871-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:03:29.057397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Releasing lock "refresh_cache-78dffd72-8475-4bb2-a66a-7919e902e9df" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:03:29.061765 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-acc1014f-e5f3-4c73-b8d5-a4fb401a7caf tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action" status: 202 len: 0 microversion: 2.1 time: 4.321110 Jun 18 22:03:29.063151 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 299/613] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:24 2022] POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action => generated 0 bytes in 4323 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:03:29.090247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:29.096569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:29.122903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:29.123560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:29.125815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:29.126771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:29.185232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:29.196451 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86b47034-3db4-4bab-b4f8-bd59e6950cf4 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1464 microversion: 2.1 time: 0.840032 Jun 18 22:03:29.199768 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 315/614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:28 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1464 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:29.400788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1567423188", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "ecf270c2-fa45-4f50-b885-5754dbdc2136"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:29.541762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:29.561920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:29.570171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:29.571421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6312afbc-6f06-44ae-9e82-f53f3d01baef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.505835 Jun 18 22:03:29.577090 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 300/615] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:29 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:29.595989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-50f958a3-48dc-4e59-82c9-b7c4788d84b9 req-55fdbb84-3da8-4b31-aab6-070ac37605fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:29.616141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-50f958a3-48dc-4e59-82c9-b7c4788d84b9 req-55fdbb84-3da8-4b31-aab6-070ac37605fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:29.623097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-50f958a3-48dc-4e59-82c9-b7c4788d84b9 req-55fdbb84-3da8-4b31-aab6-070ac37605fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:29.661380 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-50f958a3-48dc-4e59-82c9-b7c4788d84b9 req-55fdbb84-3da8-4b31-aab6-070ac37605fe service nova] Creating event network-changed:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:03:29.675763 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-50f958a3-48dc-4e59-82c9-b7c4788d84b9 req-55fdbb84-3da8-4b31-aab6-070ac37605fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097204 Jun 18 22:03:29.676768 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 301/616] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:29.687266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:29.701299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:29.723030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:29.723786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:29.724748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:29.728299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:29.927184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] validate_networks() for [('ecf270c2-fa45-4f50-b885-5754dbdc2136', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:30.539388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:30.551459 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eb9cc385-7f84-4bc0-b0be-ce10992266e6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.871302 Jun 18 22:03:30.557877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 302/617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:29 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:30.569560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1c798db3-0c61-4084-896a-597308021c9b req-d566daad-6c19-48b0-be73-7ab933c5c1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb0ac13-8caa-4624-a0d1-bbc8e938f068", "tag": "3ffec254-22f3-4483-b4ed-5f41380ce50c"}, {"server_uuid": "895ce88e-d460-48c8-8725-ce256689c9cb", "name": "network-vif-deleted", "tag": "ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:30.610157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1c798db3-0c61-4084-896a-597308021c9b req-d566daad-6c19-48b0-be73-7ab933c5c1a6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:30.610906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1c798db3-0c61-4084-896a-597308021c9b req-d566daad-6c19-48b0-be73-7ab933c5c1a6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:30.628490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1c798db3-0c61-4084-896a-597308021c9b req-d566daad-6c19-48b0-be73-7ab933c5c1a6 service nova] Creating event network-changed:3ffec254-22f3-4483-b4ed-5f41380ce50c for instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 on nch1-master-1 Jun 18 22:03:30.629193 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1c798db3-0c61-4084-896a-597308021c9b req-d566daad-6c19-48b0-be73-7ab933c5c1a6 service nova] Creating event network-vif-deleted:ad1e41b9-cb5d-4fc6-963a-c0d5f43ec85e for instance 895ce88e-d460-48c8-8725-ce256689c9cb on nch2-master-1 Jun 18 22:03:30.643515 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1c798db3-0c61-4084-896a-597308021c9b req-d566daad-6c19-48b0-be73-7ab933c5c1a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084059 Jun 18 22:03:30.644702 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 303/618] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:30.653666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:30.671480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:30.689783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:30.691107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:30.692227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:30.692913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:30.911355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:30.947103 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d789a36-5eeb-4cac-9639-8377475d4c7f tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1321 microversion: 2.1 time: 0.300556 Jun 18 22:03:30.954409 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 304/619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:30 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:30.963429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f9df893-6fb2-4366-9a1b-34da060859b3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '.version_select at 0x7fea14854160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:30.971633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f9df893-6fb2-4366-9a1b-34da060859b3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:30.973211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f9df893-6fb2-4366-9a1b-34da060859b3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.020821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f9df893-6fb2-4366-9a1b-34da060859b3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.065060 Jun 18 22:03:31.026462 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 305/620] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:03:30 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:31.031419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f0722ee-2be5-4626-8507-0a7d2436b8d2 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '.version_select at 0x7fea14931700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:31.496235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:31.496745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:31.497167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:31.497589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:31.498004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:31.516816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.517936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.519436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.520115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.555227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Getting quotas for project c5893b4b7c9c49bf87729b506675446e. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:31.572180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Getting quotas for user db0ce8caf601458c94d03b85b37e4371 and project c5893b4b7c9c49bf87729b506675446e. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:31.606714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:31.608892 ncdv-master-1 devstack@n-api.service[130902]: WARNING nova.utils [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1567423188 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-156742318 Jun 18 22:03:31.622839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:31.630801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f0722ee-2be5-4626-8507-0a7d2436b8d2 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/e3c373b5-e140-4344-bc9b-beabe2969906" status: 200 len: 184 microversion: 2.1 time: 0.602970 Jun 18 22:03:31.638037 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 306/621] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:03:31 2022] GET /compute/v2.1/os-floating-ips/e3c373b5-e140-4344-bc9b-beabe2969906 => generated 184 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:31.646892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b9aa16d-2da5-4692-9cf3-1920253c7b1d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14854280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:31.727203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b7bd50c9-8f12-420b-9602-7f98f52e0f2a tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.525748 Jun 18 22:03:31.729462 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 316/622] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:03:31.744310 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b9aa16d-2da5-4692-9cf3-1920253c7b1d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.084970 Jun 18 22:03:31.746460 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 307/623] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:31 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:31.748591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:31.749859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:31.759146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.759853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:31.760674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.761922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:31.762339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.762899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.773356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.774708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.775809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.776482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.823389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:31.823842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:31.824295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lazy-loading 'fault' on Instance uuid 81f7013c-d348-42e9-9f1c-8904d844d7d7 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:31.922160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:31.967274 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f98abb88-ad28-42bd-9414-0428449901a3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 200 len: 1308 microversion: 2.1 time: 0.208158 Jun 18 22:03:32.020386 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 317/624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:31 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:32.054490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:32.055269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:32.075217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.075670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.076514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.076947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.108405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:32.118652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:32.123093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:32.126225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b009eed6-aece-445f-8bf5-b49be0d62025 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.378725 Jun 18 22:03:32.128791 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 308/625] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:31 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:32.142586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6e32b909-ee75-404a-bf3c-71fedb306c01 req-092baa22-e354-48ef-90a3-b500333d67ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf95372-e587-4ff1-b0ad-168c53b2732a", "name": "network-vif-unplugged", "status": "completed", "tag": "da0dbb4c-1902-431d-bf2a-102b1b5e2ad3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:32.180022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6e32b909-ee75-404a-bf3c-71fedb306c01 req-092baa22-e354-48ef-90a3-b500333d67ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.180864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6e32b909-ee75-404a-bf3c-71fedb306c01 req-092baa22-e354-48ef-90a3-b500333d67ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.208610 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6e32b909-ee75-404a-bf3c-71fedb306c01 req-092baa22-e354-48ef-90a3-b500333d67ad service nova] Creating event network-vif-unplugged:da0dbb4c-1902-431d-bf2a-102b1b5e2ad3 for instance adf95372-e587-4ff1-b0ad-168c53b2732a on nch1-master-1 Jun 18 22:03:32.219680 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6e32b909-ee75-404a-bf3c-71fedb306c01 req-092baa22-e354-48ef-90a3-b500333d67ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088541 Jun 18 22:03:32.230775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 309/626] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:32.248906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:32.251630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:32.273907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.274667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.276567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.278371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.347531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3bb1ac6e-7a90-407b-8496-1482dde054d0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1644 microversion: 2.1 time: 0.325798 Jun 18 22:03:32.348616 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 318/627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:32 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1644 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:32.356175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Action: 'action', calling method: .version_select at 0x7fea16fd38b0>, body: {"removeFloatingIp": {"address": "172.35.2.213"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:32.680111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:32.687022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.690077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.691993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.693169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.703695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:32.713752 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5fa5c97a-e4a9-46a5-ae83-f08724b336d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.480718 Jun 18 22:03:32.714955 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 310/628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:32 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:32.724092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:32.725324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:32.736813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.737681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.738707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:32.739306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:32.960876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:32.986951 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b36dd59-49bf-4707-92a8-a51ada3719cc tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1236 microversion: 2.1 time: 0.268276 Jun 18 22:03:33.002197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 311/629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:32 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1236 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:33.007451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:33.013436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:33.040896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:33.042125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:33.043871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:33.045508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:33.242311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:33.253483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9939185-6fb1-4f9f-a79e-618431132de9 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1321 microversion: 2.1 time: 0.257059 Jun 18 22:03:33.257334 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 312/630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:32 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:33.268914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-851867789", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "739254b4-0b9e-4570-96ec-dfd475b9db29"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:33.336151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Acquired lock "refresh_cache-78dffd72-8475-4bb2-a66a-7919e902e9df" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:03:33.429356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] validate_networks() for [('739254b4-0b9e-4570-96ec-dfd475b9db29', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:35.892330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:35.893637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:35.894292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:35.894895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:35.895477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:35.925590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:35.928919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:35.936297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:35.937623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:35.953736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Building network info cache for instance {{(pid=130902) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:03:36.045772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:36.067045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for user 681cfb0e560145b4abef98dbd417f3e0 and project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:36.110758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:36.116352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:36.254609 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef790cfa-bc77-4618-a0c4-edf96dbe3b0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.995924 Jun 18 22:03:36.262375 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 313/631] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:03:36.270931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf6ae259-d443-4b83-83c7-e9a9229336d7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea148a6c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:36.439860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf6ae259-d443-4b83-83c7-e9a9229336d7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.180224 Jun 18 22:03:36.444346 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 314/632] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:36 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:36.451450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:36.452102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 81f7013c-d348-42e9-9f1c-8904d844d7d7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:36.476314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:36.476776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:36.481403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:36.481869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:36.485198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:36.555566 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] HTTP exception thrown: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 could not be found. Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Request method failure captured: Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 HTTP/1.1 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkttkZc3q10kmyFjiMNdHnkl1wVknrCEm5wwSI3Z3rSIvoquc4hph5TUzyGxazhQUqChCjQIb8YUvSj6jUTGRXYE7O2fTzHiIKjJbLb3OMT-Uy4LS--hBYn5kUQtfbM2bmxwXLzAGX6RwG-I3OteR2XqbLdYqNju2S5_ZG6JYe-GBC4 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8a610355b4324f8f8bac4b1673685d44 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveMigrationNegativeTest-1004805103 Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:03:36.558947 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8a610355b4324f8f8bac4b1673685d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8a610355b4324f8f8bac4b1673685d44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8a610355b4324f8f8bac4b1673685d44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8a610355b4324f8f8bac4b1673685d44", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveMigrationNegativeTest-1004805103 Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8a610355b4324f8f8bac4b1673685d44 Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1004805103 Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveMigrationNegativeTest-1004805103-project Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 02a8362ef1d14be9b41ba2e6c904807f Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveMigrationNegativeTest-1004805103-project Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 could not be found. Jun 18 22:03:36.560859 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '81f7013c-d348-42e9-9f1c-8904d844d7d7'} Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 could not be found. Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:36.561829 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 could not be found. Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 could not be found. Jun 18 22:03:36.564089 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:03:36.566745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Returning 404 to user: Instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:36.566745 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5d4a55d-42ad-4958-b513-bb706c1f6354 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7" status: 404 len: 111 microversion: 2.1 time: 0.121014 Jun 18 22:03:36.570402 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 315/633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:36 2022] GET /compute/v2.1/servers/81f7013c-d348-42e9-9f1c-8904d844d7d7 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:36.590418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:36.591445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:36.609355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:36.609838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:36.611427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:36.613079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.217902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:37.239130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:37.244835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:37.248529 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3393f0b0-bd98-4dcf-bd65-d37c34aaa3f8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.675932 Jun 18 22:03:37.249188 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 316/634] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:36 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:37.268823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9fe1127e-1134-4706-bb44-a3f68888653b req-efd9af20-25a6-4373-af4a-457bbd245620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f7013c-d348-42e9-9f1c-8904d844d7d7", "name": "network-vif-deleted", "tag": "28eca057-81a8-4140-bcc6-ddb807338d2f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:37.281161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Updating instance_info_cache with network_info: [{"id": "43465871-6115-43f5-abc6-7a0d1c2533d4", "address": "fa:16:3e:7c:2e:98", "network": {"id": "e17875e3-e111-45e6-a0c0-c6b1e856376c", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1800056884-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b63c52467494445b437e444a52e075e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap43465871-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:03:37.299708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Releasing lock "refresh_cache-78dffd72-8475-4bb2-a66a-7919e902e9df" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:03:37.304608 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21edaeb4-a3ec-4199-9be4-845a51f26132 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action" status: 202 len: 0 microversion: 2.1 time: 4.954617 Jun 18 22:03:37.309930 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 319/635] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:32 2022] POST /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df/action => generated 0 bytes in 4960 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:03:37.313726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9fe1127e-1134-4706-bb44-a3f68888653b req-efd9af20-25a6-4373-af4a-457bbd245620 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.314212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9fe1127e-1134-4706-bb44-a3f68888653b req-efd9af20-25a6-4373-af4a-457bbd245620 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.331749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:37.338256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:37.362305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.362768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.363571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.366735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.371592 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9fe1127e-1134-4706-bb44-a3f68888653b req-efd9af20-25a6-4373-af4a-457bbd245620 service nova] Creating event network-vif-deleted:28eca057-81a8-4140-bcc6-ddb807338d2f for instance 81f7013c-d348-42e9-9f1c-8904d844d7d7 on nch1-master-1 Jun 18 22:03:37.377567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9fe1127e-1134-4706-bb44-a3f68888653b req-efd9af20-25a6-4373-af4a-457bbd245620 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121207 Jun 18 22:03:37.378814 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 317/636] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:37.391277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:37.396359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:37.410870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:37.411536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.412060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.413009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.415389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.678590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:37.692923 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-87c9db44-a965-44fe-b52f-89d3cd638946 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.309062 Jun 18 22:03:37.694336 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 318/637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:37 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:37.708004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:37.709275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:37.722556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.723938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.726111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.726863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.743465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:37.780968 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fbe569a-7f73-4997-aa31-8dfa0fe636fe tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.467554 Jun 18 22:03:37.796793 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 320/638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:37 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:37.811041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ea0da174-fbc0-4fac-a346-06f0c78be783 req-72e3f650-507b-46d5-be75-9b73f3e4abd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67d33e4-d613-42be-8321-005a5ef130f0", "name": "network-vif-plugged", "status": "completed", "tag": "358af369-3e3e-422f-bc34-0998011b792c"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:37.879304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea0da174-fbc0-4fac-a346-06f0c78be783 req-72e3f650-507b-46d5-be75-9b73f3e4abd6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:37.889973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea0da174-fbc0-4fac-a346-06f0c78be783 req-72e3f650-507b-46d5-be75-9b73f3e4abd6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:37.923200 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ea0da174-fbc0-4fac-a346-06f0c78be783 req-72e3f650-507b-46d5-be75-9b73f3e4abd6 service nova] Creating event network-vif-plugged:358af369-3e3e-422f-bc34-0998011b792c for instance e67d33e4-d613-42be-8321-005a5ef130f0 on nch2-master-1 Jun 18 22:03:37.940804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ea0da174-fbc0-4fac-a346-06f0c78be783 req-72e3f650-507b-46d5-be75-9b73f3e4abd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139972 Jun 18 22:03:37.947893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 321/639] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:37.956125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-577d4487-bd2f-4f70-817f-b0fa3cbdd6a2 req-1c5d9e09-b5cc-4bd3-8cb7-0c59c30b6448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:38.002647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-577d4487-bd2f-4f70-817f-b0fa3cbdd6a2 req-1c5d9e09-b5cc-4bd3-8cb7-0c59c30b6448 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.003979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-577d4487-bd2f-4f70-817f-b0fa3cbdd6a2 req-1c5d9e09-b5cc-4bd3-8cb7-0c59c30b6448 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.046790 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-577d4487-bd2f-4f70-817f-b0fa3cbdd6a2 req-1c5d9e09-b5cc-4bd3-8cb7-0c59c30b6448 service nova] Creating event network-changed:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:03:38.053935 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-577d4487-bd2f-4f70-817f-b0fa3cbdd6a2 req-1c5d9e09-b5cc-4bd3-8cb7-0c59c30b6448 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103335 Jun 18 22:03:38.055749 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 322/640] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:38.064044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.065980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:38.088010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.088831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.092428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.095374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.106602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:38.118740 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-360c9a3a-6bc1-4049-8724-41e57a661628 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1389 microversion: 2.1 time: 0.422587 Jun 18 22:03:38.128118 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 319/641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:37 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1389 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:38.139779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.142753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:38.157077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.158329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.159153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.160095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.265727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:38.297693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:38.308047 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c86c64ce-3e7b-425b-95fe-5a577d3f7d41 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1262 microversion: 2.1 time: 0.250071 Jun 18 22:03:38.308643 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 323/642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:38 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1262 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:38.347116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.347895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:38.364077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.364538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.369955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.371126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.437307 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] HTTP exception thrown: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Request method failure captured: Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb HTTP/1.1 Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktf4XX-x7SvQKMbsh3S1UoY5f2LFMFmaqt0Dz-WrhJlRUmwvzkxu2tSgAaTxYmnZL69aK-BrAWdf4-UiA1m0ZpT_c3B4s1g6SCWh4FvM9QQ2PBIoJRkOsc-lPcNv6mxWwO72qnYQK7tO29Cv4QLh2w5tS8O0ahWoOEjTMae1x6ef24 Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:03:38.439070 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b63c52467494445b437e444a52e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b63c52467494445b437e444a52e075e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 58c3911cbbdf4e35ae8df9eb8b23f22d Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.440705 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '895ce88e-d460-48c8-8725-ce256689c9cb'} Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:38.441473 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.442629 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.443803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Returning 404 to user: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:38.443803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-891a5afb-8e01-4ade-ad4d-930c24fd8e14 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "DELETE /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 404 len: 111 microversion: 2.1 time: 0.109519 Jun 18 22:03:38.462731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 324/643] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:38 2022] DELETE /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:38.470489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c8ccd9a-4d09-4c3e-b4d5-54308b4eb74c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14a498b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.534334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c79df3b2-d9e4-4274-a0d5-8454646cf833 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "DELETE /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 204 len: 0 microversion: 2.1 time: 0.405388 Jun 18 22:03:38.538731 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 320/644] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:38 2022] DELETE /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:38.550450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.551214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:38.567718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.568334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.568999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.574501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.586967 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c8ccd9a-4d09-4c3e-b4d5-54308b4eb74c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.122974 Jun 18 22:03:38.588134 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 325/645] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:38 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:38.595927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.600083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 895ce88e-d460-48c8-8725-ce256689c9cb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:38.615000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.618158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.619407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.621401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.686050 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] HTTP exception thrown: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Request method failure captured: Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb HTTP/1.1 Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktf4XX-x7SvQKMbsh3S1UoY5f2LFMFmaqt0Dz-WrhJlRUmwvzkxu2tSgAaTxYmnZL69aK-BrAWdf4-UiA1m0ZpT_c3B4s1g6SCWh4FvM9QQ2PBIoJRkOsc-lPcNv6mxWwO72qnYQK7tO29Cv4QLh2w5tS8O0ahWoOEjTMae1x6ef24 Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:03:38.701842 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b63c52467494445b437e444a52e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b63c52467494445b437e444a52e075e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 58c3911cbbdf4e35ae8df9eb8b23f22d Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.703270 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '895ce88e-d460-48c8-8725-ce256689c9cb'} Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:38.703985 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. Jun 18 22:03:38.705166 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:38.707432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Returning 404 to user: Instance 895ce88e-d460-48c8-8725-ce256689c9cb could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:38.707432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8eeb01dd-49ad-4569-aa7e-03d697cff2a8 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb" status: 404 len: 111 microversion: 2.1 time: 0.114271 Jun 18 22:03:38.707687 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 326/646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:38 2022] GET /compute/v2.1/servers/895ce88e-d460-48c8-8725-ce256689c9cb => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:38.721925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:38.722574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:38.751192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.752980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:38.753991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:38.757477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:39.169554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:39.179340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:39.188252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:39.197423 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef579fae-6783-44cf-84e1-93cc08647083 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.658998 Jun 18 22:03:39.199098 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 321/647] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:38 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:39.211875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:39.212788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:39.219565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:39.232041 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f5ea960f-04f2-486a-82fc-91b1f5bb8825 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1475 microversion: 2.1 time: 0.519560 Jun 18 22:03:39.244654 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 327/648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:38 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1475 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:39.248336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:39.252203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b86370f5-6047-40e0-9ab9-b00b07b24b23 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '.version_select at 0x7fea14adf040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:39.253022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:39.254107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:39.257145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:39.850641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:39.863434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ad5ea224-bac7-4f0c-a400-9418a1d92a52 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.663090 Jun 18 22:03:39.866091 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 322/649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:39 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:39.883175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:39.891041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:39.903215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:39.904524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:39.906346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:39.910185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:40.831318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:40.851346 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-333600d7-6ff3-4fd6-bbe8-ce6a17cd8dde tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.977512 Jun 18 22:03:40.861429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 323/650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:39 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:40.866516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:40.872180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:40.885788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:40.886613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:40.887616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:40.888233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:41.336279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:41.349644 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-97ce79e5-9656-4c4e-bf11-119f4a00def1 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1389 microversion: 2.1 time: 0.482815 Jun 18 22:03:41.359126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 324/651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:40 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1389 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:41.371650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:41.374291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:41.387559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:41.388361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:41.389444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:41.390093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:41.543422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:41.594932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:41.753007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:41.764883 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3202d84d-6310-4d07-8a92-52ade2da7c95 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.411997 Jun 18 22:03:41.765829 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 325/652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:41 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:41.770490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb9ddd1f-c8d7-444b-94c8-de3262071252 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea147c7700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:41.866200 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb9ddd1f-c8d7-444b-94c8-de3262071252 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.099111 Jun 18 22:03:41.866819 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 326/653] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:41 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:41.878628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf95372-e587-4ff1-b0ad-168c53b2732a", "name": "network-vif-deleted", "tag": "da0dbb4c-1902-431d-bf2a-102b1b5e2ad3"}, {"server_uuid": "afb0ac13-8caa-4624-a0d1-bbc8e938f068", "name": "network-vif-unplugged", "status": "completed", "tag": "3ffec254-22f3-4483-b4ed-5f41380ce50c"}, {"name": "network-changed", "server_uuid": "210b3808-a777-4302-962d-be85bff00e6a", "tag": "0c6e286c-a838-4bcc-9852-a5e035068f99"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:41.900761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:41.903722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:41.923374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] Creating event network-vif-deleted:da0dbb4c-1902-431d-bf2a-102b1b5e2ad3 for instance adf95372-e587-4ff1-b0ad-168c53b2732a on nch1-master-1 Jun 18 22:03:41.923873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] Creating event network-vif-unplugged:3ffec254-22f3-4483-b4ed-5f41380ce50c for instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 on nch1-master-1 Jun 18 22:03:41.924582 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] Creating event network-changed:0c6e286c-a838-4bcc-9852-a5e035068f99 for instance 210b3808-a777-4302-962d-be85bff00e6a on nch2-master-1 Jun 18 22:03:41.936797 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-eb6b937b-3e0d-4a96-a189-2bb967080b24 req-e1e52444-ce03-4c32-89d4-963ba203065d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.068538 Jun 18 22:03:41.937679 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 327/654] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:41.943113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2fa2d5c8-b74e-4ebc-ac2d-f916a8168f7a req-5eb2c6e9-f432-4662-9d5b-e10c273c0b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cda02d-382a-44e4-99c8-614e7cf17b1d", "name": "network-vif-plugged", "status": "completed", "tag": "a3e1ef97-77e2-445b-90d4-3c9dfe6c5db1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:41.953953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2fa2d5c8-b74e-4ebc-ac2d-f916a8168f7a req-5eb2c6e9-f432-4662-9d5b-e10c273c0b9c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:41.954646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2fa2d5c8-b74e-4ebc-ac2d-f916a8168f7a req-5eb2c6e9-f432-4662-9d5b-e10c273c0b9c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:41.967203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2fa2d5c8-b74e-4ebc-ac2d-f916a8168f7a req-5eb2c6e9-f432-4662-9d5b-e10c273c0b9c service nova] Creating event network-vif-plugged:a3e1ef97-77e2-445b-90d4-3c9dfe6c5db1 for instance a2cda02d-382a-44e4-99c8-614e7cf17b1d on nch1-master-1 Jun 18 22:03:41.974835 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2fa2d5c8-b74e-4ebc-ac2d-f916a8168f7a req-5eb2c6e9-f432-4662-9d5b-e10c273c0b9c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035533 Jun 18 22:03:41.979477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 328/655] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:41.997499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:41.999334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:42.007225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.008107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.009809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.010408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.190729 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b86370f5-6047-40e0-9ab9-b00b07b24b23 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/e3c373b5-e140-4344-bc9b-beabe2969906" status: 202 len: 0 microversion: 2.1 time: 2.944327 Jun 18 22:03:42.192214 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 328/656] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:03:39 2022] DELETE /compute/v2.1/os-floating-ips/e3c373b5-e140-4344-bc9b-beabe2969906 => generated 0 bytes in 2947 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:03:42.197451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:42.198365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:42.216335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.216784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.217610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.218044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.290561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.291364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.291972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lazy-loading 'fault' on Instance uuid 90d039b9-d9c8-4691-b4ad-f293cd66d34e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:42.363834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a8362ef1d14be9b41ba2e6c904807f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a610355b4324f8f8bac4b1673685d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:42.375079 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3272c52c-e05b-4dca-9634-0871ca5e3ce3 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 200 len: 1309 microversion: 2.1 time: 0.181560 Jun 18 22:03:42.380494 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 329/657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:42 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:42.398543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:42.404139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:42.426398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.427214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.429840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.430450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.531834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:42.546369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:42.547893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:42.549119 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-789f6804-01d1-40c7-9095-e8db8022d608 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.567932 Jun 18 22:03:42.553093 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 329/658] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:41 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:42.558719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:42.559359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:42.568205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.568541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.569363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.569802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.914463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:42.922972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0fdd25a-8c59-4502-9148-d88f00b90d47 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.540460 Jun 18 22:03:42.929569 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 330/659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:42 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:42.934993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:42.939705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:42.960644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.961624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:42.962690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:42.964203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.008733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:43.136051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:43.157888 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6bc91eab-11e2-4149-af6c-42240322bf04 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1316 microversion: 2.1 time: 0.603545 Jun 18 22:03:43.174973 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 330/660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:42 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1316 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:43.180927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:43.186246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:43.187127 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ec2406f-e4af-419f-9577-0536fe74a10f tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "DELETE /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 204 len: 0 microversion: 2.1 time: 0.253756 Jun 18 22:03:43.194299 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 331/661] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:42 2022] DELETE /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:43.204551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:43.205680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:43.209268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.209268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.215656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.222805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.232500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.233497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.236512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.240840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.708848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:43.725370 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-693c3d9c-f327-4c86-bf30-9162d1eb257a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.529346 Jun 18 22:03:43.726307 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 332/662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:43 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:43.731092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-751e98d2-4773-47b8-ad9f-021783ae30cd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea149023a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:43.740249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:43.749896 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e67e33cd-6381-452f-93f9-a12c74b573f2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1389 microversion: 2.1 time: 0.572490 Jun 18 22:03:43.750204 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 331/663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:43 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1389 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:43.755377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:43.756183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:43.763264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.765587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.766691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.773197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.857209 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-751e98d2-4773-47b8-ad9f-021783ae30cd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.129696 Jun 18 22:03:43.860335 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 333/664] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:43 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:43.871284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:43.871960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] [instance: 90d039b9-d9c8-4691-b4ad-f293cd66d34e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:43.887864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.889438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.890559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.891304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.914291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] HTTP exception thrown: Instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e could not be found. Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Request method failure captured: Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e HTTP/1.1 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkttkZc3q10kmyFjiMNdHnkl1wVknrCEm5wwSI3Z3rSIvoquc4hph5TUzyGxazhQUqChCjQIb8YUvSj6jUTGRXYE7O2fTzHiIKjJbLb3OMT-Uy4LS--hBYn5kUQtfbM2bmxwXLzAGX6RwG-I3OteR2XqbLdYqNju2S5_ZG6JYe-GBC4 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8a610355b4324f8f8bac4b1673685d44 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-LiveMigrationNegativeTest-1004805103 Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:03:43.927207 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8a610355b4324f8f8bac4b1673685d44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8a610355b4324f8f8bac4b1673685d44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8a610355b4324f8f8bac4b1673685d44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8a610355b4324f8f8bac4b1673685d44", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-LiveMigrationNegativeTest-1004805103 Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8a610355b4324f8f8bac4b1673685d44 Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1004805103 Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-LiveMigrationNegativeTest-1004805103-project Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 02a8362ef1d14be9b41ba2e6c904807f Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-LiveMigrationNegativeTest-1004805103-project Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e could not be found. Jun 18 22:03:43.929092 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '90d039b9-d9c8-4691-b4ad-f293cd66d34e'} Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e could not be found. Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:43.929823 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e could not be found. Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e could not be found. Jun 18 22:03:43.930956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:43.933676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] Returning 404 to user: Instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:43.934820 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02d152d2-1123-48b9-886c-ff591d35f465 tempest-LiveMigrationNegativeTest-1004805103 tempest-LiveMigrationNegativeTest-1004805103-project] 10.222.0.30 "GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e" status: 404 len: 111 microversion: 2.1 time: 0.073520 Jun 18 22:03:43.936309 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 334/665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:43 2022] GET /compute/v2.1/servers/90d039b9-d9c8-4691-b4ad-f293cd66d34e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:43.942229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1503db7d-50fe-4dcd-bd2f-3f14318bd67a req-fad09541-bebf-4249-9e51-144623892430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2915c85a-6454-4b71-9078-0375b4fbdc7e", "tag": "b9ec270a-bd87-4e67-83fd-6757c8bfb188"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:43.957896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1503db7d-50fe-4dcd-bd2f-3f14318bd67a req-fad09541-bebf-4249-9e51-144623892430 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:43.958723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1503db7d-50fe-4dcd-bd2f-3f14318bd67a req-fad09541-bebf-4249-9e51-144623892430 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:43.988159 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1503db7d-50fe-4dcd-bd2f-3f14318bd67a req-fad09541-bebf-4249-9e51-144623892430 service nova] Creating event network-changed:b9ec270a-bd87-4e67-83fd-6757c8bfb188 for instance 2915c85a-6454-4b71-9078-0375b4fbdc7e on nch1-master-1 Jun 18 22:03:43.997409 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1503db7d-50fe-4dcd-bd2f-3f14318bd67a req-fad09541-bebf-4249-9e51-144623892430 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059484 Jun 18 22:03:44.000814 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 335/666] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:44.009715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:44.013623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:44.046079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.046781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:44.047959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.048594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:44.168554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:44.183449 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39ee4fbb-79e3-4875-b1d1-29251b0f9f33 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1526 microversion: 2.1 time: 0.430499 Jun 18 22:03:44.184502 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 332/667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:43 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1526 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:44.196128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c744b224-8b94-4d14-bcff-bec5dc085d28 req-7b4d565c-f2e8-4768-83ba-6ffb678465b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f67d4bc-748f-4d54-912b-806862936a19", "tag": "45094155-19d5-4eb9-afe3-1c3e4479b7bb"}, {"server_uuid": "90d039b9-d9c8-4691-b4ad-f293cd66d34e", "name": "network-vif-deleted", "tag": "927caece-c695-4502-92bf-7789cee05a54"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:44.229759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c744b224-8b94-4d14-bcff-bec5dc085d28 req-7b4d565c-f2e8-4768-83ba-6ffb678465b5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.230259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c744b224-8b94-4d14-bcff-bec5dc085d28 req-7b4d565c-f2e8-4768-83ba-6ffb678465b5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:44.278750 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c744b224-8b94-4d14-bcff-bec5dc085d28 req-7b4d565c-f2e8-4768-83ba-6ffb678465b5 service nova] Creating event network-changed:45094155-19d5-4eb9-afe3-1c3e4479b7bb for instance 3f67d4bc-748f-4d54-912b-806862936a19 on nch2-master-1 Jun 18 22:03:44.284546 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c744b224-8b94-4d14-bcff-bec5dc085d28 req-7b4d565c-f2e8-4768-83ba-6ffb678465b5 service nova] Creating event network-vif-deleted:927caece-c695-4502-92bf-7789cee05a54 for instance 90d039b9-d9c8-4691-b4ad-f293cd66d34e on nch2-master-1 Jun 18 22:03:44.293328 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c744b224-8b94-4d14-bcff-bec5dc085d28 req-7b4d565c-f2e8-4768-83ba-6ffb678465b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.105790 Jun 18 22:03:44.294637 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 333/668] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:44.303236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:44.304309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:44.314042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.314888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:44.315957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.316629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:44.340337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:44.497667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:44.514476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:44.516251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:44.517698 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17198e5a-55b4-40ed-b5de-dfa1bbbb2cc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1567 microversion: 2.25 time: 0.512589 Jun 18 22:03:44.529217 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 336/669] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:44 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1567 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:44.535084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:44.536255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:44.543109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.543824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:44.544837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:44.545491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.202985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:45.216316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:45.217451 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac6c92d9-78f0-4a28-a1d1-0e2e10dc2347 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.920166 Jun 18 22:03:45.218064 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 334/670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:44 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:45.223722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:45.224651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:45.226069 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a87bd491-9225-4b44-a671-7a9ca5996306 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1466 microversion: 2.1 time: 0.695509 Jun 18 22:03:45.227219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 337/671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:44 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1466 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:45.231102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.231549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.232324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.232794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:45.233122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.233644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:45.245443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.246064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.247063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.247595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.483191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:45.495444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f66e0fc-de6b-4d09-a6eb-1f5c148d8bf2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1389 microversion: 2.1 time: 0.266580 Jun 18 22:03:45.511483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 338/672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:45 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1389 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:45.519323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f06851d-25e6-46c0-a5f4-27019f40835d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14bc6e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:45.585916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:45.586472 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f06851d-25e6-46c0-a5f4-27019f40835d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.073292 Jun 18 22:03:45.594072 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 339/673] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:45 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:45.598404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c96618f-b686-4309-be4d-64233aef2da4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.378052 Jun 18 22:03:45.606440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-310ac02d-4b03-46e2-b7a0-2c36b77c1fc1 req-d66d7d12-4204-4a74-a120-8b66f39c8d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b3808-a777-4302-962d-be85bff00e6a", "name": "network-vif-plugged", "status": "completed", "tag": "0c6e286c-a838-4bcc-9852-a5e035068f99"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:45.609742 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 335/674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:45 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:45.620105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:45.621687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:45.631014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-310ac02d-4b03-46e2-b7a0-2c36b77c1fc1 req-d66d7d12-4204-4a74-a120-8b66f39c8d48 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.631470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-310ac02d-4b03-46e2-b7a0-2c36b77c1fc1 req-d66d7d12-4204-4a74-a120-8b66f39c8d48 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.638714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.640566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.642055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:45.643634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:45.656393 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-310ac02d-4b03-46e2-b7a0-2c36b77c1fc1 req-d66d7d12-4204-4a74-a120-8b66f39c8d48 service nova] Creating event network-vif-plugged:0c6e286c-a838-4bcc-9852-a5e035068f99 for instance 210b3808-a777-4302-962d-be85bff00e6a on nch2-master-1 Jun 18 22:03:45.662991 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-310ac02d-4b03-46e2-b7a0-2c36b77c1fc1 req-d66d7d12-4204-4a74-a120-8b66f39c8d48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067475 Jun 18 22:03:45.663983 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 340/675] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:45.998702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:46.010818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bf4c618e-1d7f-4e24-9c1d-97365173bea4 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1526 microversion: 2.1 time: 0.399582 Jun 18 22:03:46.011421 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 336/676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:45 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1526 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:46.031974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:46.038132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:46.043784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:46.052317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.053027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.054032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.054659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.095191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:46.150786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:46.151999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:46.161394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.166730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.167864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.168533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.489756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:46.498765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:46.503741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:46.510430 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-234fdf7f-5dcf-4f7e-9d3e-02d801b5f78e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1557 microversion: 2.25 time: 0.482437 Jun 18 22:03:46.511619 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 337/677] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:46 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1557 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:46.526549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:46.533696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:46.548029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.548492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.549331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.549781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.897907 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c66ea7f6-d5df-4664-84fc-f2d48ed81d0e tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1617 microversion: 2.1 time: 1.231808 Jun 18 22:03:46.913864 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 341/678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:45 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1617 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:46.919812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:46.920810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:46.928673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.929484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.931181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.932077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.952329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:46.961673 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fb6ee08-9710-4837-b76f-38952f06cbec tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.448617 Jun 18 22:03:46.971112 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 338/679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:46 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:46.975134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c840be8e-929c-48b1-9bf2-fded1c3583e0 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '.version_select at 0x7fea14854280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:46.981436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c840be8e-929c-48b1-9bf2-fded1c3583e0 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:46.981899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c840be8e-929c-48b1-9bf2-fded1c3583e0 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:46.996786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c840be8e-929c-48b1-9bf2-fded1c3583e0 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.030883 Jun 18 22:03:47.004937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 339/680] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Jun 18 22:03:46 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:47.011719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3dc0e87f-36b7-4081-9d11-dbc763d12bf9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea148a6430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:47.096295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3dc0e87f-36b7-4081-9d11-dbc763d12bf9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.090030 Jun 18 22:03:47.100684 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 340/681] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:47 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:47.111248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:47.113675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:47.130987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.133880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.135036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.137664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.492139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:47.502892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b96f34fa-9925-4c36-85fe-81f237e27026 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1389 microversion: 2.1 time: 0.587337 Jun 18 22:03:47.503498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 342/682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:46 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1389 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:47.511490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-957a2840-65f8-4aa8-a270-1ebccffda3f6 req-0fe87766-0e9d-4d9e-8734-e94f7ba729ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78dffd72-8475-4bb2-a66a-7919e902e9df", "name": "network-vif-deleted", "tag": "43465871-6115-43f5-abc6-7a0d1c2533d4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:47.531854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-957a2840-65f8-4aa8-a270-1ebccffda3f6 req-0fe87766-0e9d-4d9e-8734-e94f7ba729ef service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.540203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-957a2840-65f8-4aa8-a270-1ebccffda3f6 req-0fe87766-0e9d-4d9e-8734-e94f7ba729ef service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.562733 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-957a2840-65f8-4aa8-a270-1ebccffda3f6 req-0fe87766-0e9d-4d9e-8734-e94f7ba729ef service nova] Creating event network-vif-deleted:43465871-6115-43f5-abc6-7a0d1c2533d4 for instance 78dffd72-8475-4bb2-a66a-7919e902e9df on nch2-master-1 Jun 18 22:03:47.572413 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-957a2840-65f8-4aa8-a270-1ebccffda3f6 req-0fe87766-0e9d-4d9e-8734-e94f7ba729ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064707 Jun 18 22:03:47.573678 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 343/683] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:47.580272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45668246-cf5f-48f1-9d5d-9619a7ff8a5a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: .version_select at 0x7fea14a95430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-703463044", "policies": ["affinity"]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:47.604760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-45668246-cf5f-48f1-9d5d-9619a7ff8a5a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:47.608262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:47.613303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-45668246-cf5f-48f1-9d5d-9619a7ff8a5a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:47.619045 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f138c2f2-c7dd-46df-bb8a-177f020e7a37 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.515013 Jun 18 22:03:47.625151 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 341/684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:47 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:47.633143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:47.633929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:47.649341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:47.660675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.661478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.662440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.663107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.756618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-45668246-cf5f-48f1-9d5d-9619a7ff8a5a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:47.768365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-45668246-cf5f-48f1-9d5d-9619a7ff8a5a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:47.773392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:47.790202 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45668246-cf5f-48f1-9d5d-9619a7ff8a5a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.214492 Jun 18 22:03:47.803933 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 344/685] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:03:47 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:47.810809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:47.811927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:47.822999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.824205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.825239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.825828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.831524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:47.871441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:47.872186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:47.873210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lazy-loading 'fault' on Instance uuid 78dffd72-8475-4bb2-a66a-7919e902e9df {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:47.955904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid afb0ac13-8caa-4624-a0d1-bbc8e938f068 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:03:47.985510 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9a838d3-3737-4ba4-ab10-adc6988255e7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 2050 microversion: 2.25 time: 0.359093 Jun 18 22:03:48.008760 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 342/686] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:47 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 2050 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:48.014066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:48.015155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:48.026776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:48.028982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:48.030202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:48.032879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:48.035087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58c3911cbbdf4e35ae8df9eb8b23f22d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b63c52467494445b437e444a52e075e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:48.048790 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3842bcc6-155f-4264-876c-0230a7a577af tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 200 len: 1314 microversion: 2.1 time: 0.239517 Jun 18 22:03:48.057069 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 345/687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:47 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:48.112466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1691373957", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "818e9f98-ecac-4891-94fb-d2f5e83de272"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:48.235220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:48.669550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:48.681917 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64ea12ac-50f2-479e-a38f-8b482a56e44f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.671601 Jun 18 22:03:48.683193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 343/688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:48 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:48.695892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec9c7de1-c427-40fa-8452-58bddce394bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14821280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:48.764763 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec9c7de1-c427-40fa-8452-58bddce394bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1412 microversion: 2.1 time: 0.079632 Jun 18 22:03:48.765320 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 344/689] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:48 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:48.770699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-990384218", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "39432198-5051-484b-846b-d7e8994b5707"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:48.815163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:48.815618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:48.816105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:48.816518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:48.816934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:48.867752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:48.869104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:48.869747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] validate_networks() for [('39432198-5051-484b-846b-d7e8994b5707', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:48.875869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:48.876407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:48.919099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:48.940161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:48.957315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Going to run 2 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:48.961335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:49.042985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130902) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 18 22:03:49.066068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:49.078533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:49.176404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:49.186209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:49.215551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=039a68da-48d6-4f1e-9aab-82c4595b9f50,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:49.293280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:49.310667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:49.366867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:49.374443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:49.418578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b78fe495-da63-449c-b209-36ecfaff7be5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.310578 Jun 18 22:03:49.423671 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 346/690] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:03:49.430344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:49.431521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:49.441144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.442296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.443858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.444702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.468058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:49.468766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:49.469430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:49.469845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:49.470262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:49.480884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.481617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.482606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.483201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.530290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:49.548427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for user 76897f7be7494bb589de747493240449 and project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:49.563125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:49.565531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:49.629916 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b017d63a-0d4f-4eca-a0ba-ab6ad7765947 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.863346 Jun 18 22:03:49.630878 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 345/691] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:03:49.636320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:49.636932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:49.644918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.645403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.646188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.646606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.680536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:49.691821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a755791f-59c8-4716-963c-c9ad727c0772 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1588 microversion: 2.1 time: 0.266765 Jun 18 22:03:49.692669 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 347/692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:49 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1588 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:49.697918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:49.698557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] [instance: 78dffd72-8475-4bb2-a66a-7919e902e9df] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:49.705013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.705504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.706282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.706722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.740108 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] HTTP exception thrown: Instance 78dffd72-8475-4bb2-a66a-7919e902e9df could not be found. Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Request method failure captured: Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df HTTP/1.1 Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktf4XX-x7SvQKMbsh3S1UoY5f2LFMFmaqt0Dz-WrhJlRUmwvzkxu2tSgAaTxYmnZL69aK-BrAWdf4-UiA1m0ZpT_c3B4s1g6SCWh4FvM9QQ2PBIoJRkOsc-lPcNv6mxWwO72qnYQK7tO29Cv4QLh2w5tS8O0ahWoOEjTMae1x6ef24 Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:03:49.741982 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7b63c52467494445b437e444a52e075e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7b63c52467494445b437e444a52e075e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7b63c52467494445b437e444a52e075e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7b63c52467494445b437e444a52e075e Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1379938453 Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 58c3911cbbdf4e35ae8df9eb8b23f22d Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1379938453-project Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 78dffd72-8475-4bb2-a66a-7919e902e9df could not be found. Jun 18 22:03:49.743516 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '78dffd72-8475-4bb2-a66a-7919e902e9df'} Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78dffd72-8475-4bb2-a66a-7919e902e9df could not be found. Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:03:49.744387 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78dffd72-8475-4bb2-a66a-7919e902e9df could not be found. Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78dffd72-8475-4bb2-a66a-7919e902e9df could not be found. Jun 18 22:03:49.745829 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:03:49.747093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] Returning 404 to user: Instance 78dffd72-8475-4bb2-a66a-7919e902e9df could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:03:49.747093 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-84fbce3a-fe9f-4e11-981f-5f943b9d9425 tempest-FloatingIPsAssociationTestJSON-1379938453 tempest-FloatingIPsAssociationTestJSON-1379938453-project] 10.222.0.30 "GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df" status: 404 len: 111 microversion: 2.1 time: 0.049630 Jun 18 22:03:49.747606 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 348/693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:49 2022] GET /compute/v2.1/servers/78dffd72-8475-4bb2-a66a-7919e902e9df => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:03:49.755077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-61d9d536-3ce6-4b89-8f3a-de1584e41b06 req-5ce7b6f5-a007-4fd9-a3bc-d75fff182adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f67d4bc-748f-4d54-912b-806862936a19", "name": "network-vif-plugged", "status": "completed", "tag": "45094155-19d5-4eb9-afe3-1c3e4479b7bb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:49.765321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-61d9d536-3ce6-4b89-8f3a-de1584e41b06 req-5ce7b6f5-a007-4fd9-a3bc-d75fff182adb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.765812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-61d9d536-3ce6-4b89-8f3a-de1584e41b06 req-5ce7b6f5-a007-4fd9-a3bc-d75fff182adb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.779304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-61d9d536-3ce6-4b89-8f3a-de1584e41b06 req-5ce7b6f5-a007-4fd9-a3bc-d75fff182adb service nova] Creating event network-vif-plugged:45094155-19d5-4eb9-afe3-1c3e4479b7bb for instance 3f67d4bc-748f-4d54-912b-806862936a19 on nch2-master-1 Jun 18 22:03:49.784460 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-61d9d536-3ce6-4b89-8f3a-de1584e41b06 req-5ce7b6f5-a007-4fd9-a3bc-d75fff182adb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Jun 18 22:03:49.785785 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 349/694] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:49.792756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:49.797986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:49.799031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Searching by: {'deleted': False, 'project_id': 'c5285b07988c4c8581f047981271fee1'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:03:49.823018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.823610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.824548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:49.825183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:49.928604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:03:50.013517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:50.026702 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-070ab679-ebd6-48e7-a6dc-c447cbca868d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.394355 Jun 18 22:03:50.029734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 346/695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:49 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:50.044171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e649ad71-2252-4837-a834-f22d61c6721d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.256725 Jun 18 22:03:50.046652 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 350/696] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:03:49 2022] GET /compute/v2.1/servers => generated 1003 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:50.054799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-379fd600-1f84-44c9-bea7-2ece98f064ca tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.056078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-379fd600-1f84-44c9-bea7-2ece98f064ca tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:50.143391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-379fd600-1f84-44c9-bea7-2ece98f064ca tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:50.159588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-379fd600-1f84-44c9-bea7-2ece98f064ca tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:50.164008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-379fd600-1f84-44c9-bea7-2ece98f064ca tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:50.168208 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-379fd600-1f84-44c9-bea7-2ece98f064ca tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1261 microversion: 2.25 time: 0.118966 Jun 18 22:03:50.181210 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 351/697] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1261 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:50.192641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.195386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:50.216571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:50.219862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:50.222890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:50.223686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:50.327407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d45855c-eaad-460e-b98f-bbc896de3f9d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '.version_select at 0x7fea149315e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.410956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d45855c-eaad-460e-b98f-bbc896de3f9d tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a" status: 200 len: 371 microversion: 2.1 time: 0.379840 Jun 18 22:03:50.412195 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 347/698] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a => generated 371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:50.418029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.418852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:50.430337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:50.431091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:50.433062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:50.435507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:50.445780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:50.454735 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65b3f5ee-fc91-4bb8-af1f-f5ca927a61bd tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1332 microversion: 2.1 time: 0.272141 Jun 18 22:03:50.455336 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 352/699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1332 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:50.465969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df1abe22-c036-4d18-8906-0351261f0908 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14adf820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.541645 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df1abe22-c036-4d18-8906-0351261f0908 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1421 microversion: 2.1 time: 0.080028 Jun 18 22:03:50.543053 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 353/700] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:50.555700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58e4d540-196f-40a3-b24a-a3d2bf87dc13 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.560950 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d994c27-b864-4123-84cc-6a694540e7f7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147387 Jun 18 22:03:50.561453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58e4d540-196f-40a3-b24a-a3d2bf87dc13 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:50.562261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 348/701] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:50.569744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-45278939-94b4-4549-8c53-60b95402a3e3 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Action: 'update', calling method: .version_select at 0x7fea147e4b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:50.653988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45278939-94b4-4549-8c53-60b95402a3e3 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:50.654805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45278939-94b4-4549-8c53-60b95402a3e3 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:50.656070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45278939-94b4-4549-8c53-60b95402a3e3 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:50.657208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45278939-94b4-4549-8c53-60b95402a3e3 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:50.715206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58e4d540-196f-40a3-b24a-a3d2bf87dc13 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:50.731752 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58e4d540-196f-40a3-b24a-a3d2bf87dc13 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1219 microversion: 2.1 time: 0.180691 Jun 18 22:03:50.733456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 354/702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:50.743733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-166e16d6-339a-4702-be22-37b4bd2304c4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14d9d3a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.833838 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-166e16d6-339a-4702-be22-37b4bd2304c4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 200 len: 1421 microversion: 2.1 time: 0.099257 Jun 18 22:03:50.840152 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 355/703] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:50.847471 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-45278939-94b4-4549-8c53-60b95402a3e3 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a" status: 200 len: 328 microversion: 2.1 time: 0.282069 Jun 18 22:03:50.849107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa6ac641-32e0-42fe-98f2-665eb4bc4053 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea149020d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.853327 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 349/704] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:03:50 2022] PUT /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a => generated 328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:50.859705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1eb16c24-d1fa-4e58-a953-da9f2b963bbb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:50.906542 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1eb16c24-d1fa-4e58-a953-da9f2b963bbb tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a" status: 202 len: 0 microversion: 2.1 time: 0.050372 Jun 18 22:03:50.908406 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 350/705] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:03:50 2022] DELETE /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:03:50.920802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba8fc473-c927-4c1b-b586-e6210977e748 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '.version_select at 0x7fea14931af0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:51.058833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ba8fc473-c927-4c1b-b586-e6210977e748 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a" status: 200 len: 371 microversion: 2.1 time: 0.146949 Jun 18 22:03:51.059749 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 351/706] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:03:50 2022] GET /compute/v2.1/os-quota-sets/5871c9523ae24283a0695e89fa639d7a => generated 371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:51.075306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:51.075961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:51.091550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:51.092295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:51.093453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:51.094051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:51.346779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:51.358736 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1275439d-225f-4811-8867-4ae65a3d4ec1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.293677 Jun 18 22:03:51.368437 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 352/707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:51 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:51.368437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:51.368437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:51.378298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:51.378757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:51.379735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:51.380180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:51.893399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:51.920131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:51.925925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:51.932541 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64af1b21-36f2-4e58-b1c8-1488583545c8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1321 microversion: 2.25 time: 0.569177 Jun 18 22:03:51.933396 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 353/708] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:51 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1321 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:51.954559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2834dc6-4f10-4a99-8c5e-c126ed188eaf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '.version_select at 0x7fea14775a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:52.072992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa6ac641-32e0-42fe-98f2-665eb4bc4053 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 204 len: 0 microversion: 2.1 time: 1.227920 Jun 18 22:03:52.077014 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 356/709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:50 2022] DELETE /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 0 bytes in 1231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:52.078923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:52.079552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:52.101264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.101760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.110916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.111372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.390205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2834dc6-4f10-4a99-8c5e-c126ed188eaf tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813/defaults" status: 200 len: 371 microversion: 2.1 time: 0.449904 Jun 18 22:03:52.391090 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 354/710] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:03:51 2022] GET /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813/defaults => generated 371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:52.403023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:52.404616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:52.411891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.412348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.413170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.413791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.547113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:52.548709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:52.557364 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-302ce0ec-02d7-468d-bba2-f1527244b7fe tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1535 microversion: 2.1 time: 0.482064 Jun 18 22:03:52.557968 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 357/711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:52 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1535 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:52.567943 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2eb8856b-c67e-45a0-a401-d4fea0112781 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1277 microversion: 2.1 time: 0.174920 Jun 18 22:03:52.571378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:52.571927 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 355/712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:52 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:52.577684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:52.580033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7f017c38-24d1-4c74-8adb-d566e5250e0e req-67251c3c-bde5-4ce8-b452-3dc401986aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2915c85a-6454-4b71-9078-0375b4fbdc7e", "name": "network-vif-plugged", "status": "completed", "tag": "b9ec270a-bd87-4e67-83fd-6757c8bfb188"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:52.581117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:52.586827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.587667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.590822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.592369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.604854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7f017c38-24d1-4c74-8adb-d566e5250e0e req-67251c3c-bde5-4ce8-b452-3dc401986aef service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.605677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7f017c38-24d1-4c74-8adb-d566e5250e0e req-67251c3c-bde5-4ce8-b452-3dc401986aef service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.631146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7f017c38-24d1-4c74-8adb-d566e5250e0e req-67251c3c-bde5-4ce8-b452-3dc401986aef service nova] Creating event network-vif-plugged:b9ec270a-bd87-4e67-83fd-6757c8bfb188 for instance 2915c85a-6454-4b71-9078-0375b4fbdc7e on nch1-master-1 Jun 18 22:03:52.643328 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7f017c38-24d1-4c74-8adb-d566e5250e0e req-67251c3c-bde5-4ce8-b452-3dc401986aef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069982 Jun 18 22:03:52.643952 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 356/713] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:52.656133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:52.657002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:52.670034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:03:52.692750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.693413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.697278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:52.699057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:52.834904 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a4957577-8a92-4469-80ef-0cde8a43152b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 204 len: 0 microversion: 2.1 time: 0.273477 Jun 18 22:03:52.837382 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 358/714] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:03:52 2022] DELETE /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:03:52.846960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-212f5c94-a109-436e-87d7-57bd6bbaa4ad tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'create', calling method: .version_select at 0x7fea15130a60>, body: {"pool": "4576993c-4367-41ca-bae0-2febb9d30834"} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:53.244211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:53.267548 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-01727597-68af-44b4-abe7-7137b5a2136e tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1310 microversion: 2.1 time: 0.622091 Jun 18 22:03:53.268414 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 357/715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:52 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1310 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:53.302895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-232ccacc-650b-4bf1-aa64-92911a713ac0 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Action: 'update', calling method: .version_select at 0x7fea14962ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:53.567405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-232ccacc-650b-4bf1-aa64-92911a713ac0 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:53.568073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-232ccacc-650b-4bf1-aa64-92911a713ac0 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:53.572180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-232ccacc-650b-4bf1-aa64-92911a713ac0 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:53.575021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-232ccacc-650b-4bf1-aa64-92911a713ac0 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:53.727962 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-232ccacc-650b-4bf1-aa64-92911a713ac0 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653" status: 200 len: 328 microversion: 2.1 time: 0.444189 Jun 18 22:03:53.729425 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 358/716] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:03:53 2022] PUT /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653 => generated 328 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:53.740617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:53.744290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:53.760035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:53.760630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:53.761597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:53.763110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:54.625255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:54.642494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:54.645764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:54.651121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36725371-5e15-4371-95f0-cb9dce9be29c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.920521 Jun 18 22:03:54.651935 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 359/717] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:53 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:54.670492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-93319332", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1a0b7d1f-26de-4ff3-a984-65723c7a5ace"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:54.768800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] validate_networks() for [('1a0b7d1f-26de-4ff3-a984-65723c7a5ace', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:03:56.435620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:03:56.437009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:03:56.437616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:03:56.438220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:03:56.439929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:03:56.462175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:56.463755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:56.465210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:56.465870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:56.515404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:03:56.523488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for user 4eef98c56e744064b2b5f131c3766c0c and project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:03:56.550290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:03:56.554594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:03:56.653501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f7b88890-67e4-4200-ba18-a59ae4008bcb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.988323 Jun 18 22:03:56.660591 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 360/718] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:03:56.667371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:56.668303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:56.676748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:56.677785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:56.678776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:56.679380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:56.722000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:57.497324 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-212f5c94-a109-436e-87d7-57bd6bbaa4ad tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.658592 Jun 18 22:03:57.498379 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 359/719] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:03:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:57.505235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d9344db9-f13f-45bb-ab39-0a029047b5e6 req-91f9a9e3-eabd-44e9-b427-0068feca3960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210b3808-a777-4302-962d-be85bff00e6a", "tag": "0c6e286c-a838-4bcc-9852-a5e035068f99"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:57.531979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d9344db9-f13f-45bb-ab39-0a029047b5e6 req-91f9a9e3-eabd-44e9-b427-0068feca3960 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.533704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d9344db9-f13f-45bb-ab39-0a029047b5e6 req-91f9a9e3-eabd-44e9-b427-0068feca3960 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:57.557837 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d9344db9-f13f-45bb-ab39-0a029047b5e6 req-91f9a9e3-eabd-44e9-b427-0068feca3960 service nova] Creating event network-changed:0c6e286c-a838-4bcc-9852-a5e035068f99 for instance 210b3808-a777-4302-962d-be85bff00e6a on nch2-master-1 Jun 18 22:03:57.575477 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d9344db9-f13f-45bb-ab39-0a029047b5e6 req-91f9a9e3-eabd-44e9-b427-0068feca3960 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075387 Jun 18 22:03:57.576476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 360/720] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:57.593680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:57.594558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:57.609340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.610035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:57.612794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.613595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:57.650901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:57.661452 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fcd4d722-a5d3-48d1-a1d0-ef4ffedbd4e2 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1588 microversion: 2.1 time: 0.999366 Jun 18 22:03:57.684576 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 361/721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:56 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1588 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:57.690804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-012495f3-fc25-497f-87f0-b332ae22d309 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '.version_select at 0x7fea148a6c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:57.796907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012495f3-fc25-497f-87f0-b332ae22d309 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.797396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012495f3-fc25-497f-87f0-b332ae22d309 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:57.798214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012495f3-fc25-497f-87f0-b332ae22d309 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.798657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012495f3-fc25-497f-87f0-b332ae22d309 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:57.850692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:03:57.856046 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-012495f3-fc25-497f-87f0-b332ae22d309 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653/detail" status: 200 len: 916 microversion: 2.1 time: 0.169418 Jun 18 22:03:57.857261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 362/722] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:03:57 2022] GET /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653/detail => generated 916 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:57.893508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:57.897340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:57.912611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.913315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:57.914343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:57.914930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.078926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:58.095903 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11f6c107-e0a1-49cd-952c-81dc7f4b2a91 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.517920 Jun 18 22:03:58.097305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 361/723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:57 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:58.103883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d1b8b05f-0da9-4aea-aa66-af0835cf9daa req-fd2aa2f9-70a6-40da-b07d-8ae1e33e246c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67d33e4-d613-42be-8321-005a5ef130f0", "name": "network-vif-unplugged", "status": "completed", "tag": "358af369-3e3e-422f-bc34-0998011b792c"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:58.131793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d1b8b05f-0da9-4aea-aa66-af0835cf9daa req-fd2aa2f9-70a6-40da-b07d-8ae1e33e246c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.132746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d1b8b05f-0da9-4aea-aa66-af0835cf9daa req-fd2aa2f9-70a6-40da-b07d-8ae1e33e246c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.151973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d1b8b05f-0da9-4aea-aa66-af0835cf9daa req-fd2aa2f9-70a6-40da-b07d-8ae1e33e246c service nova] Creating event network-vif-unplugged:358af369-3e3e-422f-bc34-0998011b792c for instance e67d33e4-d613-42be-8321-005a5ef130f0 on nch2-master-1 Jun 18 22:03:58.161186 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d1b8b05f-0da9-4aea-aa66-af0835cf9daa req-fd2aa2f9-70a6-40da-b07d-8ae1e33e246c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062269 Jun 18 22:03:58.163436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 362/724] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:58.178600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:58.180271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:58.189008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.190053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.191218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.191870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.664668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:58.677584 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ecc3e9d-8411-40e2-a1f6-f5668041f70c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1494 microversion: 2.1 time: 0.818824 Jun 18 22:03:58.692139 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 363/725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:57 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1494 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:58.701528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:58.702392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:58.710024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.711829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.713074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.713672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.764420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:58.787255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:58.791756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:58.795939 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15f4f71d-2e00-4bf9-9453-f1f4dfbb5315 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.630687 Jun 18 22:03:58.797183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 363/726] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:03:58 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:03:58.813106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:03:58.821536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9de175b3-652c-4322-a5b7-a394a8b4d9db tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1264 microversion: 2.1 time: 0.127813 Jun 18 22:03:58.822206 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 364/727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:58 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1264 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:58.826885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7c8ebe4a-347e-45f2-b4a2-9529ab08caba req-add1592d-cfac-4a47-8999-13b4ea4ac141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468ab9a6-b57f-41bc-8271-2a6c51106e81", "tag": "e0c10288-e99c-4acf-bc15-6aa0400da027"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:58.827427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.57"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:58.835345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:58.861373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7c8ebe4a-347e-45f2-b4a2-9529ab08caba req-add1592d-cfac-4a47-8999-13b4ea4ac141 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.862151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7c8ebe4a-347e-45f2-b4a2-9529ab08caba req-add1592d-cfac-4a47-8999-13b4ea4ac141 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.878726 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7c8ebe4a-347e-45f2-b4a2-9529ab08caba req-add1592d-cfac-4a47-8999-13b4ea4ac141 service nova] Creating event network-changed:e0c10288-e99c-4acf-bc15-6aa0400da027 for instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 on nch1-master-1 Jun 18 22:03:58.883854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.885947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.890382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:58.891545 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7c8ebe4a-347e-45f2-b4a2-9529ab08caba req-add1592d-cfac-4a47-8999-13b4ea4ac141 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067069 Jun 18 22:03:58.892404 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 365/728] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:58.895341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:58.908296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Action: 'update', calling method: .version_select at 0x7fea147a88b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:03:58.958107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Acquired lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:03:59.103493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.104392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.106019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.106956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.167841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.168922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.170483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.171238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.253846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62671b6e-871f-4a18-84e3-a1c02bc037b7 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653?user_id=30f0b3c317bc49ef99dd5ba17975b197" status: 200 len: 328 microversion: 2.1 time: 0.356765 Jun 18 22:03:59.255373 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 366/729] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Jun 18 22:03:58 2022] PUT /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653?user_id=30f0b3c317bc49ef99dd5ba17975b197 => generated 328 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:03:59.272208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:59.278705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:59.291636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.292326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.293313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.293986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.709641 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-929828f9-9984-447a-8931-55df3e077d57 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1645 microversion: 2.1 time: 0.452869 Jun 18 22:03:59.722118 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 367/730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:59 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1645 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:03:59.726078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:03:59.726976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:03:59.735365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.736200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.737274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:03:59.737801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:03:59.858750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:00.209997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:00.255383 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0b92ba0-f5ce-4139-b187-dbbe7fb70eb7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.541960 Jun 18 22:04:00.256225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 368/731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:03:59 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:00.279086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f12f1365-a5a0-4d4b-bdc0-5560471e6ab2 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '.version_select at 0x7fea147e4550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:00.724660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=34 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:00.727869 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f12f1365-a5a0-4d4b-bdc0-5560471e6ab2 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653?user_id=30f0b3c317bc49ef99dd5ba17975b197" status: 200 len: 370 microversion: 2.1 time: 0.465728 Jun 18 22:04:00.729258 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 369/732] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Jun 18 22:04:00 2022] GET /compute/v2.1/os-quota-sets/4ae82f501733415e89a0c98820b2e653?user_id=30f0b3c317bc49ef99dd5ba17975b197 => generated 370 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:00.740491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7730a069-bf13-4768-bfe3-19d8d4e746cf req-5734f6d3-97b8-4251-a88b-2ac0e729166f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67d33e4-d613-42be-8321-005a5ef130f0", "name": "network-vif-deleted", "tag": "358af369-3e3e-422f-bc34-0998011b792c"}, {"name": "network-changed", "server_uuid": "c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79", "tag": "bd8a15a9-02da-4737-bf34-0f1ed6541286"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:00.752047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7730a069-bf13-4768-bfe3-19d8d4e746cf req-5734f6d3-97b8-4251-a88b-2ac0e729166f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:00.752869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7730a069-bf13-4768-bfe3-19d8d4e746cf req-5734f6d3-97b8-4251-a88b-2ac0e729166f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:00.795921 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7730a069-bf13-4768-bfe3-19d8d4e746cf req-5734f6d3-97b8-4251-a88b-2ac0e729166f service nova] Creating event network-vif-deleted:358af369-3e3e-422f-bc34-0998011b792c for instance e67d33e4-d613-42be-8321-005a5ef130f0 on nch2-master-1 Jun 18 22:04:00.796521 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7730a069-bf13-4768-bfe3-19d8d4e746cf req-5734f6d3-97b8-4251-a88b-2ac0e729166f service nova] Creating event network-changed:bd8a15a9-02da-4737-bf34-0f1ed6541286 for instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 on nch1-master-1 Jun 18 22:04:00.837786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7730a069-bf13-4768-bfe3-19d8d4e746cf req-5734f6d3-97b8-4251-a88b-2ac0e729166f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102085 Jun 18 22:04:00.841142 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 370/733] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:00.862254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:00.870048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:00.894507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:00.901396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:00.902822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:00.905532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:01.123929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Building network info cache for instance {{(pid=130902) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:04:01.247347 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-43a27dff-5d2f-43f3-9c74-3892a50b8f94 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1645 microversion: 2.1 time: 0.401707 Jun 18 22:04:01.253306 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 371/734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:00 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1645 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:01.267896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:01.268801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:01.275693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:01.282000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:01.283024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:01.283732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:01.648004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:01.657426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:01.659454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:01.660931 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7654c18b-7acf-4859-a3d7-cdd97d6cc15a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.406357 Jun 18 22:04:01.672306 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 372/735] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:01 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:01.677938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:01.678981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:01.687871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:01.689147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:01.690501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:01.691210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.254942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:02.264015 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5638e88b-9118-44f9-b886-858d9cd4f560 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.589971 Jun 18 22:04:02.264762 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 373/736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:01 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:02.273997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7d87cc26-de96-4634-887c-ec18a885e774 req-ac88d99b-8d6d-4917-9871-f8b0f023dbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "039a68da-48d6-4f1e-9aab-82c4595b9f50", "tag": "818dbee5-4d83-4443-a2c8-1325e6537710"}, {"name": "network-changed", "server_uuid": "678d2a2b-9907-4e75-8cc7-424583f5cca7", "tag": "401011df-8eff-4d01-b8b2-b3e66f069fde"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:02.288607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7d87cc26-de96-4634-887c-ec18a885e774 req-ac88d99b-8d6d-4917-9871-f8b0f023dbf3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.289071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7d87cc26-de96-4634-887c-ec18a885e774 req-ac88d99b-8d6d-4917-9871-f8b0f023dbf3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.303636 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7d87cc26-de96-4634-887c-ec18a885e774 req-ac88d99b-8d6d-4917-9871-f8b0f023dbf3 service nova] Creating event network-changed:818dbee5-4d83-4443-a2c8-1325e6537710 for instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 on nch1-master-1 Jun 18 22:04:02.304192 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7d87cc26-de96-4634-887c-ec18a885e774 req-ac88d99b-8d6d-4917-9871-f8b0f023dbf3 service nova] Creating event network-changed:401011df-8eff-4d01-b8b2-b3e66f069fde for instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 on nch2-master-1 Jun 18 22:04:02.315130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7d87cc26-de96-4634-887c-ec18a885e774 req-ac88d99b-8d6d-4917-9871-f8b0f023dbf3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044706 Jun 18 22:04:02.315728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 374/737] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:02.447364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Updating instance_info_cache with network_info: [{"id": "45094155-19d5-4eb9-afe3-1c3e4479b7bb", "address": "fa:16:3e:c5:85:3e", "network": {"id": "ecf270c2-fa45-4f50-b885-5754dbdc2136", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-463439867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c5893b4b7c9c49bf87729b506675446e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap45094155-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:04:02.464201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Releasing lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130902) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:04:02.465474 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f1acca52-8f0a-4a8a-9f59-ea0ce18350af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action" status: 202 len: 0 microversion: 2.1 time: 3.667069 Jun 18 22:04:02.466681 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 364/738] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:03:58 2022] POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action => generated 0 bytes in 3669 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:04:02.471808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-518d3be3-f045-4ae4-9a68-ddd79d88d56c tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:02.474238 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:04:02.474238 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:04:02.475613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518d3be3-f045-4ae4-9a68-ddd79d88d56c tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.476325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518d3be3-f045-4ae4-9a68-ddd79d88d56c tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.477249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518d3be3-f045-4ae4-9a68-ddd79d88d56c tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.477709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518d3be3-f045-4ae4-9a68-ddd79d88d56c tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.502671 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-518d3be3-f045-4ae4-9a68-ddd79d88d56c tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034693 Jun 18 22:04:02.503337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 365/739] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:04:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:02.507746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:02.508359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:02.515552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.516009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.516792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.517277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.590768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b438149-527d-48d7-bfa0-6835df9e58f0 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Calling method '.version_select at 0x7fea1478a700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:02.612691 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0b438149-527d-48d7-bfa0-6835df9e58f0 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] HTTP exception thrown: Image not found. Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b438149-527d-48d7-bfa0-6835df9e58f0 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Request method failure captured: Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/3fafa060-fef0-4ae3-9f6e-34a06eeddb1c/metadata/os_distro HTTP/1.1 Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvQ9XTUwT9xdd3X1p4ZVr9_yboTH8TQ21Ya7A40-o-njc48M_cpyK6b2fqSWQrvUafKms5uzFgwNciI9e97PtJlmd4h1OcZDVgSSxTHPJT05ooU2ZvSAhPOswtDw4APOkJsRJ2A7H77WXtlVBQ5enhkZVc46kVn8OtoFCjn8WHfidY Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:02.619342 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40e3c1170ca7453d94bd37157475dca2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c0b7f548b6bc46e1983a955e1c900fb9 Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'image_id': '3fafa060-fef0-4ae3-9f6e-34a06eeddb1c', 'id': 'os_distro'} Jun 18 22:04:02.620694 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:02.621592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3fafa060-fef0-4ae3-9f6e-34a06eeddb1c Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:02.622733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3fafa060-fef0-4ae3-9f6e-34a06eeddb1c could not be found. Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:02.624113 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.626605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b438149-527d-48d7-bfa0-6835df9e58f0 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:02.628598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b438149-527d-48d7-bfa0-6835df9e58f0 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] 10.222.0.30 "DELETE /compute/v2.1/images/3fafa060-fef0-4ae3-9f6e-34a06eeddb1c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.303769 Jun 18 22:04:02.628598 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 375/740] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:04:02 2022] DELETE /compute/v2.1/images/3fafa060-fef0-4ae3-9f6e-34a06eeddb1c/metadata/os_distro => generated 62 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:02.628929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6af5ec9-8c87-4d33-81d9-5781ef1569f8 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Calling method '.version_select at 0x7fea147a8310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:02.656651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:02.664322 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2fdfda49-b906-494b-9e81-c6bab8c5aaa5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.160040 Jun 18 22:04:02.664922 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 366/741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:02 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:02.669441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed89a93a-6161-4ae5-886e-3bffb1a86b2c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'create', calling method: .version_select at 0x7fea149a01f0>, body: {"pool": "4576993c-4367-41ca-bae0-2febb9d30834"} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:02.763225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6af5ec9-8c87-4d33-81d9-5781ef1569f8 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813/defaults" status: 200 len: 371 microversion: 2.1 time: 0.134627 Jun 18 22:04:02.763225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 376/742] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:04:02 2022] GET /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813/defaults => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:02.763985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:02.764628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:02.772295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.772828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.773706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.774219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.847380 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aad20e2c-40a1-4cb8-bd34-d29dfb979c0a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e/action" status: 202 len: 0 microversion: 2.1 time: 0.088042 Jun 18 22:04:02.848249 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 377/743] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:02 2022] POST /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:02.853895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82243170-7317-47b6-961b-a6c9a653ce57 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Calling method '.version_select at 0x7fea147afca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:02.877181 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-82243170-7317-47b6-961b-a6c9a653ce57 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] HTTP exception thrown: Image not found. Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82243170-7317-47b6-961b-a6c9a653ce57 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Request method failure captured: Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/images/83ea6c54-32e1-4913-a733-11a77ec67a03/metadata/os_version HTTP/1.1 Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvQ9XTUwT9xdd3X1p4ZVr9_yboTH8TQ21Ya7A40-o-njc48M_cpyK6b2fqSWQrvUafKms5uzFgwNciI9e97PtJlmd4h1OcZDVgSSxTHPJT05ooU2ZvSAhPOswtDw4APOkJsRJ2A7H77WXtlVBQ5enhkZVc46kVn8OtoFCjn8WHfidY Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:02.879487 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40e3c1170ca7453d94bd37157475dca2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c0b7f548b6bc46e1983a955e1c900fb9 Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'image_id': '83ea6c54-32e1-4913-a733-11a77ec67a03', 'id': 'os_version'} Jun 18 22:04:02.881010 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:02.882048 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83ea6c54-32e1-4913-a733-11a77ec67a03 Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:02.883291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83ea6c54-32e1-4913-a733-11a77ec67a03 could not be found. Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:02.884699 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:02.886493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82243170-7317-47b6-961b-a6c9a653ce57 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:02.887782 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82243170-7317-47b6-961b-a6c9a653ce57 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] 10.222.0.30 "GET /compute/v2.1/images/83ea6c54-32e1-4913-a733-11a77ec67a03/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.031341 Jun 18 22:04:02.887782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 378/744] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:04:02 2022] GET /compute/v2.1/images/83ea6c54-32e1-4913-a733-11a77ec67a03/metadata/os_version => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:02.892180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:02.892898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:02.900449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.900899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:02.901711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:02.902146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.124602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:03.135035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:03.137069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:03.141105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2de5bb7b-4f26-4c25-b504-d1721302b340 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.252612 Jun 18 22:04:03.141957 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 379/745] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:02 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:03.146560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38267f7c-809d-4d70-8b06-b21bd15cd1e5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Action: 'update', calling method: .version_select at 0x7fea147afd30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:03.213340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38267f7c-809d-4d70-8b06-b21bd15cd1e5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.213802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38267f7c-809d-4d70-8b06-b21bd15cd1e5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.214636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38267f7c-809d-4d70-8b06-b21bd15cd1e5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.215088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38267f7c-809d-4d70-8b06-b21bd15cd1e5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.452926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-38267f7c-809d-4d70-8b06-b21bd15cd1e5 tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813" status: 200 len: 329 microversion: 2.1 time: 0.309722 Jun 18 22:04:03.453771 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 380/746] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Jun 18 22:04:03 2022] PUT /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813 => generated 329 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:03.458747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:03.459532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:03.465823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.466498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.467444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.468024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.648868 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81798669-be3b-49a1-88ad-1bb8db417a1a tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1650 microversion: 2.1 time: 0.193507 Jun 18 22:04:03.649244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 381/747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:03 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1650 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:03.657306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ec739c9b-6143-4c35-81d2-4dc7861924d4 req-2dd2e0b3-84d7-4926-ab62-0f9bfd7a68e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f67d4bc-748f-4d54-912b-806862936a19", "tag": "45094155-19d5-4eb9-afe3-1c3e4479b7bb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:03.664149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ec739c9b-6143-4c35-81d2-4dc7861924d4 req-2dd2e0b3-84d7-4926-ab62-0f9bfd7a68e5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.664581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ec739c9b-6143-4c35-81d2-4dc7861924d4 req-2dd2e0b3-84d7-4926-ab62-0f9bfd7a68e5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.676489 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ec739c9b-6143-4c35-81d2-4dc7861924d4 req-2dd2e0b3-84d7-4926-ab62-0f9bfd7a68e5 service nova] Creating event network-changed:45094155-19d5-4eb9-afe3-1c3e4479b7bb for instance 3f67d4bc-748f-4d54-912b-806862936a19 on nch2-master-1 Jun 18 22:04:03.681758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ec739c9b-6143-4c35-81d2-4dc7861924d4 req-2dd2e0b3-84d7-4926-ab62-0f9bfd7a68e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031044 Jun 18 22:04:03.682354 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 382/748] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:03.687645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca3e3df7-29fd-4fe6-93b9-2545fa56221e tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Calling method '.version_select at 0x7fea147af9d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:03.714528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ca3e3df7-29fd-4fe6-93b9-2545fa56221e tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] HTTP exception thrown: Image not found. Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca3e3df7-29fd-4fe6-93b9-2545fa56221e tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Request method failure captured: Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/images/a6d8bb78-6e0a-4aeb-91ad-f21e6bc83a49/metadata HTTP/1.1 Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvQ9XTUwT9xdd3X1p4ZVr9_yboTH8TQ21Ya7A40-o-njc48M_cpyK6b2fqSWQrvUafKms5uzFgwNciI9e97PtJlmd4h1OcZDVgSSxTHPJT05ooU2ZvSAhPOswtDw4APOkJsRJ2A7H77WXtlVBQ5enhkZVc46kVn8OtoFCjn8WHfidY Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:03.716775 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40e3c1170ca7453d94bd37157475dca2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c0b7f548b6bc46e1983a955e1c900fb9 Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'image_id': 'a6d8bb78-6e0a-4aeb-91ad-f21e6bc83a49'} Jun 18 22:04:03.719723 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:03.720873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a6d8bb78-6e0a-4aeb-91ad-f21e6bc83a49 Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:03.722891 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6d8bb78-6e0a-4aeb-91ad-f21e6bc83a49 could not be found. Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:03.725589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:03.726845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca3e3df7-29fd-4fe6-93b9-2545fa56221e tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:03.729413 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca3e3df7-29fd-4fe6-93b9-2545fa56221e tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] 10.222.0.30 "GET /compute/v2.1/images/a6d8bb78-6e0a-4aeb-91ad-f21e6bc83a49/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035274 Jun 18 22:04:03.729413 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 383/749] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:04:03 2022] GET /compute/v2.1/images/a6d8bb78-6e0a-4aeb-91ad-f21e6bc83a49/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:03.729413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:03.729413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:03.732707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:03.737006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.737496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.738284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:03.738721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:03.964617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed89a93a-6161-4ae5-886e-3bffb1a86b2c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.298572 Jun 18 22:04:03.965302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 367/750] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:04:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:03.970081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bad50d18-54c1-4ab3-b8ee-a1202ce77f2e tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Action: 'update', calling method: .version_select at 0x7fea149a0dc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:03.978895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:03.986952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4365c381-32e6-4546-9c3f-be90a08db6d3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.265970 Jun 18 22:04:03.987924 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 384/751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:03 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:03.993266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:03.994242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:04.001054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.001164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.002042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.002498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.064195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bad50d18-54c1-4ab3-b8ee-a1202ce77f2e tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.065175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bad50d18-54c1-4ab3-b8ee-a1202ce77f2e tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.066361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bad50d18-54c1-4ab3-b8ee-a1202ce77f2e tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.067099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bad50d18-54c1-4ab3-b8ee-a1202ce77f2e tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.174580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:04.180425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:04.188048 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ac87603-546a-4b05-88be-b747bb36d4e1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.198349 Jun 18 22:04:04.188768 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 385/752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:03 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:04.194034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0cde3673-afbe-4821-b80e-e9103b2471d6 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Action: 'update_all', calling method: .version_select at 0x7fea147751f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:04.223817 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0cde3673-afbe-4821-b80e-e9103b2471d6 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] HTTP exception thrown: Image not found. Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0cde3673-afbe-4821-b80e-e9103b2471d6 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Request method failure captured: Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/images/77637a01-00d8-48d4-b13a-5081a29e401c/metadata HTTP/1.1 Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 57 Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvQ9XTUwT9xdd3X1p4ZVr9_yboTH8TQ21Ya7A40-o-njc48M_cpyK6b2fqSWQrvUafKms5uzFgwNciI9e97PtJlmd4h1OcZDVgSSxTHPJT05ooU2ZvSAhPOswtDw4APOkJsRJ2A7H77WXtlVBQ5enhkZVc46kVn8OtoFCjn8WHfidY Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:04.226639 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40e3c1170ca7453d94bd37157475dca2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c0b7f548b6bc46e1983a955e1c900fb9 Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:04:04.227906 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'image_id': '77637a01-00d8-48d4-b13a-5081a29e401c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:04.228910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 77637a01-00d8-48d4-b13a-5081a29e401c Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:04.230098 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 77637a01-00d8-48d4-b13a-5081a29e401c could not be found. Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:04.231267 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:04:04.232364 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.235942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0cde3673-afbe-4821-b80e-e9103b2471d6 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:04.237463 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0cde3673-afbe-4821-b80e-e9103b2471d6 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] 10.222.0.30 "PUT /compute/v2.1/images/77637a01-00d8-48d4-b13a-5081a29e401c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.046801 Jun 18 22:04:04.238715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 386/753] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:04:04 2022] PUT /compute/v2.1/images/77637a01-00d8-48d4-b13a-5081a29e401c/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:04.245189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.39"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:04.246980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:04.254515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.255575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.256689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.257309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.291066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Acquired lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:04:04.508352 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bad50d18-54c1-4ab3-b8ee-a1202ce77f2e tempest-QuotasAdminTestJSON-2045637414 tempest-QuotasAdminTestJSON-2045637414-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813" status: 200 len: 329 microversion: 2.1 time: 0.541963 Jun 18 22:04:04.508940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 368/754] 10.222.0.30 () {60 vars in 1262 bytes} [Sat Jun 18 22:04:03 2022] PUT /compute/v2.1/os-quota-sets/18f2d50ee9b74209b100e2fb806ca813 => generated 329 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:04.513694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:04.514467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:04.521096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.521549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.522428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.522865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.866392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:04.875781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:04.877327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:04.878590 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-364db486-d979-4403-968b-7d32ef1edf77 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.368508 Jun 18 22:04:04.879188 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 369/755] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:04 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:04.894343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a757c32-3ad7-4da7-924e-c72a417b2f84 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Action: 'update', calling method: .version_select at 0x7fea14a30a60>, body: {"meta": {"os_distro": "alt"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:04.926414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834.", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:04:04.927011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Releasing lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:04:04.927568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] HTTP exception thrown: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.927568 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] Jun 18 22:04:04.933442 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-7a757c32-3ad7-4da7-924e-c72a417b2f84 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] HTTP exception thrown: Image not found. Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a757c32-3ad7-4da7-924e-c72a417b2f84 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Request method failure captured: Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/images/396946e4-2b8b-4cf6-b001-a26a96e39bae/metadata/os_distro HTTP/1.1 Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 30 Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvQ9XTUwT9xdd3X1p4ZVr9_yboTH8TQ21Ya7A40-o-njc48M_cpyK6b2fqSWQrvUafKms5uzFgwNciI9e97PtJlmd4h1OcZDVgSSxTHPJT05ooU2ZvSAhPOswtDw4APOkJsRJ2A7H77WXtlVBQ5enhkZVc46kVn8OtoFCjn8WHfidY Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:04.937751 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40e3c1170ca7453d94bd37157475dca2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: c0b7f548b6bc46e1983a955e1c900fb9 Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: {"meta": {"os_distro": "alt"}} Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: exception: Image not found. Jun 18 22:04:04.939321 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'image_id': '396946e4-2b8b-4cf6-b001-a26a96e39bae', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:04.940363 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 396946e4-2b8b-4cf6-b001-a26a96e39bae Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:04.941635 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 396946e4-2b8b-4cf6-b001-a26a96e39bae could not be found. Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:04.942818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:04:04.944037 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.945569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a757c32-3ad7-4da7-924e-c72a417b2f84 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Returning 404 to user: Image not found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:04.945569 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a757c32-3ad7-4da7-924e-c72a417b2f84 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] 10.222.0.30 "PUT /compute/v2.1/images/396946e4-2b8b-4cf6-b001-a26a96e39bae/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.048645 Jun 18 22:04:04.945569 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 370/756] 10.222.0.30 () {60 vars in 1309 bytes} [Sat Jun 18 22:04:04 2022] PUT /compute/v2.1/images/396946e4-2b8b-4cf6-b001-a26a96e39bae/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Request method failure captured: Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action HTTP/1.1 Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 45 Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuuRoIySRmVhOFBmj0BD6-Q9CRT1Dp_cnSN1Ajl1sk8KlonO4zG24rQvMmNJs6EATm4bTTkLMfcyhwxZ6TLDnHyL9L8thkFVWrZpErN6kc_UkAFESJ8N6kihITQrlNwBfFGDRpix3ncUA4RgnOq3cIefKEMdyYAx3jMy78MR5dXX5I Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:04.945832 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5893b4b7c9c49bf87729b506675446e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: db0ce8caf601458c94d03b85b37e4371 Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: {"addFloatingIp": {"address": "172.35.2.39"}} Jun 18 22:04:04.947410 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3f67d4bc-748f-4d54-912b-806862936a19', 'body': {'addFloatingIp': {'address': '172.35.2.39'}}} Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:04.948366 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:04:04.949628 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.950860 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.952018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Returning 400 to user: Cannot associate floating IP 172.35.2.39 (02998de6-d0f1-45c2-87fc-e0369742c67f) with port 45094155-19d5-4eb9-afe3-1c3e4479b7bb using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 4576993c-4367-41ca-bae0-2febb9d30834. Jun 18 22:04:04.953313 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-c4d0dddf-482d-423b-95f5-633061b0c6b4'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:04.954115 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a5da33f-f043-45e1-b4d8-24717f958535 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action" status: 400 len: 380 microversion: 2.1 time: 0.707246 Jun 18 22:04:04.954115 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 387/757] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:04 2022] POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action => generated 380 bytes in 708 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:04:04.954115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d6b865d-b4ca-40e8-b54a-912705cc82e4 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Action: 'create', calling method: .version_select at 0x7fea146a73a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:04.963266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:04.963898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:04.971588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.972215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.972789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:04.973327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:04.988502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:04.990955 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-2d6b865d-b4ca-40e8-b54a-912705cc82e4 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] HTTP exception thrown: Image not found. Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d6b865d-b4ca-40e8-b54a-912705cc82e4 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Request method failure captured: Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/images/61c3cebf-79c7-490a-9ce9-eb64a5fb2aac/metadata HTTP/1.1 Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 57 Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvQ9XTUwT9xdd3X1p4ZVr9_yboTH8TQ21Ya7A40-o-njc48M_cpyK6b2fqSWQrvUafKms5uzFgwNciI9e97PtJlmd4h1OcZDVgSSxTHPJT05ooU2ZvSAhPOswtDw4APOkJsRJ2A7H77WXtlVBQ5enhkZVc46kVn8OtoFCjn8WHfidY Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:04.994473 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40e3c1170ca7453d94bd37157475dca2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40e3c1170ca7453d94bd37157475dca2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 40e3c1170ca7453d94bd37157475dca2 Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759 Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c0b7f548b6bc46e1983a955e1c900fb9 Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1587123759-project Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:04:04.995756 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'image_id': '61c3cebf-79c7-490a-9ce9-eb64a5fb2aac', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:04.996594 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 61c3cebf-79c7-490a-9ce9-eb64a5fb2aac Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:04:04.997651 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61c3cebf-79c7-490a-9ce9-eb64a5fb2aac could not be found. Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:04.998760 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:04:04.999835 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:05.002875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d6b865d-b4ca-40e8-b54a-912705cc82e4 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:05.002875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d6b865d-b4ca-40e8-b54a-912705cc82e4 tempest-ImagesMetadataNegativeTestJSON-1587123759 tempest-ImagesMetadataNegativeTestJSON-1587123759-project] 10.222.0.30 "POST /compute/v2.1/images/61c3cebf-79c7-490a-9ce9-eb64a5fb2aac/metadata" status: 404 len: 62 microversion: 2.1 time: 0.047842 Jun 18 22:04:05.002875 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 388/758] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Jun 18 22:04:04 2022] POST /compute/v2.1/images/61c3cebf-79c7-490a-9ce9-eb64a5fb2aac/metadata => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:05.133560 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4718326d-1024-498e-bbf6-8891563ea3c7 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1630 microversion: 2.1 time: 0.192721 Jun 18 22:04:05.135136 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 371/759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:04 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1630 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:05.142461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:05.143459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:05.151909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:05.152511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:05.153886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:05.154630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:05.247880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-04cf35b6-bce4-486b-a2ad-2d6a9ea30adb tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '.version_select at 0x7fea15112c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:05.445851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:05.455105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d12f0d05-9d88-42fb-983b-5e987d798c30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.318776 Jun 18 22:04:05.455896 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 372/760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:05 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:05.460903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:05.462181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:05.468471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:05.480638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:05.481835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:05.483580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:05.529301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lazy-loading 'flavor' on Instance uuid 2915c85a-6454-4b71-9078-0375b4fbdc7e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:05.543446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Going to try to live migrate instance to nch2-master-1 {{(pid=130902) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:04:05.554464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=15,nova_api:INSERT=14 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:06.124547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-04cf35b6-bce4-486b-a2ad-2d6a9ea30adb tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/02998de6-d0f1-45c2-87fc-e0369742c67f" status: 202 len: 0 microversion: 2.1 time: 1.121495 Jun 18 22:04:06.125057 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 389/761] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:04:05 2022] DELETE /compute/v2.1/os-floating-ips/02998de6-d0f1-45c2-87fc-e0369742c67f => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:06.134395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:06.135461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:06.156715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:06.158091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:06.160384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:06.161330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:06.455389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:06.463150 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77cb7e8e-9913-437e-9030-e3a989c76823 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.337027 Jun 18 22:04:06.475102 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 390/762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:06 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:06.483304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:06.485442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:06.520925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:06.521420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:06.530016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:06.531370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:06.728885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:06.737663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:06.739159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:06.741127 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6e66f0e-e22f-4634-ac63-32ed8e62f596 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.275085 Jun 18 22:04:06.741850 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 391/763] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:06 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:06.749706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.57"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:06.901300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:06.908828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:06.910551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:06.912105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:06.912980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:07.327372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Acquired lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:04:08.779997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Building network info cache for instance {{(pid=130903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:04:08.858816 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ee00d22-33cb-4db4-8da7-492da608e744 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e/action" status: 202 len: 0 microversion: 2.1 time: 3.401645 Jun 18 22:04:08.861385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 373/764] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:05 2022] POST /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e/action => generated 0 bytes in 3405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:08.868012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:08.869024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:08.889733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:08.890540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:08.892689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:08.893548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:09.313235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:09.328631 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2bfa952b-a967-4aff-8650-d18928b18570 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.465142 Jun 18 22:04:09.329698 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 374/765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:08 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:09.345368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9ba37a30-8248-4e94-aee7-a2087aa3fde3 req-7e85961a-627c-4bd5-84de-4bdab4bf0d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79", "name": "network-vif-plugged", "status": "completed", "tag": "bd8a15a9-02da-4737-bf34-0f1ed6541286"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:09.355264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9ba37a30-8248-4e94-aee7-a2087aa3fde3 req-7e85961a-627c-4bd5-84de-4bdab4bf0d68 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:09.355745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9ba37a30-8248-4e94-aee7-a2087aa3fde3 req-7e85961a-627c-4bd5-84de-4bdab4bf0d68 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:09.368251 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9ba37a30-8248-4e94-aee7-a2087aa3fde3 req-7e85961a-627c-4bd5-84de-4bdab4bf0d68 service nova] Creating event network-vif-plugged:bd8a15a9-02da-4737-bf34-0f1ed6541286 for instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 on nch1-master-1 Jun 18 22:04:09.376098 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9ba37a30-8248-4e94-aee7-a2087aa3fde3 req-7e85961a-627c-4bd5-84de-4bdab4bf0d68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 Jun 18 22:04:09.383409 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 375/766] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:09.413537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:09.415304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:09.458850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:09.459653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:09.460697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:09.461447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:09.826286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:09.836255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-10bb8996-73ce-46ba-b1b2-a50f414dae43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.443452 Jun 18 22:04:09.836851 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 376/767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:09 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:09.850853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:09.851496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:09.869367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:09.869992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:09.870804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:09.871282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:10.075981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Updating instance_info_cache with network_info: [{"id": "45094155-19d5-4eb9-afe3-1c3e4479b7bb", "address": "fa:16:3e:c5:85:3e", "network": {"id": "ecf270c2-fa45-4f50-b885-5754dbdc2136", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-463439867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c5893b4b7c9c49bf87729b506675446e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap45094155-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:04:10.111847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Releasing lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:04:10.112875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f928cda5-9217-41e0-9345-7ca5c114d797 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action" status: 202 len: 0 microversion: 2.1 time: 3.369889 Jun 18 22:04:10.116998 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 392/768] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:06 2022] POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action => generated 0 bytes in 3374 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:04:10.122029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:10.138371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:10.141308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:10.143643 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f024c7b-dcad-4f4d-9916-dee54eeca6e0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1361 microversion: 2.25 time: 0.296859 Jun 18 22:04:10.154496 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 377/769] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:09 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:10.162631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ee206385-8a39-4700-9d51-6aa92d3fbde4 req-812205e7-1c64-432f-abb6-6eee088119d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f67d4bc-748f-4d54-912b-806862936a19", "tag": "45094155-19d5-4eb9-afe3-1c3e4479b7bb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:10.172624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ee206385-8a39-4700-9d51-6aa92d3fbde4 req-812205e7-1c64-432f-abb6-6eee088119d8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:10.173849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ee206385-8a39-4700-9d51-6aa92d3fbde4 req-812205e7-1c64-432f-abb6-6eee088119d8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:10.193103 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ee206385-8a39-4700-9d51-6aa92d3fbde4 req-812205e7-1c64-432f-abb6-6eee088119d8 service nova] Creating event network-changed:45094155-19d5-4eb9-afe3-1c3e4479b7bb for instance 3f67d4bc-748f-4d54-912b-806862936a19 on nch2-master-1 Jun 18 22:04:10.206409 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ee206385-8a39-4700-9d51-6aa92d3fbde4 req-812205e7-1c64-432f-abb6-6eee088119d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047393 Jun 18 22:04:10.207979 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 378/770] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:10.221993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:10.225739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:10.236038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:10.237448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:10.238714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:10.239369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:10.380489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-780361708", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:10.454851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:10.740483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:10.751415 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57161a37-b7de-4e86-b301-61e90da38148 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1504 microversion: 2.1 time: 0.539182 Jun 18 22:04:10.753716 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 379/771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:10 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:10.771047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41743621-9088-4d2d-b968-4012a02ecd7f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '.version_select at 0x7fea147a73a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:11.303656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:11.304247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:11.304951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:11.305665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:11.306712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:11.319700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:11.321154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:11.322526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:11.323248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:11.393675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Getting quotas for project 24245a540466462bb9a908267f505f28. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:11.409738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Getting quotas for user f8783e0de2414f20ade6604bd0089fab and project 24245a540466462bb9a908267f505f28. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:11.437260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:11.440326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:11.536982 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7384d06a-6d73-429e-9380-758edf5b9a80 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407017 Jun 18 22:04:11.538466 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 393/772] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:04:11.554386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:11.556276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:11.567413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:11.568042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:11.569315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:11.570116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:11.998461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:12.012953 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8f829141-4e9e-42cf-9708-5fdaf72de969 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.472808 Jun 18 22:04:12.014310 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 394/773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:11 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:12.020653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:12.021591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:12.040283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:12.041334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:12.042430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:12.044074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:12.306963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:12.316283 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49b11d17-7b34-41e9-94ac-b074343e3d6a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.300542 Jun 18 22:04:12.316869 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 395/774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:12 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:12.323570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d1395f6c-8e99-47a9-819b-13d743ea5fe6 req-68d8fbe3-17be-46ed-905c-d2b13be87c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2915c85a-6454-4b71-9078-0375b4fbdc7e", "name": "network-vif-unplugged", "status": "completed", "tag": "b9ec270a-bd87-4e67-83fd-6757c8bfb188"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:12.334589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d1395f6c-8e99-47a9-819b-13d743ea5fe6 req-68d8fbe3-17be-46ed-905c-d2b13be87c67 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:12.335031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d1395f6c-8e99-47a9-819b-13d743ea5fe6 req-68d8fbe3-17be-46ed-905c-d2b13be87c67 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:12.365695 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d1395f6c-8e99-47a9-819b-13d743ea5fe6 req-68d8fbe3-17be-46ed-905c-d2b13be87c67 service nova] Creating event network-vif-unplugged:b9ec270a-bd87-4e67-83fd-6757c8bfb188 for instance 2915c85a-6454-4b71-9078-0375b4fbdc7e on nch1-master-1 Jun 18 22:04:12.383103 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d1395f6c-8e99-47a9-819b-13d743ea5fe6 req-68d8fbe3-17be-46ed-905c-d2b13be87c67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062947 Jun 18 22:04:12.383973 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 396/775] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:12.389608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:12.394812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:12.409381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:12.409719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:12.410498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:12.417448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:12.879849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41743621-9088-4d2d-b968-4012a02ecd7f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/27514cdb-524c-48e6-9e1c-2306c982c771" status: 202 len: 0 microversion: 2.1 time: 2.113466 Jun 18 22:04:12.885247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 380/776] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:04:10 2022] DELETE /compute/v2.1/os-floating-ips/27514cdb-524c-48e6-9e1c-2306c982c771 => generated 0 bytes in 2119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:12.890978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b0c4efa4-dd75-44e2-a33b-0dd0f940c276 req-296fea1c-228f-47a7-94e9-5cefeee10f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468ab9a6-b57f-41bc-8271-2a6c51106e81", "name": "network-vif-plugged", "status": "completed", "tag": "e0c10288-e99c-4acf-bc15-6aa0400da027"}, {"server_uuid": "678d2a2b-9907-4e75-8cc7-424583f5cca7", "name": "network-vif-plugged", "status": "completed", "tag": "401011df-8eff-4d01-b8b2-b3e66f069fde"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:12.912170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b0c4efa4-dd75-44e2-a33b-0dd0f940c276 req-296fea1c-228f-47a7-94e9-5cefeee10f51 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:12.912619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b0c4efa4-dd75-44e2-a33b-0dd0f940c276 req-296fea1c-228f-47a7-94e9-5cefeee10f51 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:12.915139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:12.924237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:12.937729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:12.940579 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c87dd94-f924-478a-8158-6cbf3788ec43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1556 microversion: 2.25 time: 0.555184 Jun 18 22:04:12.947105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b0c4efa4-dd75-44e2-a33b-0dd0f940c276 req-296fea1c-228f-47a7-94e9-5cefeee10f51 service nova] Creating event network-vif-plugged:e0c10288-e99c-4acf-bc15-6aa0400da027 for instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 on nch1-master-1 Jun 18 22:04:12.947940 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b0c4efa4-dd75-44e2-a33b-0dd0f940c276 req-296fea1c-228f-47a7-94e9-5cefeee10f51 service nova] Creating event network-vif-plugged:401011df-8eff-4d01-b8b2-b3e66f069fde for instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 on nch2-master-1 Jun 18 22:04:12.957220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 397/777] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:12 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1556 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:12.965599 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b0c4efa4-dd75-44e2-a33b-0dd0f940c276 req-296fea1c-228f-47a7-94e9-5cefeee10f51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078889 Jun 18 22:04:12.969389 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 381/778] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:12.988477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:12.989288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:13.008036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:13.008478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:13.009283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:13.009717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:13.011730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1796325946", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:13.191091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:13.691842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:13.707630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a9c231d-2ee2-4fda-aa77-8084ed968618 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1504 microversion: 2.1 time: 0.736843 Jun 18 22:04:13.708234 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 382/779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:12 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1504 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:13.730076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24875676-8d37-4595-9f41-5958eacc7ee6 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24875676-8d37-4595-9f41-5958eacc7ee6 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Request method failure captured: Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action HTTP/1.1 Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 34 Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuuRoIySRmVhOFBmj0BD6-Q9CRT1Dp_cnSN1Ajl1sk8KlonO4zG24rQvMmNJs6EATm4bTTkLMfcyhwxZ6TLDnHyL9L8thkFVWrZpErN6kc_UkAFESJ8N6kihITQrlNwBfFGDRpix3ncUA4RgnOq3cIefKEMdyYAx3jMy78MR5dXX5I Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:13.732658 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5893b4b7c9c49bf87729b506675446e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: db0ce8caf601458c94d03b85b37e4371 Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: {"addFloatingIp": {"address": ""}} Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:04:13.734040 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3f67d4bc-748f-4d54-912b-806862936a19', 'body': {'addFloatingIp': {'address': ''}}} Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi '' Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:13.735436 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:04:13.736827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:04:13.738141 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 18 22:04:13.738141 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:13.743531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24875676-8d37-4595-9f41-5958eacc7ee6 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:13.745611 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24875676-8d37-4595-9f41-5958eacc7ee6 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action" status: 400 len: 142 microversion: 2.1 time: 0.035933 Jun 18 22:04:13.746740 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 383/780] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:13 2022] POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action => generated 142 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:04:13.755251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:13.756208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:13.767579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:13.770113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:13.772415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:13.773113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:13.892269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:13.893144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:13.893735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:13.894238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:13.894762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:13.911343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:13.912173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:13.914434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:13.917270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:13.962541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Getting quotas for project 24245a540466462bb9a908267f505f28. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:13.974776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Getting quotas for user f8783e0de2414f20ade6604bd0089fab and project 24245a540466462bb9a908267f505f28. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:14.006266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:14.008711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:14.076130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:14.092445 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7a2478a6-f80d-466d-af99-d65cda6093bc tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.133778 Jun 18 22:04:14.093868 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 398/781] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:04:14.100123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:14.100897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:14.107974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.108790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.109738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.110271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.170243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:14.250375 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95f84c6d-80ca-47f4-bf51-9b3877179b5f tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 2048 microversion: 2.25 time: 0.502263 Jun 18 22:04:14.252102 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 384/782] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:13 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 2048 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:14.259407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:14.261257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:14.270027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.271561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.272623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.273279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.351966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:14.362336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea01d5b1-a7ad-44aa-baca-fc567f0d64ac tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.267201 Jun 18 22:04:14.362926 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 399/783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:14 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:14.374279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:14.376817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:14.391202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.391636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.392496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.394584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.438438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Acquired lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:04:14.502956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=34 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:14.641154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Releasing lock "refresh_cache-3f67d4bc-748f-4d54-912b-806862936a19" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:04:14.641934 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] HTTP exception thrown: floating IP not found Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Request method failure captured: Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action HTTP/1.1 Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 41 Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuuRoIySRmVhOFBmj0BD6-Q9CRT1Dp_cnSN1Ajl1sk8KlonO4zG24rQvMmNJs6EATm4bTTkLMfcyhwxZ6TLDnHyL9L8thkFVWrZpErN6kc_UkAFESJ8N6kihITQrlNwBfFGDRpix3ncUA4RgnOq3cIefKEMdyYAx3jMy78MR5dXX5I Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:14.643777 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5893b4b7c9c49bf87729b506675446e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: db0ce8caf601458c94d03b85b37e4371 Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:14.645116 ncdv-master-1 devstack@n-api.service[130903]: exception: floating IP not found Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3f67d4bc-748f-4d54-912b-806862936a19', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:14.645970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 18 22:04:14.648031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:14.649872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Returning 404 to user: floating IP not found {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:14.649872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56be123e-fa98-418b-92cd-5e1a3bc78b7c tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action" status: 404 len: 67 microversion: 2.1 time: 0.279006 Jun 18 22:04:14.649872 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 400/784] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:14 2022] POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action => generated 67 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:14.650810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39887691-e19c-450a-b790-484a6fa25a1d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:14.651429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39887691-e19c-450a-b790-484a6fa25a1d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:14.801611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39887691-e19c-450a-b790-484a6fa25a1d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:14.810012 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39887691-e19c-450a-b790-484a6fa25a1d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1214 microversion: 2.1 time: 0.162793 Jun 18 22:04:14.810590 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 401/785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:14 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:14.821326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:14.832492 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8542884f-db52-4d8b-bca8-d5dccc0368fc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1319 microversion: 2.1 time: 0.578420 Jun 18 22:04:14.833114 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 385/786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:14 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:14.834316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:14.834947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:14.844797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-82804eaf-bc35-4aea-9178-4389e8704309 req-d5ad7dd0-2fb3-4e3a-8ce2-2101acf6b75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2915c85a-6454-4b71-9078-0375b4fbdc7e", "tag": "b9ec270a-bd87-4e67-83fd-6757c8bfb188"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:14.860792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.861695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.863857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.869258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.870134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-82804eaf-bc35-4aea-9178-4389e8704309 req-d5ad7dd0-2fb3-4e3a-8ce2-2101acf6b75f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:14.871561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-82804eaf-bc35-4aea-9178-4389e8704309 req-d5ad7dd0-2fb3-4e3a-8ce2-2101acf6b75f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:14.908490 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-82804eaf-bc35-4aea-9178-4389e8704309 req-d5ad7dd0-2fb3-4e3a-8ce2-2101acf6b75f service nova] Creating event network-changed:b9ec270a-bd87-4e67-83fd-6757c8bfb188 for instance 2915c85a-6454-4b71-9078-0375b4fbdc7e on nch1-master-1 Jun 18 22:04:14.918326 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-82804eaf-bc35-4aea-9178-4389e8704309 req-d5ad7dd0-2fb3-4e3a-8ce2-2101acf6b75f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077532 Jun 18 22:04:14.924423 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 386/787] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:14.929892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45ad09f4-8882-4041-9791-8d669ad688af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:15.019333 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-45ad09f4-8882-4041-9791-8d669ad688af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45ad09f4-8882-4041-9791-8d669ad688af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Request method failure captured: Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action HTTP/1.1 Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 44 Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuuRoIySRmVhOFBmj0BD6-Q9CRT1Dp_cnSN1Ajl1sk8KlonO4zG24rQvMmNJs6EATm4bTTkLMfcyhwxZ6TLDnHyL9L8thkFVWrZpErN6kc_UkAFESJ8N6kihITQrlNwBfFGDRpix3ncUA4RgnOq3cIefKEMdyYAx3jMy78MR5dXX5I Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:15.023739 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5893b4b7c9c49bf87729b506675446e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: db0ce8caf601458c94d03b85b37e4371 Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:04:15.025323 ncdv-master-1 devstack@n-api.service[130902]: exception: Floating IP not found for address 0.0.0.0. Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3f67d4bc-748f-4d54-912b-806862936a19', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:15.026496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 18 22:04:15.027849 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:15.032675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45ad09f4-8882-4041-9791-8d669ad688af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:15.033942 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45ad09f4-8882-4041-9791-8d669ad688af tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action" status: 404 len: 88 microversion: 2.1 time: 0.108149 Jun 18 22:04:15.035020 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 387/788] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:14 2022] POST /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19/action => generated 88 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:15.050653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:15.059025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:15.072621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.073157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.074701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.075741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.308902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:15.349270 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0608f0c9-7abc-4f4b-a60e-3e8cee60a641 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 2048 microversion: 2.25 time: 0.534978 Jun 18 22:04:15.350347 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 402/789] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:14 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 2048 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:15.366481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c3a7342c-d55f-4f13-a97b-aac6f6cd0cbc req-8a557309-1b20-4c22-a354-552b308154c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "039a68da-48d6-4f1e-9aab-82c4595b9f50", "name": "network-vif-plugged", "status": "completed", "tag": "818dbee5-4d83-4443-a2c8-1325e6537710"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:15.386578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c3a7342c-d55f-4f13-a97b-aac6f6cd0cbc req-8a557309-1b20-4c22-a354-552b308154c6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.387024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c3a7342c-d55f-4f13-a97b-aac6f6cd0cbc req-8a557309-1b20-4c22-a354-552b308154c6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.390142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:15.399218 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-115025dd-5590-41d5-b577-c8d58b150a40 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1504 microversion: 2.1 time: 0.362905 Jun 18 22:04:15.409447 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 388/790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:15 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:15.416275 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c3a7342c-d55f-4f13-a97b-aac6f6cd0cbc req-8a557309-1b20-4c22-a354-552b308154c6 service nova] Creating event network-vif-plugged:818dbee5-4d83-4443-a2c8-1325e6537710 for instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 on nch1-master-1 Jun 18 22:04:15.420072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:15.420700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:15.436974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c3a7342c-d55f-4f13-a97b-aac6f6cd0cbc req-8a557309-1b20-4c22-a354-552b308154c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083864 Jun 18 22:04:15.439195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.439658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.441989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.442438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.442555 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 403/791] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:15.448723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-047a7c02-90e8-43d3-a323-a0ebfc7d27af tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:15.450211 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:04:15.450211 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:04:15.451439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-047a7c02-90e8-43d3-a323-a0ebfc7d27af tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.451893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-047a7c02-90e8-43d3-a323-a0ebfc7d27af tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.452706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-047a7c02-90e8-43d3-a323-a0ebfc7d27af tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.453162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-047a7c02-90e8-43d3-a323-a0ebfc7d27af tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.497964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:04:15.562921 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-047a7c02-90e8-43d3-a323-a0ebfc7d27af tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.118949 Jun 18 22:04:15.568455 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 404/792] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Jun 18 22:04:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:04:15.587344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:15.591281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:15.628948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:15.632293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.635256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.641565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.644228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.698602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c2f3051-f6e6-4369-b543-0b3aa3d413f2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 204 len: 0 microversion: 2.1 time: 0.285771 Jun 18 22:04:15.701600 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 389/793] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:15 2022] DELETE /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:04:15.715574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:15.717438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:15.731919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.732538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.733487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.734094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.826430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f9386a1-743b-4583-8b62-b6c5c73439b4 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79/action" status: 202 len: 0 microversion: 2.25 time: 0.120977 Jun 18 22:04:15.830374 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 390/794] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:04:15 2022] POST /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:04:15.836577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:15.842869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:15.856521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.857337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:15.858216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:15.858926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.071119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:16.091233 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ba35a69-0c53-4721-bd54-ced4f642a084 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.518334 Jun 18 22:04:16.092174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 405/795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:15 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:16.098274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:16.099272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:16.106825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.107469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.108582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.109318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.147930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:16.173848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d2294ee-ecd9-48d3-839a-03a6f1c53245 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1541 microversion: 2.1 time: 0.341729 Jun 18 22:04:16.174795 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 391/796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:15 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1541 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:16.181105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:16.182099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:16.194807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.195791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.196758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.197386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.240223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:16.251564 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9ed57943-76e3-457c-8b79-6719d38de88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1274 microversion: 2.1 time: 0.157930 Jun 18 22:04:16.254947 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 406/797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:16 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:16.260163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:16.261353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:16.283306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.283890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.285319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.288765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.448911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:16.467506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d8dd1045-1e49-45c5-ac17-760b5fa5cdc7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 2033 microversion: 2.25 time: 0.291347 Jun 18 22:04:16.468195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 392/798] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:16 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 2033 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:16.476682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:16.477406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:16.486516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.487188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.488131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.488714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.508680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:16.516977 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e31e169-bb78-4d6d-86e1-c016be066eb1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1468 microversion: 2.1 time: 0.260637 Jun 18 22:04:16.528909 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 407/799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:16 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1468 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:16.528909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:16.528909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:16.538174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.539229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.543160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.543937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.580344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'flavor' on Instance uuid c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:16.623829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Going to try to live migrate instance to nch2-master-1 {{(pid=130903) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:04:16.650120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:16.697716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:16.709799 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bf9b5f6-76ff-4dee-a2d1-139c8e677222 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1504 microversion: 2.1 time: 0.236458 Jun 18 22:04:16.710675 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 393/800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:16 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:16.715786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:16.717572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:16.725093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.726344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.727535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:16.728240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:16.968913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:16.977280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e5bd3690-848e-4520-958f-807462c9c4f5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1319 microversion: 2.1 time: 0.265249 Jun 18 22:04:16.978152 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 394/801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:16 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:17.107833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:17.110495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:17.130922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:17.131643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:17.150974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:17.154154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:17.447965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:17.458670 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bab33e2a-9a27-43fc-8acc-a680bcf7ec0f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1306 microversion: 2.1 time: 0.354842 Jun 18 22:04:17.459780 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 395/802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:17 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1306 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:17.465362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:17.466243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:17.473178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:17.473982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:17.474938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:17.476535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:17.957610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:17.970305 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f486ac5-2c7e-4d17-ae7c-8d70dc5e8f2f tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1541 microversion: 2.1 time: 0.509153 Jun 18 22:04:17.982727 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 396/803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:17 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1541 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:17.989075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:17.990021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:18.000901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:18.001622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:18.002619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:18.003628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:18.125145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:18.151763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57f26d38-57aa-452d-8a77-1d3d88663381 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1272 microversion: 2.1 time: 0.166286 Jun 18 22:04:18.153011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 397/804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:17 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:18.174793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-befbdcd1-fe3a-494f-8c2b-db3e85c1f856 req-36cfd915-dc0f-4a3c-b55b-20e477df4491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2915c85a-6454-4b71-9078-0375b4fbdc7e", "name": "network-vif-unplugged", "status": "completed", "tag": "b9ec270a-bd87-4e67-83fd-6757c8bfb188"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:18.208193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-befbdcd1-fe3a-494f-8c2b-db3e85c1f856 req-36cfd915-dc0f-4a3c-b55b-20e477df4491 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:18.210682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-befbdcd1-fe3a-494f-8c2b-db3e85c1f856 req-36cfd915-dc0f-4a3c-b55b-20e477df4491 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:18.231229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-befbdcd1-fe3a-494f-8c2b-db3e85c1f856 req-36cfd915-dc0f-4a3c-b55b-20e477df4491 service nova] Creating event network-vif-unplugged:b9ec270a-bd87-4e67-83fd-6757c8bfb188 for instance 2915c85a-6454-4b71-9078-0375b4fbdc7e on nch1-master-1 Jun 18 22:04:18.236194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-befbdcd1-fe3a-494f-8c2b-db3e85c1f856 req-36cfd915-dc0f-4a3c-b55b-20e477df4491 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075004 Jun 18 22:04:18.241715 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 398/805] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:18.322554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-261494014", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "713f6b19-8618-481c-a909-4b80c35af0b4"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:18.415742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] validate_networks() for [('713f6b19-8618-481c-a909-4b80c35af0b4', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:19.287440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:19.288113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:19.288623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:19.289175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:19.290257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:19.305620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:19.306371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:19.307480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:19.308173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:19.366311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Getting quotas for project 1821f70f45ef4861bb8d49faaba64b20. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:19.373507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Getting quotas for user 1e85a218336047078ebb040193bd24a9 and project 1821f70f45ef4861bb8d49faaba64b20. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:19.396889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:19.399620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:19.465106 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e7be5fc6-3faa-4871-b219-5e238e1c570b tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221812 Jun 18 22:04:19.474530 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 399/806] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:04:19.480417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:19.481612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:19.493322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:19.495069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:19.496343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:19.498345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:19.803677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:19.815524 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27accd2a-de4e-431d-a349-86f40bdc0429 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1504 microversion: 2.1 time: 0.339280 Jun 18 22:04:19.819463 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 400/807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:19 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:19.825227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:19.828353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:19.841261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:19.842879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:19.844614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:19.845415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.210853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:20.223362 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-76639b73-2d87-4a13-9b19-30d95f9065d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1469 microversion: 2.1 time: 0.402479 Jun 18 22:04:20.235873 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 401/808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:19 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1469 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:20.243589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:20.244382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:20.261199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.261906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.262654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.268281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.414743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c8436746-8d2b-440b-82bd-18e307c25388 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79/action" status: 202 len: 0 microversion: 2.25 time: 3.894510 Jun 18 22:04:20.415798 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 408/809] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:04:16 2022] POST /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79/action => generated 0 bytes in 3896 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:04:20.421862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:20.422573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:20.442627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.443088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.446456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.447277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.493678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:20.503609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b867d8e8-537a-4922-9c01-5337e626dec6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1485 microversion: 2.1 time: 0.277203 Jun 18 22:04:20.504627 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 402/810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:20 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1485 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:20.520846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7fd196ba-a9ff-4a89-9ae4-b9141b507eac req-565cc957-6252-4d88-9485-13123f0cade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bb4fcc9-fabe-4536-9514-c539642cc9c2", "tag": "5f35a6e4-ed0a-4464-9526-b7258e8cc72d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:20.530639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7fd196ba-a9ff-4a89-9ae4-b9141b507eac req-565cc957-6252-4d88-9485-13123f0cade6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.542256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7fd196ba-a9ff-4a89-9ae4-b9141b507eac req-565cc957-6252-4d88-9485-13123f0cade6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.571678 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7fd196ba-a9ff-4a89-9ae4-b9141b507eac req-565cc957-6252-4d88-9485-13123f0cade6 service nova] Creating event network-changed:5f35a6e4-ed0a-4464-9526-b7258e8cc72d for instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 on nch2-master-1 Jun 18 22:04:20.583645 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7fd196ba-a9ff-4a89-9ae4-b9141b507eac req-565cc957-6252-4d88-9485-13123f0cade6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076147 Jun 18 22:04:20.584283 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 403/811] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:20.586350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:20.592778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:20.593758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:20.601184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.601849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.602204 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f51bf730-cab1-4855-86a6-64a8e4dd6db3 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1499 microversion: 2.1 time: 0.185143 Jun 18 22:04:20.602971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.603573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.612420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 409/812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:20 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1499 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:20.617655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:20.618279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:20.631125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.631919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:20.632894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:20.633519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.003955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.012630 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1a747458-4826-4962-bb4d-10144ab14cd2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1219 microversion: 2.1 time: 0.398953 Jun 18 22:04:21.013244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 410/813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:20 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1219 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:21.034804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:21.048889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.051867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Searching by: {'reservation_id': 'r-5hahs6xt', 'deleted': False, 'project_id': 'c5285b07988c4c8581f047981271fee1'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:04:21.073784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.077338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.082316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.083071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.131174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.143997 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c36a3ce6-7a52-4829-ad07-78cbcf7c8f05 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.555296 Jun 18 22:04:21.145558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 404/814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:20 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:21.152446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4bd8e342-b45b-4ace-9958-b6dd2650ff2b req-d3dbad55-894d-491f-bad1-de70dc435f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f67d4bc-748f-4d54-912b-806862936a19", "name": "network-vif-deleted", "tag": "45094155-19d5-4eb9-afe3-1c3e4479b7bb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:21.164093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4bd8e342-b45b-4ace-9958-b6dd2650ff2b req-d3dbad55-894d-491f-bad1-de70dc435f03 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.165083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4bd8e342-b45b-4ace-9958-b6dd2650ff2b req-d3dbad55-894d-491f-bad1-de70dc435f03 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.183011 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4bd8e342-b45b-4ace-9958-b6dd2650ff2b req-d3dbad55-894d-491f-bad1-de70dc435f03 service nova] Creating event network-vif-deleted:45094155-19d5-4eb9-afe3-1c3e4479b7bb for instance 3f67d4bc-748f-4d54-912b-806862936a19 on nch2-master-1 Jun 18 22:04:21.198709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4bd8e342-b45b-4ace-9958-b6dd2650ff2b req-d3dbad55-894d-491f-bad1-de70dc435f03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051371 Jun 18 22:04:21.199960 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 405/815] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:21.202623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=24 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:21.206780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:21.208186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:21.215013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.215601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.217207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.217911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.330774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:04:21.373369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.388004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.390572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.392135 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fb63e2ff-3355-43f7-bf8a-0dff59a46a11 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.190986 Jun 18 22:04:21.403932 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 406/816] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:21 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:21.408843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4357895-dd8e-4ca9-8136-19770fd28e10 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:21.417323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4357895-dd8e-4ca9-8136-19770fd28e10 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.417823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4357895-dd8e-4ca9-8136-19770fd28e10 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.445273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=99 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:21.456186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.473870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.477706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.498161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4357895-dd8e-4ca9-8136-19770fd28e10 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Going to try to stop instance {{(pid=130902) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:04:21.503983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:21.562637 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4357895-dd8e-4ca9-8136-19770fd28e10 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7/action" status: 202 len: 0 microversion: 2.1 time: 0.157776 Jun 18 22:04:21.564175 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 407/817] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:21 2022] POST /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:21.581072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:21.584133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:21.612877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.617502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.618484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.620948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.720686 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9a0f4a9-f033-445d-abf2-37002275fa03 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-5hahs6xt" status: 200 len: 2930 microversion: 2.1 time: 0.702217 Jun 18 22:04:21.722599 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 411/818] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Jun 18 22:04:21 2022] GET /compute/v2.1/servers/detail?reservation_id=r-5hahs6xt => generated 2930 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:21.729714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:21.730997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:21.740634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.741203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.742421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.742916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.794236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.805837 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-143780e8-344b-4dfe-977d-4234eadded05 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1504 microversion: 2.1 time: 0.239293 Jun 18 22:04:21.828873 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 408/819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:21 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:21.841598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:21.842300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:21.849343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.849806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.850592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.851026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.935491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:21.935935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:21.936397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lazy-loading 'fault' on Instance uuid 3f67d4bc-748f-4d54-912b-806862936a19 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:21.951694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:21.963966 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-26cd37a3-9591-4085-a4b5-94ca8bc5c1d8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.239903 Jun 18 22:04:21.971452 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 412/820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:21 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:21.985702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f4c13a1c-a84b-43b2-8f33-3d7ab8081962 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.018712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0ce8caf601458c94d03b85b37e4371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5893b4b7c9c49bf87729b506675446e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:22.034436 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b27527c8-f0d9-4aa4-8c01-7b8658ce7349 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 200 len: 1322 microversion: 2.1 time: 0.204051 Jun 18 22:04:22.035077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 409/821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:21 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:22.047651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.048286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:22.064431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_groups [None req-f4c13a1c-a84b-43b2-8f33-3d7ab8081962 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Querying cell d349766c-949b-4923-9574-b93ba690371c(cell1) for 2 instances {{(pid=130903) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 18 22:04:22.065723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4c13a1c-a84b-43b2-8f33-3d7ab8081962 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.066472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4c13a1c-a84b-43b2-8f33-3d7ab8081962 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.072409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.075592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.076506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.078242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.107969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f4c13a1c-a84b-43b2-8f33-3d7ab8081962 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/818e9f98-ecac-4891-94fb-d2f5e83de272" status: 200 len: 265 microversion: 2.1 time: 0.135000 Jun 18 22:04:22.108957 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 413/822] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:04:21 2022] GET /compute/v2.1/os-server-groups/818e9f98-ecac-4891-94fb-d2f5e83de272 => generated 265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:22.125013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.126457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:22.142053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.142990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.143985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.144599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.232658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:22.241787 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2974d412-3697-47bf-950a-b427ee086c8c tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1275 microversion: 2.1 time: 0.205587 Jun 18 22:04:22.251481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 410/823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:22 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:22.255129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.256004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:22.262841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.263571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.264541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.265179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.455433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d813997-a12c-4a5c-81c4-6b33a3107bcc tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1620 microversion: 2.1 time: 0.339256 Jun 18 22:04:22.456547 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 414/824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:22 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1620 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:22.461527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.462255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:22.468976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.469800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.470703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.471242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.690521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:22.700336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:22.702099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:22.703447 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da52f81d-db90-4a60-87e9-526a10e9bab4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.245655 Jun 18 22:04:22.704003 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 415/825] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:22 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:22.720350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.721217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:22.726418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:22.736098 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15736124-cbcb-4ae0-a4e1-45109ad73803 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.488475 Jun 18 22:04:22.752308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.752916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.754027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.754473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.757407 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 411/826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:22 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:22.824389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:22.825936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:22.835522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.836332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.837357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:22.837941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:22.911657 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93823065-f156-4adc-bd5b-81609750a0d9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 200 len: 1619 microversion: 2.1 time: 0.195298 Jun 18 22:04:22.913635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 416/827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:22 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 1619 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:22.933351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13857907-353a-4dc4-a5b5-e6903951c8f8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: .version_select at 0x7fea1478a8b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1481401476", "policies": ["anti-affinity"]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:22.944071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:22.957268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-13857907-353a-4dc4-a5b5-e6903951c8f8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:22.963428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-13857907-353a-4dc4-a5b5-e6903951c8f8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:23.024338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-13857907-353a-4dc4-a5b5-e6903951c8f8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:23.030258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-13857907-353a-4dc4-a5b5-e6903951c8f8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:23.037670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:23.047614 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eaacbde2-c821-4682-a01b-56f92689d6ee tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1479 microversion: 2.1 time: 0.227529 Jun 18 22:04:23.050180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 412/828] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:22 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1479 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:23.062898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:23.063609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:23.065589 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-13857907-353a-4dc4-a5b5-e6903951c8f8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.136021 Jun 18 22:04:23.067542 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 417/829] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:04:22 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:23.072194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.072685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.073601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.074119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.074823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:23.075684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] [instance: 3f67d4bc-748f-4d54-912b-806862936a19] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:23.086400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.087690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.090093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.090866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.111366 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] HTTP exception thrown: Instance 3f67d4bc-748f-4d54-912b-806862936a19 could not be found. Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Request method failure captured: Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 HTTP/1.1 Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuuRoIySRmVhOFBmj0BD6-Q9CRT1Dp_cnSN1Ajl1sk8KlonO4zG24rQvMmNJs6EATm4bTTkLMfcyhwxZ6TLDnHyL9L8thkFVWrZpErN6kc_UkAFESJ8N6kihITQrlNwBfFGDRpix3ncUA4RgnOq3cIefKEMdyYAx3jMy78MR5dXX5I Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:23.114225 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5893b4b7c9c49bf87729b506675446e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5893b4b7c9c49bf87729b506675446e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5893b4b7c9c49bf87729b506675446e Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: db0ce8caf601458c94d03b85b37e4371 Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 3f67d4bc-748f-4d54-912b-806862936a19 could not be found. Jun 18 22:04:23.115879 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3f67d4bc-748f-4d54-912b-806862936a19'} Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f67d4bc-748f-4d54-912b-806862936a19 could not be found. Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:23.116769 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f67d4bc-748f-4d54-912b-806862936a19 could not be found. Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f67d4bc-748f-4d54-912b-806862936a19 could not be found. Jun 18 22:04:23.118088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:23.120575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] Returning 404 to user: Instance 3f67d4bc-748f-4d54-912b-806862936a19 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:23.121762 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f21c2564-41c6-4b83-9cba-6eaa1500f8c2 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140 tempest-FloatingIPsAssociationNegativeTestJSON-1908308140-project] 10.222.0.30 "GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19" status: 404 len: 111 microversion: 2.1 time: 0.052763 Jun 18 22:04:23.135351 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 418/830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:23 2022] GET /compute/v2.1/servers/3f67d4bc-748f-4d54-912b-806862936a19 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:23.151989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28742fee-a6b0-401c-a18e-0760a0baae3b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '.version_select at 0x7fea14949b80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:23.157566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28742fee-a6b0-401c-a18e-0760a0baae3b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.158699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28742fee-a6b0-401c-a18e-0760a0baae3b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.206817 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28742fee-a6b0-401c-a18e-0760a0baae3b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1547 microversion: 2.1 time: 0.066216 Jun 18 22:04:23.216563 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 419/831] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:04:23 2022] GET /compute/v2.1/os-migrations => generated 1547 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:23.222208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:23.222867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:23.248391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.250626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.254029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.255025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.504588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:23.516308 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d713cf5-ab8a-4339-9967-5033c3638073 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.464765 Jun 18 22:04:23.517817 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 413/832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:23 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:23.523728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1991050471", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2d917f93-c1fa-4481-873b-e280d4c11dfe"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:23.604314 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0e3dec4-e0c1-42c3-89d7-52ac6abf5b9b tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1630 microversion: 2.1 time: 0.382939 Jun 18 22:04:23.605968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 420/833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:23 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1630 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:23.624700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:23.625590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:23.627914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:23.648579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.654670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.655732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.656341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.793692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:23.801568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6410c9a-ec01-4197-9ef7-c171f55d89f2 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1273 microversion: 2.1 time: 0.186115 Jun 18 22:04:23.803034 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 421/834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:23 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:23.807982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4114b3aa-7d25-4bfa-9f78-6e6a3c9dd3fc req-3514ebbb-cc44-4bfc-998a-a30d3c5ab100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69af1d6-c62d-4abf-8063-3db8eac96369", "tag": "b6f31b95-34e9-45ce-9222-5853a15ec7ca"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:23.817500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4114b3aa-7d25-4bfa-9f78-6e6a3c9dd3fc req-3514ebbb-cc44-4bfc-998a-a30d3c5ab100 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.818206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4114b3aa-7d25-4bfa-9f78-6e6a3c9dd3fc req-3514ebbb-cc44-4bfc-998a-a30d3c5ab100 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.831361 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4114b3aa-7d25-4bfa-9f78-6e6a3c9dd3fc req-3514ebbb-cc44-4bfc-998a-a30d3c5ab100 service nova] Creating event network-changed:b6f31b95-34e9-45ce-9222-5853a15ec7ca for instance e69af1d6-c62d-4abf-8063-3db8eac96369 on nch2-master-1 Jun 18 22:04:23.836683 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4114b3aa-7d25-4bfa-9f78-6e6a3c9dd3fc req-3514ebbb-cc44-4bfc-998a-a30d3c5ab100 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032079 Jun 18 22:04:23.837315 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 422/835] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:23.842939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d9a846c-4f5f-4fe8-8cc3-eb5f401bd057 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Action: 'create', calling method: .version_select at 0x7fea14a80a60>, body: {"keypair": {"name": "tempest-keypair-328138441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDD8/iPL42QvBXjlTUjsJFluJis+5hybg5RTBMwrTty+jhXUacujH/jLL+An5an1v9Tkll6TK8VqA7QSMLRGrnwhIs6bfmuREupec1dFYwiEUCtrOZD8GvmAWGRxRgbawQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:23.857526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-5d9a846c-4f5f-4fe8-8cc3-eb5f401bd057 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:23.863188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-5d9a846c-4f5f-4fe8-8cc3-eb5f401bd057 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for user 681cfb0e560145b4abef98dbd417f3e0 and project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:23.899363 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5d9a846c-4f5f-4fe8-8cc3-eb5f401bd057 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060542 Jun 18 22:04:23.900612 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 423/836] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:04:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:23.906677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:23.907586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:23.920369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.920895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:23.921799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:23.922355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.284528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:24.293468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:24.294961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:24.296107 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a502d631-74bf-4639-b0ee-1d5542f53376 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.394338 Jun 18 22:04:24.306635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:24.306635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:24.306635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:24.306635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:24.306635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:24.308124 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 424/837] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:23 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:24.309344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:24.314718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:24.315518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:24.330047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.330749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.331533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.332116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.348489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.349300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.351797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.352591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.382910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:24.388661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:24.401923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Going to run 2 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:24.404242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:24.458951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:24.470278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:24.511219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:24.517113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:24.534696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=04eb76cf-c46e-44de-add1-1a8e0810d76e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:24.586176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:24.591645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:24.597759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:24.609179 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a265f66d-fd63-4e22-8c2c-a3d4b62714d2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.299561 Jun 18 22:04:24.611417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 425/838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:24 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:24.618333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:24.620050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:24.629114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.630137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.631886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.632575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.636788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:24.642399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:24.680265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce64b6b3-185d-4c20-833f-4d3bef9f5847 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.160905 Jun 18 22:04:24.680937 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 414/839] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:04:24.689363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:24.692934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:24.693735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Searching by: {'deleted': False, 'project_id': 'c5285b07988c4c8581f047981271fee1'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:04:24.711891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.712705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.713819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.714400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.764292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:04:24.813337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83a8a9b4-1902-4f22-8e8f-d8038ffb4483 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.127876 Jun 18 22:04:24.820814 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 415/840] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:04:24 2022] GET /compute/v2.1/servers => generated 1665 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:24.826510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:24.827127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:24.834000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.834618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.835563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:24.836254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:24.982548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:25.000169 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a6c0d35-c9b5-48a2-8b00-c374dd4770e6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.387280 Jun 18 22:04:25.006133 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 426/841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:24 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:25.017407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0de38d0-6b3f-44a8-b15c-7e77ff9f2e14 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:25.018298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c0de38d0-6b3f-44a8-b15c-7e77ff9f2e14 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:25.148347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c0de38d0-6b3f-44a8-b15c-7e77ff9f2e14 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:25.160084 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c0de38d0-6b3f-44a8-b15c-7e77ff9f2e14 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1219 microversion: 2.1 time: 0.150636 Jun 18 22:04:25.162940 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 427/842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:25 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:25.199642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:25.205938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-36a10cab-4ec7-49d6-b669-5ca5b2990c79 req-a8ce99ff-e4e0-4712-ba19-3be7aa1e1b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb4fcc9-fabe-4536-9514-c539642cc9c2", "name": "network-vif-plugged", "status": "completed", "tag": "5f35a6e4-ed0a-4464-9526-b7258e8cc72d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:25.216517 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-865f00a1-cf7e-4c2d-af2a-54b729c7d4f7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.394511 Jun 18 22:04:25.229257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-36a10cab-4ec7-49d6-b669-5ca5b2990c79 req-a8ce99ff-e4e0-4712-ba19-3be7aa1e1b79 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:25.229257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-36a10cab-4ec7-49d6-b669-5ca5b2990c79 req-a8ce99ff-e4e0-4712-ba19-3be7aa1e1b79 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:25.238412 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 416/843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:24 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:25.252071 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-36a10cab-4ec7-49d6-b669-5ca5b2990c79 req-a8ce99ff-e4e0-4712-ba19-3be7aa1e1b79 service nova] Creating event network-vif-plugged:5f35a6e4-ed0a-4464-9526-b7258e8cc72d for instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 on nch2-master-1 Jun 18 22:04:25.264928 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-36a10cab-4ec7-49d6-b669-5ca5b2990c79 req-a8ce99ff-e4e0-4712-ba19-3be7aa1e1b79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061594 Jun 18 22:04:25.266755 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 428/844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:04:25.315990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:25.317326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:25.329283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:25.330296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:25.332326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:25.334390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:25.630385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:25.631578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:25.657416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:25.661202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:25.662239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:25.663066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:25.697267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:26.063203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.079371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.080899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.082985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c0ba2f2-daf6-4e4e-b8e9-6967dd7e842e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.772555 Jun 18 22:04:26.094691 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 417/845] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:25 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:26.104786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:26.105705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:26.112692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:26.113473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:26.114930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:26.115525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:26.206943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.219617 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a86d0f4-dc28-4ef0-98b3-6ad82ca17811 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.595360 Jun 18 22:04:26.238282 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 429/846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:25 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:26.248436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:26.253437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:26.264847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:26.265865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:26.266895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:26.267517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:26.428479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.436476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-42a951b6-4b68-469f-8003-e9f43f4259ed tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1215 microversion: 2.1 time: 0.196617 Jun 18 22:04:26.436940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.438757 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 430/847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:26 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:26.444065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:26.444926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:26.453114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:26.453790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:26.454753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:26.455376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:26.458898 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c958d2b0-edda-4852-af45-c68d125741b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.360306 Jun 18 22:04:26.460005 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 418/848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:26 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:26.684689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:26.695549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d0015ea4-d4e4-44fe-8fe6-0af99e16aaf3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.255319 Jun 18 22:04:26.702854 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 431/849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:26 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:27.101877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:27.103097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:27.112605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.113586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.114934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.115600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.245638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:27.246819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:27.255933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.258365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.259835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.263604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.816733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:27.834567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e5d1343f-100c-4ffc-9b85-f7d3c3d0257f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.592991 Jun 18 22:04:27.845527 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 432/850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:27 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:27.852470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:27.853344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:27.862237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.862797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.863837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.864542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.902482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:27.926859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:27.929339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:27.933646 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2ff5275-f82c-4106-aec8-2e9a10903b4c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.835096 Jun 18 22:04:27.945285 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 419/851] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:27 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:27.948289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:27.949817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:27.957122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.957882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.958831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:27.959298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:27.983888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:27.999068 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-844194bc-ece7-449d-b052-a3fc0ce48980 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1277 microversion: 2.1 time: 0.151868 Jun 18 22:04:28.000189 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 433/852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:27 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1277 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:28.005203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b4b8fb48-5663-4dbe-b337-861bd14197a8 req-264487dd-f6d3-410a-8189-22dba747bd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ea1489-6cb5-472a-a53a-596455331aed", "tag": "36886011-8108-48e4-8ec9-914a2e3a99ba"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:28.014409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4b8fb48-5663-4dbe-b337-861bd14197a8 req-264487dd-f6d3-410a-8189-22dba747bd78 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:28.015105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4b8fb48-5663-4dbe-b337-861bd14197a8 req-264487dd-f6d3-410a-8189-22dba747bd78 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:28.028147 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b4b8fb48-5663-4dbe-b337-861bd14197a8 req-264487dd-f6d3-410a-8189-22dba747bd78 service nova] Creating event network-changed:36886011-8108-48e4-8ec9-914a2e3a99ba for instance 53ea1489-6cb5-472a-a53a-596455331aed on nch2-master-1 Jun 18 22:04:28.034486 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b4b8fb48-5663-4dbe-b337-861bd14197a8 req-264487dd-f6d3-410a-8189-22dba747bd78 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032842 Jun 18 22:04:28.035654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 434/853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:28.047597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:28.048329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:28.055090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:28.055760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:28.056529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:28.056970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:28.360493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:28.370398 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6018fddc-61a5-42fb-abd8-214ad68de7f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.427495 Jun 18 22:04:28.372506 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 420/854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:27 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:28.377533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1166271188", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "739254b4-0b9e-4570-96ec-dfd475b9db29"}], "security_groups": [{"name": "tempest-securitygroup--1812182427"}], "key_name": "tempest-keypair-328138441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:28.472671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:28.480977 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0f4ff23-008b-4c9c-b34f-7e6989c8ef0f tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.443037 Jun 18 22:04:28.490293 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 435/855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:28 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:28.641811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] validate_networks() for [('739254b4-0b9e-4570-96ec-dfd475b9db29', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:28.857495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:28.858152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:28.867341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:28.867809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:28.868607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:28.869086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:29.794543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:29.810618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-444c0d0c-158c-42bd-9cef-3d3392c7698e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.959992 Jun 18 22:04:29.811253 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 436/856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:28 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:29.827775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:29.830825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:29.845704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:29.846820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:29.848328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:29.849246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.180574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:30.182399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:30.183392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:30.183989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:30.184739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:30.201076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.204370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.205764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.206824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.232531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:30.236622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:30.243401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for user 681cfb0e560145b4abef98dbd417f3e0 and project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:30.245227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:30.248789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:30.251434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88cc3dea-d658-4efa-945f-20a9f1101d47 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.436707 Jun 18 22:04:30.255670 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 437/857] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:29 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:30.262798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:30.263701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:30.277485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:30.280463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:30.288082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.289802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.290821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.292991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.344194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e12deda-6c59-4c69-9db7-6da368877fed tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.970480 Jun 18 22:04:30.345271 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 421/858] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:04:30.352032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5a2b8040-a0fc-4e83-889f-a78ff840215a req-8615337c-0769-4362-adf3-c50f96eeadc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69af1d6-c62d-4abf-8063-3db8eac96369", "name": "network-vif-plugged", "status": "completed", "tag": "b6f31b95-34e9-45ce-9222-5853a15ec7ca"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:30.362768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5a2b8040-a0fc-4e83-889f-a78ff840215a req-8615337c-0769-4362-adf3-c50f96eeadc3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.363460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5a2b8040-a0fc-4e83-889f-a78ff840215a req-8615337c-0769-4362-adf3-c50f96eeadc3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.379853 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5a2b8040-a0fc-4e83-889f-a78ff840215a req-8615337c-0769-4362-adf3-c50f96eeadc3 service nova] Creating event network-vif-plugged:b6f31b95-34e9-45ce-9222-5853a15ec7ca for instance e69af1d6-c62d-4abf-8063-3db8eac96369 on nch2-master-1 Jun 18 22:04:30.387177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5a2b8040-a0fc-4e83-889f-a78ff840215a req-8615337c-0769-4362-adf3-c50f96eeadc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040345 Jun 18 22:04:30.388328 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 422/859] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:30.395876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:30.396882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:30.407268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:30.411920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.412569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.413616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.414257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.727671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:30.737418 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82244875-0de8-4049-bdc5-9f3625736a85 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.478548 Jun 18 22:04:30.742056 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 438/860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:30 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:30.751642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:30.757602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:30.768811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.769312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.770134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.770578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.922308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:30.932268 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-458a8188-03f2-4e91-a386-803c38409e28 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.541721 Jun 18 22:04:30.935802 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 423/861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:30 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:30.941535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-629f5557-b5bf-456e-9501-3d437f13464d req-6ae2ad01-d1ab-40f7-b7d5-486776377a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79", "name": "network-vif-unplugged", "status": "completed", "tag": "bd8a15a9-02da-4737-bf34-0f1ed6541286"}, {"name": "network-changed", "server_uuid": "c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79", "tag": "bd8a15a9-02da-4737-bf34-0f1ed6541286"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:30.966381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-629f5557-b5bf-456e-9501-3d437f13464d req-6ae2ad01-d1ab-40f7-b7d5-486776377a41 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:30.967572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-629f5557-b5bf-456e-9501-3d437f13464d req-6ae2ad01-d1ab-40f7-b7d5-486776377a41 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:30.995756 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-629f5557-b5bf-456e-9501-3d437f13464d req-6ae2ad01-d1ab-40f7-b7d5-486776377a41 service nova] Creating event network-vif-unplugged:bd8a15a9-02da-4737-bf34-0f1ed6541286 for instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 on nch1-master-1 Jun 18 22:04:30.996684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-629f5557-b5bf-456e-9501-3d437f13464d req-6ae2ad01-d1ab-40f7-b7d5-486776377a41 service nova] Creating event network-changed:bd8a15a9-02da-4737-bf34-0f1ed6541286 for instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 on nch1-master-1 Jun 18 22:04:31.010421 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-629f5557-b5bf-456e-9501-3d437f13464d req-6ae2ad01-d1ab-40f7-b7d5-486776377a41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.073066 Jun 18 22:04:31.014924 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 424/862] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:31.037287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a861ed50-39de-4048-8bf4-367dddfac86f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.041111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a861ed50-39de-4048-8bf4-367dddfac86f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.080528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.092959 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ab5a0af-0bc5-49a6-9122-e14da69ea5ec tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.347579 Jun 18 22:04:31.093932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 439/863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:30 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:31.111213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.111965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.119986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.120444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.121806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.121908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.175234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:04:31.253438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:31.258755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a861ed50-39de-4048-8bf4-367dddfac86f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.267994 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a861ed50-39de-4048-8bf4-367dddfac86f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1234 microversion: 2.1 time: 0.251462 Jun 18 22:04:31.269153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 425/864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:31 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1234 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:31.275365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.277616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.287312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.288162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.289257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.290068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.308808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:31.327018 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-394cfb0b-84c7-4949-890e-cdf8b4619f69 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 204 len: 0 microversion: 2.1 time: 0.219560 Jun 18 22:04:31.328405 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 440/865] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:31 2022] DELETE /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:04:31.364111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.370141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.391684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.392392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.393412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.394037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.534679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.545514 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06ad40fd-7e72-4281-9e1b-a4c8c1f9373b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.274932 Jun 18 22:04:31.548028 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 426/866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:31 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:31.553932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.554775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.563409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.564067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.565111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.566251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.634512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.645334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.646842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.648303 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec2fdf46-3365-4791-89fb-5f231b2fd3f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.310280 Jun 18 22:04:31.649894 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 441/867] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:31 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:31.760973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.761635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.776351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.776906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.777782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.778241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.833773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:31.859765 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7c951a3-a377-4567-ad86-f67ac4f829e8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1712 microversion: 2.1 time: 0.308835 Jun 18 22:04:31.860794 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 427/868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:31 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1712 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:31.951885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:31.952944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:31.961686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.962725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:31.964130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:31.964763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.099932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:32.109751 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-484cc707-cc14-49c1-b285-ac484c471616 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.354054 Jun 18 22:04:32.114068 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 442/869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:31 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:32.121741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:32.123569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:32.131881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.138027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.139096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.140273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.331734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:32.343122 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65057b1a-03ff-43d7-be12-62c280a1b0ce tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.394742 Jun 18 22:04:32.353193 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 428/870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:31 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:32.358255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:32.359214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:32.366078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.366879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.367878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.368545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.481416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:32.487484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:32.501909 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd18c77c-118e-4782-a387-d08907c02d4a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1292 microversion: 2.1 time: 0.147471 Jun 18 22:04:32.502812 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 429/871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:32 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1292 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:32.505439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3513e6b8-9da4-41eb-894f-3b0057cfc9dc tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.389683 Jun 18 22:04:32.506240 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 443/872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:32 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:32.570272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:32.573516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:32.604540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.608224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.611001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.613749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.666752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:32.667433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:32.676239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.677013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.678163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:32.679073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:32.978146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:32.989154 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3e239cc-7f97-4f49-b126-dcb62ee0ad58 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.427163 Jun 18 22:04:32.990260 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 430/873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:32 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:32.999336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-914f88bb-be47-4ad6-bd21-6127e5c53f38 req-c7953fb9-a1a1-4168-8ca5-437efe5226ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4adc167-d585-4cf1-bd68-f2f85e8d045a", "tag": "9121111a-541a-4e12-b4be-357c5d525b9d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:33.015581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-914f88bb-be47-4ad6-bd21-6127e5c53f38 req-c7953fb9-a1a1-4168-8ca5-437efe5226ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.016096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-914f88bb-be47-4ad6-bd21-6127e5c53f38 req-c7953fb9-a1a1-4168-8ca5-437efe5226ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.016812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.030181 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-914f88bb-be47-4ad6-bd21-6127e5c53f38 req-c7953fb9-a1a1-4168-8ca5-437efe5226ad service nova] Creating event network-changed:9121111a-541a-4e12-b4be-357c5d525b9d for instance e4adc167-d585-4cf1-bd68-f2f85e8d045a on nch2-master-1 Jun 18 22:04:33.035335 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-914f88bb-be47-4ad6-bd21-6127e5c53f38 req-c7953fb9-a1a1-4168-8ca5-437efe5226ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043907 Jun 18 22:04:33.042909 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 431/874] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:33.043380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.048214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:33.048927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:33.057348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.057944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.058744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.059181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.059407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.061456 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66fc52dc-008e-4d54-84f5-357d9eab8e93 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.398672 Jun 18 22:04:33.066486 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 444/875] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:32 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:04:33.133185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:33.134037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:33.148459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.149239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.152517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.153290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.166912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:33.233507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.243189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4be8f042-1646-4886-999a-4adde0b2ec3a tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1712 microversion: 2.1 time: 0.198936 Jun 18 22:04:33.246289 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 432/876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:33 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1712 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:33.258783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-84a0f657-1062-4058-99b6-e6536177a5a0 req-d80a12a7-ffb6-4b57-a58d-418d2e3ee979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04eb76cf-c46e-44de-add1-1a8e0810d76e", "tag": "07c4f4d6-aaae-4a49-9184-361e8cfcee93"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:33.292872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-84a0f657-1062-4058-99b6-e6536177a5a0 req-d80a12a7-ffb6-4b57-a58d-418d2e3ee979 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.292872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-84a0f657-1062-4058-99b6-e6536177a5a0 req-d80a12a7-ffb6-4b57-a58d-418d2e3ee979 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.307937 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-84a0f657-1062-4058-99b6-e6536177a5a0 req-d80a12a7-ffb6-4b57-a58d-418d2e3ee979 service nova] Creating event network-changed:07c4f4d6-aaae-4a49-9184-361e8cfcee93 for instance 04eb76cf-c46e-44de-add1-1a8e0810d76e on nch1-master-1 Jun 18 22:04:33.318235 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-84a0f657-1062-4058-99b6-e6536177a5a0 req-d80a12a7-ffb6-4b57-a58d-418d2e3ee979 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063800 Jun 18 22:04:33.321542 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 433/877] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:33.361077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:33.361836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:33.372916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.373401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.374188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.377658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.564144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.574450 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e18fa69e-b509-4816-93e0-6dfcca348b79 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.446950 Jun 18 22:04:33.589202 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 445/878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:33 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:33.601113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:33.604061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:33.617739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.618615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.620587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.620948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.621714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.631674 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4147cb76-c254-45ef-937f-0f137721a726 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.275045 Jun 18 22:04:33.632789 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 434/879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:33 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:33.637616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:33.638421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:33.644604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.645303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.646276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:33.646870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:33.728562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.741338 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4ee0747-6bf3-4f83-b06e-ddd9dfa6c6dc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1292 microversion: 2.1 time: 0.149902 Jun 18 22:04:33.742288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 446/880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:33 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1292 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:33.815002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:33.824579 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c9be09f-640e-4e9f-8287-7872bb9488c7 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.190522 Jun 18 22:04:33.825514 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 435/881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:33 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:34.009350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:34.011063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:34.015090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:34.041306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.046962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.048059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.049472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.079544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:34.080421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:34.094828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.096058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.099489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.101529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.515672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:34.524867 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6ec168db-ec76-4f2c-a61c-821b1102efca tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1314 microversion: 2.1 time: 0.521220 Jun 18 22:04:34.535230 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 447/882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:34 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:34.535230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:34.535230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:34.540685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.541189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.542241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.542714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.547856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:34.563138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:34.564906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:34.566291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7fc455f-0fe8-45ea-99fe-1bedb248e31a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.490830 Jun 18 22:04:34.577011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 436/883] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:34 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:34.596484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:34.597446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:34.608852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.609858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.611557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.612682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.947314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:34.960894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da03a9ad-ac57-4d5c-9bdb-d3d482964662 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1712 microversion: 2.1 time: 0.433120 Jun 18 22:04:34.970552 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 448/884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:34 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1712 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:34.970552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:34.970552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:34.977022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.977532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.978499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:34.978969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:34.986619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:35.008557 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c0eacc92-7b02-4350-b5dd-40f37a04c5ff tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.414840 Jun 18 22:04:35.009505 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 437/885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:34 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:35.023916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:35.034813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:35.042138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.042754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.043628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.043962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.154555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=15 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:35.460957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:35.468340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:35.477760 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a07c4dd2-c9a3-4a5e-a7e0-4e87e7c79536 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.463524 Jun 18 22:04:35.481113 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 438/886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:35 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:35.481282 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-977f6235-389e-4795-b98b-2645547be1ae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.514080 Jun 18 22:04:35.482253 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 449/887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:34 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:35.485422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:35.486197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:35.487903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-22e9e74a-6b60-4e1f-a70c-79acf9c0f147 req-d4b711ab-c61d-4605-ae2c-3e109a05797d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210b3808-a777-4302-962d-be85bff00e6a", "name": "network-vif-deleted", "tag": "0c6e286c-a838-4bcc-9852-a5e035068f99"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:35.499868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.501408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-22e9e74a-6b60-4e1f-a70c-79acf9c0f147 req-d4b711ab-c61d-4605-ae2c-3e109a05797d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.501863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-22e9e74a-6b60-4e1f-a70c-79acf9c0f147 req-d4b711ab-c61d-4605-ae2c-3e109a05797d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.501983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.502813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.504658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.516245 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-22e9e74a-6b60-4e1f-a70c-79acf9c0f147 req-d4b711ab-c61d-4605-ae2c-3e109a05797d service nova] Creating event network-vif-deleted:0c6e286c-a838-4bcc-9852-a5e035068f99 for instance 210b3808-a777-4302-962d-be85bff00e6a on nch2-master-1 Jun 18 22:04:35.521575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-22e9e74a-6b60-4e1f-a70c-79acf9c0f147 req-d4b711ab-c61d-4605-ae2c-3e109a05797d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037673 Jun 18 22:04:35.522534 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 450/888] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:35.528148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0fa1a633-dea1-4ae8-8acb-87ceda0edb2e req-9ea83979-736b-4bec-b781-6b2364cd5b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea1489-6cb5-472a-a53a-596455331aed", "name": "network-vif-plugged", "status": "completed", "tag": "36886011-8108-48e4-8ec9-914a2e3a99ba"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:35.538950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0fa1a633-dea1-4ae8-8acb-87ceda0edb2e req-9ea83979-736b-4bec-b781-6b2364cd5b23 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.539407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0fa1a633-dea1-4ae8-8acb-87ceda0edb2e req-9ea83979-736b-4bec-b781-6b2364cd5b23 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.551969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0fa1a633-dea1-4ae8-8acb-87ceda0edb2e req-9ea83979-736b-4bec-b781-6b2364cd5b23 service nova] Creating event network-vif-plugged:36886011-8108-48e4-8ec9-914a2e3a99ba for instance 53ea1489-6cb5-472a-a53a-596455331aed on nch2-master-1 Jun 18 22:04:35.558304 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0fa1a633-dea1-4ae8-8acb-87ceda0edb2e req-9ea83979-736b-4bec-b781-6b2364cd5b23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034317 Jun 18 22:04:35.559589 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 451/889] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:35.568331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:35.569293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:35.582078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.582787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.583891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.584688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.765141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:35.778296 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4108e664-8fcc-40bd-b250-6eec0a43bd94 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.297250 Jun 18 22:04:35.779518 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 439/890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:35 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:35.785336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:35.786508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:35.794023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.794994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.795959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.796831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.801232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:35.812404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f153cc3-522f-41b0-8f91-56772367fa6d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1464 microversion: 2.1 time: 0.251089 Jun 18 22:04:35.826036 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 452/891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:35 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:35.832261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:35.833496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:35.841247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.841997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:35.843028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:35.843626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.047415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:36.059845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:36.061696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:36.064668 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97095692-f119-4ba1-8d30-09fc63f043ea tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.282640 Jun 18 22:04:36.064847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:36.066268 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 440/892] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:35 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:36.074129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22ce377c-1d94-4997-bf4e-2980e62f4357 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1461 microversion: 2.1 time: 0.246591 Jun 18 22:04:36.085061 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 453/893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:35 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1461 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:36.085294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:36.085294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:36.085480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:36.085480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:36.085641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.085641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.089591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.089591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.090501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.090501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.093719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.093719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.136834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.137318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.137775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lazy-loading 'fault' on Instance uuid 210b3808-a777-4302-962d-be85bff00e6a {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:36.216650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79c12f29545c40ec955650696bb91a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad7b33b97ba48a6a4989ff35985a4ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:36.228849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff63e425-4681-49a1-aa21-7c961df973c4 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 200 len: 1353 microversion: 2.1 time: 0.161136 Jun 18 22:04:36.229532 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 441/894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:36 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 1353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:36.234318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-955033205", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8bb4fcc9-fabe-4536-9514-c539642cc9c2"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:36.294811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:36.351967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:36.362358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ef24db5-e0e6-4e08-84b4-45ca0238f459 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.285486 Jun 18 22:04:36.370972 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 454/895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:36 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:36.496243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:36.503279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:36.514773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.515224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:36.516007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:36.516501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.340443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:37.341303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:37.341759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:37.342195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:37.342788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:37.365102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:37.367171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.368179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:37.373240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.431587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:37.441257 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-674a1784-f885-4792-9085-a0efcf5e9be7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.949099 Jun 18 22:04:37.442492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Getting quotas for project 24245a540466462bb9a908267f505f28. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:37.444457 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 455/896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:36 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:37.449977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:37.452212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:37.454908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Getting quotas for user f8783e0de2414f20ade6604bd0089fab and project 24245a540466462bb9a908267f505f28. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:37.467854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:37.470574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.473481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:37.474055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.476853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:37.479775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:37.581694 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1fd45227-597d-4b52-ac8c-26319dc59ab2 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350881 Jun 18 22:04:37.586668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 442/897] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:04:37.616366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:37.631853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:37.650056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:37.653283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.654333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:37.656308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:37.991862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.008234 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff9458c4-3743-4a84-a32e-4acd3da7eaaf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.561902 Jun 18 22:04:38.018538 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 456/898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:37 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:38.027849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.028978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.042236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.042799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.043703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.049372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.178104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.196990 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8dbc4aa-120d-42bd-8630-8a1c29914f41 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1315 microversion: 2.1 time: 0.605597 Jun 18 22:04:38.197932 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 443/899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:37 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:38.202914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.209120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.223289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.224203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.225513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.226077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.257834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a HTTP/1.1 Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:38.259617 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:38.261375 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '210b3808-a777-4302-962d-be85bff00e6a'} Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:38.262150 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:38.263453 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.265736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:38.265944 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d8701ce-226b-4b84-ad55-38b3661fddca tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 404 len: 111 microversion: 2.1 time: 0.061973 Jun 18 22:04:38.266832 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 444/900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:38 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:38.276117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.277220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.300858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.301626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.302655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.303310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.344875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:38.667793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.694076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.697604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.699140 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-801ac1e8-b899-4754-9aff-f9c6ee220ce8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.678892 Jun 18 22:04:38.710889 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 457/901] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:38 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:38.716787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.717902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.734413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.735054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.738610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.739287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.766175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.777146 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-70af2242-7bb1-4a2f-8e9a-059da6637e60 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.508793 Jun 18 22:04:38.785935 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 445/902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:38 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:38.793470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9ac03f9f-8d94-4402-9990-af0cc241996f req-98ed935b-d3d0-4f69-9a56-71ffe6cc08bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79", "name": "network-vif-unplugged", "status": "completed", "tag": "bd8a15a9-02da-4737-bf34-0f1ed6541286"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:38.820167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9ac03f9f-8d94-4402-9990-af0cc241996f req-98ed935b-d3d0-4f69-9a56-71ffe6cc08bc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.820725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9ac03f9f-8d94-4402-9990-af0cc241996f req-98ed935b-d3d0-4f69-9a56-71ffe6cc08bc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.847609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9ac03f9f-8d94-4402-9990-af0cc241996f req-98ed935b-d3d0-4f69-9a56-71ffe6cc08bc service nova] Creating event network-vif-unplugged:bd8a15a9-02da-4737-bf34-0f1ed6541286 for instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 on nch1-master-1 Jun 18 22:04:38.855458 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9ac03f9f-8d94-4402-9990-af0cc241996f req-98ed935b-d3d0-4f69-9a56-71ffe6cc08bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066640 Jun 18 22:04:38.856354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 446/903] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:38.860415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:38.863567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.864750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.874154 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2eb6f99-76c2-44d3-88c5-982753639b3e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1217 microversion: 2.1 time: 0.161751 Jun 18 22:04:38.874965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.875808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.877422 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 458/904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:38 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1217 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:38.879980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.881638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.902951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.906137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.919715 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:38.922503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a HTTP/1.1 Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:38.924239 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:38.925681 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'adf95372-e587-4ff1-b0ad-168c53b2732a'} Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:38.926401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:38.928024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:38.931570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:38.931570 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55a566ca-bd39-4feb-992b-df4bceee2fc8 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 404 len: 111 microversion: 2.1 time: 0.069480 Jun 18 22:04:38.934720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.937233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.939010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.949487 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 447/905] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:38 2022] DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:38.970886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:38.972409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:38.990047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.990749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:38.991769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:38.992561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:39.029788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a HTTP/1.1 Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:39.032006 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:39.033638 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'adf95372-e587-4ff1-b0ad-168c53b2732a'} Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:39.034498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:39.036083 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:39.039668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:39.040847 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b98c2ec-f3db-4df8-84d8-2110d24b3e0b tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 404 len: 111 microversion: 2.1 time: 0.085107 Jun 18 22:04:39.047829 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 448/906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:38 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:39.060617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:39.066702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:39.077997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:39.079992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:39.081304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:39.081747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:39.439231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:39.450227 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b75951a6-8694-4672-96ff-d0aab7513910 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.568120 Jun 18 22:04:39.451525 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 459/907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:38 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:39.465188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf33465f-2ebe-4010-9d7a-4206283335c6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '.version_select at 0x7fea14a55dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:39.499073 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf33465f-2ebe-4010-9d7a-4206283335c6 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-528000322" status: 202 len: 0 microversion: 2.1 time: 0.046274 Jun 18 22:04:39.502364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 460/908] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-528000322 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:39.515854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:39.516728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:39.536112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:39.538111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:39.540358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:39.544434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:39.554136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:39.566985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-571d5c48-3725-4be2-9a13-14b2722e6fcd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.517358 Jun 18 22:04:39.579566 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 449/909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:39 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:39.723810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:39.724790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:39.743513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:39.744157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:39.745010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:39.746386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.383704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:40.398138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3787e72-d778-4ee7-974c-6d99f8ba179a tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1504 microversion: 2.1 time: 0.894248 Jun 18 22:04:40.399689 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 461/910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:39 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1504 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:40.414854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8e34e790-00d0-426d-b2d1-22175c8e61dd req-1939491a-80d5-4c78-b2b7-5ef80f69d9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb76cf-c46e-44de-add1-1a8e0810d76e", "name": "network-vif-plugged", "status": "completed", "tag": "07c4f4d6-aaae-4a49-9184-361e8cfcee93"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:40.425441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8e34e790-00d0-426d-b2d1-22175c8e61dd req-1939491a-80d5-4c78-b2b7-5ef80f69d9ff service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.426479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8e34e790-00d0-426d-b2d1-22175c8e61dd req-1939491a-80d5-4c78-b2b7-5ef80f69d9ff service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.442029 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8e34e790-00d0-426d-b2d1-22175c8e61dd req-1939491a-80d5-4c78-b2b7-5ef80f69d9ff service nova] Creating event network-vif-plugged:07c4f4d6-aaae-4a49-9184-361e8cfcee93 for instance 04eb76cf-c46e-44de-add1-1a8e0810d76e on nch1-master-1 Jun 18 22:04:40.448971 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8e34e790-00d0-426d-b2d1-22175c8e61dd req-1939491a-80d5-4c78-b2b7-5ef80f69d9ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046066 Jun 18 22:04:40.450525 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 462/911] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:40.457437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:40.458411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:40.466289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.467056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.468082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.468725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.660091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:40.680685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:40.685512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:40.689683 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0eb58613-5e13-46ea-9607-ec4f1a9ca369 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.975880 Jun 18 22:04:40.690599 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 450/912] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:39 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:40.706751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:40.707789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:40.715204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.716012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.716998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.717672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.775190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:40.784796 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9da577d-7864-40ac-b068-b7f605b4e203 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.332725 Jun 18 22:04:40.786371 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 463/913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:40 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:40.792240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:40.793072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:40.803156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.804105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.805323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:40.805980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:40.849136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:04:40.853208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:40.991963 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd7011b4-6414-49d1-b6bc-d3f8b7c9ae48 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 204 len: 0 microversion: 2.1 time: 0.203882 Jun 18 22:04:41.016473 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 464/914] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:40 2022] DELETE /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:04:41.023312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.024022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:41.031811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.032266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.033080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.033523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.075672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:41.093578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4edb2580-d88c-4566-8cca-05a5abbf741a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.402181 Jun 18 22:04:41.094200 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 451/915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:40 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:41.098726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.099317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:41.109457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.109907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.110689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.111297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.337485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:41.349711 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1986b84c-4aa1-4608-986a-51119b1bb132 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.330515 Jun 18 22:04:41.359712 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 465/916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:41 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:41.364844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ff364308-96fc-42ae-9921-b10c889fdcd2 req-f209f748-8439-44ce-ae1c-2ce6e87e72b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:41.374589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff364308-96fc-42ae-9921-b10c889fdcd2 req-f209f748-8439-44ce-ae1c-2ce6e87e72b1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.375469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff364308-96fc-42ae-9921-b10c889fdcd2 req-f209f748-8439-44ce-ae1c-2ce6e87e72b1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.387507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ff364308-96fc-42ae-9921-b10c889fdcd2 req-f209f748-8439-44ce-ae1c-2ce6e87e72b1 service nova] Creating event network-changed:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch1-master-1 Jun 18 22:04:41.393166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ff364308-96fc-42ae-9921-b10c889fdcd2 req-f209f748-8439-44ce-ae1c-2ce6e87e72b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031985 Jun 18 22:04:41.394103 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 466/917] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:41.399414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.400475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:41.407707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.408165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.408980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.409920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.469067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:41.489298 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11808b90-cfd7-4dd1-9abb-7defe8d63ded tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.388029 Jun 18 22:04:41.490403 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 452/918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:41 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:41.656322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7bca579f-ea85-4259-8e2a-b8df2fb695e9 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.659466 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:04:41.659466 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:04:41.703596 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7bca579f-ea85-4259-8e2a-b8df2fb695e9 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1498649338" status: 202 len: 0 microversion: 2.1 time: 0.055175 Jun 18 22:04:41.705583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 453/919] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:04:41 2022] DELETE /compute/v2.1/flavors/1498649338 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:04:41.715797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:41.727614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.727985 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b91d8dc-4b99-4e5b-b110-5e20fb75d140 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1510 microversion: 2.1 time: 0.332333 Jun 18 22:04:41.728830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:41.733577 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 467/920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:41 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:41.745378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a5923ad-404b-4dd6-af03-6ae7a204269b tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.751719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.754676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.758354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.759017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.789805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a5923ad-404b-4dd6-af03-6ae7a204269b tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.053222 Jun 18 22:04:41.802208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 468/921] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:04:41 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:41.807889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:41.808890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:41.817786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.818783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:41.819936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:41.820557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.012228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.021788 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-592c1c8f-948b-4799-a776-bfcd7a6a465d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.217641 Jun 18 22:04:42.023728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 469/922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:41 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:42.032181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55dfb6fb-e266-4142-b2ef-fc9e1d03c305 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.033600 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:04:42.033600 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:04:42.052616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.063894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55dfb6fb-e266-4142-b2ef-fc9e1d03c305 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1789190926" status: 202 len: 0 microversion: 2.1 time: 0.038066 Jun 18 22:04:42.064906 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 470/923] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:04:42 2022] DELETE /compute/v2.1/flavors/1789190926 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:04:42.065765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.067623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.068818 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ac6fc50-fde7-4a60-b268-6173c2837d86 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1566 microversion: 2.25 time: 0.361737 Jun 18 22:04:42.070519 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 454/924] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:41 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1566 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:42.075051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1445cef0-0076-443b-adea-4e9da5717f24 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.102020 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1445cef0-0076-443b-adea-4e9da5717f24 tempest-ServersWithSpecificFlavorTestJSON-252427743 tempest-ServersWithSpecificFlavorTestJSON-252427743-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031371 Jun 18 22:04:42.112676 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 471/925] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:42.112880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.112880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.125154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.126874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.127838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.128298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.130448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.131229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.138060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.138562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.139356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.139792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.153913 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a HTTP/1.1 Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:42.155655 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.156986 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '210b3808-a777-4302-962d-be85bff00e6a'} Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:42.157729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.158902 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.160720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:42.160720 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d9f435e3-162a-4e61-9e23-31529542feb7 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 404 len: 111 microversion: 2.1 time: 0.030523 Jun 18 22:04:42.160871 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 472/926] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:42 2022] DELETE /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:04:42.165679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.166296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: 210b3808-a777-4302-962d-be85bff00e6a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.172650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.173142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.173934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.174367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.191885 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a HTTP/1.1 Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:42.193464 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.194758 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '210b3808-a777-4302-962d-be85bff00e6a'} Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:42.196195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. Jun 18 22:04:42.197417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.198610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance 210b3808-a777-4302-962d-be85bff00e6a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:42.198610 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-185ade82-840d-43bc-871e-c42e2fbbd308 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a" status: 404 len: 111 microversion: 2.1 time: 0.033025 Jun 18 22:04:42.198761 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 473/927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/servers/210b3808-a777-4302-962d-be85bff00e6a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:42.207019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.207532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.214703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.215155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.215938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.216373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.233079 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a HTTP/1.1 Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:42.234664 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.235956 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'adf95372-e587-4ff1-b0ad-168c53b2732a'} Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:42.236675 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.238064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.239217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:42.239217 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da808a35-f605-43a2-9569-7ffba3dc8f91 tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 404 len: 111 microversion: 2.1 time: 0.036447 Jun 18 22:04:42.239962 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 474/928] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:42 2022] DELETE /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:42.244732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.245439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] [instance: adf95372-e587-4ff1-b0ad-168c53b2732a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.257773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.258224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.259043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.259476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.279679 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] HTTP exception thrown: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Request method failure captured: Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a HTTP/1.1 Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirksviZgd0lvR-QVAFBYS9DsbYimoqvrQEVOpO1X3Hh0ZS0LdBLpvOyjuUpTkfou-tDfcQkfmboeKWL9h_cidZCJ6JaVSQ1LoDBOSJLI5ME0gM0jQXqhzIiJmQTiXkHVmzYrgIlfZDP1Gvxr-JXI70skKMJKV6SPc2haGrfUHtQVCK_c Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:42.283500 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dad7b33b97ba48a6a4989ff35985a4ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dad7b33b97ba48a6a4989ff35985a4ca", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: dad7b33b97ba48a6a4989ff35985a4ca Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434 Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 79c12f29545c40ec955650696bb91a65 Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1200061434-project Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.284912 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'adf95372-e587-4ff1-b0ad-168c53b2732a'} Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:42.285850 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. Jun 18 22:04:42.287014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:42.288069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] Returning 404 to user: Instance adf95372-e587-4ff1-b0ad-168c53b2732a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:42.289022 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7607e43c-c966-4674-a9db-747cad943d8d tempest-ServersWithSpecificFlavorTestJSON-1200061434 tempest-ServersWithSpecificFlavorTestJSON-1200061434-project] 10.222.0.30 "GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a" status: 404 len: 111 microversion: 2.1 time: 0.047698 Jun 18 22:04:42.289221 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 475/929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/servers/adf95372-e587-4ff1-b0ad-168c53b2732a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:42.314107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.322619 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5cfc9c5-d17b-41ec-a7d8-fc92c8415218 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.216341 Jun 18 22:04:42.330814 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 455/930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:42.367419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.368139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.376245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.376826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.377714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.378276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.498871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6074fc5d-8aa1-4005-98f9-5cc322bc517f req-a5f9f36a-f899-441e-bd17-94c90c4064e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4adc167-d585-4cf1-bd68-f2f85e8d045a", "name": "network-vif-plugged", "status": "completed", "tag": "9121111a-541a-4e12-b4be-357c5d525b9d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:42.514576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6074fc5d-8aa1-4005-98f9-5cc322bc517f req-a5f9f36a-f899-441e-bd17-94c90c4064e1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.516844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6074fc5d-8aa1-4005-98f9-5cc322bc517f req-a5f9f36a-f899-441e-bd17-94c90c4064e1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.536645 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6074fc5d-8aa1-4005-98f9-5cc322bc517f req-a5f9f36a-f899-441e-bd17-94c90c4064e1 service nova] Creating event network-vif-plugged:9121111a-541a-4e12-b4be-357c5d525b9d for instance e4adc167-d585-4cf1-bd68-f2f85e8d045a on nch2-master-1 Jun 18 22:04:42.543055 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6074fc5d-8aa1-4005-98f9-5cc322bc517f req-a5f9f36a-f899-441e-bd17-94c90c4064e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050167 Jun 18 22:04:42.545206 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 456/931] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:04:42.552476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.553389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.579648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.580437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.581527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.582142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.655770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.663336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-86187c62-e26e-4270-a7d1-b0de711f6dbe tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.300032 Jun 18 22:04:42.673449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 476/932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:42.746126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:42.747134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:42.755593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.756438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.758076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:42.758738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:42.895904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.910115 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41c3bcc9-81cd-41aa-bade-fb645786b303 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.363100 Jun 18 22:04:42.911367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 457/933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:42.957328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:42.966017 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c77af45-53c5-4a7c-ba31-2929f05a2189 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1510 microversion: 2.1 time: 0.224547 Jun 18 22:04:42.969078 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 477/934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:42 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:43.041989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.042682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:43.048859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.049345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.050126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.050535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.091773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.095836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:43.108870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.109596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.111576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.111576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.272736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:43.283768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b63fda0-f347-4074-b3d0-7474f84f1083 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1319 microversion: 2.1 time: 0.245184 Jun 18 22:04:43.293187 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 458/935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:43.341684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.342967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:43.359916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:43.361760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.364364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.368784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.369341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.374968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:43.377060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:43.379367 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a35795b5-edf8-4883-947f-3bda46c70b6e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1541 microversion: 2.25 time: 0.294783 Jun 18 22:04:43.394130 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 478/936] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1541 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:43.401115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d9ad010-3498-4271-b55e-ff33517b3fad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '.version_select at 0x7fea145ed670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.405424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d9ad010-3498-4271-b55e-ff33517b3fad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.405982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d9ad010-3498-4271-b55e-ff33517b3fad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.418054 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d9ad010-3498-4271-b55e-ff33517b3fad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.021845 Jun 18 22:04:43.427827 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 479/937] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:43.433164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.433942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:43.442458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.442997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.443856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.444374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.685698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:43.699150 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e05169ab-ea2f-4464-84a9-f432e267bdc5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.362155 Jun 18 22:04:43.711822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 459/938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:43.723300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.726185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:43.743383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.746865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.747973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:43.748437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:43.800868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:04:43.827526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67146004-b59e-402a-b5c1-f4a225c2239c tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 2033 microversion: 2.25 time: 0.398271 Jun 18 22:04:43.828148 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 480/939] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 2033 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:43.865248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93793587-3930-4fe9-b429-288fa1b6137c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Action: 'create', calling method: .version_select at 0x7fea145a1e50>, body: {"keypair": {"name": "tempest-keypair-1502729623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBzQ3pZ2QyzClD0d1dtJiCOR2mAPBulDmjXYJvi/acrXUCQnjx3GvKsf2pAtxQphxVqheAZ2WU3r2SHj81jLWHtGpbmDi10BapB5rxgSFSKMUn4MUUV6G9rfOOoAqYdIw=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:43.882991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-93793587-3930-4fe9-b429-288fa1b6137c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:43.896172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-93793587-3930-4fe9-b429-288fa1b6137c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for user 76897f7be7494bb589de747493240449 and project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:43.980360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93793587-3930-4fe9-b429-288fa1b6137c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.131358 Jun 18 22:04:43.981869 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 481/940] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:04:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 18 22:04:43.988808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:43.989985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:44.004684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.005270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.006272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.006856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.122277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:44.131586 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e2ee88f-2e67-4408-ac83-ccbd11c2b927 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.418129 Jun 18 22:04:44.139325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 460/941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:44.158165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:44.160381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:44.192738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.193331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.194233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.205494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.410224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:44.419005 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98f87491-2dc8-45a7-94b4-226b9492bf99 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.435827 Jun 18 22:04:44.436600 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 482/942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:43 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:44.436600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-770856bf-522d-46c2-887e-c544b6b08f67 req-02b40fa3-1347-4f43-af30-0f618124e6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57d0708-ff66-4e0d-8534-1e1f10c91b99", "tag": "9b132b81-60a2-4830-81e5-f1d9a9c509aa"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:44.460524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-770856bf-522d-46c2-887e-c544b6b08f67 req-02b40fa3-1347-4f43-af30-0f618124e6b9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.461587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-770856bf-522d-46c2-887e-c544b6b08f67 req-02b40fa3-1347-4f43-af30-0f618124e6b9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.477025 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-770856bf-522d-46c2-887e-c544b6b08f67 req-02b40fa3-1347-4f43-af30-0f618124e6b9 service nova] Creating event network-changed:9b132b81-60a2-4830-81e5-f1d9a9c509aa for instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 on nch2-master-1 Jun 18 22:04:44.485878 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-770856bf-522d-46c2-887e-c544b6b08f67 req-02b40fa3-1347-4f43-af30-0f618124e6b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054720 Jun 18 22:04:44.485878 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 483/943] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:44.493782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:44.494601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:44.504128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.504128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.505605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.505778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.629596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e85a218336047078ebb040193bd24a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1821f70f45ef4861bb8d49faaba64b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:44.639723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed3c1f17-601d-4022-9584-b1ef430c90d3 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 200 len: 1510 microversion: 2.1 time: 0.498912 Jun 18 22:04:44.640691 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 461/944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:44 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:44.718163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:44.720973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:44.721935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:44.726295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:44.727630 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35476876-6a61-4246-896e-8dec73da6714 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1469 microversion: 2.1 time: 0.240260 Jun 18 22:04:44.746259 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 484/945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:44 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1469 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:44.746574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.747241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.748429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.749160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.753302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:44.753999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:44.764181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.764640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:44.766049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:44.766892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.097749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:45.100821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:45.108563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-137f0cdf-c9d5-4863-acaa-31df49a39f60 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.394559 Jun 18 22:04:45.110175 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 462/946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:44 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:45.125971 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24d1a384-94ac-4860-9803-aad420252f58 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 200 len: 1467 microversion: 2.1 time: 0.375054 Jun 18 22:04:45.145774 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 485/947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:44 2022] GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 1467 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:45.152551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:45.156792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:45.157465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:45.161885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:45.163484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Searching by: {'reservation_id': 'r-gck5q1fb', 'deleted': False, 'project_id': 'c5285b07988c4c8581f047981271fee1'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:04:45.170604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.171416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.172021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.172478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.172936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.173295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.173850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.177602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.243048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=11 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:45.319517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:04:45.413072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:45.414173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=43 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:45.422735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:45.426476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6428bcf3-9086-440a-b215-e434af9bf67d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.274407 Jun 18 22:04:45.427726 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 486/948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:45 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:45.430935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.431414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.447201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:45.448670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:45.467385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:45.477896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.478404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.479746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.480582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.911252 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2e2d435-cb71-4038-81f7-764d942e798b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-gck5q1fb" status: 200 len: 2929 microversion: 2.1 time: 0.763365 Jun 18 22:04:45.921312 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 463/949] 10.222.0.30 () {58 vars in 1196 bytes} [Sat Jun 18 22:04:45 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gck5q1fb => generated 2929 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:45.921312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:45.921312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:45.927007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.927513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.928732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.931797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:45.961162 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed HTTP/1.1 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:45.967298 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:45.968933 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '53ea1489-6cb5-472a-a53a-596455331aed'} Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:45.969943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:45.971908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:45.974077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:45.975553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:45.977289 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f1928e8-4527-4107-adac-6b757d71c2fa tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 404 len: 111 microversion: 2.1 time: 0.063172 Jun 18 22:04:45.977289 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 464/950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:45 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:45.985922 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16704c90-b9a2-4ed2-9e73-fc7add23af62 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.545079 Jun 18 22:04:45.986644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-32157846-9bf5-446e-acbc-6753c8ba4c95 req-61890b4e-0dd5-4c38-8edf-815f15953a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "name": "network-vif-plugged", "status": "completed", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:45.997347 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 487/951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:45 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:45.997553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-32157846-9bf5-446e-acbc-6753c8ba4c95 req-61890b4e-0dd5-4c38-8edf-815f15953a9f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:45.997717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-32157846-9bf5-446e-acbc-6753c8ba4c95 req-61890b4e-0dd5-4c38-8edf-815f15953a9f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.002654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fb4e9313-65f1-45e0-bf32-4ea41251d608 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.012445 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-32157846-9bf5-446e-acbc-6753c8ba4c95 req-61890b4e-0dd5-4c38-8edf-815f15953a9f service nova] Creating event network-vif-plugged:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch1-master-1 Jun 18 22:04:46.022979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_groups [None req-fb4e9313-65f1-45e0-bf32-4ea41251d608 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Querying cell d349766c-949b-4923-9574-b93ba690371c(cell1) for 2 instances {{(pid=130903) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 18 22:04:46.024517 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-32157846-9bf5-446e-acbc-6753c8ba4c95 req-61890b4e-0dd5-4c38-8edf-815f15953a9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042205 Jun 18 22:04:46.025629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb4e9313-65f1-45e0-bf32-4ea41251d608 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.026078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb4e9313-65f1-45e0-bf32-4ea41251d608 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.039049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:46.041402 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 465/952] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:46.049745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1752876407", "metadata": {"image_type": "test"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:46.052823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.069805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fb4e9313-65f1-45e0-bf32-4ea41251d608 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/2d917f93-c1fa-4481-873b-e280d4c11dfe" status: 200 len: 271 microversion: 2.1 time: 0.071085 Jun 18 22:04:46.077351 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 488/953] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:04:45 2022] GET /compute/v2.1/os-server-groups/2d917f93-c1fa-4481-873b-e280d4c11dfe => generated 271 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:46.083959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.084881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.087018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.087540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.089448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.090588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.095827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.096578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.097687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.098508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.112253 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed/action HTTP/1.1 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 112 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:46.114823 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1752876407", "metadata": {"image_type": "test"}}} Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:46.116195 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '53ea1489-6cb5-472a-a53a-596455331aed', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1752876407', 'metadata': {'image_type': 'test'}}}} Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.117076 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.118263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.122548 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:46.122548 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:46.122548 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.122548 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.122548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:46.122548 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e5631ae3-44ff-461b-82e0-b052efa23039 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "POST /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed/action" status: 404 len: 111 microversion: 2.1 time: 0.074983 Jun 18 22:04:46.130219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 466/954] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Jun 18 22:04:46 2022] POST /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:46.135459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.136260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.145933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.145933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.145933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.145933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.149069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:46.320306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3543587b-ec3b-4ba2-a267-69d3a90da485 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 200 len: 1618 microversion: 2.1 time: 0.241354 Jun 18 22:04:46.321646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 489/955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:46 2022] GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 1618 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:46.334728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:46.337804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71403eaf-0c8e-40d8-9faa-d49470d8b361 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1613760805", "metadata": {"image_type": "test"}}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:46.339037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-71403eaf-0c8e-40d8-9faa-d49470d8b361 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Failed to fetch instance by id tempest-invalid-1652901315 {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:04:46.339621 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-71403eaf-0c8e-40d8-9faa-d49470d8b361 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance tempest-invalid-1652901315 could not be found. Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71403eaf-0c8e-40d8-9faa-d49470d8b361 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/tempest-invalid-1652901315/action HTTP/1.1 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 112 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:46.341331 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1613760805", "metadata": {"image_type": "test"}}} Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:04:46.342675 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance tempest-invalid-1652901315 could not be found. Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'tempest-invalid-1652901315', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1613760805', 'metadata': {'image_type': 'test'}}}} Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1652901315 could not be found. Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.344177 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1652901315 could not be found. Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1652901315 could not be found. Jun 18 22:04:46.345697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.346820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71403eaf-0c8e-40d8-9faa-d49470d8b361 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance tempest-invalid-1652901315 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:46.346820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-71403eaf-0c8e-40d8-9faa-d49470d8b361 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-1652901315/action" status: 404 len: 101 microversion: 2.1 time: 0.008997 Jun 18 22:04:46.346820 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 490/956] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:04:46 2022] POST /compute/v2.1/servers/tempest-invalid-1652901315/action => generated 101 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:46.349774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.350391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.350845 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bdbc36a9-eb06-4ea2-bf5d-637759aabdd8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.219333 Jun 18 22:04:46.351452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 467/957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:46 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:46.357543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.358011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.358812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.359260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.365537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27fd2248-1c2a-45d5-969e-c8f78dad7d26 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2064804626"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:46.366670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27fd2248-1c2a-45d5-969e-c8f78dad7d26 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:04:46.367134 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-27fd2248-1c2a-45d5-969e-c8f78dad7d26 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27fd2248-1c2a-45d5-969e-c8f78dad7d26 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 57 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:46.368788 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: {"createImage": {"name": "tempest-test-snap-2064804626"}} Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:46.370575 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2064804626'}}} Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.371369 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.372756 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.376890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27fd2248-1c2a-45d5-969e-c8f78dad7d26 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:46.376890 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27fd2248-1c2a-45d5-969e-c8f78dad7d26 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017020 Jun 18 22:04:46.381483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 468/958] 10.222.0.30 () {60 vars in 1274 bytes} [Sat Jun 18 22:04:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:46.387109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a334fdc4-057c-4d6a-88a3-c0dac6b052de tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-494031501"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:46.388121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a334fdc4-057c-4d6a-88a3-c0dac6b052de tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:04:46.388630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a334fdc4-057c-4d6a-88a3-c0dac6b052de tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a334fdc4-057c-4d6a-88a3-c0dac6b052de tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 56 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:46.390530 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: {"createImage": {"name": "tempest-test-snap-494031501"}} Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:46.391871 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-494031501'}}} Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.392677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 18 22:04:46.394476 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.396146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a334fdc4-057c-4d6a-88a3-c0dac6b052de tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:46.396146 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a334fdc4-057c-4d6a-88a3-c0dac6b052de tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.009583 Jun 18 22:04:46.397493 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 469/959] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Jun 18 22:04:46 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:46.403425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.403964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.410898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.411434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.412229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.412683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.427945 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed HTTP/1.1 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:46.429634 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.431055 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '53ea1489-6cb5-472a-a53a-596455331aed'} Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:46.431827 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.434117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.435749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:46.435749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ed6622b-a71c-4f04-87fd-7a0b0c011c93 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 404 len: 111 microversion: 2.1 time: 0.032739 Jun 18 22:04:46.435749 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 470/960] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:04:46 2022] DELETE /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:46.442969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.443593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] [instance: 53ea1489-6cb5-472a-a53a-596455331aed] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.450284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.450781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.451881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.452356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.467973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] HTTP exception thrown: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Request method failure captured: Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed HTTP/1.1 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvhlp_QqN7FNPI6lcT-Xx7jh-zivQll9WACFJAiqKpEaPPV6mrhvF8uGzSJ1W_2EhQFHw9dfiD2bx7_DA_oGmJKRWB68lj-umDzN8_N4EIWNkd45QBRyQUL71C7qyCwQGoro-lkZ8C_bchDyFy5tMds5NFsnoxxg-weX6dC3ZZDhK4 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:04:46.469744 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1821f70f45ef4861bb8d49faaba64b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1821f70f45ef4861bb8d49faaba64b20", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1821f70f45ef4861bb8d49faaba64b20 Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-546167731 Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1e85a218336047078ebb040193bd24a9 Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesNegativeTestJSON-546167731-project Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.471074 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '53ea1489-6cb5-472a-a53a-596455331aed'} Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:46.471828 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. Jun 18 22:04:46.473001 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:04:46.475806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] Returning 404 to user: Instance 53ea1489-6cb5-472a-a53a-596455331aed could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:46.475806 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2aa6262b-dea9-4224-93de-0a09cd2a4890 tempest-ImagesNegativeTestJSON-546167731 tempest-ImagesNegativeTestJSON-546167731-project] 10.222.0.30 "GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed" status: 404 len: 111 microversion: 2.1 time: 0.034600 Jun 18 22:04:46.477120 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 471/961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:46 2022] GET /compute/v2.1/servers/53ea1489-6cb5-472a-a53a-596455331aed => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:46.482126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:46.482860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:46.491373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.492299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.493321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.494021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.625916 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8832dda6-8f85-44d3-943d-cc2b8ad411a9 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1620 microversion: 2.1 time: 0.280663 Jun 18 22:04:46.633111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 491/962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:46 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1620 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:46.635415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1a2e0c30-8b3f-44ab-b6e3-2dd0e148767a req-446a3533-744e-4786-9982-47ee74709fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ea1489-6cb5-472a-a53a-596455331aed", "name": "network-vif-deleted", "tag": "36886011-8108-48e4-8ec9-914a2e3a99ba"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:46.645619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1a2e0c30-8b3f-44ab-b6e3-2dd0e148767a req-446a3533-744e-4786-9982-47ee74709fca service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:46.646417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1a2e0c30-8b3f-44ab-b6e3-2dd0e148767a req-446a3533-744e-4786-9982-47ee74709fca service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:46.686772 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1a2e0c30-8b3f-44ab-b6e3-2dd0e148767a req-446a3533-744e-4786-9982-47ee74709fca service nova] Creating event network-vif-deleted:36886011-8108-48e4-8ec9-914a2e3a99ba for instance 53ea1489-6cb5-472a-a53a-596455331aed on nch2-master-1 Jun 18 22:04:46.697306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1a2e0c30-8b3f-44ab-b6e3-2dd0e148767a req-446a3533-744e-4786-9982-47ee74709fca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068553 Jun 18 22:04:46.699457 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 492/963] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:46.743563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:46.752722 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3acae803-4fae-4ff4-a810-b4f22cafb4c4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.274761 Jun 18 22:04:46.764074 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 472/964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:46 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:46.772389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-52454466", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a2cda02d-382a-44e4-99c8-614e7cf17b1d"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:46.840887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:47.005528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:47.006407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:47.024403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.024850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.025672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.026104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.380100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:47.389770 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4a5bcb2-2a0f-4c15-ad1c-a928f3ed6d9d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.387981 Jun 18 22:04:47.390716 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 473/965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:47 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:47.396161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:47.397190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:47.403983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.404443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:47.404945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.405071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:47.405507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:47.405635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.405946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.406170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:47.406667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:47.416507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.418688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.419821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.420474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.440624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:47.448318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:47.463632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:47.467610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:47.523523 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c8e56273-87f5-474d-b92c-4949d6bda87c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756441 Jun 18 22:04:47.525488 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 493/966] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:04:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:04:47.541784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a39cd7ad-1835-438e-b5a1-d59e72e1e993 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:47.542647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a39cd7ad-1835-438e-b5a1-d59e72e1e993 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:47.648434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a39cd7ad-1835-438e-b5a1-d59e72e1e993 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:47.665359 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a39cd7ad-1835-438e-b5a1-d59e72e1e993 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1215 microversion: 2.1 time: 0.127315 Jun 18 22:04:47.666328 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 494/967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:47 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:47.728077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:47.738519 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fcff44a-d053-4b0f-a438-7843542e38b8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.346355 Jun 18 22:04:47.739249 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 474/968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:47 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:47.774193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:47.775433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:47.785062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.785771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:47.786997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:47.787606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.378536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:48.389358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24f67d37-200d-4b01-96cf-603e9cc70a9c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1360 microversion: 2.1 time: 0.621124 Jun 18 22:04:48.390654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 495/969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:47 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1360 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:48.413176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:48.413958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:48.425350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:48.426444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.427612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:48.428289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.683089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:48.684470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:48.692096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:48.692876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.693927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:48.694568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.703558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:48.713759 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5714179-ea50-4567-bf5c-a1d060706382 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.309152 Jun 18 22:04:48.714412 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 475/970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:48 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:48.757055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:48.758213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:48.768476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:48.769335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.770419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:48.771166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:48.798299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:48.810771 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a434639d-681c-4630-a722-f0bd2ae70304 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1267 microversion: 2.1 time: 0.131653 Jun 18 22:04:48.815198 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 496/971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:48 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:49.066146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:49.076440 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-756a4d1a-af68-4f35-af65-e562e6da4155 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.324038 Jun 18 22:04:49.088302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 476/972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:48 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:49.410983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:49.413326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:49.436596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:49.444330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:49.448511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:49.452489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:49.669752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dde6acc4-5751-489c-b48b-e943575a42cc tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Calling method '.version_select at 0x7fea14693ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:49.818376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dde6acc4-5751-489c-b48b-e943575a42cc tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.364383 Jun 18 22:04:49.825458 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 477/973] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:04:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:04:49.825995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:49.826805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:49.842394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:49.843310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:49.844402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:49.844994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:50.001459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:50.010464 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d9363172-b6cd-4923-8350-3631ebc0a84c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1544 microversion: 2.1 time: 0.605876 Jun 18 22:04:50.033303 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 497/974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:49 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1544 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:50.039149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3e870e9-112b-497c-8a31-4b4f85c28d65 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Action: 'create', calling method: .version_select at 0x7fea145a1ee0>, body: {"pool": "non_exist_pool"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:50.138970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d3e870e9-112b-497c-8a31-4b4f85c28d65 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] HTTP exception thrown: Floating IP pool not found. Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3e870e9-112b-497c-8a31-4b4f85c28d65 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Request method failure captured: Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 26 Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwBl08BFG1BOhGkk_9hGfFUEyNDvVpJNYpfzmi458JLqklOZtl-macQ3HpgIxvRheGjzwOzveBVsmg9x4aEmf1ywbO7nIAtdygTSSDT3-OTrkI1cCo6jCfN1hwdc0jPbPk8hywDb_S7QN9M6hYwoXToN3u3nE213uqxesIIRQP0x0Q Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e0c1dd409b0646c0bfe6e4e59a3a4e6e Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-876868298 Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:50.141074 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e0c1dd409b0646c0bfe6e4e59a3a4e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0c1dd409b0646c0bfe6e4e59a3a4e6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0c1dd409b0646c0bfe6e4e59a3a4e6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e0c1dd409b0646c0bfe6e4e59a3a4e6e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-876868298 Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e0c1dd409b0646c0bfe6e4e59a3a4e6e Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-876868298 Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsNegativeTestJSON-876868298-project Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1b50d4456513401a9ef5a9e518f770ac Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-876868298-project Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: {"pool": "non_exist_pool"} Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: exception: Floating IP pool not found. Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 18 22:04:50.142415 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:50.143347 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 18 22:04:50.144635 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:50.147216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3e870e9-112b-497c-8a31-4b4f85c28d65 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Returning 404 to user: Floating IP pool not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:50.148842 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d3e870e9-112b-497c-8a31-4b4f85c28d65 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.113855 Jun 18 22:04:50.149672 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 498/975] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:04:50 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:04:50.155836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:50.161968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:50.180667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:50.181697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:50.185846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:50.186611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:51.012713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:51.025827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d156ad5-f9e4-4412-8a45-e6defb8d25cf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 1.205123 Jun 18 22:04:51.028185 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 478/976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:49 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:51.044945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-795324474", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "39432198-5051-484b-846b-d7e8994b5707"}], "security_groups": [{"name": "tempest-securitygroup--476139378"}], "key_name": "tempest-keypair-1502729623", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:51.300447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] validate_networks() for [('39432198-5051-484b-846b-d7e8994b5707', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:04:52.198055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:52.225956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b67e42c-13d9-46f8-b548-fa3a9cbf213b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 2.074967 Jun 18 22:04:52.226983 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 499/977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:50 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:52.233166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:52.233970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:52.240666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:52.242203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:52.243459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:52.244096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:52.430576 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5e0b4f0b-fd43-4412-8b7c-d1e4de3ee389 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.202203 Jun 18 22:04:52.431505 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 500/978] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:04:52 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:52.437733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:52.438362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:52.457546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:52.457999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:52.458793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:52.459232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.131787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:53.143261 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-13369224-9e6d-4448-979e-d088bcee33bf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.710387 Jun 18 22:04:53.154047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 501/979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:52 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:53.159737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-417f0662-b747-4307-ac02-9cdfc12a7ec9 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Calling method '.version_select at 0x7fea1450cdc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:53.276375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-417f0662-b747-4307-ac02-9cdfc12a7ec9 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP db010e22-6c5d-4fb4-ada2-bb34a8948b8a could not be found", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:04:53.278891 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-417f0662-b747-4307-ac02-9cdfc12a7ec9 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] HTTP exception thrown: Floating IP not found for ID db010e22-6c5d-4fb4-ada2-bb34a8948b8a Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-417f0662-b747-4307-ac02-9cdfc12a7ec9 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Request method failure captured: Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-floating-ips/db010e22-6c5d-4fb4-ada2-bb34a8948b8a HTTP/1.1 Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwBl08BFG1BOhGkk_9hGfFUEyNDvVpJNYpfzmi458JLqklOZtl-macQ3HpgIxvRheGjzwOzveBVsmg9x4aEmf1ywbO7nIAtdygTSSDT3-OTrkI1cCo6jCfN1hwdc0jPbPk8hywDb_S7QN9M6hYwoXToN3u3nE213uqxesIIRQP0x0Q Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e0c1dd409b0646c0bfe6e4e59a3a4e6e Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-876868298 Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:04:53.281772 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e0c1dd409b0646c0bfe6e4e59a3a4e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0c1dd409b0646c0bfe6e4e59a3a4e6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e0c1dd409b0646c0bfe6e4e59a3a4e6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e0c1dd409b0646c0bfe6e4e59a3a4e6e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-876868298 Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e0c1dd409b0646c0bfe6e4e59a3a4e6e Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-876868298 Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsNegativeTestJSON-876868298-project Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1b50d4456513401a9ef5a9e518f770ac Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-876868298-project Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: exception: Floating IP not found for ID db010e22-6c5d-4fb4-ada2-bb34a8948b8a Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'db010e22-6c5d-4fb4-ada2-bb34a8948b8a'} Jun 18 22:04:53.283349 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:04:53.284185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP db010e22-6c5d-4fb4-ada2-bb34a8948b8a could not be found Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b608d1b-2d5c-4629-953d-d38687332ae9'] Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID db010e22-6c5d-4fb4-ada2-bb34a8948b8a. Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:53.285456 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID db010e22-6c5d-4fb4-ada2-bb34a8948b8a Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:04:53.287150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:04:53.289481 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID db010e22-6c5d-4fb4-ada2-bb34a8948b8a Jun 18 22:04:53.289481 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:04:53.291158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-417f0662-b747-4307-ac02-9cdfc12a7ec9 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] Returning 404 to user: Floating IP not found for ID db010e22-6c5d-4fb4-ada2-bb34a8948b8a {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:04:53.292335 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-417f0662-b747-4307-ac02-9cdfc12a7ec9 tempest-FloatingIPsNegativeTestJSON-876868298 tempest-FloatingIPsNegativeTestJSON-876868298-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/db010e22-6c5d-4fb4-ada2-bb34a8948b8a" status: 404 len: 111 microversion: 2.1 time: 0.137112 Jun 18 22:04:53.293310 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 502/980] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:04:53 2022] DELETE /compute/v2.1/os-floating-ips/db010e22-6c5d-4fb4-ada2-bb34a8948b8a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:04:53.319082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dbb01e8e-63c4-47ef-aab2-7c9778cbe2f7 req-584e3544-49ea-4c49-9286-7192d3aa3acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d548829-c243-4cad-9c16-cce987616762", "tag": "db797937-0996-4cb8-bfec-ec8fe80125f0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:53.328013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:04:53.328571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:04:53.329084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:04:53.329509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:04:53.335882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:04:53.340528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dbb01e8e-63c4-47ef-aab2-7c9778cbe2f7 req-584e3544-49ea-4c49-9286-7192d3aa3acf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.343229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dbb01e8e-63c4-47ef-aab2-7c9778cbe2f7 req-584e3544-49ea-4c49-9286-7192d3aa3acf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.362761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dbb01e8e-63c4-47ef-aab2-7c9778cbe2f7 req-584e3544-49ea-4c49-9286-7192d3aa3acf service nova] Creating event network-changed:db797937-0996-4cb8-bfec-ec8fe80125f0 for instance 0d548829-c243-4cad-9c16-cce987616762 on nch2-master-1 Jun 18 22:04:53.370580 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dbb01e8e-63c4-47ef-aab2-7c9778cbe2f7 req-584e3544-49ea-4c49-9286-7192d3aa3acf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073676 Jun 18 22:04:53.370892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.371256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.372118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.372348 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 503/981] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:53.380829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:53.381748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.390145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:53.419048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.422515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.426115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.426649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.443345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:04:53.467159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for user 76897f7be7494bb589de747493240449 and project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:04:53.490863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:04:53.496857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:04:53.605269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f330200-714c-4d69-8c5e-10e5dd2cf756 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.575609 Jun 18 22:04:53.606331 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 479/982] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:04:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:04:53.618974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:53.619594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:53.641556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.642193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:53.643057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:53.643616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:54.256037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:54.266860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-27e6050d-5009-4c03-8936-b16bcda5a3b7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1495 microversion: 2.1 time: 0.891632 Jun 18 22:04:54.268542 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 504/983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:53 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1495 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:54.285767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b35daf8f-eeee-437e-a727-b55c1cf46dab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:54.292370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b35daf8f-eeee-437e-a727-b55c1cf46dab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:54.446261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b35daf8f-eeee-437e-a727-b55c1cf46dab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:54.455892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b35daf8f-eeee-437e-a727-b55c1cf46dab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:54.458495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b35daf8f-eeee-437e-a727-b55c1cf46dab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:54.463193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:54.473416 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b35daf8f-eeee-437e-a727-b55c1cf46dab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1285 microversion: 2.25 time: 0.190223 Jun 18 22:04:54.487071 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 505/984] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:54 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:54.489486 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dd91ca66-0545-4349-a68f-1dd37dc10027 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 0.880255 Jun 18 22:04:54.501176 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 480/985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:53 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:54.509549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:54.510636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:54.512114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1d7dd2ca-3384-4e17-aa1e-44ceeed091d9 req-7eb5fa6a-dbbd-4e3d-9870-c18d6fcf7499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57d0708-ff66-4e0d-8534-1e1f10c91b99", "name": "network-vif-plugged", "status": "completed", "tag": "9b132b81-60a2-4830-81e5-f1d9a9c509aa"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:54.529578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:54.532873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:54.534603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:54.535411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1d7dd2ca-3384-4e17-aa1e-44ceeed091d9 req-7eb5fa6a-dbbd-4e3d-9870-c18d6fcf7499 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:54.536540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:54.539057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1d7dd2ca-3384-4e17-aa1e-44ceeed091d9 req-7eb5fa6a-dbbd-4e3d-9870-c18d6fcf7499 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:54.564070 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1d7dd2ca-3384-4e17-aa1e-44ceeed091d9 req-7eb5fa6a-dbbd-4e3d-9870-c18d6fcf7499 service nova] Creating event network-vif-plugged:9b132b81-60a2-4830-81e5-f1d9a9c509aa for instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 on nch2-master-1 Jun 18 22:04:54.578936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1d7dd2ca-3384-4e17-aa1e-44ceeed091d9 req-7eb5fa6a-dbbd-4e3d-9870-c18d6fcf7499 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076309 Jun 18 22:04:54.579567 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 481/986] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:55.285964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:55.286668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:55.294198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.294949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.296045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.296642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.332472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:55.346165 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-efa09e80-fe85-4f6b-9f7f-58b643ffd11e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1313 microversion: 2.1 time: 0.856005 Jun 18 22:04:55.347471 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 506/987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:54 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:55.493699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:55.494320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:55.505195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.508768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.509645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.510934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.668909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:55.683784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:55.686181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:55.687802 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5c27d37-1c0f-4ee5-bfc6-cdf3b17b455b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1343 microversion: 2.25 time: 0.198360 Jun 18 22:04:55.689434 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 507/988] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:55 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:04:55.694297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:55.695364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:55.703126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.703815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.704740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.705639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.842460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:55.861294 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d3e2058-d159-46eb-97da-f9ac83d2bcc3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 200 len: 1472 microversion: 2.1 time: 0.579373 Jun 18 22:04:55.876331 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 482/989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:55 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 1472 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:55.885997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-986216498"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:55.892397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:55.899584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.900349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:55.902050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:55.902713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:56.112337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:56.129592 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2cae2f34-655b-45da-8519-35be9b0f45d6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 0.438862 Jun 18 22:04:56.130517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 508/990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:55 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:56.135031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9f6c56a8-e1b1-40a7-8d72-b19615d48883 req-1a9d54c7-5379-4b82-bcc9-c0832de37d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:04:56.153175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9f6c56a8-e1b1-40a7-8d72-b19615d48883 req-1a9d54c7-5379-4b82-bcc9-c0832de37d8f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:56.153617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9f6c56a8-e1b1-40a7-8d72-b19615d48883 req-1a9d54c7-5379-4b82-bcc9-c0832de37d8f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:56.182912 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9f6c56a8-e1b1-40a7-8d72-b19615d48883 req-1a9d54c7-5379-4b82-bcc9-c0832de37d8f service nova] Creating event network-changed:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch1-master-1 Jun 18 22:04:56.193820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9f6c56a8-e1b1-40a7-8d72-b19615d48883 req-1a9d54c7-5379-4b82-bcc9-c0832de37d8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061871 Jun 18 22:04:56.198257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 509/991] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:04:56.365390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:56.366803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:56.386438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:56.389390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:56.394534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:56.396361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:56.507708 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f7ed59bb-e593-44a0-9daa-1557f1e01b67 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7/action" status: 202 len: 0 microversion: 2.1 time: 0.628121 Jun 18 22:04:56.508815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 483/992] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:04:55 2022] POST /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:04:56.529065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a4adaaae-b48a-4115-b192-47143dd8a14a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea144f3940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:56.624908 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a4adaaae-b48a-4115-b192-47143dd8a14a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.108076 Jun 18 22:04:56.632113 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 484/993] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:56 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:56.707257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:56.711275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:56.729295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:56.736931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:56.738158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:56.743144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:56.921052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:56.935157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:56.944305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:56.944305 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16aa4e8b-eefe-4b8e-bea5-17777c89aaab tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1343 microversion: 2.25 time: 0.241261 Jun 18 22:04:56.947202 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 485/994] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:56 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1343 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:04:57.124325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:57.133574 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f8726cc9-fa15-4240-a357-57b127a86e35 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1463 microversion: 2.1 time: 0.772282 Jun 18 22:04:57.134923 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 510/995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:56 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1463 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:57.152547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:57.153246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:57.168005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.168005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.168005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.168394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.350949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:57.355725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'deleted': False, 'project_id': 'a6a5988d0538426288555ee3fc2bfec4'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:04:57.377063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.379085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.382339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.382982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.564890 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9016a1b6-e38b-4cf9-8fd2-0d31cbc37b0d tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.406251 Jun 18 22:04:57.567011 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 511/996] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:04:57 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:04:57.592793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:57.603443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'deleted': False} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:04:57.618933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.623899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.628457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.630545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.758741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:57.773365 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-327b915c-98ea-48ae-bcf5-4d34768bb241 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 0.624733 Jun 18 22:04:57.783077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 486/997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:57 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:57.788820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-083f9c15-856f-4ece-86ef-d6f4987add55 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea144f34c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:57.828286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:04:57.857551 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-083f9c15-856f-4ece-86ef-d6f4987add55 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.072913 Jun 18 22:04:57.858542 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 487/998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:57 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:57.962827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:57.964908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:57.977660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.982406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:57.983657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:57.986194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:58.053212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:58.053701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:58.301818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:58.330077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:58.332299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:58.336418 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18cf68aa-5656-4922-b5e5-d26be019d4bc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1343 microversion: 2.25 time: 0.377784 Jun 18 22:04:58.343015 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 488/999] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:57 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1343 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:04:58.791582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:58.792210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:58.805927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:58.807057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:58.808002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:58.808621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:59.262209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:04:59.276240 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d761c793-12b1-456d-b719-64c00c293880 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 0.488587 Jun 18 22:04:59.277790 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 489/1000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:04:58 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:04:59.287542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e792083a-ebad-40a2-b010-70cd3d31adb0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14531f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:59.357065 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e792083a-ebad-40a2-b010-70cd3d31adb0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.077234 Jun 18 22:04:59.364838 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 490/1001] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:04:59 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:04:59.371096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:59.371988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:04:59.380304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:59.381063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:59.382082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:59.382656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:59.389130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:59.856824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-897a3321-34bd-4004-bb7d-d17134723b2a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 25711 microversion: 2.1 time: 2.272031 Jun 18 22:04:59.857766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 512/1002] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Jun 18 22:04:57 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 25711 bytes in 2276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:04:59.901165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:04:59.906042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'deleted': False, 'project_id': 'a6a5988d0538426288555ee3fc2bfec4'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:04:59.918206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:59.918838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:59.922815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:04:59.923556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:04:59.964952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:04:59.985644 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98f63a46-b1c9-4a25-b7b0-3e9b9178477e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=24245a540466462bb9a908267f505f28" status: 200 len: 15 microversion: 2.1 time: 0.091195 Jun 18 22:04:59.998638 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 513/1003] 10.222.0.30 () {58 vars in 1230 bytes} [Sat Jun 18 22:04:59 2022] GET /compute/v2.1/servers/detail?tenant_id=24245a540466462bb9a908267f505f28 => generated 15 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:05:00.016234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:00.023385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'tenant_id': '24245a540466462bb9a908267f505f28', 'deleted': False} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:05:00.030021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:00.030662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:00.031635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:00.032363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:00.095887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:05:00.252454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:00.254599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:00.309924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:00.327356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:00.328937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:00.330161 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-927a3158-c9d3-44f6-83cf-79221018015a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 0.964005 Jun 18 22:05:00.330718 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 491/1004] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:04:59 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:00.650365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-534e047b-ebc9-4471-aea3-156dc6b0fdba tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea14620f70>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfSvYIml+i1rkJsB/33LbmOsrBaZPn4kdw3elGX9GA3nN1P3mOxIl7sy1q9WU7xZpXtxzoQRgXJHP5aEgRy954pja25szGJpsgNgwp5KxxPCyTBAKO1J5uZLKijyAawGA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:00.656311 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-534e047b-ebc9-4471-aea3-156dc6b0fdba tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-534e047b-ebc9-4471-aea3-156dc6b0fdba tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 257 Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:05:00.659968 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfSvYIml+i1rkJsB/33LbmOsrBaZPn4kdw3elGX9GA3nN1P3mOxIl7sy1q9WU7xZpXtxzoQRgXJHP5aEgRy954pja25szGJpsgNgwp5KxxPCyTBAKO1J5uZLKijyAawGA=="}} Jun 18 22:05:00.661307 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfSvYIml+i1rkJsB/33LbmOsrBaZPn4kdw3elGX9GA3nN1P3mOxIl7sy1q9WU7xZpXtxzoQRgXJHP5aEgRy954pja25szGJpsgNgwp5KxxPCyTBAKO1J5uZLKijyAawGA=='}}} Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 18 22:05:00.662055 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 18 22:05:00.663146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 18 22:05:00.664309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:00.666822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-534e047b-ebc9-4471-aea3-156dc6b0fdba tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:00.668032 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-534e047b-ebc9-4471-aea3-156dc6b0fdba tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.333287 Jun 18 22:05:00.669575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 492/1005] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:05:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:05:00.679850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:00.680571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:00.693979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:00.694640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:00.695817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:00.696308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.058501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b341e4b2-14e1-4f75-8b61-c73c82418323 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=24245a540466462bb9a908267f505f28" status: 200 len: 4824 microversion: 2.1 time: 1.054441 Jun 18 22:05:01.060759 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 514/1006] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:04:59 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=24245a540466462bb9a908267f505f28 => generated 4824 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:01.082644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9612bf3f-6179-44f3-9977-4bbf13ef0e63 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1455ca60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:01.159537 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9612bf3f-6179-44f3-9977-4bbf13ef0e63 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.082099 Jun 18 22:05:01.160830 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 515/1007] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:01 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:01.174525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea145ed550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1774056373", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.233970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:01.259072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:01.259714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for user 1beb8610e39144788d17f96aaf21dec9 and project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:01.268148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4f10ac5a-683e-4d50-8fe2-93b1d3232d18 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 0.597055 Jun 18 22:05:01.271470 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 493/1008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:00 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:01.280670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b12aaa72-414b-4759-bad1-911678767ffe req-45ae533a-4819-4431-9152-376e618f75a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.302205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:01.303052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b12aaa72-414b-4759-bad1-911678767ffe req-45ae533a-4819-4431-9152-376e618f75a1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.303696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b12aaa72-414b-4759-bad1-911678767ffe req-45ae533a-4819-4431-9152-376e618f75a1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 2167 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1774056373", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:05:01.316256 ncdv-master-1 devstack@n-api.service[130903]: exception: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1774056373', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:01.318755 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d4cc346-73a9-4b3f-a0f0-c3dd76e3d9de tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.148813 Jun 18 22:05:01.321630 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 516/1009] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:01.332001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:01.332348 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b12aaa72-414b-4759-bad1-911678767ffe req-45ae533a-4819-4431-9152-376e618f75a1 service nova] Creating event network-changed:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch1-master-1 Jun 18 22:05:01.339103 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b12aaa72-414b-4759-bad1-911678767ffe req-45ae533a-4819-4431-9152-376e618f75a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066236 Jun 18 22:05:01.340302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 494/1010] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:01.349240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4401624e-4195-4750-971a-0a8ca08f7a27 req-4b948655-d287-48a1-baa0-913d86706c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d548829-c243-4cad-9c16-cce987616762", "name": "network-vif-plugged", "status": "completed", "tag": "db797937-0996-4cb8-bfec-ec8fe80125f0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.359638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4401624e-4195-4750-971a-0a8ca08f7a27 req-4b948655-d287-48a1-baa0-913d86706c4f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.359865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'tenant_id': 'a6a5988d0538426288555ee3fc2bfec4', 'deleted': False} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:05:01.360466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4401624e-4195-4750-971a-0a8ca08f7a27 req-4b948655-d287-48a1-baa0-913d86706c4f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.377004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4401624e-4195-4750-971a-0a8ca08f7a27 req-4b948655-d287-48a1-baa0-913d86706c4f service nova] Creating event network-vif-plugged:db797937-0996-4cb8-bfec-ec8fe80125f0 for instance 0d548829-c243-4cad-9c16-cce987616762 on nch2-master-1 Jun 18 22:05:01.377490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.377982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.378827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.383325 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4401624e-4195-4750-971a-0a8ca08f7a27 req-4b948655-d287-48a1-baa0-913d86706c4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041271 Jun 18 22:05:01.385160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.385560 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 495/1011] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:01.401413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8f1afc7-ad5a-4598-95eb-ef1262e2a973 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea14620f70>, body: {"keypair": {"name": "tempest-keypair-38732035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKQJGkCmPDUuM/Wyofk/niJwxaj32AqHCvSg29lKUMlHlfDRORmWFwOq1DgZDx6aBtuPRTnka1Z/7VdCkO/rTTdjTTu98wr3/aTO8VZ4qF3yu2fUBdJGTrMif8LgXSTzQ=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.456310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-a8f1afc7-ad5a-4598-95eb-ef1262e2a973 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:01.462847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-a8f1afc7-ad5a-4598-95eb-ef1262e2a973 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for user 1beb8610e39144788d17f96aaf21dec9 and project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:01.495777 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8f1afc7-ad5a-4598-95eb-ef1262e2a973 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.107930 Jun 18 22:05:01.498501 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 496/1012] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:01.511128 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b861ba98-cd65-4c45-907a-e4eac91962a0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a6a5988d0538426288555ee3fc2bfec4" status: 200 len: 15 microversion: 2.1 time: 0.191843 Jun 18 22:05:01.511437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:01.512237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:01.518565 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 517/1013] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:05:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a6a5988d0538426288555ee3fc2bfec4 => generated 15 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:05:01.531039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.531430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.532215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.532651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.537512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea145ed670>, body: {"keypair": {"name": "tempest-keypair-38732035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7bI5uiX5CMfcinxk2/+A4biviBnbYYd+uxQMnprAgM10+dY66m6qucMtOzTO69mVezww6TolC6kmdRkwYD3JfQ9SkPO8cdGIa9aYJ8AprD2Q2Ut+RLifVchNdCgZqy5g=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.590915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:01.608814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for user 1beb8610e39144788d17f96aaf21dec9 and project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:01.639983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:01.664760 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] HTTP exception thrown: Key pair 'tempest-keypair-38732035' already exists. Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 271 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: {"keypair": {"name": "tempest-keypair-38732035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7bI5uiX5CMfcinxk2/+A4biviBnbYYd+uxQMnprAgM10+dY66m6qucMtOzTO69mVezww6TolC6kmdRkwYD3JfQ9SkPO8cdGIa9aYJ8AprD2Q2Ut+RLifVchNdCgZqy5g=="}} Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: exception: Key pair 'tempest-keypair-38732035' already exists. Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-38732035', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7bI5uiX5CMfcinxk2/+A4biviBnbYYd+uxQMnprAgM10+dY66m6qucMtOzTO69mVezww6TolC6kmdRkwYD3JfQ9SkPO8cdGIa9aYJ8AprD2Q2Ut+RLifVchNdCgZqy5g=='}}} Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result.read() Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '1beb8610e39144788d17f96aaf21dec9-tempest-keypair-38732035' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 18 22:05:01.668237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi session.flush() Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result.read() Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 18 22:05:01.672579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '1beb8610e39144788d17f96aaf21dec9-tempest-keypair-38732035' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 18, 22, 5, 1, 656683), 'updated_at': None, 'name': 'tempest-keypair-38732035', 'user_id': '1beb8610e39144788d17f96aaf21dec9', 'fingerprint': '0c:0a:c9:22:33:ca:ca:8e:e6:5f:e8:2e:cf:a2:69:02', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7bI5uiX5CMfcinxk2/+A4biviBnbYYd+uxQMnprAgM10+dY66m6qucMtOzTO69mVezww6TolC6kmdRkwYD3JfQ9SkPO8cdGIa9aYJ8AprD2Q2Ut+RLifVchNdCgZqy5g==', 'type': 'ssh'}] Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi keypair.create() Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._create() Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-38732035' already exists. Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 18 22:05:01.677012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-38732035' already exists. Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-38732035' already exists. Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 409 to user: Key pair 'tempest-keypair-38732035' already exists. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a6551f13-b6e7-44f9-911f-e763d8244f71 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.150179 Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 518/1014] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:05:01.680935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82a90797-b8b5-4ce7-8228-e32eb7e5aee4 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:01.695862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82a90797-b8b5-4ce7-8228-e32eb7e5aee4 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009583 Jun 18 22:05:01.695862 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 519/1015] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Jun 18 22:05:01 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:05:01.695862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9eaca0de-5e68-4337-8dde-c2a46b14e92b tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Calling method '.version_select at 0x7fea14949af0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:01.724806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9eaca0de-5e68-4337-8dde-c2a46b14e92b tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38732035" status: 202 len: 0 microversion: 2.1 time: 0.039133 Jun 18 22:05:01.725692 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 520/1016] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Jun 18 22:05:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38732035 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:01.730738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.731708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:01.739587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.740276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.742001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.742746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.856966 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d36c406-337b-4904-8c8b-028cc797646e tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.129761 Jun 18 22:05:01.858062 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 521/1017] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:01.866214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bac43eaf-4843-4839-8922-ad24acc8c0f8 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea14378ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjquxuJTgpTyERrSmf0efxIQAI4qkN3DsgKqIqWLGfy/HbEhwlja29s7GCp/k65VHXR042Av3HbLhtJQazABs1B0gLoqsFSYK6J3Tm5o9oOd6mzRzJiENhlBawk68KeLg=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bac43eaf-4843-4839-8922-ad24acc8c0f8 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 247 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjquxuJTgpTyERrSmf0efxIQAI4qkN3DsgKqIqWLGfy/HbEhwlja29s7GCp/k65VHXR042Av3HbLhtJQazABs1B0gLoqsFSYK6J3Tm5o9oOd6mzRzJiENhlBawk68KeLg=="}} Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjquxuJTgpTyERrSmf0efxIQAI4qkN3DsgKqIqWLGfy/HbEhwlja29s7GCp/k65VHXR042Av3HbLhtJQazABs1B0gLoqsFSYK6J3Tm5o9oOd6mzRzJiENhlBawk68KeLg=='}}} Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi '' Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:05:01.868436 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bac43eaf-4843-4839-8922-ad24acc8c0f8 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:01.873187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bac43eaf-4843-4839-8922-ad24acc8c0f8 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012343 Jun 18 22:05:01.875810 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 522/1018] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:05:01 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:05:01.884981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:01.888590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:01.889637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '24245a540466462bb9a908267f505f28'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:05:01.898710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.899314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:01.900435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:01.901117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:02.066947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:05:02.195341 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a170c005-66b6-446c-873c-5cb87d8a3288 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.314543 Jun 18 22:05:02.196584 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 523/1019] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Jun 18 22:05:01 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:02.203817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea1455c8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-415613517", "public_key": " "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:02.224831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:02.234250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for user 1beb8610e39144788d17f96aaf21dec9 and project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:02.282705 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 94 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-415613517", "public_key": " "}} Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: exception: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-415613517', 'public_key': ' '}}} Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:02.285912 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:02.291199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.296509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:02.297720 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4cee2ac-c698-4434-9f06-c80fd21c3356 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.099425 Jun 18 22:05:02.298964 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 524/1020] 10.222.0.30 () {60 vars in 1157 bytes} [Sat Jun 18 22:05:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:02.315775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5df1cc2f-f142-486c-8cca-ed5913c27094 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145ed550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:02.393071 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5df1cc2f-f142-486c-8cca-ed5913c27094 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.092565 Jun 18 22:05:02.394405 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 525/1021] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:02 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:02.402613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:02.403845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:02.413529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:02.414255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:02.415251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:02.415852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:02.557559 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ef41bec-b558-486f-98f1-857d99dead98 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.161065 Jun 18 22:05:02.558544 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 526/1022] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:02 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:02.563520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:02.564977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:02.573065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:02.573630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:02.574497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:02.574952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:02.622060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:02.631678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:02.633428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:02.634676 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5f81371-aec0-4fd9-ba67-6772a8ba893f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 1.135154 Jun 18 22:05:02.635789 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 497/1023] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:01 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:02.658175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c99106d-9b4b-4a34-bfaf-1a761a104b69 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea146260d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTObTb2TOq7gQ2VyyEjm26sY9D4wdJOkusSCfhzg+NguJm350tushTrtSpKik+dMvyfcFaAnDRLavRJomsUSgn+IJIwW/WtQwoG6rzz8+fWdr81poxO8hEFf/3dHWBuAA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c99106d-9b4b-4a34-bfaf-1a761a104b69 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 507 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTObTb2TOq7gQ2VyyEjm26sY9D4wdJOkusSCfhzg+NguJm350tushTrtSpKik+dMvyfcFaAnDRLavRJomsUSgn+IJIwW/WtQwoG6rzz8+fWdr81poxO8hEFf/3dHWBuAA=="}} Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTObTb2TOq7gQ2VyyEjm26sY9D4wdJOkusSCfhzg+NguJm350tushTrtSpKik+dMvyfcFaAnDRLavRJomsUSgn+IJIwW/WtQwoG6rzz8+fWdr81poxO8hEFf/3dHWBuAA=='}}} Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 18 22:05:02.661468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:02.665188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c99106d-9b4b-4a34-bfaf-1a761a104b69 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:02.667501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c99106d-9b4b-4a34-bfaf-1a761a104b69 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.028171 Jun 18 22:05:02.677145 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 498/1024] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:05:02 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:05:02.683747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:02.684956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:02.692760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:02.693482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:02.694693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:02.695485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:03.112929 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c04017a2-4405-4b6d-9581-482f78ed49d0 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1612 microversion: 2.1 time: 0.432131 Jun 18 22:05:03.114300 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 499/1025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:02 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1612 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:03.121857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Action: 'create', calling method: .version_select at 0x7fea145268b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1036188041", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:03.176280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:03.191005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Getting quotas for user 1beb8610e39144788d17f96aaf21dec9 and project 37df598baf854c16997629e2c8d8399a. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:03.231674 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 118 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1036188041", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: exception: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1036188041', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 18 22:05:03.237665 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 18 22:05:03.242777 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.248823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:03.249975 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15cc6606-1939-457e-99e4-fa2af154fe06 tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.133387 Jun 18 22:05:03.251511 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 500/1026] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:05:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:05:03.258251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:03.259144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:03.269681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:03.270138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:03.270967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:03.271405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:03.289374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:03.301439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9232edea-90a5-466c-858e-30882e70f811 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1315 microversion: 2.1 time: 0.739162 Jun 18 22:05:03.302969 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 527/1027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:02 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:03.316309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93b0af96-d201-4574-8659-e80332a782da tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Calling method '.version_select at 0x7fea1455caf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:03.335479 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-93b0af96-d201-4574-8659-e80332a782da tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1845915412 not found for user 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93b0af96-d201-4574-8659-e80332a782da tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Request method failure captured: Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1845915412 HTTP/1.1 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwLWYIyjur40XUdkHQquKpO0OkJYgAzXoBpvOMtz_WAmS2QM8XWYa1x-Sk5lNgAb_yxzQLvBebVCz2PB0UgzVBOLOyVQCv4HRIzTnu2nYqnPWSBYe-5j6iMFBpjbnMT_7aS3_btIwu4lTHf19Lo4X5jQdQ57S1ge2tGawLYRxKM4HA Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37df598baf854c16997629e2c8d8399a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37df598baf854c16997629e2c8d8399a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37df598baf854c16997629e2c8d8399a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 37df598baf854c16997629e2c8d8399a Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1566290683 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1566290683-project Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: exception: Keypair tempest-keypair-non-existent-1845915412 not found for user 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'tempest-keypair-non-existent-1845915412'} Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1845915412 not found for user 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.337662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1845915412 not found for user 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1845915412 not found for user 1beb8610e39144788d17f96aaf21dec9 Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93b0af96-d201-4574-8659-e80332a782da tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1845915412 not found for user 1beb8610e39144788d17f96aaf21dec9 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93b0af96-d201-4574-8659-e80332a782da tempest-KeyPairsNegativeTestJSON-1566290683 tempest-KeyPairsNegativeTestJSON-1566290683-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1845915412" status: 404 len: 145 microversion: 2.1 time: 0.035171 Jun 18 22:05:03.341865 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 528/1028] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1845915412 => generated 145 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:05:03.408875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7e73c66a-4335-4f5a-9689-5a2e13ab585f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142c7e50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:03.423204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:03.507465 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7e73c66a-4335-4f5a-9689-5a2e13ab585f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.102881 Jun 18 22:05:03.514985 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 529/1029] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:03 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:03.659488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:03.660311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:03.675221 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d73a2f2d-7b5c-4075-bd0b-4b3f2b9195c3 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1612 microversion: 2.1 time: 0.422366 Jun 18 22:05:03.681204 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 501/1030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:03 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1612 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:03.687636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:03.688121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:03.688968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:03.697316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:03.698644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:03.703121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:05:03.708411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:03.730579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:03.733972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:03.743202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:03.744146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.105798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:05:04.164425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:04.186150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:04.191198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:04.197463 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fea5535c-2285-4db1-990e-3b36a7521fff tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 0.545212 Jun 18 22:05:04.200521 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 530/1031] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:03 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:04.253810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7ce49b51-a839-42ab-a45e-9660a1730679 req-e9158e73-3aa1-4664-bfee-c3a0b5e0c927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678d2a2b-9907-4e75-8cc7-424583f5cca7", "name": "network-vif-plugged", "status": "completed", "tag": "401011df-8eff-4d01-b8b2-b3e66f069fde"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:04.272788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7ce49b51-a839-42ab-a45e-9660a1730679 req-e9158e73-3aa1-4664-bfee-c3a0b5e0c927 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.274042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7ce49b51-a839-42ab-a45e-9660a1730679 req-e9158e73-3aa1-4664-bfee-c3a0b5e0c927 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.287802 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7ce49b51-a839-42ab-a45e-9660a1730679 req-e9158e73-3aa1-4664-bfee-c3a0b5e0c927 service nova] Creating event network-vif-plugged:401011df-8eff-4d01-b8b2-b3e66f069fde for instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 on nch2-master-1 Jun 18 22:05:04.297319 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7ce49b51-a839-42ab-a45e-9660a1730679 req-e9158e73-3aa1-4664-bfee-c3a0b5e0c927 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046218 Jun 18 22:05:04.300162 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 531/1032] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:05:04.324317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:04.325732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:04.335311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.336068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.337018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.337632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.344774 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f17b4561-02d0-4dc1-ac7b-0060c9f2d86a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 2958 microversion: 2.1 time: 0.650959 Jun 18 22:05:04.362086 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 502/1033] 10.222.0.30 () {58 vars in 1189 bytes} [Sat Jun 18 22:05:03 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 2958 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:04.369490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:04.388462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:05:04.402515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.405540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.407386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.407938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.438444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a5d6e0b-fdcd-48c7-af88-8062ccd74d46 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.074923 Jun 18 22:05:04.440054 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 503/1034] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Jun 18 22:05:04 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:05:04.454952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:04.457087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:04.465794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.466582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.468758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.469473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.611802 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1a10a70-7fbc-43f1-82a7-86e17cd64d34 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.163343 Jun 18 22:05:04.616062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 504/1035] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:04 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:04.624423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c74272f-6c0d-48b0-8b15-f2b9951e7136 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14626a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:04.710378 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c74272f-6c0d-48b0-8b15-f2b9951e7136 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.091304 Jun 18 22:05:04.718354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 505/1036] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:04 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:04.736663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:04.740109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:04.766402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:04.774931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.775384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.776194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.778115 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e678d171-f0b7-433d-ad2c-2bbe93dff168 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1464 microversion: 2.1 time: 0.458412 Jun 18 22:05:04.778807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.781305 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 532/1037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:04 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1464 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:04.797371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:04.798383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:04.808867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.809770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:04.812221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:04.815016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.048121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:05.048552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:05.049248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:05.049833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:05.050409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:05.136646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:05.146998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:05.147787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.148824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:05.149582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.163370 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-00bcc577-28ab-4cbf-8bdc-a25e0ee6ff49 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1615 microversion: 2.1 time: 0.370018 Jun 18 22:05:05.167349 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 533/1038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:04 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1615 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:05.187038 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7eed3163-d9a7-48c3-90a3-8cdd8addb031 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 1065 microversion: 2.1 time: 0.466696 Jun 18 22:05:05.195721 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 506/1039] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:04 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 1065 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 18 22:05:05.203236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:05.204201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:05.218821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:05.221840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:05.226084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.230486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:05.231363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.233060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:05.252870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:05.255902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.263886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:05.264813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:05.906286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:05.919991 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3e4c125-4403-4fef-a238-1be3fa13ec16 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.719404 Jun 18 22:05:05.922752 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 534/1040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:05 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:05.944425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-925786407", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a2cda02d-382a-44e4-99c8-614e7cf17b1d"]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:05.960595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:05.974246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:05.983297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:05.984895 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-71e561d6-f1ea-478f-94bd-aed84056d359 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 0.770231 Jun 18 22:05:06.002006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 507/1041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:05 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:06.015657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-224e2413-8b68-44a6-be2f-3a4a0b8c90ea tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1461e700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:06.152184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:05:06.174015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-224e2413-8b68-44a6-be2f-3a4a0b8c90ea tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.166800 Jun 18 22:05:06.175358 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 508/1042] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:06 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:06.488714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:06.489397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:06.490797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:06.491476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:06.492052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:06.517843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=31 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:06.521885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:06.522504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:06.523856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:06.524662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:06.553251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:06.560772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:06.585241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:05:06.588207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:05:06.673724 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aec45d79-ef02-48b2-bd77-735f88fd05c5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749450 Jun 18 22:05:06.678876 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 535/1043] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:05:06.690401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e14c2bff-bd56-46d5-8bf4-08b07d34142f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:06.692080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e14c2bff-bd56-46d5-8bf4-08b07d34142f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:06.837296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e14c2bff-bd56-46d5-8bf4-08b07d34142f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:06.847916 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e14c2bff-bd56-46d5-8bf4-08b07d34142f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1216 microversion: 2.1 time: 0.160388 Jun 18 22:05:06.849480 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 509/1044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:06 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:06.938129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:06.939870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:06.948212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:06.948899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:06.949931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:06.950640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:07.011180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:07.012543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:07.035179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:07.035995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:07.039079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:07.041612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:07.255703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:07.264531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9d3535e-9a14-456a-8ca3-38a87e5fac48 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.330477 Jun 18 22:05:07.270900 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 536/1045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:06 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:07.283940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9ee38086-8a80-491e-9c87-648caa0a7dc9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1455caf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:07.369714 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9ee38086-8a80-491e-9c87-648caa0a7dc9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.097164 Jun 18 22:05:07.371730 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 537/1046] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:07 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:07.432548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:07.446500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:07.449788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:07.458699 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ba225bc-77ea-4077-8e0f-ced934d2ac8b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 0.453156 Jun 18 22:05:07.461509 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 510/1047] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:07 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:07.867064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:07.868370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:07.883522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:07.886405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:07.887789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:07.889373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:08.047716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:08.068622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-771f09dc-b8b7-40d9-9353-a8d7931c8ea1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1212 microversion: 2.1 time: 0.207140 Jun 18 22:05:08.073998 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 538/1048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:07 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1212 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:08.239745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c75dda8f-543a-4d84-aaa2-f33ea09a7f01 req-b8b9bdb4-9c80-488a-87f6-e73b54185ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "name": "network-vif-plugged", "status": "completed", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:08.275046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c75dda8f-543a-4d84-aaa2-f33ea09a7f01 req-b8b9bdb4-9c80-488a-87f6-e73b54185ab3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:08.275617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c75dda8f-543a-4d84-aaa2-f33ea09a7f01 req-b8b9bdb4-9c80-488a-87f6-e73b54185ab3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:08.288144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:08.289576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:08.304426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:08.304894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:08.305737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:08.306193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:08.322797 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c75dda8f-543a-4d84-aaa2-f33ea09a7f01 req-b8b9bdb4-9c80-488a-87f6-e73b54185ab3 service nova] Creating event network-vif-plugged:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch1-master-1 Jun 18 22:05:08.341125 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c75dda8f-543a-4d84-aaa2-f33ea09a7f01 req-b8b9bdb4-9c80-488a-87f6-e73b54185ab3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100564 Jun 18 22:05:08.342396 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 511/1049] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:08.345092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:08.390445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab28b42e-0269-4888-a692-a591b0f27cb1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea144bdc10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:08.512591 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab28b42e-0269-4888-a692-a591b0f27cb1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.128709 Jun 18 22:05:08.513702 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 512/1050] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:08 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:08.524097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:08.525222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:08.536725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:08.537476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:08.538439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:08.539026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:08.796126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:08.805748 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-adf0370f-2252-4d95-87d4-1ca942a2c8aa tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.521905 Jun 18 22:05:08.812880 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 539/1051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:08 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:09.094912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:09.096411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:09.107368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:09.110193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:09.112673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:09.114327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:09.148076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:09.165217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:09.176287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:09.177775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ccb17a3-c9a4-4cec-a2e7-7cf96843707c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 0.662470 Jun 18 22:05:09.183354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 513/1052] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:08 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:09.259442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:09.267860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ddc8cfb-36ae-49a6-a331-04de52d91bf2 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1274 microversion: 2.1 time: 0.179933 Jun 18 22:05:09.271571 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 540/1053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:09 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:09.526816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f4d74ef-8eec-4c17-a798-527cf23be8c7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145264c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:09.634095 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f4d74ef-8eec-4c17-a798-527cf23be8c7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.111584 Jun 18 22:05:09.634695 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 514/1054] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:09 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:09.833276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:09.834338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:09.844710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:09.846181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:09.847242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:09.853209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:10.201093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:10.201729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:10.218234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:10.218689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:10.219499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:10.219937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:10.262174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:10.676108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:10.705431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:10.709460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:10.710921 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4421d344-8bea-434d-bc89-bcd3c0e9fd1c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1410 microversion: 2.25 time: 0.513890 Jun 18 22:05:10.714980 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 515/1055] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:10 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1410 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:05:10.733317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:10.736670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:10.737541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:10.751161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:10.752244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:10.753301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:10.758906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:10.763124 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77b761f3-3742-4451-84d1-78282bcec568 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.929606 Jun 18 22:05:10.763766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 541/1056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:09 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:10.811227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7e3b571a-fb86-459d-8ecc-faeb4b8ea065 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142c7670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:10.946708 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7e3b571a-fb86-459d-8ecc-faeb4b8ea065 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.175751 Jun 18 22:05:10.947877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 542/1057] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:10 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:11.341473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3b4721bd-9730-4283-a512-ad395ef35322 tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-375655793", "id": 1337697963, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:11.348275 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:05:11.348275 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:05:11.396786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3b4721bd-9730-4283-a512-ad395ef35322 tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.330583 Jun 18 22:05:11.408269 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 543/1058] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:05:11 2022] POST /compute/v2.1/flavors => generated 470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:05:11.417740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f475d3c2-e976-4108-966d-c9c034f44ffe tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:11.424124 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:05:11.424124 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:05:11.894276 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f475d3c2-e976-4108-966d-c9c034f44ffe tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1337697963/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.484412 Jun 18 22:05:11.898227 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 544/1059] 10.222.0.30 () {62 vars in 1264 bytes} [Sat Jun 18 22:05:11 2022] POST /compute/v2.1/flavors/1337697963/os-extra_specs => generated 62 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:11.918989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:11.919664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:11.935477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:11.937196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:11.941054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:11.942216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:11.970923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:11.980531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b0bb6692-bfc0-4973-88eb-3dbbed29dfe1 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 1.264035 Jun 18 22:05:11.993875 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 516/1060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:10 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:12.005177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:12.021525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:12.067241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:12.073763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:12.077670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:12.080579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:12.710432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:12.736775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30c6bd1e-cd53-4a70-a897-013e9b52585b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.741571 Jun 18 22:05:12.749481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 517/1061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:11 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:12.764504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1fa032fd-89e8-402f-aa71-eafd363e3239 tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:12.767515 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:05:12.767515 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:05:12.806188 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1fa032fd-89e8-402f-aa71-eafd363e3239 tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1337697963" status: 202 len: 0 microversion: 2.86 time: 0.051850 Jun 18 22:05:12.811584 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 518/1062] 10.222.0.30 () {60 vars in 1201 bytes} [Sat Jun 18 22:05:12 2022] DELETE /compute/v2.1/flavors/1337697963 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:05:12.823674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75a9a95a-c063-4b39-8578-835ac204b665 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1447c310>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:12.885856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:12.894813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:12.908136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:12.909428 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98c33f88-88aa-4608-b139-7716aed3cbc8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1606 microversion: 2.25 time: 1.001709 Jun 18 22:05:12.910057 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 545/1063] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:05:11 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1606 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:12.935993 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75a9a95a-c063-4b39-8578-835ac204b665 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.116863 Jun 18 22:05:12.936193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-585351f8-b92e-4c0d-9ca8-6c2ff4fae615 tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:12.937543 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 519/1064] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:12 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:12.961308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:12.962355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:12.974981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:12.976186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:12.983274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:12.983990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:13.049318 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-585351f8-b92e-4c0d-9ca8-6c2ff4fae615 tempest-FlavorMetadataValidation-1869888902 tempest-FlavorMetadataValidation-1869888902-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.134518 Jun 18 22:05:13.049750 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 546/1065] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:05:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:05:13.072674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:13.073315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:13.098006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:13.098754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:13.099712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:13.101556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:13.430990 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f208091f-afa9-4e3d-92ae-d0e3c5e621e1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.482223 Jun 18 22:05:13.431885 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 520/1066] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:05:12 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-interface => generated 285 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:05:13.668200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9a05e5fc-0690-4591-ae51-86f809f25aae req-a6d5874e-c60d-4ab8-b2c2-fceb20226374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16514926-e8ef-4c58-8270-2e0b2cfe0155", "tag": "c2e80933-8169-4f8d-9654-70ce8d174456"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:13.701668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9a05e5fc-0690-4591-ae51-86f809f25aae req-a6d5874e-c60d-4ab8-b2c2-fceb20226374 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:13.702111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9a05e5fc-0690-4591-ae51-86f809f25aae req-a6d5874e-c60d-4ab8-b2c2-fceb20226374 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:13.730356 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9a05e5fc-0690-4591-ae51-86f809f25aae req-a6d5874e-c60d-4ab8-b2c2-fceb20226374 service nova] Creating event network-changed:c2e80933-8169-4f8d-9654-70ce8d174456 for instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 on nch2-master-1 Jun 18 22:05:13.740210 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9a05e5fc-0690-4591-ae51-86f809f25aae req-a6d5874e-c60d-4ab8-b2c2-fceb20226374 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078321 Jun 18 22:05:13.744315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 521/1067] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:05:13.766262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:13.767278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:13.796842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:13.802780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:13.803906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:13.805514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:14.384432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:14.397956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-150b3465-5a46-4092-aebb-c4cbb7de74c7 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 1.347092 Jun 18 22:05:14.402260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 547/1068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:13 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:14.420735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5cefabe1-c3af-43e9-886c-2ff6cea4f1b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142e3a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:14.427588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:14.514217 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5cefabe1-c3af-43e9-886c-2ff6cea4f1b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.107057 Jun 18 22:05:14.515080 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 548/1069] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:14 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:15.289900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:15.301664 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c6de84c-7b30-4fe9-ad09-50e1a22763a8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 1.540387 Jun 18 22:05:15.305539 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 522/1070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:13 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:15.420383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:15.421165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:15.439581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:15.440642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:15.441611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:15.442243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:15.527804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f6a47ea-bbed-4d27-ae77-2b356f36aad7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1437aaf0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:15.605437 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4f6a47ea-bbed-4d27-ae77-2b356f36aad7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.081228 Jun 18 22:05:15.607731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 523/1071] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:15 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:16.163034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:16.173021 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b423f012-ccc8-4da5-8f60-1d718ac163db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.756971 Jun 18 22:05:16.178935 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 549/1072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:15 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:16.319963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:16.321381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:16.339739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:16.340798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:16.344343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:16.344988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:16.620959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef49018f-a61f-4dc2-b263-4fecc46b98ef tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142c7160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:16.633859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:16.635698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:16.660569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:16.670725 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47a4e5c7-9c3f-435d-8879-e3c1d7b07414 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.356140 Jun 18 22:05:16.682241 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 524/1073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:16 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:16.720054 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef49018f-a61f-4dc2-b263-4fecc46b98ef tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.104128 Jun 18 22:05:16.720901 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 550/1074] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:16 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:17.195058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:17.196299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:17.205824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=17 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:17.212546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:17.213018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:17.213951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:17.221763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:17.608537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f832f549-86e8-48b2-b924-f8dcb46f81c8 req-aea4b7ee-f9f8-49d0-a06d-57d3230b8521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:17.633352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f832f549-86e8-48b2-b924-f8dcb46f81c8 req-aea4b7ee-f9f8-49d0-a06d-57d3230b8521 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:17.634003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f832f549-86e8-48b2-b924-f8dcb46f81c8 req-aea4b7ee-f9f8-49d0-a06d-57d3230b8521 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:17.674815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f832f549-86e8-48b2-b924-f8dcb46f81c8 req-aea4b7ee-f9f8-49d0-a06d-57d3230b8521 service nova] Creating event network-changed:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch1-master-1 Jun 18 22:05:17.683840 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f832f549-86e8-48b2-b924-f8dcb46f81c8 req-aea4b7ee-f9f8-49d0-a06d-57d3230b8521 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078989 Jun 18 22:05:17.693614 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 551/1075] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:05:17.705335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:17.714021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:17.747385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:17.747848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:17.748720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:17.749132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:17.774482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:17.786670 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6117e2b-be2f-47f0-8aff-8ba440659735 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.596440 Jun 18 22:05:17.790744 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 525/1076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:17 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:17.796891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-76e70e7e-c706-4a4e-88af-2fe113ac93f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14626940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:17.912813 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-76e70e7e-c706-4a4e-88af-2fe113ac93f5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.119557 Jun 18 22:05:17.922994 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 526/1077] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:17 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:18.045340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:18.057918 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e483ed87-6859-4c0f-a44c-2bc9cc86e54c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.362463 Jun 18 22:05:18.069023 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 552/1078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:17 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:18.811199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:18.812781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:18.826292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:18.827886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:18.828921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:18.829639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:18.930144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a10120f-59d7-4836-8672-f26915a4b982 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1455cca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:19.024048 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a10120f-59d7-4836-8672-f26915a4b982 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.099472 Jun 18 22:05:19.025216 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 553/1079] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:18 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:19.087271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:19.088195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:19.094504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:19.098479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:19.102711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:19.103715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:19.104656 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-effa8977-b7f9-4162-adfd-fac14d6d394f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.302221 Jun 18 22:05:19.105588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:19.107167 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 527/1080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:18 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:19.380164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:19.390100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25f02ba6-bdbd-438e-9b98-78d438e00ec7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.307720 Jun 18 22:05:19.393801 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 554/1081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:19 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:20.042384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d60ac96f-3c1e-47ff-8ae0-9963ac1d2141 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145e0b80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:20.121470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d60ac96f-3c1e-47ff-8ae0-9963ac1d2141 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.083022 Jun 18 22:05:20.123179 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 528/1082] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:20 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:20.133254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:20.133890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:20.156872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:20.157778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:20.158831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:20.159273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:20.411232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:20.411870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:20.438089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:20.439320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:20.443393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:20.444457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:20.552479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:20.590603 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a52f5b04-1703-4b62-af90-6ed5e695cee8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.470827 Jun 18 22:05:20.600069 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 555/1083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:20 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:20.938305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:20.954633 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06fa7905-1fda-4a63-babc-2bd946a84e9a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.548018 Jun 18 22:05:20.962331 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 529/1084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:20 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:21.012180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c89aee42-9203-44f7-aa8d-38f1cf8529a5 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Action: 'create', calling method: .version_select at 0x7fea14296280>, body: {"keypair": {"name": "tempest-keypair-671514485", "type": "ssh", "user_id": "ad853b9eebe341c8ab8c45ab0011a8cf", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPAWIbDaQiufjWGGqEP7emmcJhDgz9/FP9buqkYsko5B532mQPLnFbjLdpuh1uGBiEg+taBPoOTK/TVY7JUJYK4d2BwqCBQ1f4qipq7j5Ck+4ArtrlV91n0BBZbvJAA9A=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:21.142060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be18d26e-64c5-4e2b-aa7a-9607bac20290 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea143aaa60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.191187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c89aee42-9203-44f7-aa8d-38f1cf8529a5 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Getting quotas for project a76a01fddb914993a01decf0cc0ce931. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:21.222316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:21.225363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c89aee42-9203-44f7-aa8d-38f1cf8529a5 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Getting quotas for user 236533706af8489abed755618c65e133 and project a76a01fddb914993a01decf0cc0ce931. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:21.265654 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c89aee42-9203-44f7-aa8d-38f1cf8529a5 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.664927 Jun 18 22:05:21.267347 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 556/1085] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:05:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 675 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:05:21.288505 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be18d26e-64c5-4e2b-aa7a-9607bac20290 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.147454 Jun 18 22:05:21.289585 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 530/1086] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:21 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:21.300061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1b73f9c-1d0e-4e0f-ba13-01286f555894 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Action: 'create', calling method: .version_select at 0x7fea14296af0>, body: {"keypair": {"name": "tempest-keypair-1489488121", "type": "ssh", "user_id": "ad853b9eebe341c8ab8c45ab0011a8cf", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc4ReJqsQZvPw3arpgH+LdY2yS5bzuHiBE03LxEV+bnODNHr0kSLFMNGFFkSesdd1gI9VBlrZ9JCIomb/hKeUWBKrsyIUU08jNTEQ0+UyZBTzhDhaXOXhQ2jJqgynEqbQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:21.342774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-d1b73f9c-1d0e-4e0f-ba13-01286f555894 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Getting quotas for project a76a01fddb914993a01decf0cc0ce931. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:21.357476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-d1b73f9c-1d0e-4e0f-ba13-01286f555894 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Getting quotas for user 236533706af8489abed755618c65e133 and project a76a01fddb914993a01decf0cc0ce931. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:21.433629 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1b73f9c-1d0e-4e0f-ba13-01286f555894 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.156331 Jun 18 22:05:21.446440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f4b337a-aa0f-4add-8f94-2330fed652cd tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Calling method '.version_select at 0x7fea14531550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.467444 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 557/1087] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:05:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:05:21.472524 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f4b337a-aa0f-4add-8f94-2330fed652cd tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-671514485?user_id=ad853b9eebe341c8ab8c45ab0011a8cf" status: 200 len: 511 microversion: 2.10 time: 0.029943 Jun 18 22:05:21.484879 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 531/1088] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Jun 18 22:05:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-671514485?user_id=ad853b9eebe341c8ab8c45ab0011a8cf => generated 511 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:05:21.486752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40cd83a9-9426-4fbb-bed1-1aabab392bbd tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Action: 'create', calling method: .version_select at 0x7fea1454ed30>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-985496004", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsv8lBRgsldWnApfM5CyxYuwVa69A6Yy6Z9kCNegXyLJEOvXpB2h/Udd2wuQxqRQ3shlXwavd5+/9cHMaGSzHnaR7GKuUhuEUeMW/gYpwQxXT20Xaoax4jsZsOPy1Ei2w=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:21.522429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-40cd83a9-9426-4fbb-bed1-1aabab392bbd tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Getting quotas for project a76a01fddb914993a01decf0cc0ce931. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:21.538735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-40cd83a9-9426-4fbb-bed1-1aabab392bbd tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Getting quotas for user 236533706af8489abed755618c65e133 and project a76a01fddb914993a01decf0cc0ce931. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:21.615452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.616094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:21.616721 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40cd83a9-9426-4fbb-bed1-1aabab392bbd tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.134107 Jun 18 22:05:21.617850 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 558/1089] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:05:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:05:21.628405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6ded4342-a86b-4cc8-8d4e-cef5d66a321e tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Calling method '.version_select at 0x7fea14278310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.631228 ncdv-master-1 devstack@n-api.service[130903]: WARNING oslo_db.sqlalchemy.utils [None req-6ded4342-a86b-4cc8-8d4e-cef5d66a321e tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 18 22:05:21.647292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:21.647912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:21.650936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:21.652957 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6ded4342-a86b-4cc8-8d4e-cef5d66a321e tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=ad853b9eebe341c8ab8c45ab0011a8cf" status: 200 len: 725 microversion: 2.10 time: 0.026931 Jun 18 22:05:21.653585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:21.654593 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 559/1090] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Jun 18 22:05:21 2022] GET /compute/v2.1/os-keypairs?user_id=ad853b9eebe341c8ab8c45ab0011a8cf => generated 725 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:05:21.665601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cac0a322-9795-492b-8d14-0258e3727f2a tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Calling method '.version_select at 0x7fea14377e50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.703492 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cac0a322-9795-492b-8d14-0258e3727f2a tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-985496004" status: 204 len: 0 microversion: 2.10 time: 0.043129 Jun 18 22:05:21.704451 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 560/1091] 10.222.0.30 () {60 vars in 1321 bytes} [Sat Jun 18 22:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-985496004 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:05:21.715012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-74a76509-480b-4004-91f2-69fa1d1ae619 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Calling method '.version_select at 0x7fea1454ed30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.765160 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-74a76509-480b-4004-91f2-69fa1d1ae619 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489488121?user_id=ad853b9eebe341c8ab8c45ab0011a8cf" status: 204 len: 0 microversion: 2.10 time: 0.047872 Jun 18 22:05:21.766016 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 561/1092] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Jun 18 22:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489488121?user_id=ad853b9eebe341c8ab8c45ab0011a8cf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 18 22:05:21.785067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bf667e8-123f-4626-95a5-a6dbf4705df8 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] Calling method '.version_select at 0x7fea14296670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.848105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1bf667e8-123f-4626-95a5-a6dbf4705df8 tempest-KeyPairsV210TestJSON-874783798 tempest-KeyPairsV210TestJSON-874783798-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-671514485?user_id=ad853b9eebe341c8ab8c45ab0011a8cf" status: 204 len: 0 microversion: 2.10 time: 0.071594 Jun 18 22:05:21.848975 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 562/1093] 10.222.0.30 () {60 vars in 1339 bytes} [Sat Jun 18 22:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-671514485?user_id=ad853b9eebe341c8ab8c45ab0011a8cf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 18 22:05:21.980901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:21.981779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:21.999039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:22.004351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:22.005440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:22.007609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:22.034671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:22.059201 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4935ffef-f3fd-49d7-b418-d8420d10b318 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.452822 Jun 18 22:05:22.060266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 532/1094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:21 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:22.303431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73523059-2483-4d6f-a1dd-ca5c7f4d071d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14391670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:22.412867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:22.416261 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73523059-2483-4d6f-a1dd-ca5c7f4d071d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.117106 Jun 18 22:05:22.423219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 533/1095] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:22 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:22.427945 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e488a693-7f86-4a7d-9c16-018283a4a1ac tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.453362 Jun 18 22:05:22.431581 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 563/1096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:21 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:23.090318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:23.091227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:23.110823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:23.112072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:23.114513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:23.116129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:23.162869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ec5289e8-e6f7-4b69-99e2-df0b0cfd2b9e req-9ba0802c-314e-4b7c-8916-2a568446f3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16514926-e8ef-4c58-8270-2e0b2cfe0155", "name": "network-vif-plugged", "status": "completed", "tag": "c2e80933-8169-4f8d-9654-70ce8d174456"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:23.189793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ec5289e8-e6f7-4b69-99e2-df0b0cfd2b9e req-9ba0802c-314e-4b7c-8916-2a568446f3a4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:23.197820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ec5289e8-e6f7-4b69-99e2-df0b0cfd2b9e req-9ba0802c-314e-4b7c-8916-2a568446f3a4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:23.253451 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ec5289e8-e6f7-4b69-99e2-df0b0cfd2b9e req-9ba0802c-314e-4b7c-8916-2a568446f3a4 service nova] Creating event network-vif-plugged:c2e80933-8169-4f8d-9654-70ce8d174456 for instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 on nch2-master-1 Jun 18 22:05:23.263112 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ec5289e8-e6f7-4b69-99e2-df0b0cfd2b9e req-9ba0802c-314e-4b7c-8916-2a568446f3a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104264 Jun 18 22:05:23.263828 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 564/1097] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:23.435142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6cf1a504-a45a-4256-b4d4-f12e1ae886eb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145ed940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:23.572968 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6cf1a504-a45a-4256-b4d4-f12e1ae886eb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.145908 Jun 18 22:05:23.573794 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 565/1098] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:23 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:23.589288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:23.602044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:23.626338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:23.634298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:23.635966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:23.642423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:23.708726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:23.730427 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-221b2964-f498-4834-aaf4-b2fe8b3eafab tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.656105 Jun 18 22:05:23.748138 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 534/1099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:23 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:24.001086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:24.016787 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b09e67a8-83c9-4ac9-8a37-099f79b9c1a9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1469 microversion: 2.1 time: 0.441044 Jun 18 22:05:24.018040 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 566/1100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:23 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1469 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:24.587154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ca5030f-ec4d-4c81-8c57-81f85dcffe72 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145edb80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:24.666561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-889209ec-4415-4009-a0bc-25ad7aaae500 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea1438be50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1257766790", "description": "tempest-description-2039450270"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:24.691318 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ca5030f-ec4d-4c81-8c57-81f85dcffe72 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.108142 Jun 18 22:05:24.694706 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 567/1101] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:24 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:24.807215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1384000640", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:24.913131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:05:25.506940 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-889209ec-4415-4009-a0bc-25ad7aaae500 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.370326 Jun 18 22:05:25.514990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 535/1102] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:05:24 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:25.521361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:25.522182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:25.555992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:25.559573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:25.563290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:25.566747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:26.105359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:26.124721 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5f4998c3-bc7d-4f96-8c2d-d8b8927463db tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1316 microversion: 2.1 time: 0.606130 Jun 18 22:05:26.133107 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 536/1103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:25 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1316 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:26.150163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:26.153843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:26.202173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:26.203071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:26.205340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:26.210928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:26.626523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:26.627825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:26.628820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:26.629509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:26.630160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:26.653555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:26.653773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:26.660834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:26.664735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:26.688250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:26.697086 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f67afb7-d34d-4d6b-80bd-f8ad49254657 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1475 microversion: 2.1 time: 0.559990 Jun 18 22:05:26.698855 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 537/1104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:26 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1475 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:26.713957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c195e369-87a4-4e39-b27f-f3ade66a9afa tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea14620040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-124809240", "description": "tempest-description-406490374"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:26.734936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:26.752664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:26.775040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:05:26.782292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:05:26.910678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c8444bf-fac2-4ea2-8373-8982da7f84ed tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214847 Jun 18 22:05:26.912067 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 568/1105] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:05:26.936055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-320534b3-d99f-419d-91a4-ea145e8da2bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14377550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:27.017016 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c195e369-87a4-4e39-b27f-f3ade66a9afa tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.306412 Jun 18 22:05:27.021841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 538/1106] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:05:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:27.028542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-899e3096-43a1-4cd2-b2aa-8122bcbbee11 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:27.029508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-899e3096-43a1-4cd2-b2aa-8122bcbbee11 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:27.052077 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-320534b3-d99f-419d-91a4-ea145e8da2bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1411 microversion: 2.1 time: 0.138615 Jun 18 22:05:27.054032 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 569/1107] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:26 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:27.154075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:27.154751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:27.173301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:27.174943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:27.176897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:27.186928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-899e3096-43a1-4cd2-b2aa-8122bcbbee11 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:27.212009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:27.227680 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-899e3096-43a1-4cd2-b2aa-8122bcbbee11 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1215 microversion: 2.1 time: 0.198132 Jun 18 22:05:27.241620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 539/1108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:27 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:27.276353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-421df956-0342-4bf0-9fb1-7ca991fbd2cc req-780d7bde-3f80-457b-9159-5b181b16b825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb4fcc9-fabe-4536-9514-c539642cc9c2", "name": "network-vif-unplugged", "status": "completed", "tag": "5f35a6e4-ed0a-4464-9526-b7258e8cc72d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:27.297237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-421df956-0342-4bf0-9fb1-7ca991fbd2cc req-780d7bde-3f80-457b-9159-5b181b16b825 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:27.298935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-421df956-0342-4bf0-9fb1-7ca991fbd2cc req-780d7bde-3f80-457b-9159-5b181b16b825 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:27.318915 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-421df956-0342-4bf0-9fb1-7ca991fbd2cc req-780d7bde-3f80-457b-9159-5b181b16b825 service nova] Creating event network-vif-unplugged:5f35a6e4-ed0a-4464-9526-b7258e8cc72d for instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 on nch2-master-1 Jun 18 22:05:27.327062 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-421df956-0342-4bf0-9fb1-7ca991fbd2cc req-780d7bde-3f80-457b-9159-5b181b16b825 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056939 Jun 18 22:05:27.328971 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 540/1109] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:27.340087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2139450561", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a3a7674f-c3a7-42ae-95e5-bf6ca8c29269"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:27.421950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] validate_networks() for [('a3a7674f-c3a7-42ae-95e5-bf6ca8c29269', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:05:27.923805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:27.935776 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5db56c7-13c5-4349-8929-88788500964d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1465 microversion: 2.1 time: 0.789658 Jun 18 22:05:27.941205 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 570/1110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:27 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1465 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:27.946243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:27.955278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:27.961932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:27.970759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:27.971901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:27.972490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:28.532495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:28.551919 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a379b3a5-5b6c-433c-9099-797b2385a168 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1475 microversion: 2.1 time: 0.609089 Jun 18 22:05:28.568936 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 571/1111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:27 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1475 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:28.574594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:28.575552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:28.585817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:28.586620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:28.587739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:28.588495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:28.654399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:28.656493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:28.657593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:28.658360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:28.658995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:28.692343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:28.693015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:28.694977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:28.696533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:28.752340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Getting quotas for project 1d3c1a33ed1449bdbec74fb4d3c0784f. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:28.769713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Getting quotas for user 035a5cccca15429e845012dd629d5038 and project 1d3c1a33ed1449bdbec74fb4d3c0784f. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:28.832263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:05:28.840609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:05:28.853742 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed6dd26d-a48d-4d08-8f53-d20d6fa9de09 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1616 microversion: 2.1 time: 0.280784 Jun 18 22:05:28.855996 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 572/1112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:28 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1616 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:28.871160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-218b49de-2a3e-4e74-9adc-e493f1255b96 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14266040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:28.996515 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-218b49de-2a3e-4e74-9adc-e493f1255b96 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1420 microversion: 2.1 time: 0.138668 Jun 18 22:05:28.997956 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 573/1113] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:28 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:29.008949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:29.011190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:29.043240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:29.051888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:29.055827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e78ad491-eaba-4756-ab61-d91403e3ece2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724555 Jun 18 22:05:29.058278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:29.059283 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 541/1114] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:05:29.066789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:29.071768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1be741b4-eabb-41ba-87f4-9d59a76c4ebb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14820790>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:29.173117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1be741b4-eabb-41ba-87f4-9d59a76c4ebb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 200 len: 1420 microversion: 2.1 time: 0.110311 Jun 18 22:05:29.175438 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 542/1115] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:29 2022] GET /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:29.182357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38cd5296-cb15-411b-a224-2ca2378cc9a6 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:29.183233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-38cd5296-cb15-411b-a224-2ca2378cc9a6 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:29.376527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:29.391358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-899b438b-732d-4a5e-8b96-2ad6c5e2654b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1285 microversion: 2.1 time: 0.391522 Jun 18 22:05:29.394560 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 574/1116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:28 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1285 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:29.407226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fdf002b7-6737-4c0d-bcca-cddbe58fcb6e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1454e4c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:29.528987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38cd5296-cb15-411b-a224-2ca2378cc9a6 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:29.543091 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38cd5296-cb15-411b-a224-2ca2378cc9a6 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1216 microversion: 2.1 time: 0.364367 Jun 18 22:05:29.545988 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 543/1117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:29 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1216 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:29.580989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1230732057", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a2cda02d-382a-44e4-99c8-614e7cf17b1d"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:29.715840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:05:30.490256 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fdf002b7-6737-4c0d-bcca-cddbe58fcb6e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 204 len: 0 microversion: 2.1 time: 1.094152 Jun 18 22:05:30.491218 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 575/1118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:29 2022] DELETE /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:05:30.497215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:30.500309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:30.514751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:30.518791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:30.519690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:30.520051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.016719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:31.030726 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8246eced-f49a-47e3-bcf4-941968de3f11 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1475 microversion: 2.1 time: 0.538188 Jun 18 22:05:31.031697 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 576/1119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:30 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1475 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:31.042826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:31.048055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:31.061307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.066604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.069513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.070106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.091095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:31.120694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:31.122227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:31.122942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:31.123571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:31.124200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:31.157333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.157900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.158839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.163968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.193747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:31.199716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Getting quotas for user 545b6c16175f418587d6c8649b3ba8b0 and project c5285b07988c4c8581f047981271fee1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:31.213071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:05:31.215782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:05:31.231639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:31.283002 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc91510d-3d03-4b4d-8f3b-fe17119bec62 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722040 Jun 18 22:05:31.284880 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 544/1120] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:05:31.295215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:31.295907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:31.308891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.309534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.310324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.311398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.376764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:05:31.509724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5dd15331-2b7d-486b-bf29-a5fa11b28859 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 204 len: 0 microversion: 2.1 time: 0.222673 Jun 18 22:05:31.511226 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 545/1121] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:05:31 2022] DELETE /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:05:31.535405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:31.536811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:31.548487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:31.564436 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a847a5c5-806f-4208-8c01-64637214884d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.531243 Jun 18 22:05:31.567398 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 577/1122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:31 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:31.570786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.571990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.573892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.575534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.582735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1f57e56a-cbfe-405f-9aaf-2c3c1134614b req-c8e18433-78d2-4e35-a166-de5f26032768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678d2a2b-9907-4e75-8cc7-424583f5cca7", "name": "network-vif-unplugged", "status": "completed", "tag": "401011df-8eff-4d01-b8b2-b3e66f069fde"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:31.627841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1f57e56a-cbfe-405f-9aaf-2c3c1134614b req-c8e18433-78d2-4e35-a166-de5f26032768 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:31.630337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1f57e56a-cbfe-405f-9aaf-2c3c1134614b req-c8e18433-78d2-4e35-a166-de5f26032768 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:31.670600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:31.678954 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1f57e56a-cbfe-405f-9aaf-2c3c1134614b req-c8e18433-78d2-4e35-a166-de5f26032768 service nova] Creating event network-vif-unplugged:401011df-8eff-4d01-b8b2-b3e66f069fde for instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 on nch2-master-1 Jun 18 22:05:31.700607 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1f57e56a-cbfe-405f-9aaf-2c3c1134614b req-c8e18433-78d2-4e35-a166-de5f26032768 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130407 Jun 18 22:05:31.703807 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 578/1123] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:31.725580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6460620-c93f-4eb8-a935-81b70880b439 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:31.727330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6460620-c93f-4eb8-a935-81b70880b439 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:31.817964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:31.832943 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d222141c-e465-4fb8-bdbe-812737da45ed tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1274 microversion: 2.1 time: 0.315253 Jun 18 22:05:31.833917 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 546/1124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:31 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1274 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:31.848063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1876805530", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1a0b7d1f-26de-4ff3-a984-65723c7a5ace"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:31.916590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e6460620-c93f-4eb8-a935-81b70880b439 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:31.926054 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6460620-c93f-4eb8-a935-81b70880b439 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1217 microversion: 2.1 time: 0.220822 Jun 18 22:05:31.936257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 579/1125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:31 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:31.958312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] validate_networks() for [('1a0b7d1f-26de-4ff3-a984-65723c7a5ace', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:05:32.048605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:32.049670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:32.056916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:32.058929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:32.061337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:32.062100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:32.485879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:32.501568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4bc62b2d-bd05-45d1-8428-d17bafbbb71b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1475 microversion: 2.1 time: 0.456729 Jun 18 22:05:32.502906 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 580/1126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:32 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1475 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:32.584836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:32.587049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:32.597613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:32.598728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:32.605291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:32.606209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.127357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:33.138624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a0c74e2a-470a-45b7-b1eb-d88fb2734676 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.558859 Jun 18 22:05:33.140976 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 581/1127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:32 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:33.154255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d81f1c9a-8c85-4c12-86d7-a4ce49c7ab77 req-c0cfc5e9-8b3c-4d1f-807b-31995bbb4219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "980110ca-e679-4848-9c62-97f89f2949e9", "tag": "72a92448-3cc1-4a92-865f-530516163c9b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:33.176953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d81f1c9a-8c85-4c12-86d7-a4ce49c7ab77 req-c0cfc5e9-8b3c-4d1f-807b-31995bbb4219 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.177652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d81f1c9a-8c85-4c12-86d7-a4ce49c7ab77 req-c0cfc5e9-8b3c-4d1f-807b-31995bbb4219 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.203685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d81f1c9a-8c85-4c12-86d7-a4ce49c7ab77 req-c0cfc5e9-8b3c-4d1f-807b-31995bbb4219 service nova] Creating event network-changed:72a92448-3cc1-4a92-865f-530516163c9b for instance 980110ca-e679-4848-9c62-97f89f2949e9 on nch1-master-1 Jun 18 22:05:33.213647 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d81f1c9a-8c85-4c12-86d7-a4ce49c7ab77 req-c0cfc5e9-8b3c-4d1f-807b-31995bbb4219 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067452 Jun 18 22:05:33.214994 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 582/1128] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:33.222765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:33.223966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:33.250232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.250713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.254268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.257002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.398658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:33.399302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:33.400306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:33.400825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:33.401530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:33.421664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.431293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.432631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.433330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.474524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:33.485412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:33.500470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4e9486d-681d-4795-8658-aed1b6873af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1274 microversion: 2.1 time: 0.282220 Jun 18 22:05:33.501569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for user 4eef98c56e744064b2b5f131c3766c0c and project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:33.505781 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 583/1129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:33 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:33.530480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:33.532168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:33.552870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.554712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.557523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:05:33.557901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.558477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.563673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:05:33.660351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:33.669639 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4906eac-ab90-46c1-9e55-cbbeb23a889f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1275 microversion: 2.1 time: 0.161835 Jun 18 22:05:33.671093 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 584/1130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:33 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:33.678391 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1da8b72d-3486-4301-a47c-9145562d4af6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.839974 Jun 18 22:05:33.693431 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 547/1131] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:05:33.699505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-99504623-dd3b-464d-839d-62c34d670182 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:33.700179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-99504623-dd3b-464d-839d-62c34d670182 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:33.702231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:33.703611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:33.717549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.718740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.721137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.722423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:33.922656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-99504623-dd3b-464d-839d-62c34d670182 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:33.930817 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-99504623-dd3b-464d-839d-62c34d670182 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1208 microversion: 2.1 time: 0.236151 Jun 18 22:05:33.931434 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 548/1132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:33 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:33.951243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a47ff2e3-9207-4668-ad6c-ef657e2bdabe req-32590cec-4397-4d0d-a0d8-5db70506e26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb4fcc9-fabe-4536-9514-c539642cc9c2", "name": "network-vif-plugged", "status": "completed", "tag": "5f35a6e4-ed0a-4464-9526-b7258e8cc72d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:33.998714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a47ff2e3-9207-4668-ad6c-ef657e2bdabe req-32590cec-4397-4d0d-a0d8-5db70506e26e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:33.999140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a47ff2e3-9207-4668-ad6c-ef657e2bdabe req-32590cec-4397-4d0d-a0d8-5db70506e26e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:34.067881 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a47ff2e3-9207-4668-ad6c-ef657e2bdabe req-32590cec-4397-4d0d-a0d8-5db70506e26e service nova] Creating event network-vif-plugged:5f35a6e4-ed0a-4464-9526-b7258e8cc72d for instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 on nch2-master-1 Jun 18 22:05:34.103129 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a47ff2e3-9207-4668-ad6c-ef657e2bdabe req-32590cec-4397-4d0d-a0d8-5db70506e26e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160428 Jun 18 22:05:34.124292 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 549/1133] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:34.126923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:34.140462 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41662dfd-a455-4e09-92fe-2ba31c58eca6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1475 microversion: 2.1 time: 0.467930 Jun 18 22:05:34.141479 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 585/1134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:33 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1475 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:34.168515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:34.170188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:34.184067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:34.184891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:34.187708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:34.189533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:34.523798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:34.524762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:34.532576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:34.536940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:34.538318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:34.546418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:34.972611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:34.989777 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed23c6d5-b733-4a7c-8c3b-ab4b5b406585 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.836301 Jun 18 22:05:35.000879 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 550/1135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:34 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:35.007351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:35.008506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:35.022475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:35.101827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.079s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:35.128398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:35.129944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:35.185913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:35.196544 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75054dc3-81ee-4860-a1c0-8a4402d0d971 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.677213 Jun 18 22:05:35.197467 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 586/1136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:34 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:35.210567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:35.211495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:35.213602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:35.221275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:35.221993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:35.222974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:35.223573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:35.312124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:35.331995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b39e1df-31b5-4ea6-90dd-4ccc2194bbbf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1275 microversion: 2.1 time: 0.328131 Jun 18 22:05:35.363037 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 551/1137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:35 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:35.382584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:35.390063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:35.410641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:35.413350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:35.414689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:35.417309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:35.426479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:35.444268 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a2330d48-a48a-47e0-b7f9-064e16df2775 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1260 microversion: 2.1 time: 0.245387 Jun 18 22:05:35.445319 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 587/1138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:35 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:35.762066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:35.776224 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb4cae9b-c525-4b7d-888d-798aaae1c3e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1475 microversion: 2.1 time: 0.406389 Jun 18 22:05:35.779314 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 552/1139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:35 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1475 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:36.009374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:36.009943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:36.021615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.022448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.023257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.025802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.214524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:36.215142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:36.221824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.222709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.223735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.224589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.317300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:36.327536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-52b4656c-36a7-4c7d-897c-c23c543959d1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.322816 Jun 18 22:05:36.339502 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 588/1140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:36 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:36.346717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6f14e58a-b925-4593-be5a-06af66964899 req-e9eb51e4-4c7f-4a55-a097-672969d728d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "678d2a2b-9907-4e75-8cc7-424583f5cca7", "name": "network-vif-deleted", "tag": "401011df-8eff-4d01-b8b2-b3e66f069fde"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:36.378170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6f14e58a-b925-4593-be5a-06af66964899 req-e9eb51e4-4c7f-4a55-a097-672969d728d7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.382254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6f14e58a-b925-4593-be5a-06af66964899 req-e9eb51e4-4c7f-4a55-a097-672969d728d7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.400589 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6f14e58a-b925-4593-be5a-06af66964899 req-e9eb51e4-4c7f-4a55-a097-672969d728d7 service nova] Creating event network-vif-deleted:401011df-8eff-4d01-b8b2-b3e66f069fde for instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 on nch2-master-1 Jun 18 22:05:36.409549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6f14e58a-b925-4593-be5a-06af66964899 req-e9eb51e4-4c7f-4a55-a097-672969d728d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065538 Jun 18 22:05:36.411014 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 589/1141] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:36.419688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:36.422175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:36.437412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.437967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.443313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.448798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.702551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:36.855658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:36.866779 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3eb64aba-89f1-4a30-a186-27a356ba9d4e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.656297 Jun 18 22:05:36.869536 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 553/1142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:36 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:36.897423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:36.901978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:36.913650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.922828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:36.924084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:36.924692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:37.034598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:37.046845 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f531727-89d7-47e3-bdeb-e83a6e382a74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.633883 Jun 18 22:05:37.049805 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 590/1143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:36 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:37.079935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:37.080695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:37.106588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:37.107393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:37.108510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:37.109284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:37.136381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:37.175199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d18a9773-6f7f-416d-b8e5-159ca1854c2b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1266 microversion: 2.1 time: 0.290521 Jun 18 22:05:37.178558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 554/1144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:36 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1266 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:37.344808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:37.345465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:37.362532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:37.363039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:37.363921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:37.364368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:37.730598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:37.763753 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f065d2b4-3fb5-40eb-8734-08a66c9c754c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1461 microversion: 2.1 time: 0.712742 Jun 18 22:05:37.764383 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 591/1145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:37 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1461 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:37.781287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:37.782261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:37.817840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:37.819377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:37.820513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:37.821346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.011820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:38.036995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-552fa2e4-2237-4119-8df2-6fc446f0c739 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.696607 Jun 18 22:05:38.065456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 555/1146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:37 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:38.081644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:38.082715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:38.092300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.093263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.095470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.096134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.373891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:38.389866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39d86fae-42e9-46ae-82ea-b3f43aa15219 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1461 microversion: 2.1 time: 0.613171 Jun 18 22:05:38.390489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 592/1147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:37 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1461 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:38.406819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:38.407738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:38.414870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.415558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.417676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.418325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.500772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:38.517369 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6531f1f-754f-446f-9aff-c483ada09b77 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.446812 Jun 18 22:05:38.519279 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 556/1148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:38 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:38.527428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:38.528310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:38.537951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.538849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.539929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.540570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.724050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:38.733289 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ba375ea2-cc71-418d-baef-8b3b9236ad9d tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.331062 Jun 18 22:05:38.745223 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 593/1149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:38 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:38.751179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:38.753508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:38.770676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.771421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.772384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.773061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.854065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:38.870512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7be56488-9cb2-40b2-80e9-14446bc9d98f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.349759 Jun 18 22:05:38.871152 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 557/1150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:38 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:38.900853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4004ec83-fa4f-4402-bbe4-dd1319f0c8e2 req-40c87750-68c0-4d16-832c-49a7d5ae9a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d436e95-9552-4166-af2f-4299bfcce1d4", "tag": "87ec2284-fa7d-4ce6-8978-c5e46a70d113"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:38.910945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:38.911384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:38.911920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:38.912395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:38.918035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:38.926589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4004ec83-fa4f-4402-bbe4-dd1319f0c8e2 req-40c87750-68c0-4d16-832c-49a7d5ae9a26 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:38.929945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4004ec83-fa4f-4402-bbe4-dd1319f0c8e2 req-40c87750-68c0-4d16-832c-49a7d5ae9a26 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:38.960384 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4004ec83-fa4f-4402-bbe4-dd1319f0c8e2 req-40c87750-68c0-4d16-832c-49a7d5ae9a26 service nova] Creating event network-changed:87ec2284-fa7d-4ce6-8978-c5e46a70d113 for instance 8d436e95-9552-4166-af2f-4299bfcce1d4 on nch1-master-1 Jun 18 22:05:38.967282 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4004ec83-fa4f-4402-bbe4-dd1319f0c8e2 req-40c87750-68c0-4d16-832c-49a7d5ae9a26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078044 Jun 18 22:05:38.968375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 558/1151] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:39.018042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:39.027125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.027583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.028478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.031165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.060589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:39.072100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:39.073935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:39.084613 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b02537d1-305e-4a61-973d-86cf6adc9293 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 1065 microversion: 2.1 time: 0.335614 Jun 18 22:05:39.085961 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 594/1152] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:38 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 1065 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 18 22:05:39.087608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.088226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.089076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.089706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.101863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:39.102479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:39.116358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.120045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.121125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.121642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.415178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:39.431241 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57168404-c1c8-4116-bfe6-40ecb00dd726 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.363318 Jun 18 22:05:39.433248 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 559/1153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:39 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:39.456488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:39.468993 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bfdffe00-8702-4b97-b59b-2cad037e8210 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.371477 Jun 18 22:05:39.470379 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 595/1154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:39 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:39.536654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:39.538022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:39.556311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.569596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.575741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.577623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.752205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:39.752921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:39.766409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.766939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.768156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.770030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.818436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:39.830255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dcd69dd8-f696-41ee-b78f-29f32bee3af3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.298836 Jun 18 22:05:39.831777 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 560/1155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:39 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:39.889853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:39.891168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:39.903088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.903965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:39.906359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:39.908118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:40.169545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:40.184268 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4593f1a6-f69b-4bdd-8314-f1a30d9eac12 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.435952 Jun 18 22:05:40.185003 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 596/1156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:39 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:40.265108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:40.282863 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f22df300-3b16-4fd5-8056-1c5fa499fbd7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.395991 Jun 18 22:05:40.295969 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 561/1157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:39 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:40.450524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:40.451607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:40.468922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:40.472653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:40.473983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:40.474658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:40.487698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:40.487904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:40.499519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:40.500008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:40.500846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:40.507420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:40.888323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:40.904686 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-646fae42-f905-41a8-a56f-1ccca945f557 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.459432 Jun 18 22:05:40.918081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:40.918641 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 597/1158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:40 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:40.928570 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3ea956f-92fc-414d-8de2-01943bfaea52 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.445714 Jun 18 22:05:40.930292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:40.934210 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 562/1159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:40 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:40.949721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:40.987489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:40.988139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:40.990005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:40.990747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.011491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8caf316c-7c60-40fd-8443-e65cd60a474d req-9b4e7a46-c5dc-44fd-bb87-bcea45c88ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63c3783-668b-445a-898a-2cfba0c43440", "tag": "46d3c9cc-13a1-47b0-80a8-628b828571fd"}, {"name": "network-changed", "server_uuid": "869eea9f-3a55-41e5-a036-656377f664ae", "tag": "3546b8cb-91fd-4c67-b8ea-9dbdc007acf3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:41.032551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8caf316c-7c60-40fd-8443-e65cd60a474d req-9b4e7a46-c5dc-44fd-bb87-bcea45c88ba1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.037673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8caf316c-7c60-40fd-8443-e65cd60a474d req-9b4e7a46-c5dc-44fd-bb87-bcea45c88ba1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.098096 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8caf316c-7c60-40fd-8443-e65cd60a474d req-9b4e7a46-c5dc-44fd-bb87-bcea45c88ba1 service nova] Creating event network-changed:46d3c9cc-13a1-47b0-80a8-628b828571fd for instance c63c3783-668b-445a-898a-2cfba0c43440 on nch1-master-1 Jun 18 22:05:41.098973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8caf316c-7c60-40fd-8443-e65cd60a474d req-9b4e7a46-c5dc-44fd-bb87-bcea45c88ba1 service nova] Creating event network-changed:3546b8cb-91fd-4c67-b8ea-9dbdc007acf3 for instance 869eea9f-3a55-41e5-a036-656377f664ae on nch2-master-1 Jun 18 22:05:41.117070 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8caf316c-7c60-40fd-8443-e65cd60a474d req-9b4e7a46-c5dc-44fd-bb87-bcea45c88ba1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109908 Jun 18 22:05:41.119855 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 563/1160] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:05:41.204652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:41.206156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:41.220835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.221481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.222382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.223063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.442619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:41.461900 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bdaa618e-40d8-422b-a6ba-a2d9eb7be285 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.541769 Jun 18 22:05:41.462612 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 598/1161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:40 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:41.467960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:41.468785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:41.489972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.491413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.493003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.493731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.550735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:41.564794 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-955ebd9c-06fa-4484-abb3-59d64f07b645 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.364682 Jun 18 22:05:41.566871 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 564/1162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:41 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:41.788472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:41.800466 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7bc8917-d0af-4b99-8c5e-377e9e2fd746 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.336647 Jun 18 22:05:41.805734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 599/1163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:41 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:41.925721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:41.926357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:41.941595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.942062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.942879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.943316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.950889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:41.951626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:41.955364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=20 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:41.960876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.961334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:41.962802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:41.963623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:42.598853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:42.653909 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4497583b-60a9-4e56-8fee-79f806235240 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.728366 Jun 18 22:05:42.659290 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 565/1164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:41 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:42.665281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:42.680261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:42.690823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:42.706366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:42.707253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:42.708385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:42.709170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:42.709482 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-abd3f028-99b4-48bc-ac53-94d0218c839b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.756655 Jun 18 22:05:42.713805 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 600/1165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:41 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:42.725495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:42.726460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:42.742253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:42.743019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:42.744431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:42.744968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.039241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:43.045285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:43.050568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:43.051742 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ec9805b-3f87-4581-828e-5196f14c978c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.336706 Jun 18 22:05:43.054444 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 601/1166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:42 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:43.057789 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3627cca4-4437-467a-96c8-0b234c18a9a8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.397028 Jun 18 22:05:43.058522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 566/1167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:42 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:43.065797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:43.067388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:43.077107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.077652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.078536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.079033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.257937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:43.279872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-46b52575-8f01-4cb7-b088-de19330f02b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.219620 Jun 18 22:05:43.290649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 602/1168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:43 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:43.412696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3bdb787c-de61-4349-9f6e-0645af1a4318 req-78c9a814-c157-4af6-beb5-a14d0a60792b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "980110ca-e679-4848-9c62-97f89f2949e9", "name": "network-vif-plugged", "status": "completed", "tag": "72a92448-3cc1-4a92-865f-530516163c9b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:43.426939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3bdb787c-de61-4349-9f6e-0645af1a4318 req-78c9a814-c157-4af6-beb5-a14d0a60792b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.427390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3bdb787c-de61-4349-9f6e-0645af1a4318 req-78c9a814-c157-4af6-beb5-a14d0a60792b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.454503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:43.463654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3bdb787c-de61-4349-9f6e-0645af1a4318 req-78c9a814-c157-4af6-beb5-a14d0a60792b service nova] Creating event network-vif-plugged:72a92448-3cc1-4a92-865f-530516163c9b for instance 980110ca-e679-4848-9c62-97f89f2949e9 on nch1-master-1 Jun 18 22:05:43.479869 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3bdb787c-de61-4349-9f6e-0645af1a4318 req-78c9a814-c157-4af6-beb5-a14d0a60792b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069584 Jun 18 22:05:43.481854 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 567/1169] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:43.675917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:43.676720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:43.687196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.687586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.688381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.689384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.734866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:43.736053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:43.751081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.756751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.758220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:43.758916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:43.928481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=24 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:43.962579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:43.975130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c636ccd3-6b6a-43e5-985a-7edc778d41be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.302315 Jun 18 22:05:43.975780 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 603/1170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:43 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:44.041414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:44.049644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-00fc9ceb-e8c1-422e-a072-a5cfa76c89b9 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.320530 Jun 18 22:05:44.055194 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 568/1171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:43 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:44.070885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:44.071671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:44.078542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:44.078944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:44.079632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:44.079797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:44.080931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:44.081798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:44.087898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:44.088493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:44.089429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:44.089925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:44.332630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:44.345722 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6444a87f-4cc6-4de4-bd2f-5489c139cfd8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.271352 Jun 18 22:05:44.346325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 569/1172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:44 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:44.351034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:44.353215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:44.364517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:44.378409 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40906e09-609c-4e22-aa78-f1289796c920 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.313430 Jun 18 22:05:44.379355 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 604/1173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:44 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:44.380045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:44.380762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:44.384397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:44.385144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:44.545791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:44.554490 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a114da0-4574-4290-a607-6b35eab920a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.207091 Jun 18 22:05:44.555490 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 570/1174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:44 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:44.992389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:44.993328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:45.000613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.001402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.002399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.003006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.076339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:45.084904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:45.096945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.097727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.098736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.099514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.303303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:45.319699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e016fa18-0563-4c7f-9943-95c3c4358ea5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1315 microversion: 2.1 time: 0.331210 Jun 18 22:05:45.323436 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 605/1175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:44 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:45.333143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:45.341557 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d9cd8c2-65f3-4001-8457-f56623b7990f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.278355 Jun 18 22:05:45.342154 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 571/1176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:45 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:45.374718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:45.375585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:45.383973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.384930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.386478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.387009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.399206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:45.404744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:45.423272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.424446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.425493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.428522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.695498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:45.699209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:45.710493 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f528de4a-f92f-47fb-973c-48ccfa0668bc tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.317309 Jun 18 22:05:45.712187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a6c7f30-e5a3-4d09-b4d9-04f22891b347 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.345042 Jun 18 22:05:45.712846 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 606/1177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:45 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:45.719098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:45.719880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:45.720245 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 572/1178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:45 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:45.729495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.729993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.730828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:45.731261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:45.891056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:45.899861 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c41a971c-a3f8-4ce6-89a6-8a1c4c8b1f0b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.185748 Jun 18 22:05:45.909910 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 607/1179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:45 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:46.337362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:46.338193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:46.346091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.346635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.347523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.348022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.358713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:46.359272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:46.376612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.377181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.378041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.378725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.590960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:46.599699 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ce378ab-6801-4297-8126-2d5dff112f86 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1501 microversion: 2.1 time: 0.266325 Jun 18 22:05:46.610579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:46.612600 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 573/1180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:46 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:46.617821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:46.618565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:46.619448 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6458c73a-309e-4660-9f7f-8f72b4b3de30 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.264614 Jun 18 22:05:46.620805 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 608/1181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:46 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:46.626113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.626563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.627360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.627796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.657218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:05:46.730589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:46.731461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:46.743609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.744197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.745015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.745993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.788260 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6761d67f-f85e-42c1-908a-e8ab2afc4c81 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 204 len: 0 microversion: 2.1 time: 0.173837 Jun 18 22:05:46.793372 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 574/1182] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:05:46 2022] DELETE /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:05:46.800426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:46.801221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:46.809195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.809721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.810895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:46.811543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:46.980944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:46.991480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-48c8200d-6446-42a8-b501-25c13efdb0a0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.266206 Jun 18 22:05:46.992091 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 609/1183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:46 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:47.001283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:47.003716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:47.009880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.010565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.011514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.012110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.045887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:47.056684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1129e1ce-2beb-46f6-994d-e6e4c8c415b0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.261646 Jun 18 22:05:47.058070 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 575/1184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:46 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:47.069616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:47.070602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:47.078320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.078774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.079652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.080734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.220910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:47.237002 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4f711bd4-5aa4-4bdd-983c-e2acb4868d8b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1507 microversion: 2.1 time: 0.243798 Jun 18 22:05:47.238109 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 610/1185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:46 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:47.303180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:47.312648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0e998ddf-b244-4a00-9881-eef7700d31e3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.253500 Jun 18 22:05:47.314081 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 576/1186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:47 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:47.638892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:47.639438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:47.646995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.647451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.648381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.648982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.666157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:47.803428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:47.811529 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7222c632-edc9-4282-ae39-56aee546675c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.176742 Jun 18 22:05:47.812333 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 611/1187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:47 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:47.903645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e7c81484-b43c-4daf-8241-e858ff11f785 req-b7f42a7f-2a39-4d93-ae55-7a391e7db5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869eea9f-3a55-41e5-a036-656377f664ae", "name": "network-vif-plugged", "status": "completed", "tag": "3546b8cb-91fd-4c67-b8ea-9dbdc007acf3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:47.915920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e7c81484-b43c-4daf-8241-e858ff11f785 req-b7f42a7f-2a39-4d93-ae55-7a391e7db5a3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:47.917334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e7c81484-b43c-4daf-8241-e858ff11f785 req-b7f42a7f-2a39-4d93-ae55-7a391e7db5a3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:47.930739 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e7c81484-b43c-4daf-8241-e858ff11f785 req-b7f42a7f-2a39-4d93-ae55-7a391e7db5a3 service nova] Creating event network-vif-plugged:3546b8cb-91fd-4c67-b8ea-9dbdc007acf3 for instance 869eea9f-3a55-41e5-a036-656377f664ae on nch2-master-1 Jun 18 22:05:47.936467 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e7c81484-b43c-4daf-8241-e858ff11f785 req-b7f42a7f-2a39-4d93-ae55-7a391e7db5a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037974 Jun 18 22:05:47.937481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 577/1188] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:48.008270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:48.009425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:48.016553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.016553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.017761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.017861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.077513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:48.085971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:48.100016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.103214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.104195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.105053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.292550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:48.332701 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4f479bf2-1be4-4488-8f51-0a36dc39c10a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.328043 Jun 18 22:05:48.334072 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 612/1189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:48 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:48.342201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:48.343068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:48.351323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.351951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.352971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.353532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.361566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:48.371709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17c9b792-c718-4333-8e21-42f8df3a7ae2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.298632 Jun 18 22:05:48.372998 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 578/1190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:48 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:48.380561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:48.381563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:48.388574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:48.390715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.391385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.392503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.393202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.586297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:48.597656 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24addf02-a70e-4875-ae8b-cc5071ac80d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1507 microversion: 2.1 time: 0.262103 Jun 18 22:05:48.599136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 613/1191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:48 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:48.612237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:48.620161 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a640605-7c0f-4fbf-8a18-758a03e92626 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1308 microversion: 2.1 time: 0.245387 Jun 18 22:05:48.620893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 579/1192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:48 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:48.829894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:48.830586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:48.837802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.838285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.839123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:48.839548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:48.979017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:48.987055 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a41afee-dc37-4213-b7dc-e14296768f6a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.161354 Jun 18 22:05:48.993672 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 614/1193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:48 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:49.351568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:49.352354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:49.360324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.360983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.361959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.362754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.389915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:49.390555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:49.399224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.399824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.400725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.403196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.659259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:49.667297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a37b378-a6cc-4968-a628-8cd5865ad1c4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.319997 Jun 18 22:05:49.671432 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 580/1194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:49 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:49.678461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:49.684557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:49.692286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.692509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:49.693129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.694232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.695009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.705179 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-648b0629-dab4-41e4-9c81-111d808c1595 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.319356 Jun 18 22:05:49.708031 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 615/1195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:49 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:49.720308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:49.722113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:49.738387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.739186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:49.740431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:49.741171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.000790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:50.011391 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0516e943-e2fb-46de-8d07-95f556b9972b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1507 microversion: 2.1 time: 0.338510 Jun 18 22:05:50.014668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 581/1196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:49 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1507 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:50.020623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-da43e9c1-4a46-4131-8edc-c57a159712dd req-9412894f-8bf8-4692-b3be-a1342184b732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d436e95-9552-4166-af2f-4299bfcce1d4", "name": "network-vif-plugged", "status": "completed", "tag": "87ec2284-fa7d-4ce6-8978-c5e46a70d113"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:50.047430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:50.052286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-da43e9c1-4a46-4131-8edc-c57a159712dd req-9412894f-8bf8-4692-b3be-a1342184b732 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.061119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-da43e9c1-4a46-4131-8edc-c57a159712dd req-9412894f-8bf8-4692-b3be-a1342184b732 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.080663 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b93f5d48-930d-48ce-950e-5e7c713d3daf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1487 microversion: 2.1 time: 0.367921 Jun 18 22:05:50.082554 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 616/1197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:49 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1487 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:50.110399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:50.114812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:50.132998 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-da43e9c1-4a46-4131-8edc-c57a159712dd req-9412894f-8bf8-4692-b3be-a1342184b732 service nova] Creating event network-vif-plugged:87ec2284-fa7d-4ce6-8978-c5e46a70d113 for instance 8d436e95-9552-4166-af2f-4299bfcce1d4 on nch1-master-1 Jun 18 22:05:50.139754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.140727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.141053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.145129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.147825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-da43e9c1-4a46-4131-8edc-c57a159712dd req-9412894f-8bf8-4692-b3be-a1342184b732 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128699 Jun 18 22:05:50.148773 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 582/1198] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:50.199620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:50.200265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:50.230180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.233469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.236196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.236651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.318913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lazy-loading 'flavor' on Instance uuid 869eea9f-3a55-41e5-a036-656377f664ae {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:05:50.401152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:50.486681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:50.494918 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b27cae2e-9252-4faf-8713-5c786827eb9d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.411203 Jun 18 22:05:50.495986 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 617/1199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:50 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:50.513932 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-696dd15e-c3ec-4edc-9d74-caeeaa123aae tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae/action" status: 202 len: 0 microversion: 2.1 time: 0.363652 Jun 18 22:05:50.517517 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 583/1200] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:50 2022] POST /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:50.523601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:50.524804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:50.533668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.534430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.535292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.535837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.675986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:50.689140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:50.690033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:50.694940 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e116779d-3869-4af7-bd16-0afba6bfbb0d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1495 microversion: 2.1 time: 0.175776 Jun 18 22:05:50.700538 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 618/1201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:50 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1495 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:50.702690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.703347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.704280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.705054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.725958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:50.726590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:50.733580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.734166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.735002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:50.735448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:50.963977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:50.990008 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11283045-0a10-49ba-998e-3eb7f9de6ac6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.305593 Jun 18 22:05:51.000472 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 584/1202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:50 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:51.028462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:51.030916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:51.043203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.043672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:51.063493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.064315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:51.118592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:51.132912 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7697472-b9b4-41df-aa1d-52f966a2cb43 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.409064 Jun 18 22:05:51.134783 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 619/1203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:50 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:51.167100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-341ea248-9137-4cdb-8bc7-61755226ae21 req-afaebcbf-0380-4030-b431-2c89970df4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "980110ca-e679-4848-9c62-97f89f2949e9", "name": "network-vif-deleted", "tag": "72a92448-3cc1-4a92-865f-530516163c9b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:51.177302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-341ea248-9137-4cdb-8bc7-61755226ae21 req-afaebcbf-0380-4030-b431-2c89970df4b8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.178146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-341ea248-9137-4cdb-8bc7-61755226ae21 req-afaebcbf-0380-4030-b431-2c89970df4b8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:51.187706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:51.194947 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-341ea248-9137-4cdb-8bc7-61755226ae21 req-afaebcbf-0380-4030-b431-2c89970df4b8 service nova] Creating event network-vif-deleted:72a92448-3cc1-4a92-865f-530516163c9b for instance 980110ca-e679-4848-9c62-97f89f2949e9 on nch1-master-1 Jun 18 22:05:51.203213 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0a0c496-d069-4ca7-8072-5226c9978803 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1465 microversion: 2.1 time: 0.178680 Jun 18 22:05:51.204183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 585/1204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:51 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:51.209621 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-341ea248-9137-4cdb-8bc7-61755226ae21 req-afaebcbf-0380-4030-b431-2c89970df4b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046069 Jun 18 22:05:51.210545 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 620/1205] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:51.513482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:51.514896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:51.522654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.523023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:51.523982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.524601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:51.714301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:51.715782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:51.731208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.735321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:51.739448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:51.741714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.042189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:52.050043 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-abb2a684-2621-4233-9b3b-9b3ab0775643 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 200 len: 1478 microversion: 2.1 time: 0.341647 Jun 18 22:05:52.055637 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 621/1206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:51 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 1478 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:52.059355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:52.060524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:52.061278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:52.068500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.069006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.069644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c45aa8c4-dc26-4a19-a128-f4a1008d2947 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.560746 Jun 18 22:05:52.069845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.070247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 586/1207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:51 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:52.070356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.090143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2103410669"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:52.091386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:52.101496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.101955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.102751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.103213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.272205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:52.284292 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81415d5e-9feb-4d35-959d-25664a4464df tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.226770 Jun 18 22:05:52.293974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 622/1208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:52 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:52.293974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:52.293974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:52.302051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.302880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.303880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.304732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.534346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:52.551894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-334dacf3-905a-464c-8057-e726148a9921 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1316 microversion: 2.1 time: 0.263310 Jun 18 22:05:52.563725 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 623/1209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:52 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:52.575925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:52.578250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:52.593262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.595159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.597528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.599467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.680774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:52.681264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:52.681727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'fault' on Instance uuid 980110ca-e679-4848-9c62-97f89f2949e9 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:05:52.761415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:52.761981 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fdfa4e37-4c02-46ec-9779-b5d6ec46ed13 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae/action" status: 202 len: 0 microversion: 2.1 time: 0.690454 Jun 18 22:05:52.762630 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 587/1210] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:52 2022] POST /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:05:52.774185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c38e4c2-a2e2-4ce7-81c5-1c1bf99f2262 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 200 len: 1305 microversion: 2.1 time: 0.208637 Jun 18 22:05:52.776177 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 624/1211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:52 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 1305 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:52.782760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc7e198c-2ce2-4c3a-9b98-a1d379f3ccf2 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1438b0d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:52.861738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc7e198c-2ce2-4c3a-9b98-a1d379f3ccf2 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.090672 Jun 18 22:05:52.862605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 588/1212] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:52 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:53.040111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0de910b8-d6f1-4e37-a4b1-772dca81f9f9 req-f6a2a819-4c11-40bc-86af-0b79c2d35287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c3783-668b-445a-898a-2cfba0c43440", "name": "network-vif-plugged", "status": "completed", "tag": "46d3c9cc-13a1-47b0-80a8-628b828571fd"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:53.050733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0de910b8-d6f1-4e37-a4b1-772dca81f9f9 req-f6a2a819-4c11-40bc-86af-0b79c2d35287 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.051341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0de910b8-d6f1-4e37-a4b1-772dca81f9f9 req-f6a2a819-4c11-40bc-86af-0b79c2d35287 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.065575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0de910b8-d6f1-4e37-a4b1-772dca81f9f9 req-f6a2a819-4c11-40bc-86af-0b79c2d35287 service nova] Creating event network-vif-plugged:46d3c9cc-13a1-47b0-80a8-628b828571fd for instance c63c3783-668b-445a-898a-2cfba0c43440 on nch1-master-1 Jun 18 22:05:53.071502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0de910b8-d6f1-4e37-a4b1-772dca81f9f9 req-f6a2a819-4c11-40bc-86af-0b79c2d35287 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Jun 18 22:05:53.072544 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 625/1213] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:53.092036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:53.092866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:53.113844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.115309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.116298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.117084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.303757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:53.304648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:53.312157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.313062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.313848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.314469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.376799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:53.390802 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18578b28-6d0e-4c51-ab91-26886456d457 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.303470 Jun 18 22:05:53.396741 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 589/1214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:53 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:53.570743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:53.571925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:53.579519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.579740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:53.580453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.581404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.582196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.589149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5913a1a-d401-4b62-88f8-44f8269ec4ec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1317 microversion: 2.1 time: 0.289768 Jun 18 22:05:53.598909 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 626/1215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:53 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:53.792256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:53.793652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:53.801740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.802707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.803835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.804264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.816094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:53.820233 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 HTTP/1.1 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '980110ca-e679-4848-9c62-97f89f2949e9'} Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:53.822146 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:05:53.827064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:53.828776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:53.829856 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee9c932d-867f-4481-9c1a-b2ee5f512dc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 404 len: 111 microversion: 2.1 time: 0.041946 Jun 18 22:05:53.842244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 627/1216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:53 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:05:53.848252 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9a636a0-3371-4c7e-bc11-16ba7bd1e31a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1504 microversion: 2.1 time: 0.281471 Jun 18 22:05:53.849499 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 590/1217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:53 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:53.864674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1257766790"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:53.865509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:53.876469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ee6ed5c-d253-4f58-b770-01871ae41a3e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14391940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:53.883871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.884658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.886837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:53.887682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:53.968157 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ee6ed5c-d253-4f58-b770-01871ae41a3e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.095612 Jun 18 22:05:53.970258 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 591/1218] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:53 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:05:54.047382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1785187459", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:54.137166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:05:54.330118 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.network.security_group_api [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Adding security group 7098ed53-0267-4ba7-8020-b7e0a419346d to port 87ec2284-fa7d-4ce6-8978-c5e46a70d113 Jun 18 22:05:55.380752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:05:55.382921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:05:55.384436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:05:55.385821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:05:55.386398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:05:55.404259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:55.405252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:55.406353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:55.407045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:55.450385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f4edf59c-521d-45a9-aebb-6d28a8210d96 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4/action" status: 202 len: 0 microversion: 2.1 time: 1.589568 Jun 18 22:05:55.451122 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 628/1219] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:53 2022] POST /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4/action => generated 0 bytes in 1591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:55.461564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:55.462756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:55.496201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:55.504756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:55.506494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:55.507229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:55.515887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:05:55.526419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:05:55.579829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:05:55.588709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:05:55.720554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bcbfe4f0-3ffc-4bec-b102-ca35c7c33477 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677181 Jun 18 22:05:55.734729 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 592/1220] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:05:55.742054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:55.749538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:55.773206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:55.773958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:55.776639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:55.777701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:55.868185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:55.878568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7922c98-1107-4a9a-8cad-68a6fe13d608 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.421180 Jun 18 22:05:55.884683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 629/1221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:55 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:55.901086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-abd6b795-07a6-40ab-96f6-60483baa5f4d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea141fe430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:55.991123 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-abd6b795-07a6-40ab-96f6-60483baa5f4d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.104795 Jun 18 22:05:55.991867 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 630/1222] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:55 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:55.996561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-124809240"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:56.007598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:56.028602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:56.038703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:56.040083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:56.040556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:56.052560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:56.221107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:56.230407 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3e53d12-4792-487c-b910-e386d01bc190 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1467 microversion: 2.1 time: 0.494483 Jun 18 22:05:56.235028 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 593/1223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:55 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1467 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:56.247096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ebec617b-ab44-4852-bc9f-a1e8d2a0c00b req-bf9e2330-0f9b-408f-aa88-291d31a7c476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d436e95-9552-4166-af2f-4299bfcce1d4", "tag": "87ec2284-fa7d-4ce6-8978-c5e46a70d113"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:56.263535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ebec617b-ab44-4852-bc9f-a1e8d2a0c00b req-bf9e2330-0f9b-408f-aa88-291d31a7c476 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:56.265535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ebec617b-ab44-4852-bc9f-a1e8d2a0c00b req-bf9e2330-0f9b-408f-aa88-291d31a7c476 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:56.300563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ebec617b-ab44-4852-bc9f-a1e8d2a0c00b req-bf9e2330-0f9b-408f-aa88-291d31a7c476 service nova] Creating event network-changed:87ec2284-fa7d-4ce6-8978-c5e46a70d113 for instance 8d436e95-9552-4166-af2f-4299bfcce1d4 on nch1-master-1 Jun 18 22:05:56.316567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ebec617b-ab44-4852-bc9f-a1e8d2a0c00b req-bf9e2330-0f9b-408f-aa88-291d31a7c476 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078025 Jun 18 22:05:56.333446 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 594/1224] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:56.351203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1b6150e-feb7-4c98-9ef8-dad10c9b1efa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:56.354076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1b6150e-feb7-4c98-9ef8-dad10c9b1efa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:56.460561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1b6150e-feb7-4c98-9ef8-dad10c9b1efa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:56.470624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1b6150e-feb7-4c98-9ef8-dad10c9b1efa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1215 microversion: 2.1 time: 0.135426 Jun 18 22:05:56.482671 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 595/1225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:56 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:56.482671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:56.482671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:56.502790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:56.503365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:56.504310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:56.506083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:56.517259 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.network.security_group_api [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Adding security group 182ddbb3-0a7a-4617-94ec-6a507d336c65 to port 87ec2284-fa7d-4ce6-8978-c5e46a70d113 Jun 18 22:05:57.050910 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a60e8aa8-4c31-43e5-a84e-9e88f40b9495 tempest-ServersOnMultiNodesTest-1873501067 tempest-ServersOnMultiNodesTest-1873501067-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1618 microversion: 2.1 time: 0.573889 Jun 18 22:05:57.052772 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 596/1226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:56 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1618 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:57.076753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:57.079278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:57.088018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.088687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.089923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.090383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.392387 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-898f58f3-4687-49c5-90b3-a1a221a13134 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4/action" status: 202 len: 0 microversion: 2.1 time: 1.399406 Jun 18 22:05:57.393459 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 631/1227] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:05:55 2022] POST /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4/action => generated 0 bytes in 1401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:57.399148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e77aa33-2d13-4f6c-92b5-859fff673bc7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1454e0d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:57.466210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:57.480470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f14ec6f-9a6b-4948-a9fb-7aedb930e642 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.423261 Jun 18 22:05:57.484195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 597/1228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:57 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:57.490247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:57.494838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:57.500841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e77aa33-2d13-4f6c-92b5-859fff673bc7 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.105451 Jun 18 22:05:57.502116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.502796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.504056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.504703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.508454 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 632/1229] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:57 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:57.540369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:57.541249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:57.547688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:05:57.584663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.586294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.587892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.590753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.806831 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5fb7757c-7d3b-4003-b0b8-f07e498f223c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 204 len: 0 microversion: 2.1 time: 0.320496 Jun 18 22:05:57.809163 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 598/1230] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:05:57 2022] DELETE /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:05:57.833146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:57.834978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:57.860560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.866825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.869241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:57.869865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:57.986737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7224393-1950-4971-9d6b-a76372f15b8e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.476753 Jun 18 22:05:57.987906 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 633/1231] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:05:57 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4/os-security-groups => generated 1157 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:57.992535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:57.993408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:58.002596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:58.008861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:58.009631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:58.010631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:58.011220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:58.015849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-62271891-e2e9-4274-bb1c-87ef4f72dcb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1273 microversion: 2.1 time: 0.203902 Jun 18 22:05:58.019465 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 599/1232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:57 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:58.034779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-20ece50c-3f58-446c-a356-84cc1d2e0f5d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea1438b8b0>, body: {"security_group": {"name": " tempest-securitygroup -1442573955 ", "description": "tempest-description-1010911156"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:58.257167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:58.266427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c34b6809-968e-459f-95bc-ab293f1288a8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1473 microversion: 2.1 time: 0.277482 Jun 18 22:05:58.269779 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 634/1233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:57 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1473 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:58.411100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-236dd019-b083-4800-a476-b2da3d4dee0a req-5817d91c-c5db-42fb-a822-683494845554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d436e95-9552-4166-af2f-4299bfcce1d4", "tag": "87ec2284-fa7d-4ce6-8978-c5e46a70d113"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:58.419889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-236dd019-b083-4800-a476-b2da3d4dee0a req-5817d91c-c5db-42fb-a822-683494845554 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:58.421265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-236dd019-b083-4800-a476-b2da3d4dee0a req-5817d91c-c5db-42fb-a822-683494845554 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:58.435773 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-236dd019-b083-4800-a476-b2da3d4dee0a req-5817d91c-c5db-42fb-a822-683494845554 service nova] Creating event network-changed:87ec2284-fa7d-4ce6-8978-c5e46a70d113 for instance 8d436e95-9552-4166-af2f-4299bfcce1d4 on nch1-master-1 Jun 18 22:05:58.441449 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-236dd019-b083-4800-a476-b2da3d4dee0a req-5817d91c-c5db-42fb-a822-683494845554 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035042 Jun 18 22:05:58.443066 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 635/1234] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:58.499733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:58.500453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:58.506417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:58.511268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:58.512049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:58.513268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:58.514051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:58.795554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-20ece50c-3f58-446c-a356-84cc1d2e0f5d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.774694 Jun 18 22:05:58.796166 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 600/1235] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:05:58 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:58.800959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7341ce63-1c92-4283-bd72-96480c5a0eef tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea144bd1f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:58.830161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:58.840292 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-770ca82d-87c8-4165-aa1a-473fdc629214 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.345296 Jun 18 22:05:58.852297 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 636/1236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:58 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:58.868052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d373d83a-ec90-471a-976b-9e3842e30c41 req-779df14d-81dd-4064-9bda-be4312622278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869eea9f-3a55-41e5-a036-656377f664ae", "name": "network-vif-plugged", "status": "completed", "tag": "3546b8cb-91fd-4c67-b8ea-9dbdc007acf3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:58.872663 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7341ce63-1c92-4283-bd72-96480c5a0eef tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.073830 Jun 18 22:05:58.874722 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 601/1237] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:58 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:58.888846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d373d83a-ec90-471a-976b-9e3842e30c41 req-779df14d-81dd-4064-9bda-be4312622278 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:58.889656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d373d83a-ec90-471a-976b-9e3842e30c41 req-779df14d-81dd-4064-9bda-be4312622278 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:58.891292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6073204-e582-4458-98a6-efe3e314c2f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14733ee0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:58.925434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d373d83a-ec90-471a-976b-9e3842e30c41 req-779df14d-81dd-4064-9bda-be4312622278 service nova] Creating event network-vif-plugged:3546b8cb-91fd-4c67-b8ea-9dbdc007acf3 for instance 869eea9f-3a55-41e5-a036-656377f664ae on nch2-master-1 Jun 18 22:05:58.938051 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d373d83a-ec90-471a-976b-9e3842e30c41 req-779df14d-81dd-4064-9bda-be4312622278 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084080 Jun 18 22:05:58.940653 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 637/1238] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:58.974259 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f6073204-e582-4458-98a6-efe3e314c2f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf" status: 200 len: 224 microversion: 2.1 time: 0.098117 Jun 18 22:05:58.975414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 602/1239] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:05:58 2022] GET /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf => generated 224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:58.987559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8739185-ba3b-4dd6-96cf-202d15093fde tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea141fe430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:59.044530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:59.045217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:59.061186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:59.064538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:59.065621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:59.068160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:59.079618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:05:59.199385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:59.213242 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c904bc63-7943-4f3c-a736-9b61caf9b3ba tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1273 microversion: 2.1 time: 0.182128 Jun 18 22:05:59.214153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 603/1240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:59 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:59.284878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:59.285548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:59.300468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:59.301324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:59.303090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:59.304504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:59.514207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d8739185-ba3b-4dd6-96cf-202d15093fde tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf" status: 202 len: 0 microversion: 2.1 time: 0.531121 Jun 18 22:05:59.515109 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 638/1241] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:05:58 2022] DELETE /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:05:59.527537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:05:59.530075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea141b4dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:59.537831 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4bd7131d-28fb-425a-8d2f-bc0f423e00d5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1473 microversion: 2.1 time: 0.257792 Jun 18 22:05:59.548032 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 604/1242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:59 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1473 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:05:59.591451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:05:59.598864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.security_group_api [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 2f3522be-240c-45e3-a894-0f3d19b31edf not found {{(pid=130903) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:05:59.626528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.626528 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf HTTP/1.1 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: exception: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2f3522be-240c-45e3-a894-0f3d19b31edf'} Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:05:59.629576 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] Jun 18 22:05:59.634261 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:05:59.642750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:05:59.642750 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-9c93bd29-2d31-43b3-81d9-a5fda54e4975'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:05:59.648660 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dfae1f2a-80f8-4e1a-a523-7ba7d9845625 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf" status: 404 len: 194 microversion: 2.1 time: 0.129414 Jun 18 22:05:59.657353 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 639/1243] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:05:59 2022] GET /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:05:59.664473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19a253f3-238f-4e5b-b5e6-a5f9ae3fad75 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea143d8670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-309841068", "description": "tempest-description-1707548486"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:05:59.860201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:05:59.860948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:05:59.871444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:59.871894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:59.872785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:05:59.873260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:05:59.914407 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19a253f3-238f-4e5b-b5e6-a5f9ae3fad75 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.256632 Jun 18 22:05:59.915561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 605/1244] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:05:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:05:59.923481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-770f50a2-ed9a-47f5-9454-807ea501bae5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea143e5550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:00.009626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-770f50a2-ed9a-47f5-9454-807ea501bae5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.092165 Jun 18 22:06:00.013903 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 606/1245] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:05:59 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:00.023531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3386d98b-8dc7-43e6-bed7-836af98fbf8c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea143d80d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1939521787", "description": "tempest-description-1420350767"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:00.130891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:00.141358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-df0bf012-097f-405e-854c-270421ddd88f tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.287128 Jun 18 22:06:00.143331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 640/1246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:05:59 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:00.237385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:00.238932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:00.259068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:00.260932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:00.262029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:00.263972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:00.364474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:00.367931 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3386d98b-8dc7-43e6-bed7-836af98fbf8c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.351652 Jun 18 22:06:00.368947 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 607/1247] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:06:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:00.381599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf8aee86-f155-4caf-9e67-10682eac4610 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea14316040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1735707177", "description": "tempest-description-159923335"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:00.393191 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25f6f9e1-f29f-4dff-b635-e5beaea45fc3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1273 microversion: 2.1 time: 0.156097 Jun 18 22:06:00.394081 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 641/1248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:00 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:00.574405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:00.577842 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf8aee86-f155-4caf-9e67-10682eac4610 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.201446 Jun 18 22:06:00.581539 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 608/1249] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:06:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:06:00.583552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:00.594063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1357667a-054a-4c99-a10e-5245d1d8cdb4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14391700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:00.600579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:00.601694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:00.603662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:00.604392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:00.921057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:00.935207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf18ca96-5f0f-4089-acf0-5689eac1f54b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1473 microversion: 2.1 time: 0.376303 Jun 18 22:06:00.953203 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 642/1250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:00 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1473 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:01.032992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e20099ef-ca18-4fab-9b53-56ca570cf848 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14215dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:01.100069 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e20099ef-ca18-4fab-9b53-56ca570cf848 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.075732 Jun 18 22:06:01.101321 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 643/1251] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:01 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:01.159826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:01.161168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:01.177279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.177873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:01.179325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.179569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:01.427893 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1357667a-054a-4c99-a10e-5245d1d8cdb4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.839333 Jun 18 22:06:01.429484 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 609/1252] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:06:00 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:01.434905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f71f7a83-5d7e-4390-b95a-b41c86dbdd24 req-0e1c5129-7fa6-429d-b279-af667bef91eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c3783-668b-445a-898a-2cfba0c43440", "name": "network-vif-deleted", "tag": "46d3c9cc-13a1-47b0-80a8-628b828571fd"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:01.457902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f71f7a83-5d7e-4390-b95a-b41c86dbdd24 req-0e1c5129-7fa6-429d-b279-af667bef91eb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.458631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f71f7a83-5d7e-4390-b95a-b41c86dbdd24 req-0e1c5129-7fa6-429d-b279-af667bef91eb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:01.495663 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f71f7a83-5d7e-4390-b95a-b41c86dbdd24 req-0e1c5129-7fa6-429d-b279-af667bef91eb service nova] Creating event network-vif-deleted:46d3c9cc-13a1-47b0-80a8-628b828571fd for instance c63c3783-668b-445a-898a-2cfba0c43440 on nch1-master-1 Jun 18 22:06:01.518007 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f71f7a83-5d7e-4390-b95a-b41c86dbdd24 req-0e1c5129-7fa6-429d-b279-af667bef91eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086619 Jun 18 22:06:01.519464 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 610/1253] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:01.532605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:01.536410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:01.559959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.560907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:01.567680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.568518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:01.737383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:01.757489 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b176181e-c106-45db-b52c-6140e0f17e9b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.600864 Jun 18 22:06:01.758467 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 644/1254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:01 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:01.765458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a496f4b4-55b3-41ec-88c9-16848c80264e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14215ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:01.887250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:01.895246 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc784d73-e003-4738-98a1-0af9b0213c20 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.373047 Jun 18 22:06:01.896119 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 611/1255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:01 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:01.953284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:01.953918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:01.969264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.969716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:01.970502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:01.970938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:02.081589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:02.082337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:02.083662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid c63c3783-668b-445a-898a-2cfba0c43440 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:02.216953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:02.241125 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1e24bff-0350-4ec1-87cf-4d6de70042d8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 200 len: 1307 microversion: 2.1 time: 0.291727 Jun 18 22:06:02.247374 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 612/1256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:01 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:02.255700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a712528-7cfd-4300-b28d-499e8475a33a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1438b430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:02.332227 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a712528-7cfd-4300-b28d-499e8475a33a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.083399 Jun 18 22:06:02.333357 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 613/1257] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:02 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:02.416487 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a496f4b4-55b3-41ec-88c9-16848c80264e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49" status: 202 len: 0 microversion: 2.1 time: 0.655922 Jun 18 22:06:02.417381 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 645/1258] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:01 2022] DELETE /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49 => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:02.425509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea144f3160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:02.478619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:02.479647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group d74acec4-ebbf-49aa-835e-df320edebc49 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:02.479647 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.479647 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49 HTTP/1.1 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd74acec4-ebbf-49aa-835e-df320edebc49'} Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:02.483185 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-6e89e448-ca5b-4949-ac1b-6c6aff0bce5a'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dad92fc9-bb83-4e7c-afea-f14b01488b9c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49" status: 404 len: 194 microversion: 2.1 time: 0.063283 Jun 18 22:06:02.487376 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 614/1259] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:06:02 2022] GET /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:02.493419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-539fb123-ee37-4262-92da-b93815244209 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14296700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:02.777874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:02.778698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:02.782097 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-539fb123-ee37-4262-92da-b93815244209 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037" status: 202 len: 0 microversion: 2.1 time: 0.292372 Jun 18 22:06:02.782930 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 646/1260] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:02 2022] DELETE /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:06:02.787720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:02.788365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:02.789377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:02.789963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:02.796992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea141fee50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:02.868099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:02.869541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.security_group_api [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 61e082f0-c880-4dfe-baef-fca3c32b5037 not found {{(pid=130903) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:02.870476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.870476 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037 HTTP/1.1 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: exception: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '61e082f0-c880-4dfe-baef-fca3c32b5037'} Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:02.875286 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-32164165-4790-485b-83b7-278ec8be99ce'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c0b545cf-b3b3-442d-a3d3-dd19931b8f6b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037" status: 404 len: 194 microversion: 2.1 time: 0.091953 Jun 18 22:06:02.887135 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 647/1261] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:06:02 2022] GET /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:02.895550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-289e04d4-160f-4cc3-a3b5-dc0fc8af2d56 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea149494c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.122342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:03.155484 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-959d2378-d345-4001-bf73-5460b6f83e28 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.383888 Jun 18 22:06:03.156264 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 615/1262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:02 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:03.170976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.171871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:03.178789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.179644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.180668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.181366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.444260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:03.454724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43ed4623-313d-4814-b153-ee75b4fa6a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.287705 Jun 18 22:06:03.466807 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 616/1263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:03 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:03.495494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.498779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: c63c3783-668b-445a-898a-2cfba0c43440] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:03.505547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-289e04d4-160f-4cc3-a3b5-dc0fc8af2d56 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b" status: 202 len: 0 microversion: 2.1 time: 0.619016 Jun 18 22:06:03.507260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 648/1264] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:02 2022] DELETE /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:03.515179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e230b74a-65e1-4e33-8290-8584146ceed1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1455ce50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.532145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.532582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.533501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.533850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.559453 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance c63c3783-668b-445a-898a-2cfba0c43440 could not be found. Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 HTTP/1.1 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance c63c3783-668b-445a-898a-2cfba0c43440 could not be found. Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'c63c3783-668b-445a-898a-2cfba0c43440'} Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63c3783-668b-445a-898a-2cfba0c43440 could not be found. Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63c3783-668b-445a-898a-2cfba0c43440 could not be found. Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:03.562677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63c3783-668b-445a-898a-2cfba0c43440 could not be found. Jun 18 22:06:03.567547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.570383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance c63c3783-668b-445a-898a-2cfba0c43440 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:03.572194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4fa128cd-db43-49d0-b184-9de02af8349a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440" status: 404 len: 111 microversion: 2.1 time: 0.103841 Jun 18 22:06:03.573224 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 617/1265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:03 2022] GET /compute/v2.1/servers/c63c3783-668b-445a-898a-2cfba0c43440 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:03.579971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea144f3550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.622094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:03.623051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 197bdacb-21d1-454c-921b-aa54ef220f8b not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:03.623935 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.623935 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b HTTP/1.1 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '197bdacb-21d1-454c-921b-aa54ef220f8b'} Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:03.626099 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] Jun 18 22:06:03.629942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:03.635306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:03.635306 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-c3d0d5e1-a941-405d-ae85-3b5e4ec992ff'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:03.636559 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64d76745-0253-4052-9bd9-73691cf60465 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b" status: 404 len: 194 microversion: 2.1 time: 0.062169 Jun 18 22:06:03.637270 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e230b74a-65e1-4e33-8290-8584146ceed1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.125179 Jun 18 22:06:03.637620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 618/1266] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:06:03 2022] GET /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:03.638045 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 649/1267] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:03 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:03.646143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb2c7f44-ac93-46b6-8ca3-bc0aac356510 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea145c9160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.650577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.651241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:03.686956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.688199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.689096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.689547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.763986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:03.883634 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-933dc8f4-2c2f-4ad9-a641-b8da2fdc9966 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 204 len: 0 microversion: 2.1 time: 0.237912 Jun 18 22:06:03.888350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 650/1268] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:03 2022] DELETE /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:03.894558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:03.895646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:03.899892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb2c7f44-ac93-46b6-8ca3-bc0aac356510 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.257581 Jun 18 22:06:03.900872 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 619/1269] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:06:03 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:03.914550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.921404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be3f4d31-33bf-47dd-ae34-5ebc401bad19 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea145e03a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1428980610", "description": "tempest-description-1930281279"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:03.922746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:03.924529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:03.925645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:04.196721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:04.205087 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2ec00d9-fc1f-4f9b-9623-ac9cc1ddbdcf tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1471 microversion: 2.1 time: 0.314950 Jun 18 22:06:04.219600 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 651/1270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:03 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:04.236677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5ac6d3da-32bf-4a43-b113-f14b37b434e3 req-54279d3e-0988-42b6-854f-5fc6b86533cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3", "tag": "1daf0319-8098-4062-9abb-2e8692b60bc6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:04.255794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5ac6d3da-32bf-4a43-b113-f14b37b434e3 req-54279d3e-0988-42b6-854f-5fc6b86533cd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:04.257215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5ac6d3da-32bf-4a43-b113-f14b37b434e3 req-54279d3e-0988-42b6-854f-5fc6b86533cd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:04.296538 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5ac6d3da-32bf-4a43-b113-f14b37b434e3 req-54279d3e-0988-42b6-854f-5fc6b86533cd service nova] Creating event network-changed:1daf0319-8098-4062-9abb-2e8692b60bc6 for instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 on nch1-master-1 Jun 18 22:06:04.308184 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5ac6d3da-32bf-4a43-b113-f14b37b434e3 req-54279d3e-0988-42b6-854f-5fc6b86533cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086776 Jun 18 22:06:04.314377 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 652/1271] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:04.336441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:04.337384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:04.350870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:04.353500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:04.355288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:04.357405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:04.399565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be3f4d31-33bf-47dd-ae34-5ebc401bad19 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.483053 Jun 18 22:06:04.400673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 620/1272] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:06:03 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:04.421022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bbdb1911-7e0e-44a0-8292-faa59b6adf65 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea144bd430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1918996336", "description": "tempest-description-1670886324"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:04.657332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:04.667549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a64976cb-49d7-4ed5-b964-3b6b0d9803c1 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.350103 Jun 18 22:06:04.671393 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 653/1273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:04 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:04.678358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:04.682783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:04.697382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:04.699857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:04.703823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:04.704513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:04.765512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bbdb1911-7e0e-44a0-8292-faa59b6adf65 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.356583 Jun 18 22:06:04.766619 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 621/1274] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:06:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:04.771627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-53094589-b3b0-484c-b959-81391d57f4dc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1438b8b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:04.865346 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-53094589-b3b0-484c-b959-81391d57f4dc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.094111 Jun 18 22:06:04.865972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 622/1275] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:04 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:04.935830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1920047349", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a3a7674f-c3a7-42ae-95e5-bf6ca8c29269"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:04.984109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:04.996730 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c97e3262-7276-45cb-8eb7-c33558902b71 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.323786 Jun 18 22:06:04.999256 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 654/1276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:04 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:05.012527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] validate_networks() for [('a3a7674f-c3a7-42ae-95e5-bf6ca8c29269', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:05.226997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:05.227907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:05.235613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:05.236057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:05.250492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:05.250946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:05.427134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:05.863943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:05.877558 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06e53000-f01c-4955-82a7-cc469782eec8 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1471 microversion: 2.1 time: 0.652576 Jun 18 22:06:05.880215 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 655/1277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:05 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1471 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:05.901352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:05.903206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:05.916771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:05.917557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:05.918782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:05.920001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.006893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:06.007891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:06.008585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:06.009319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:06.009914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:06.035053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.035803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.039052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.041570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.096832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Getting quotas for project 1d3c1a33ed1449bdbec74fb4d3c0784f. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:06.136571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Getting quotas for user 035a5cccca15429e845012dd629d5038 and project 1d3c1a33ed1449bdbec74fb4d3c0784f. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:06.173901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:06.183545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:06.190415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:06.217400 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-21026dac-d6e9-4721-8fa7-e14712bf23a0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.334359 Jun 18 22:06:06.224572 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 656/1278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:05 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:06.302377 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-579d40ad-baf7-4b6d-b073-33916f80f56b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.370472 Jun 18 22:06:06.306127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 623/1279] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:06.319460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aef44dd9-b9a3-4d27-8632-595f4dcc364b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145e0b80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:06.419630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aef44dd9-b9a3-4d27-8632-595f4dcc364b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.111048 Jun 18 22:06:06.426547 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 624/1280] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:06 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:06.441446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:06.443455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:06.454651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.455740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.456721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.457576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.625362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea635e6f-b889-423e-90b3-d6f82d39dfca tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Calling method '.version_select at 0x7fea143770d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:06.732239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:06.754794 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-049244b6-ad6f-4285-a4c2-b0133d90bc9f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.321238 Jun 18 22:06:06.756653 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 625/1281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:06 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:06.768903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b981b8b8-f796-45f7-b069-5bcbed5e90b7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:06.772265 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea635e6f-b889-423e-90b3-d6f82d39dfca tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 371 microversion: 2.1 time: 0.545670 Jun 18 22:06:06.773168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b981b8b8-f796-45f7-b069-5bcbed5e90b7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:06.778129 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 657/1282] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:06:06 2022] GET /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 371 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:06.793471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-42c89b59-9e9a-4db8-ab86-623aba8f85de req-25ccedbd-7063-49b2-8ec4-952bd179762f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16514926-e8ef-4c58-8270-2e0b2cfe0155", "name": "network-vif-deleted", "tag": "c2e80933-8169-4f8d-9654-70ce8d174456"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:06.824840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-42c89b59-9e9a-4db8-ab86-623aba8f85de req-25ccedbd-7063-49b2-8ec4-952bd179762f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.827220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-42c89b59-9e9a-4db8-ab86-623aba8f85de req-25ccedbd-7063-49b2-8ec4-952bd179762f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.850166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-42c89b59-9e9a-4db8-ab86-623aba8f85de req-25ccedbd-7063-49b2-8ec4-952bd179762f service nova] Creating event network-vif-deleted:c2e80933-8169-4f8d-9654-70ce8d174456 for instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 on nch2-master-1 Jun 18 22:06:06.859833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-42c89b59-9e9a-4db8-ab86-623aba8f85de req-25ccedbd-7063-49b2-8ec4-952bd179762f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075368 Jun 18 22:06:06.864891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 658/1283] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:06.874112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-334ec915-99f5-4544-a568-6395d2cf4176 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Action: 'update', calling method: .version_select at 0x7fea142e3430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:06.899282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b981b8b8-f796-45f7-b069-5bcbed5e90b7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:06.917023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b981b8b8-f796-45f7-b069-5bcbed5e90b7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1216 microversion: 2.1 time: 0.158361 Jun 18 22:06:06.918182 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 626/1284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:06 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:06.931473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:06.932648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:06.941772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:06.953461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.956179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.958882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.959730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.987593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334ec915-99f5-4544-a568-6395d2cf4176 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.989155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334ec915-99f5-4544-a568-6395d2cf4176 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:06.990890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334ec915-99f5-4544-a568-6395d2cf4176 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:06.992753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-334ec915-99f5-4544-a568-6395d2cf4176 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.066489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.069659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.071731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid 16514926-e8ef-4c58-8270-2e0b2cfe0155 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:07.157943 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-334ec915-99f5-4544-a568-6395d2cf4176 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 328 microversion: 2.1 time: 0.290154 Jun 18 22:06:07.170683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 659/1285] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:06 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 328 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:07.171066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:07.171066 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c976c30-350e-43b4-877d-bee060fe5007 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 200 len: 1306 microversion: 2.1 time: 0.249647 Jun 18 22:06:07.180485 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 627/1286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:06 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 1306 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:07.242768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:07.243729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:07.255408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.255865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.256729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.257265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.262254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:07.488081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-237076222", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:07.505966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:07.517597 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fd8cb7e-e3d9-4832-ae42-8a7eb0333be0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.276829 Jun 18 22:06:07.519503 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 660/1287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:07 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:07.525454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fbf031d3-f87c-4407-bf83-4df655d2429b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14377700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:07.608268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:07.624928 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fbf031d3-f87c-4407-bf83-4df655d2429b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.104203 Jun 18 22:06:07.633207 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 661/1288] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:07 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:07.775300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:07.778760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:07.795615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.798138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.801542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.801997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.959954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:07.960703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:07.961391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:07.961956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:07.962528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:07.981011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.981565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:07.985471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:07.985919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.070375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Getting quotas for project d8f8b57202054341bfceac7ac36e6aa2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:08.085616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Getting quotas for user d9fb28e51c6a4d88b03e3c1ed3365756 and project d8f8b57202054341bfceac7ac36e6aa2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:08.103203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:08.113334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41d67754-a9c4-4386-a9e2-fdd3e5d637d5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.343998 Jun 18 22:06:08.115928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.utils [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] cores quota exceeded for d8f8b57202054341bfceac7ac36e6aa2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130902) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 18 22:06:08.117016 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Request method failure captured: Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 144 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkxMu-78CxX4GMLVjbe3HKI1xxXpU-Ib_iIyxyPIR-djAIc80Va7ohjZt42YXikpKgisl5lktpQT1BGnmw8sPfa4kLfJ-ROvDA3J69XyH3GW84_Hxw1slxjjU-EjMlz4g-cy972GGciixhCbwrdgFWAejjpUTGcxAlQhLIMIKbizmJQ Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d8f8b57202054341bfceac7ac36e6aa2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d9fb28e51c6a4d88b03e3c1ed3365756 Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-237076222", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-237076222', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452'}}} Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:06:08.120797 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 18 22:06:08.125062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.129580 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 662/1289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:07 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:08.133843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:08.134144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:08.134531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:08.135108 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14347c76-2dbb-4e28-a0ce-6f6f4e124337 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.777318 Jun 18 22:06:08.135852 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 628/1290] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 779 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:08.146917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.147859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.148804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.149420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.155293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be403405-5fe1-43ba-9078-60b510a5c0ed tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Action: 'update', calling method: .version_select at 0x7fea143d80d0>, body: {"quota_set": {"cores": 20}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:08.249076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:08.262352 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8de3e9e2-6a8f-4ad1-b221-774e92e48935 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1276 microversion: 2.1 time: 0.135145 Jun 18 22:06:08.263025 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 663/1291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:08 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1276 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:08.267673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:08.268288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 16514926-e8ef-4c58-8270-2e0b2cfe0155] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:08.282247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.282708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.283499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.283940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.303293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be403405-5fe1-43ba-9078-60b510a5c0ed tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.305318 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 could not be found. Jun 18 22:06:08.306070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be403405-5fe1-43ba-9078-60b510a5c0ed tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 HTTP/1.1 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 could not be found. Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '16514926-e8ef-4c58-8270-2e0b2cfe0155'} Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 could not be found. Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 could not be found. Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:08.307012 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 could not be found. Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance 16514926-e8ef-4c58-8270-2e0b2cfe0155 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f27d36ea-f341-42d3-8257-25cd553c8218 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155" status: 404 len: 111 microversion: 2.1 time: 0.044416 Jun 18 22:06:08.311697 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 664/1292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:08 2022] GET /compute/v2.1/servers/16514926-e8ef-4c58-8270-2e0b2cfe0155 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:08.315544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be403405-5fe1-43ba-9078-60b510a5c0ed tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.317867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be403405-5fe1-43ba-9078-60b510a5c0ed tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.331917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:08.333083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:08.346374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.346650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.347392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.348148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.376166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:08.462993 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be403405-5fe1-43ba-9078-60b510a5c0ed tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 329 microversion: 2.1 time: 0.319917 Jun 18 22:06:08.463755 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 629/1293] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:08 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 329 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:08.479644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2357b22-e12c-477d-b076-457446f13f04 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Calling method '.version_select at 0x7fea145d2b80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:08.500543 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49b3ab2e-6105-4ae2-b704-cddb0e8475a4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 204 len: 0 microversion: 2.1 time: 0.183814 Jun 18 22:06:08.501848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 665/1294] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:08 2022] DELETE /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:08.515836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:08.516819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:08.524389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.524976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.525832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.526275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.608541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2357b22-e12c-477d-b076-457446f13f04 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 371 microversion: 2.1 time: 0.135310 Jun 18 22:06:08.610512 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 630/1295] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:06:08 2022] GET /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:08.619596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:08.623749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:08.638493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.639470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.641731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.643034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.780301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:08.794909 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fbb680cc-a6ce-44f1-a4bc-4be8ea811faa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1470 microversion: 2.1 time: 0.288660 Jun 18 22:06:08.799063 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 666/1296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:08 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:08.808007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c0cd0e0-dd09-4a4e-9275-07b1c24a3515 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Action: 'update', calling method: .version_select at 0x7fea142c7550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:08.918993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c0cd0e0-dd09-4a4e-9275-07b1c24a3515 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.919853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c0cd0e0-dd09-4a4e-9275-07b1c24a3515 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.921819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c0cd0e0-dd09-4a4e-9275-07b1c24a3515 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:08.922230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:08.922682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c0cd0e0-dd09-4a4e-9275-07b1c24a3515 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:08.934740 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa6779e9-2f53-4310-913c-25f680b60274 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.322282 Jun 18 22:06:08.942255 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 631/1297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:08 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:08.956302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a8a25d0-2cc0-4a1d-b208-46e9b7419fdd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea145d2160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:09.011698 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6c0cd0e0-dd09-4a4e-9275-07b1c24a3515 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 328 microversion: 2.1 time: 0.210919 Jun 18 22:06:09.013253 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 667/1298] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:08 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:09.016935 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a8a25d0-2cc0-4a1d-b208-46e9b7419fdd tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.072019 Jun 18 22:06:09.017545 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 632/1299] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:08 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:09.078490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2107817195", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:09.137918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:09.138664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:09.146223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.150893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.152201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.152880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.156743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:09.485480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:09.493247 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef127c9e-1309-4409-87ba-e9b7958711cb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.359391 Jun 18 22:06:09.509360 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 633/1300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:09 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:09.523203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:09.523730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:09.530862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.533001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.534000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.540257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:09.540675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:09.540972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.542092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:09.542804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:09.543438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:09.557269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.557489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.558563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.559382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.584410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Getting quotas for project d8f8b57202054341bfceac7ac36e6aa2. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:09.592039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Getting quotas for user d9fb28e51c6a4d88b03e3c1ed3365756 and project d8f8b57202054341bfceac7ac36e6aa2. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:09.620358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.utils [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] instances quota exceeded for d8f8b57202054341bfceac7ac36e6aa2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130903) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 18 22:06:09.623213 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Request method failure captured: Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 145 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxMu-78CxX4GMLVjbe3HKI1xxXpU-Ib_iIyxyPIR-djAIc80Va7ohjZt42YXikpKgisl5lktpQT1BGnmw8sPfa4kLfJ-ROvDA3J69XyH3GW84_Hxw1slxjjU-EjMlz4g-cy972GGciixhCbwrdgFWAejjpUTGcxAlQhLIMIKbizmJQ Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d8f8b57202054341bfceac7ac36e6aa2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d9fb28e51c6a4d88b03e3c1ed3365756 Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2107817195", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2107817195', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452'}}} Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:06:09.626895 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:09.632099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca28194d-6a2f-4d64-900b-b5a8d560483c tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.553953 Jun 18 22:06:09.641702 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 668/1301] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:09 2022] POST /compute/v2.1/servers => generated 119 bytes in 568 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:06:09.654295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20e4cdfd-049d-4a18-8f99-8c67c33b6b63 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Action: 'update', calling method: .version_select at 0x7fea141b8160>, body: {"quota_set": {"instances": 10}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:09.759732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e4cdfd-049d-4a18-8f99-8c67c33b6b63 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.763507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e4cdfd-049d-4a18-8f99-8c67c33b6b63 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.765279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e4cdfd-049d-4a18-8f99-8c67c33b6b63 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.766807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e4cdfd-049d-4a18-8f99-8c67c33b6b63 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.774465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:09.783673 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b6a526ca-7266-43f3-95f6-e1651fd7cf8b tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.272915 Jun 18 22:06:09.793421 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 634/1302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:09 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:09.801397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:09.811890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:09.812515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:09.820210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.820655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.821451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:09.821883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:09.885099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20e4cdfd-049d-4a18-8f99-8c67c33b6b63 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 329 microversion: 2.1 time: 0.236323 Jun 18 22:06:09.892885 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 669/1303] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:09 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:09.902886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3c018a2-2c28-4036-8e00-84f28ab86a46 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Calling method '.version_select at 0x7fea141b8820>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:09.990812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:10.000231 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-362ae6c0-0d8b-44bc-97e5-094781be4eee tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1470 microversion: 2.1 time: 0.192187 Jun 18 22:06:10.010650 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 635/1304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:09 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1470 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:10.016474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:10.017421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:10.029356 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3c018a2-2c28-4036-8e00-84f28ab86a46 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 371 microversion: 2.1 time: 0.134747 Jun 18 22:06:10.032088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.032617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.033371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.033866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.035416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 670/1305] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:06:09 2022] GET /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:10.041452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:10.042250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:10.049202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.049623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.050650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.051277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.290068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:10.301622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e4b24a85-a3df-4635-bff9-4ea66a537bdf tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1470 microversion: 2.1 time: 0.264577 Jun 18 22:06:10.307602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad0a45f6-433d-4aae-a482-62c8e8e8b871 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1814 microversion: 2.1 time: 0.294643 Jun 18 22:06:10.308574 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 636/1306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:10 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1814 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:10.309370 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 671/1307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:10 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:10.316458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3adf05a5-de28-4d62-a566-7f1db09eeeb8 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Action: 'update', calling method: .version_select at 0x7fea142788b0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:10.330017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-235a67a6-73e5-486a-8a59-3f5c3baeaec0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea144bd940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:10.413935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adf05a5-de28-4d62-a566-7f1db09eeeb8 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.417969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adf05a5-de28-4d62-a566-7f1db09eeeb8 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.419889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adf05a5-de28-4d62-a566-7f1db09eeeb8 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.425253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adf05a5-de28-4d62-a566-7f1db09eeeb8 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.445770 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-235a67a6-73e5-486a-8a59-3f5c3baeaec0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.134261 Jun 18 22:06:10.452130 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 637/1308] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:10 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:10.461240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9c5edc2a-b923-4484-b5d9-8049d4f52f56 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:10.462683 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:10.462683 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:06:10.464278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c5edc2a-b923-4484-b5d9-8049d4f52f56 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.465263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c5edc2a-b923-4484-b5d9-8049d4f52f56 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.470024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c5edc2a-b923-4484-b5d9-8049d4f52f56 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.470024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c5edc2a-b923-4484-b5d9-8049d4f52f56 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.514606 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9c5edc2a-b923-4484-b5d9-8049d4f52f56 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060956 Jun 18 22:06:10.515799 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 638/1309] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:06:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:10.534360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:10.535329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:10.543906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.544526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.546076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.546574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.558798 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3adf05a5-de28-4d62-a566-7f1db09eeeb8 tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 325 microversion: 2.1 time: 0.248156 Jun 18 22:06:10.576181 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 672/1310] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:10 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:10.615990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-163d2a03-426a-4a2c-9abc-2a20b1827532 req-d43d10fe-9423-4d53-92aa-1c0c66595d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bdd659-86ea-4c21-b87a-ecc6cbd22350", "tag": "73c17b21-d012-4814-8efe-6acbce0320b1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:10.635009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-163d2a03-426a-4a2c-9abc-2a20b1827532 req-d43d10fe-9423-4d53-92aa-1c0c66595d87 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.635729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-163d2a03-426a-4a2c-9abc-2a20b1827532 req-d43d10fe-9423-4d53-92aa-1c0c66595d87 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.674291 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-163d2a03-426a-4a2c-9abc-2a20b1827532 req-d43d10fe-9423-4d53-92aa-1c0c66595d87 service nova] Creating event network-changed:73c17b21-d012-4814-8efe-6acbce0320b1 for instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 on nch2-master-1 Jun 18 22:06:10.680434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-163d2a03-426a-4a2c-9abc-2a20b1827532 req-d43d10fe-9423-4d53-92aa-1c0c66595d87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068765 Jun 18 22:06:10.681168 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 673/1311] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:06:10.699389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1338962268", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:10.761087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:10.763484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:10.777293 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f87fa851-1c32-4a0d-b668-794f87edcf83 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.257135 Jun 18 22:06:10.787348 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 639/1312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:10 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:10.808940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:10.812580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:10.824509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.824966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.826416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:10.827322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:10.833668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:11.136174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:11.136970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:11.138622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:11.139416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:11.142780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:11.163272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.164054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.165160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.167334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.233995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Getting quotas for project d8f8b57202054341bfceac7ac36e6aa2. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:11.253937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Getting quotas for user d9fb28e51c6a4d88b03e3c1ed3365756 and project d8f8b57202054341bfceac7ac36e6aa2. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:11.289966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.utils [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] ram quota exceeded for d8f8b57202054341bfceac7ac36e6aa2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130903) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 18 22:06:11.291317 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Request method failure captured: Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 145 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxMu-78CxX4GMLVjbe3HKI1xxXpU-Ib_iIyxyPIR-djAIc80Va7ohjZt42YXikpKgisl5lktpQT1BGnmw8sPfa4kLfJ-ROvDA3J69XyH3GW84_Hxw1slxjjU-EjMlz4g-cy972GGciixhCbwrdgFWAejjpUTGcxAlQhLIMIKbizmJQ Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d8f8b57202054341bfceac7ac36e6aa2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d9fb28e51c6a4d88b03e3c1ed3365756 Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1338962268", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1338962268', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452'}}} Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:06:11.301785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 18 22:06:11.306787 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:11.314841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:11.320455 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c055a2ba-5690-4a55-b6ba-8a4d6206bb9f tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.621858 Jun 18 22:06:11.321451 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 674/1313] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 628 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:06:11.331443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:11.341025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:11.354148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa8bf8db-392e-457b-a794-c33d10537f8a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.555969 Jun 18 22:06:11.354950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:11.360074 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 640/1314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:10 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:11.372551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:11.377490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.378131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:11.379495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.380933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.386902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.398484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.398946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.399762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.400195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.817985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:11.823099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:11.834243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a2874e46-a39c-4751-b628-255457e86bb6 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1470 microversion: 2.1 time: 0.509992 Jun 18 22:06:11.846234 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4413177a-343a-486d-8255-0e40cd852c4b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.484773 Jun 18 22:06:11.847498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 641/1315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:11 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:11.848509 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 675/1316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:11 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1470 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:11.863473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5be31ed5-308b-492f-b615-fbabd17cb143 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea141d2820>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:11.865362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5441b80e-b73b-4ef4-8b34-cce0b654b0af tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Action: 'update', calling method: .version_select at 0x7fea14625ee0>, body: {"quota_set": {"ram": 51200}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:11.949229 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5be31ed5-308b-492f-b615-fbabd17cb143 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.099431 Jun 18 22:06:11.955521 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 676/1317] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:11 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:11.963882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:11.965615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:11.978791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.979255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:11.980039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:11.984754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.027833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5441b80e-b73b-4ef4-8b34-cce0b654b0af tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.029388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5441b80e-b73b-4ef4-8b34-cce0b654b0af tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.030446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5441b80e-b73b-4ef4-8b34-cce0b654b0af tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.031089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5441b80e-b73b-4ef4-8b34-cce0b654b0af tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.127549 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5441b80e-b73b-4ef4-8b34-cce0b654b0af tempest-QuotasAdminNegativeTest-282555813 tempest-QuotasAdminNegativeTest-282555813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 200 len: 329 microversion: 2.1 time: 0.278447 Jun 18 22:06:12.128637 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 642/1318] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:11 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 329 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:12.141003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-12edb499-d9a6-40d6-9b3e-45ce47a036c0 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Action: 'update', calling method: .version_select at 0x7fea14625c10>, body: {"quota_set": {"ram": 0}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:12.144130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-12edb499-d9a6-40d6-9b3e-45ce47a036c0 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd9fb28e51c6a4d88b03e3c1ed3365756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f8b57202054341bfceac7ac36e6aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-12edb499-d9a6-40d6-9b3e-45ce47a036c0 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Request method failure captured: Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 HTTP/1.1 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 25 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkxMu-78CxX4GMLVjbe3HKI1xxXpU-Ib_iIyxyPIR-djAIc80Va7ohjZt42YXikpKgisl5lktpQT1BGnmw8sPfa4kLfJ-ROvDA3J69XyH3GW84_Hxw1slxjjU-EjMlz4g-cy972GGciixhCbwrdgFWAejjpUTGcxAlQhLIMIKbizmJQ Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d8f8b57202054341bfceac7ac36e6aa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d8f8b57202054341bfceac7ac36e6aa2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d8f8b57202054341bfceac7ac36e6aa2 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1197635964 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d9fb28e51c6a4d88b03e3c1ed3365756 Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-QuotasAdminNegativeTest-1197635964-project Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: {"quota_set": {"ram": 0}} Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd8f8b57202054341bfceac7ac36e6aa2', 'body': {'quota_set': {'ram': 0}}} Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:06:12.147163 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 18 22:06:12.153146 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:12.164802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-12edb499-d9a6-40d6-9b3e-45ce47a036c0 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:12.166707 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-12edb499-d9a6-40d6-9b3e-45ce47a036c0 tempest-QuotasAdminNegativeTest-1197635964 tempest-QuotasAdminNegativeTest-1197635964-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2" status: 403 len: 116 microversion: 2.1 time: 0.030259 Jun 18 22:06:12.171669 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 643/1319] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:06:12 2022] PUT /compute/v2.1/os-quota-sets/d8f8b57202054341bfceac7ac36e6aa2 => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:12.285995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:12.294795 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca3a5300-c029-4367-a6af-4776ca8e70be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.337929 Jun 18 22:06:12.298513 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 677/1320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:11 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:12.377839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:12.378413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:12.389575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.390038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.390896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.391344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.577303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:12.586833 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c822fe1c-f124-4ae1-982a-a4f45ec79b52 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.213417 Jun 18 22:06:12.588002 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 644/1321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:12 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:12.730825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1a64d41e-99e5-4e74-8d61-542d417e1327 req-24d770e2-c7a4-4365-b741-d556a1647172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d548829-c243-4cad-9c16-cce987616762", "name": "network-vif-deleted", "tag": "db797937-0996-4cb8-bfec-ec8fe80125f0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:12.742786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1a64d41e-99e5-4e74-8d61-542d417e1327 req-24d770e2-c7a4-4365-b741-d556a1647172 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.743531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1a64d41e-99e5-4e74-8d61-542d417e1327 req-24d770e2-c7a4-4365-b741-d556a1647172 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.765414 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1a64d41e-99e5-4e74-8d61-542d417e1327 req-24d770e2-c7a4-4365-b741-d556a1647172 service nova] Creating event network-vif-deleted:db797937-0996-4cb8-bfec-ec8fe80125f0 for instance 0d548829-c243-4cad-9c16-cce987616762 on nch2-master-1 Jun 18 22:06:12.774148 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1a64d41e-99e5-4e74-8d61-542d417e1327 req-24d770e2-c7a4-4365-b741-d556a1647172 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054784 Jun 18 22:06:12.781608 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 678/1322] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:12.853381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:12.854442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:12.866342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:12.867720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:12.878676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.879489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.879982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.881415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.882751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.884762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:12.885946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:12.886493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.010475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.011297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.012121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid 0d548829-c243-4cad-9c16-cce987616762 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:13.169317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:13.182992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eba06f9f-5706-40fa-a586-d5b78dd5c307 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 200 len: 1305 microversion: 2.1 time: 0.333301 Jun 18 22:06:13.196153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 645/1323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:12 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 1305 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:13.203229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd49bdd4-1541-4bcd-abdc-bbe6178cf3f9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14625c10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:13.261418 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd49bdd4-1541-4bcd-abdc-bbe6178cf3f9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.063497 Jun 18 22:06:13.263225 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 646/1324] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:13 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:13.270072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b4e05a3-834c-4089-a905-b3e5772b00c7", "device": "/dev/xvdb"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:13.271345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:13.281219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.281219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.283110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.283562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.449820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:13.457911 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c32bcd3-0a7d-49ac-a6f5-6b173338417d tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.597302 Jun 18 22:06:13.473540 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 679/1325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:12 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:13.488179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:13.489429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:13.496462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.499314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.500366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.500970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.743808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:13.755027 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dcfcf027-d0d5-41ff-9bc4-0d51133604e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.280257 Jun 18 22:06:13.756106 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 680/1326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:13 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:13.761398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:13.762262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:13.771119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.771871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.773483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.774083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:13.951887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a61b143-8d69-4a39-a7e1-65e0f295aa30 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "POST /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687011 Jun 18 22:06:13.953498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 647/1327] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:06:13 2022] POST /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:13.967607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ba2dc409-06af-4a83-bf83-1a850782b43f req-f1374a15-495f-4e52-9b0e-593d119777a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3", "name": "network-vif-plugged", "status": "completed", "tag": "1daf0319-8098-4062-9abb-2e8692b60bc6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:13.988884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ba2dc409-06af-4a83-bf83-1a850782b43f req-f1374a15-495f-4e52-9b0e-593d119777a2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:13.989401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ba2dc409-06af-4a83-bf83-1a850782b43f req-f1374a15-495f-4e52-9b0e-593d119777a2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.009186 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ba2dc409-06af-4a83-bf83-1a850782b43f req-f1374a15-495f-4e52-9b0e-593d119777a2 service nova] Creating event network-vif-plugged:1daf0319-8098-4062-9abb-2e8692b60bc6 for instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 on nch1-master-1 Jun 18 22:06:14.045840 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ba2dc409-06af-4a83-bf83-1a850782b43f req-f1374a15-495f-4e52-9b0e-593d119777a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067533 Jun 18 22:06:14.047080 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 648/1328] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:14.088848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:14.097443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-437bd9e1-e416-4217-b298-c18d8303bf37 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.340073 Jun 18 22:06:14.107952 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 681/1329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:13 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:14.206910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.207642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 0d548829-c243-4cad-9c16-cce987616762] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:14.219023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.219479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.220285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.220724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.246672 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance 0d548829-c243-4cad-9c16-cce987616762 could not be found. Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 HTTP/1.1 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 0d548829-c243-4cad-9c16-cce987616762 could not be found. Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '0d548829-c243-4cad-9c16-cce987616762'} Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d548829-c243-4cad-9c16-cce987616762 could not be found. Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d548829-c243-4cad-9c16-cce987616762 could not be found. Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:14.248468 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d548829-c243-4cad-9c16-cce987616762 could not be found. Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance 0d548829-c243-4cad-9c16-cce987616762 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:14.254737 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf1f6e53-f03d-42e2-8a1a-5444757593e4 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762" status: 404 len: 111 microversion: 2.1 time: 0.050289 Jun 18 22:06:14.259671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.260407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:14.263859 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 649/1330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:14 2022] GET /compute/v2.1/servers/0d548829-c243-4cad-9c16-cce987616762 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:14.267929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.268641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.269758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.275712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d873c4fe-b975-4ee7-a36d-168f7bc28478 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1438b4c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.276024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.363106 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d873c4fe-b975-4ee7-a36d-168f7bc28478 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1438 microversion: 2.1 time: 0.091714 Jun 18 22:06:14.363699 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 650/1331] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:14 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:14.371326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:14.435583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:14.475682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.477532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:14.493392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.494106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.494779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.495228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.592877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d56e32da-d921-4ad4-a201-ea0d84d103d3 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 204 len: 0 microversion: 2.1 time: 0.324153 Jun 18 22:06:14.592877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 682/1332] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:14 2022] DELETE /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:14.603610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.605596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:14.683774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.685536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.687682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.688314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.731138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:14.801225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:14.816193 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-874d6c8d-9cf0-4b21-8cc9-56e91ec6dda7 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.344355 Jun 18 22:06:14.827466 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 651/1333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:14 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:14.836211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.842065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:14.853482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.856571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.858708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:14.859369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:14.968839 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-19b70b15-842a-4f56-bd19-92bc13ee548e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 204 len: 0 microversion: 2.1 time: 0.379304 Jun 18 22:06:14.969799 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 683/1334] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:14 2022] DELETE /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:14.996343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:14.998043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:15.005576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:15.006034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:15.006817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:15.007258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:15.096366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:15.108497 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5d611f5-d2a8-4115-8773-06c8f02ff9da tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.276078 Jun 18 22:06:15.124473 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 652/1335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:14 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:15.129810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:15.130641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:15.137629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:15.138291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:15.139300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:15.139913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:15.257161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:15.266181 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4855c640-241e-4554-9eea-6a29ae4f1b28 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 200 len: 1473 microversion: 2.1 time: 0.286383 Jun 18 22:06:15.267179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 684/1336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:14 2022] GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:15.310513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:15.318903 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9fa627ea-7824-46f4-9975-25b0c9f9a525 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.192976 Jun 18 22:06:15.320045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 653/1337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:15 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:15.381495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06b47b62-d8bc-46c8-a28f-2ddc0e075f95 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1414df70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:15.430908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06b47b62-d8bc-46c8-a28f-2ddc0e075f95 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1447 microversion: 2.1 time: 0.053399 Jun 18 22:06:15.431716 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 685/1338] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:15 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1447 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:15.443814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-afde6796-23ce-4945-bc2c-d84d2b9e28a9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1438ba60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:15.490121 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-afde6796-23ce-4945-bc2c-d84d2b9e28a9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 200 len: 1447 microversion: 2.1 time: 0.050537 Jun 18 22:06:15.490663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 654/1339] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:15 2022] GET /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 1447 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:15.502364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-517123e8-8383-4c69-8c5e-5f0c667ab7c6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea141d2700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:15.835201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:15.835819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:15.848837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:15.849441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:15.850245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:15.850754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.053011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:16.070188 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e7dee29-f074-4baa-a1a8-2929358d1d8b tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.239128 Jun 18 22:06:16.070966 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 655/1340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:15 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:16.075419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2968a0de-983a-45d8-964b-66aa24fa1cbf req-d7566621-1dce-470e-bbd0-767d26c4631d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb4fcc9-fabe-4536-9514-c539642cc9c2", "name": "network-vif-plugged", "status": "completed", "tag": "5f35a6e4-ed0a-4464-9526-b7258e8cc72d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:16.084939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2968a0de-983a-45d8-964b-66aa24fa1cbf req-d7566621-1dce-470e-bbd0-767d26c4631d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.085608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2968a0de-983a-45d8-964b-66aa24fa1cbf req-d7566621-1dce-470e-bbd0-767d26c4631d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.098897 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2968a0de-983a-45d8-964b-66aa24fa1cbf req-d7566621-1dce-470e-bbd0-767d26c4631d service nova] Creating event network-vif-plugged:5f35a6e4-ed0a-4464-9526-b7258e8cc72d for instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 on nch2-master-1 Jun 18 22:06:16.103687 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2968a0de-983a-45d8-964b-66aa24fa1cbf req-d7566621-1dce-470e-bbd0-767d26c4631d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031599 Jun 18 22:06:16.104750 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 656/1341] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:16.126459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:16.128097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:16.134061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.134615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.135494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.136314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.324843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:16.335538 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-756f2069-4de8-4e23-8603-3851c3950881 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1315 microversion: 2.1 time: 0.213506 Jun 18 22:06:16.347940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 657/1342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:16 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:16.356052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:16.356964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:16.367078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.367565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.368929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.369418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.463734 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-517123e8-8383-4c69-8c5e-5f0c667ab7c6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 204 len: 0 microversion: 2.1 time: 0.965209 Jun 18 22:06:16.464276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 686/1343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:15 2022] DELETE /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:06:16.468917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:16.469544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:16.476664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.477155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.477940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.478384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.531995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:16.540708 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e39640a5-81f4-4b20-9aec-934bff464773 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 200 len: 1473 microversion: 2.1 time: 0.191494 Jun 18 22:06:16.541446 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 658/1344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:16 2022] GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 1473 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:16.554127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:16.554940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:16.561510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.562078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.562960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:16.563458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:16.591930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:16.667805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:16.685263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1955ca3a-3ac5-432f-b5f0-351abcb4d45a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 204 len: 0 microversion: 2.1 time: 0.142244 Jun 18 22:06:16.689332 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 659/1345] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:16 2022] DELETE /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:16.802334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-715691405", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1a0b7d1f-26de-4ff3-a984-65723c7a5ace"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:16.813956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:16.822191 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35b1f425-9fe6-4dbd-8f4c-bcf040c73c20 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.356913 Jun 18 22:06:16.832437 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 687/1346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:16 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:16.858199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] validate_networks() for [('1a0b7d1f-26de-4ff3-a984-65723c7a5ace', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:17.089516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:17.091811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:17.104363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.105081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.106106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.106693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.362353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:17.364208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:17.365198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:17.367124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:17.369608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:17.388124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:17.401739 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e2d2dfa7-874b-446d-a7db-2d9a656f7485 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.319138 Jun 18 22:06:17.404025 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 688/1347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:17 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:17.416730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.423773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.431323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.432323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.460582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:17.476983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:17.484037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Getting quotas for user 4eef98c56e744064b2b5f131c3766c0c and project df7809024c414efd8534cefdecd980cf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:17.499742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:17.502627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:17.589471 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ae968a8-3d8f-49f9-b881-dffa6a98e093 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789356 Jun 18 22:06:17.590368 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 660/1348] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:17.600773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1685309708", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:17.615615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:17.617262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:17.625019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.625816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.627198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.628375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.699764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:17.936380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:17.950551 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b847d234-9dfb-474c-94fb-d2acc8367bf5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1502 microversion: 2.1 time: 0.358837 Jun 18 22:06:17.951631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 661/1349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:17 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:17.957386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2fc978b5-2330-4d2b-8c55-e7ba41beb4fe req-cf42e223-e203-4b00-8154-74cdec44b8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04eb76cf-c46e-44de-add1-1a8e0810d76e", "name": "network-vif-deleted", "tag": "07c4f4d6-aaae-4a49-9184-361e8cfcee93"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:17.968487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2fc978b5-2330-4d2b-8c55-e7ba41beb4fe req-cf42e223-e203-4b00-8154-74cdec44b8a7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:17.969623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2fc978b5-2330-4d2b-8c55-e7ba41beb4fe req-cf42e223-e203-4b00-8154-74cdec44b8a7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:17.991594 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2fc978b5-2330-4d2b-8c55-e7ba41beb4fe req-cf42e223-e203-4b00-8154-74cdec44b8a7 service nova] Creating event network-vif-deleted:07c4f4d6-aaae-4a49-9184-361e8cfcee93 for instance 04eb76cf-c46e-44de-add1-1a8e0810d76e on nch1-master-1 Jun 18 22:06:17.999615 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2fc978b5-2330-4d2b-8c55-e7ba41beb4fe req-cf42e223-e203-4b00-8154-74cdec44b8a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046174 Jun 18 22:06:18.000650 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 662/1350] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:18.007567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:18.008846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:18.017268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.018373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.019457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.020138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.033542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:18.034874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:18.036163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:18.036795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:18.037450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:18.050866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.051703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.062367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.062910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.116088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Getting quotas for project 1bd5b89d294a4ce588fc4dd900fe952c. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:18.122527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.123182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.127824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid 04eb76cf-c46e-44de-add1-1a8e0810d76e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:18.129193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Getting quotas for user 33ec146b95734dcea62aad13f5105bdd and project 1bd5b89d294a4ce588fc4dd900fe952c. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:18.151218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:18.154576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:18.184669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:18.198596 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-526fafa9-b0d6-46d1-bb65-5223cc61ca4a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 200 len: 1309 microversion: 2.1 time: 0.196440 Jun 18 22:06:18.199269 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 663/1351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:18 2022] GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:18.208032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d15da67-536f-4b2d-bb0b-96a729a00e2a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:18.214990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d15da67-536f-4b2d-bb0b-96a729a00e2a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:18.260360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7db5f6ea-3c55-4094-ae03-0d19ada6bfb6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854869 Jun 18 22:06:18.270467 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 689/1352] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:18.282029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:18.283234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:18.293697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.294463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.297094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.297992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.610097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d15da67-536f-4b2d-bb0b-96a729a00e2a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:18.628423 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d15da67-536f-4b2d-bb0b-96a729a00e2a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1207 microversion: 2.1 time: 0.422275 Jun 18 22:06:18.629717 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 664/1353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:18 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1207 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:18.638197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-48c4970a-9174-4de2-81d2-b2f8260c3e9f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:18.648861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-48c4970a-9174-4de2-81d2-b2f8260c3e9f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:18.666559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:18.679417 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-45755351-27c0-4404-aa6e-0ea3e2acd76a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.407433 Jun 18 22:06:18.680030 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 690/1354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:18 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:18.686184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:18.686805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:18.748419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.749380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.751884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:18.766720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:18.813073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-48c4970a-9174-4de2-81d2-b2f8260c3e9f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:18.825776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-48c4970a-9174-4de2-81d2-b2f8260c3e9f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1222 microversion: 2.1 time: 0.194734 Jun 18 22:06:18.826764 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 665/1355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:18 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:19.038716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:19.050087 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3998a1fd-a0bd-4a29-bb2a-e95e526fa69e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.368896 Jun 18 22:06:19.050675 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 691/1356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:18 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:19.216265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:19.216952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 04eb76cf-c46e-44de-add1-1a8e0810d76e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:19.225348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.225803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.226735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.227211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.242624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance 04eb76cf-c46e-44de-add1-1a8e0810d76e could not be found. Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e HTTP/1.1 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 04eb76cf-c46e-44de-add1-1a8e0810d76e could not be found. Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '04eb76cf-c46e-44de-add1-1a8e0810d76e'} Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04eb76cf-c46e-44de-add1-1a8e0810d76e could not be found. Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04eb76cf-c46e-44de-add1-1a8e0810d76e could not be found. Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:19.244873 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04eb76cf-c46e-44de-add1-1a8e0810d76e could not be found. Jun 18 22:06:19.252758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:19.254132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance 04eb76cf-c46e-44de-add1-1a8e0810d76e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:19.255120 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a6b381df-429c-4f91-a050-2f037779f96a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e" status: 404 len: 111 microversion: 2.1 time: 0.043171 Jun 18 22:06:19.258583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 666/1357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:19 2022] GET /compute/v2.1/servers/04eb76cf-c46e-44de-add1-1a8e0810d76e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:19.263716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:19.264330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:19.269553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:19.272055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.272534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.273400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.274006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.411468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:19.419896 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4a3fcb2-86e4-4f2f-b9cb-111e03874afb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1475 microversion: 2.1 time: 0.159947 Jun 18 22:06:19.420615 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 692/1358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:19 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:19.646249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:19.646875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:19.655240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.655689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.657783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.658694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.697512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:19.699174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:19.729260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.731051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.732823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.733419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.747764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:19.761842 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef6b02c4-78d4-4d51-8306-3c824d8acfdf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1211 microversion: 2.1 time: 0.119693 Jun 18 22:06:19.773195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 667/1359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:19 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:19.855911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:19.857024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:19.868309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.868954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:19.869912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:19.870525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.021587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:20.038501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-507a687e-1c82-462d-8fe8-66e373d0f27f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1226 microversion: 2.1 time: 0.197734 Jun 18 22:06:20.045369 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 668/1360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:19 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1226 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:20.057014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a2c24d5c-40d0-46e2-bd0c-bf5cded7481c req-09f37920-e73f-409a-9589-136b837225ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869eea9f-3a55-41e5-a036-656377f664ae", "name": "network-vif-deleted", "tag": "3546b8cb-91fd-4c67-b8ea-9dbdc007acf3"}, {"server_uuid": "e4adc167-d585-4cf1-bd68-f2f85e8d045a", "name": "network-vif-deleted", "tag": "9121111a-541a-4e12-b4be-357c5d525b9d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:20.084338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a2c24d5c-40d0-46e2-bd0c-bf5cded7481c req-09f37920-e73f-409a-9589-136b837225ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.085165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a2c24d5c-40d0-46e2-bd0c-bf5cded7481c req-09f37920-e73f-409a-9589-136b837225ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.131589 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a2c24d5c-40d0-46e2-bd0c-bf5cded7481c req-09f37920-e73f-409a-9589-136b837225ad service nova] Creating event network-vif-deleted:3546b8cb-91fd-4c67-b8ea-9dbdc007acf3 for instance 869eea9f-3a55-41e5-a036-656377f664ae on nch2-master-1 Jun 18 22:06:20.134665 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a2c24d5c-40d0-46e2-bd0c-bf5cded7481c req-09f37920-e73f-409a-9589-136b837225ad service nova] Creating event network-vif-deleted:9121111a-541a-4e12-b4be-357c5d525b9d for instance e4adc167-d585-4cf1-bd68-f2f85e8d045a on nch2-master-1 Jun 18 22:06:20.152789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:20.161525 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a2c24d5c-40d0-46e2-bd0c-bf5cded7481c req-09f37920-e73f-409a-9589-136b837225ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114296 Jun 18 22:06:20.162246 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 669/1361] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:20.171228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:20.177249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:20.196701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.197488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.198546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.199204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.199336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f3f0cff-81da-4083-be51-f5d7c4295ad5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.506768 Jun 18 22:06:20.200148 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 693/1362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:19 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:20.205435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d71779f-37fd-44be-ba52-f5b168d0a55d"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:20.206837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:20.214296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.215207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.216944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.217608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.478845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:20.511539 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1997c24c-a7d3-45b6-9574-6df00674a76c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1476 microversion: 2.1 time: 0.336072 Jun 18 22:06:20.527599 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 670/1363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:20 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:20.532701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a0987acf-c67e-41f4-b192-bf95956eb7c6 req-712939f7-35e7-476e-92e7-0b1ba91e7e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bdd659-86ea-4c21-b87a-ecc6cbd22350", "name": "network-vif-plugged", "status": "completed", "tag": "73c17b21-d012-4814-8efe-6acbce0320b1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:20.542224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a0987acf-c67e-41f4-b192-bf95956eb7c6 req-712939f7-35e7-476e-92e7-0b1ba91e7e9a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.543125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a0987acf-c67e-41f4-b192-bf95956eb7c6 req-712939f7-35e7-476e-92e7-0b1ba91e7e9a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.559751 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a0987acf-c67e-41f4-b192-bf95956eb7c6 req-712939f7-35e7-476e-92e7-0b1ba91e7e9a service nova] Creating event network-vif-plugged:73c17b21-d012-4814-8efe-6acbce0320b1 for instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 on nch2-master-1 Jun 18 22:06:20.566135 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a0987acf-c67e-41f4-b192-bf95956eb7c6 req-712939f7-35e7-476e-92e7-0b1ba91e7e9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037010 Jun 18 22:06:20.567269 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 671/1364] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:20.574565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:20.575471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:20.583872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.584448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.585713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.586291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.628366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.628928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.629515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid e4adc167-d585-4cf1-bd68-f2f85e8d045a {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:20.730052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:20.741594 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-560ff2f4-6bdc-4bdd-afed-3af2dc6352fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 200 len: 1309 microversion: 2.1 time: 0.172339 Jun 18 22:06:20.742205 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 672/1365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:20 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 1309 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:20.770267 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-469d3b20-2856-4429-8135-cf4735ebbfa7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568634 Jun 18 22:06:20.773246 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 694/1366] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:06:20 2022] POST /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:20.775386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:20.776542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:20.785235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.786281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.787684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.788651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.791708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:20.792866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:20.810749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.812514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.818544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:20.819006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:20.956047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:20.966279 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-26eea002-8dd6-4507-93c5-37d189cb0f49 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1259 microversion: 2.1 time: 0.188284 Jun 18 22:06:20.967236 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 695/1367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:20 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:20.993265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4fb8effb-3838-400f-a926-6cc5a5d3e051 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1860 microversion: 2.1 time: 0.227728 Jun 18 22:06:20.993909 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 673/1368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:20 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1860 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:21.010514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:21.011940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:21.018331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.018783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.019544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.019952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.049160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lazy-loading 'flavor' on Instance uuid 2bb05746-912a-4d02-97e9-03847508282d {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:21.056961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:21.058028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:21.065587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Going to try to live migrate instance to nch2-master-1 {{(pid=130903) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:06:21.067749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.068522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.069610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.070702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.106619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:21.137755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:21.147759 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6740719b-dfb3-4a03-b7c1-5612e3110ffc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1274 microversion: 2.1 time: 0.097460 Jun 18 22:06:21.148346 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 674/1369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:21 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:21.225411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:21.229266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:21.251335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.251985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.253255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.253789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.458773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:21.503585 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c275995b-c395-456a-9426-e663252dab2e tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1316 microversion: 2.1 time: 0.287490 Jun 18 22:06:21.504220 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 675/1370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:21 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:21.534987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:21.536484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:21.553132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.554778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.557406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.558274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.730342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:21.739985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4898b78a-9c0a-484b-b3b6-02b47b0530f5 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1461 microversion: 2.1 time: 0.208897 Jun 18 22:06:21.756049 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 676/1371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:21 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1461 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:21.760511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:21.761414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: e4adc167-d585-4cf1-bd68-f2f85e8d045a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:21.770974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.771677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.773869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.774247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.791377 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance e4adc167-d585-4cf1-bd68-f2f85e8d045a could not be found. Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a HTTP/1.1 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance e4adc167-d585-4cf1-bd68-f2f85e8d045a could not be found. Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e4adc167-d585-4cf1-bd68-f2f85e8d045a'} Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4adc167-d585-4cf1-bd68-f2f85e8d045a could not be found. Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4adc167-d585-4cf1-bd68-f2f85e8d045a could not be found. Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:21.793134 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4adc167-d585-4cf1-bd68-f2f85e8d045a could not be found. Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance e4adc167-d585-4cf1-bd68-f2f85e8d045a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2419974-ac6c-4c6f-af31-b50a2b729f93 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a" status: 404 len: 111 microversion: 2.1 time: 0.039385 Jun 18 22:06:21.797990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 677/1372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:21 2022] GET /compute/v2.1/servers/e4adc167-d585-4cf1-bd68-f2f85e8d045a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:21.801168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:21.802223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:21.809107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.809569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.810381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:21.812465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:21.923576 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c91a0d23-d683-4f58-a4b5-9a5ecd177353 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.126337 Jun 18 22:06:21.931757 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 678/1373] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:21 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:21.942769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da9b18e9-7a50-4a13-bbef-a52d8495dd74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.014051 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da9b18e9-7a50-4a13-bbef-a52d8495dd74 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/2d917f93-c1fa-4481-873b-e280d4c11dfe" status: 204 len: 0 microversion: 2.1 time: 0.080577 Jun 18 22:06:22.015838 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 679/1374] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:06:21 2022] DELETE /compute/v2.1/os-server-groups/2d917f93-c1fa-4481-873b-e280d4c11dfe => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:22.028481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.029165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.042876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.043321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.046171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.046618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.112299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.112743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.113241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lazy-loading 'fault' on Instance uuid 8bb4fcc9-fabe-4536-9514-c539642cc9c2 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:22.238460 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e060484e-3bb2-4fd7-b843-079852f47058 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1595 microversion: 2.1 time: 0.218485 Jun 18 22:06:22.250501 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 680/1375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:22 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1595 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:22.258125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.262172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.284874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.286650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.287694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.288375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.320220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:22.390015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:22.399590 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f1659ad-7666-4d4d-b371-f5b2d5cab533 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1265 microversion: 2.1 time: 0.146610 Jun 18 22:06:22.400436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 681/1376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:22 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:22.404992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.405547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.412216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.412684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.413537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.413980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.445315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:22.542403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ac271a1a-b818-490a-a1bb-40a1f283df5e tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 204 len: 0 microversion: 2.1 time: 0.140961 Jun 18 22:06:22.543219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 682/1377] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:22 2022] DELETE /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:22.551389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.552982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.558886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.559092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.559784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.560215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.624841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:22.633631 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a124b61-b952-41b9-848f-f44297fd6c0e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1280 microversion: 2.1 time: 0.086558 Jun 18 22:06:22.634212 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 683/1378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:22 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:22.639013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:22.640428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.649428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.649958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.650777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.651214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.728157 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8866bbe1-c949-4653-88b5-837dcbfda47a tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action" status: 202 len: 0 microversion: 2.1 time: 0.092802 Jun 18 22:06:22.728836 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 684/1379] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:22 2022] POST /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:22.734044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.734663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.741061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.741528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.742361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.742752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.878965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:22.887312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11226351-6292-4c19-bd99-9be90dbed2a7 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1505 microversion: 2.1 time: 0.157038 Jun 18 22:06:22.887807 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 685/1380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:22 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:22.902131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:22.903144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:22.911683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.912206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.913240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:22.913697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:22.941635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:23.053409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:23.064279 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b771cb92-cd26-4a25-a3bb-be3b69a4cfd9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 204 len: 0 microversion: 2.1 time: 0.174859 Jun 18 22:06:23.068452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 686/1381] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:22 2022] DELETE /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:23.075375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:23.076457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.082986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.083745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.084655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.085246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.246110 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f3ecfafa-df36-4fa7-90fe-24c6ca267355 tempest-ServersAdminTestJSON-1931204077 tempest-ServersAdminTestJSON-1931204077-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1612 microversion: 2.1 time: 0.178288 Jun 18 22:06:23.247280 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 687/1382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:23 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1612 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:23.260409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1428980610"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:23.260977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.268411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.268876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.269735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.270358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.309358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-61819d53-2623-4f26-a382-aac99f2da8f9 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/action" status: 202 len: 0 microversion: 2.1 time: 2.302629 Jun 18 22:06:23.310363 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 696/1383] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:21 2022] POST /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/action => generated 0 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:23.315203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:23.316360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.324638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.325124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.325901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.326370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.445054 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.security_group_api [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Adding security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 to port 73c17b21-d012-4814-8efe-6acbce0320b1 Jun 18 22:06:23.525150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:23.533267 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-455d6bbe-965b-4a77-8a0c-01b6d1b9d068 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1475 microversion: 2.1 time: 0.221525 Jun 18 22:06:23.533754 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 697/1384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:23 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1475 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:23.547317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:23.547822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.553935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.554470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.555250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.555683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.581946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:23.657339 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3fd83acb-8e48-4f97-8a7e-c900af015553 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 204 len: 0 microversion: 2.1 time: 0.113391 Jun 18 22:06:23.657911 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 698/1385] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:23 2022] DELETE /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:23.662937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:23.663639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.670227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.670677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.671489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.671924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.896020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:23.911523 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b76664e3-acc1-4d7f-951b-1e87725d5c98 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350/action" status: 202 len: 0 microversion: 2.1 time: 0.662547 Jun 18 22:06:23.912490 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 688/1386] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:23 2022] POST /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:23.923393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:23.924025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.941955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.942416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.943524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.944027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.957609 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5d206557-4382-418e-8ffa-c5732513266a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.298383 Jun 18 22:06:23.961688 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 699/1387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:23 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:23.972514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:23.974704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:23.985955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.987848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:23.989275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:23.990475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.204234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:24.219394 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e8d2b93-c017-441a-971e-82b80b499ab1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.305607 Jun 18 22:06:24.220328 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 689/1388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:23 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:24.229651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:24.230510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:24.243357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.243950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.245508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.245508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.269473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:24.281641 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1003eba3-a3c0-4920-92b6-74c1b9cb12d6 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.317748 Jun 18 22:06:24.282637 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 700/1389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:23 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:24.299084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3012cee1-5a13-4e19-8bf5-dd8a31c6eba4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14039c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:24.442084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:24.461552 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de98262f-47d9-4b12-b4c1-043049897d46 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1469 microversion: 2.1 time: 0.238896 Jun 18 22:06:24.463544 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 690/1390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:24 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:24.470806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3251dca0-48f5-4c54-a02c-6040fba141f4 req-d4a80a33-5c55-452f-98a7-bde367ca090a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bdd659-86ea-4c21-b87a-ecc6cbd22350", "tag": "73c17b21-d012-4814-8efe-6acbce0320b1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:24.490330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3251dca0-48f5-4c54-a02c-6040fba141f4 req-d4a80a33-5c55-452f-98a7-bde367ca090a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.491293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3251dca0-48f5-4c54-a02c-6040fba141f4 req-d4a80a33-5c55-452f-98a7-bde367ca090a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.493971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-3012cee1-5a13-4e19-8bf5-dd8a31c6eba4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use.", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:24.494676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3012cee1-5a13-4e19-8bf5-dd8a31c6eba4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.494676 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3012cee1-5a13-4e19-8bf5-dd8a31c6eba4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99 HTTP/1.1 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: exception: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2cc2a51e-72db-4cb7-b409-1223ae683f99'} Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:24.496871 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3012cee1-5a13-4e19-8bf5-dd8a31c6eba4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 400 to user: Security Group 2cc2a51e-72db-4cb7-b409-1223ae683f99 in use. Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-07e6c1fd-1a4b-45d0-9485-7313b17ec695'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3012cee1-5a13-4e19-8bf5-dd8a31c6eba4 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99" status: 400 len: 185 microversion: 2.1 time: 0.214942 Jun 18 22:06:24.503010 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 701/1391] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:24 2022] DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99 => generated 185 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:06:24.510649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:24.511730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:24.526844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.527384 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3251dca0-48f5-4c54-a02c-6040fba141f4 req-d4a80a33-5c55-452f-98a7-bde367ca090a service nova] Creating event network-changed:73c17b21-d012-4814-8efe-6acbce0320b1 for instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 on nch2-master-1 Jun 18 22:06:24.527932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.528933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.531815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.533730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3251dca0-48f5-4c54-a02c-6040fba141f4 req-d4a80a33-5c55-452f-98a7-bde367ca090a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068293 Jun 18 22:06:24.534705 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 691/1392] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:24.553373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:24.554873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:24.564824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.566324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.567394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.568634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.640260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae1436f6-5d43-4b11-9fbc-eafafa6e22f0 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350/action" status: 202 len: 0 microversion: 2.1 time: 0.134942 Jun 18 22:06:24.641861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 702/1393] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:24 2022] POST /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:24.652394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:24.653946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:24.676576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.677044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.677847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.678288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.778773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:24.788021 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92a184fd-2166-4d18-99db-922ba52510eb tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1475 microversion: 2.1 time: 0.240847 Jun 18 22:06:24.789084 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 692/1394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:24 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1475 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:24.864631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:24.877420 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98a63560-f605-4037-a2ee-1806f48edd44 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1576 microversion: 2.1 time: 0.230975 Jun 18 22:06:24.877803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 703/1395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:24 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:24.981680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:24.982542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:24.989380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.990106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:24.990933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:24.991363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.206865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:25.217235 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86a10560-96f4-4b0a-8270-66b7c02c1311 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.241006 Jun 18 22:06:25.217824 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 693/1396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:24 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:25.236857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:25.237586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:25.262765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.263174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.264051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.264506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.299293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:25.300234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:25.319905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.320359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.321808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.323188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.329968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:25.826706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:25.839057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:25.847856 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9e055f9-7ece-4726-bd60-21c76d7b1f56 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.552775 Jun 18 22:06:25.850982 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ba74bebf-3a04-4e13-aeb1-b230e816b1bb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.617959 Jun 18 22:06:25.851560 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 694/1397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:25 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:25.856126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 704/1398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:25 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:25.858999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:25.860646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:25.870279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:25.870913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:25.882843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.883308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.883451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.883843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.884107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.884557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:25.884811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:25.885355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.214031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:26.223457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:26.225729 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bfe3ab7-9caa-4d38-9dd1-86a9991a3079 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1469 microversion: 2.1 time: 0.372648 Jun 18 22:06:26.226573 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 695/1399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:25 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:26.234922 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9443d840-3ba9-4c3b-b71a-9a50ad6f9425 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1475 microversion: 2.1 time: 0.377323 Jun 18 22:06:26.238477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:26.239381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:26.263636 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 705/1400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:25 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1475 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:26.267408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.269264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.272170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.273404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.280400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:26.282657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:26.298969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.299758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.302328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.302941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.622042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:26.637723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b8a8ae0-887c-4666-bcc2-cd319af14528 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1576 microversion: 2.1 time: 0.409852 Jun 18 22:06:26.648261 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 696/1401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:26 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1576 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:26.653907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:26.654728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:26.669023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.669892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.670956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.671561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.673443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:26.691990 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6bc4c25d-e989-4c82-9c96-763325f4a6b5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.426420 Jun 18 22:06:26.692958 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 706/1402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:26 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:26.706032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3db00853-1b7e-49b6-8fa0-c6e1832d66d6 req-79b8d48f-491b-4fbc-8f49-f84865596afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abd77eb-81f7-42a3-aa19-6da045f3cdf4", "tag": "eb5ce4c1-7c55-4e8b-a561-329649c8f723"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:26.716834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3db00853-1b7e-49b6-8fa0-c6e1832d66d6 req-79b8d48f-491b-4fbc-8f49-f84865596afe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.717752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3db00853-1b7e-49b6-8fa0-c6e1832d66d6 req-79b8d48f-491b-4fbc-8f49-f84865596afe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.726780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:26.743612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3db00853-1b7e-49b6-8fa0-c6e1832d66d6 req-79b8d48f-491b-4fbc-8f49-f84865596afe service nova] Creating event network-changed:eb5ce4c1-7c55-4e8b-a561-329649c8f723 for instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 on nch1-master-1 Jun 18 22:06:26.755340 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3db00853-1b7e-49b6-8fa0-c6e1832d66d6 req-79b8d48f-491b-4fbc-8f49-f84865596afe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058766 Jun 18 22:06:26.756526 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 707/1403] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:26.880027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:26.881673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:26.905399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.914801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.915902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.917533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.942786 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8fc8ad5c-76e3-41c2-92ee-bf685898e97a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 204 len: 0 microversion: 2.1 time: 0.291922 Jun 18 22:06:26.945518 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 697/1404] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:26 2022] DELETE /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:26.951099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:26.951850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:26.958558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.959015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:26.959795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:26.960420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.171609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.182707 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e73b0860-362b-48e7-8949-490cdca6ff21 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.318049 Jun 18 22:06:27.191967 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 708/1405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:26 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:27.191967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8fa4b8a1-83ad-41fc-93d7-5ff2d1780f7b req-9010bae9-2bb9-4f85-80b2-a329fa79a9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468ab9a6-b57f-41bc-8271-2a6c51106e81", "name": "network-vif-deleted", "tag": "e0c10288-e99c-4acf-bc15-6aa0400da027"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:27.200758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8fa4b8a1-83ad-41fc-93d7-5ff2d1780f7b req-9010bae9-2bb9-4f85-80b2-a329fa79a9a7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.201319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8fa4b8a1-83ad-41fc-93d7-5ff2d1780f7b req-9010bae9-2bb9-4f85-80b2-a329fa79a9a7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.211097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.218409 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8fa4b8a1-83ad-41fc-93d7-5ff2d1780f7b req-9010bae9-2bb9-4f85-80b2-a329fa79a9a7 service nova] Creating event network-vif-deleted:e0c10288-e99c-4acf-bc15-6aa0400da027 for instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 on nch1-master-1 Jun 18 22:06:27.220877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-505e36c1-6376-4d16-92f0-b30950676b40 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.273984 Jun 18 22:06:27.223818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8fa4b8a1-83ad-41fc-93d7-5ff2d1780f7b req-9010bae9-2bb9-4f85-80b2-a329fa79a9a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038893 Jun 18 22:06:27.224961 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 698/1406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:26 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:27.228166 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 709/1407] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:27.230833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:27.232725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:27.245518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:27.246475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.246600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:27.246824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.249383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.249850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.254728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.255599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.256494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.257074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.342382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.350938 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d565354-f4aa-425c-8e5b-e557f65ca76e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 200 len: 1427 microversion: 2.1 time: 0.110471 Jun 18 22:06:27.361194 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 710/1408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:27 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:27.366405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:27.367163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:27.381873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.382326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.383683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.383683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.461309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:27.524003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.545654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e7d785c8-7e97-453c-9ca2-babf45f629d8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1554 microversion: 2.1 time: 0.317211 Jun 18 22:06:27.546796 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 699/1409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:27 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1554 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:27.598469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.606273 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a41ea130-847d-4d73-beda-429337b8380c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1475 microversion: 2.1 time: 0.243826 Jun 18 22:06:27.606850 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 711/1410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:27 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1475 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:27.655979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:27.656814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:27.663505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.663952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.664941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.665633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.714632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:27.715512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:27.723075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.723675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.724756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:27.725640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:27.746289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:27.962154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.966885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:27.973333 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae0d8dac-1aca-438e-9530-0a5a7d387853 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.265202 Jun 18 22:06:27.974395 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 712/1411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:27 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:27.987404 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be37abb4-22bb-4302-9d6f-23403c6e82de tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1576 microversion: 2.1 time: 0.335477 Jun 18 22:06:27.988008 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 700/1412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:27 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1576 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:28.200179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.200997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.203121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:28.205500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=54 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:28.218434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.221157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.222231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.222689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.242119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.243136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.251997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.257288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.258793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.259326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.551907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:28.573640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-40410040-3e8a-415e-be9d-0915910fd5a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.335716 Jun 18 22:06:28.574287 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 701/1413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:28 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:28.582391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.583049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: f57d0708-ff66-4e0d-8534-1e1f10c91b99] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.593933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:28.599641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.600173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.601021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.601455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.604228 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0582868-10c9-4008-bfe7-0a7df6c39890 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.407882 Jun 18 22:06:28.614895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 713/1414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:28 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:28.620179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.620910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.625238 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] HTTP exception thrown: Instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 could not be found. Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Request method failure captured: Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 HTTP/1.1 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkvXPO7YHRddVdH0hDwBD-LLy1UHCR9tyhU23I9wbly48TIZmP1N98UFV3EeLxe0E_o2nrk-IhP_RtTDOFQpDzjIeQmFPjkoNwevf_boNLPCrJ--dgtIhN4E09enEyw3Ry7KXIzgb6iDiqDTVXIHyAAD_ZSoEBOczbO4mnn7Ze1aDY8 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 24245a540466462bb9a908267f505f28 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/24245a540466462bb9a908267f505f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/24245a540466462bb9a908267f505f28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/24245a540466462bb9a908267f505f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_24245a540466462bb9a908267f505f28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 24245a540466462bb9a908267f505f28 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAdminTestJSON-784907320-project Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: f8783e0de2414f20ade6604bd0089fab Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAdminTestJSON-784907320-project Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 could not be found. Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f57d0708-ff66-4e0d-8534-1e1f10c91b99'} Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 could not be found. Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 could not be found. Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:28.626967 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 could not be found. Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:28.632966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Returning 404 to user: Instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:28.635515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.635515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.635515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.635515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.638623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a3646911-6865-4508-8a44-f4c78ae3e1b3 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99" status: 404 len: 111 microversion: 2.1 time: 0.049963 Jun 18 22:06:28.639353 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 702/1415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:28 2022] GET /compute/v2.1/servers/f57d0708-ff66-4e0d-8534-1e1f10c91b99 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:28.644914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.652682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.669967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.670770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.674817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.675488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.732112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.732953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.733538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid 039a68da-48d6-4f1e-9aab-82c4595b9f50 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:28.799475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:28.810305 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e3e3c4a-4a35-48cd-b310-feabf883db43 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 200 len: 1309 microversion: 2.1 time: 0.169630 Jun 18 22:06:28.818683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 703/1416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:28 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:28.827302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.828063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.832589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=50 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:28.838259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.838723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.839510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.839788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:28.840121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.849978 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60bc105d-a050-4c29-a362-adb9c964b31e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1554 microversion: 2.1 time: 0.233897 Jun 18 22:06:28.851064 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 714/1417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:28 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1554 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:28.871036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:28.907158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f606f0f8-7db0-447e-b67f-ca4a9b2550cf", "tag": "532c23d7-17bd-4c20-a044-70c767beb815"}, {"server_uuid": "f57d0708-ff66-4e0d-8534-1e1f10c91b99", "name": "network-vif-deleted", "tag": "9b132b81-60a2-4830-81e5-f1d9a9c509aa"}, {"server_uuid": "039a68da-48d6-4f1e-9aab-82c4595b9f50", "name": "network-vif-deleted", "tag": "818dbee5-4d83-4443-a2c8-1325e6537710"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:28.925974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.927439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.975367 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c042576-a97c-451b-9398-aca16ecfff88 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 204 len: 0 microversion: 2.1 time: 0.155005 Jun 18 22:06:28.976065 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 704/1418] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:28 2022] DELETE /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:28.977560 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] Creating event network-changed:532c23d7-17bd-4c20-a044-70c767beb815 for instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf on nch1-master-1 Jun 18 22:06:28.978807 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] Creating event network-vif-deleted:9b132b81-60a2-4830-81e5-f1d9a9c509aa for instance f57d0708-ff66-4e0d-8534-1e1f10c91b99 on nch2-master-1 Jun 18 22:06:28.979946 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] Creating event network-vif-deleted:818dbee5-4d83-4443-a2c8-1325e6537710 for instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 on nch1-master-1 Jun 18 22:06:28.985692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:28.986634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:28.993535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.994055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:28.995182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:28.995813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.012522 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4f435b72-2551-4f85-a1dc-de354831d7a3 req-f871ddf3-1902-485c-a857-927c310935f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.111880 Jun 18 22:06:29.014793 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 715/1419] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:06:29.039475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.040659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.054667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.055815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.056624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.057157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.210200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:29.220051 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c89815ee-d572-4070-811c-4b10e0ac1dae tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1470 microversion: 2.1 time: 0.238396 Jun 18 22:06:29.221514 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 705/1420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:28 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:29.246006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:29.248882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.250051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.259072 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dfe4b745-7a46-483f-8782-cdc5f74efbae tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.237572 Jun 18 22:06:29.269085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.269085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.269085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.270141 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 716/1421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:29.270273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.534489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:29.543318 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e93c9cdd-eb97-440b-a18e-8ae8f2deabfe tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1581 microversion: 2.1 time: 0.313880 Jun 18 22:06:29.545268 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 706/1422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1581 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:29.590208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.590822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.597678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.598130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.598889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.599324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.627372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.628195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.634918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.635439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.636327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.637026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.798289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:29.806496 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8ef949aa-3cc0-4b3d-b149-523076ea99b1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.220253 Jun 18 22:06:29.815731 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 717/1423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:29.824267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:29.827940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:29.829858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.830472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 039a68da-48d6-4f1e-9aab-82c4595b9f50] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.833750 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6df56b0e-0ef2-4134-ba4b-2ada7ae1d411 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.216407 Jun 18 22:06:29.834464 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 707/1424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:29.836763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.837285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.838065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.838503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.855511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 could not be found. Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 HTTP/1.1 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 could not be found. Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '039a68da-48d6-4f1e-9aab-82c4595b9f50'} Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 could not be found. Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 could not be found. Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:29.857202 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 could not be found. Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance 039a68da-48d6-4f1e-9aab-82c4595b9f50 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a8c7cac8-f66f-4f82-aa7f-0205d45c3dea tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50" status: 404 len: 111 microversion: 2.1 time: 0.032639 Jun 18 22:06:29.862350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 718/1425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/039a68da-48d6-4f1e-9aab-82c4595b9f50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:06:29.866823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.867433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: 468ab9a6-b57f-41bc-8271-2a6c51106e81] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.867596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.868329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.873813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.874288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.875058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.875491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.876129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.876604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.877472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.877962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.889434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 could not be found. Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 HTTP/1.1 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 could not be found. Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '468ab9a6-b57f-41bc-8271-2a6c51106e81'} Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 could not be found. Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 could not be found. Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:29.890894 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 could not be found. Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance 468ab9a6-b57f-41bc-8271-2a6c51106e81 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f8a4197c-722e-40d4-a2d3-a53e034588b5 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81" status: 404 len: 111 microversion: 2.1 time: 0.029044 Jun 18 22:06:29.895933 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 719/1426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/468ab9a6-b57f-41bc-8271-2a6c51106e81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:29.902876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4ef3f340-df8a-4aac-9691-0029ef23c895 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.935600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4ef3f340-df8a-4aac-9691-0029ef23c895 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/818e9f98-ecac-4891-94fb-d2f5e83de272" status: 204 len: 0 microversion: 2.1 time: 0.037653 Jun 18 22:06:29.936237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 720/1427] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:06:29 2022] DELETE /compute/v2.1/os-server-groups/818e9f98-ecac-4891-94fb-d2f5e83de272 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:29.944273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:29.944782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:29.952148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.952148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.952885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:29.953425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:29.979649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:30.027587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:30.049779 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14d4412d-1d51-4c85-a031-bf27eba4e146 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1554 microversion: 2.1 time: 0.186530 Jun 18 22:06:30.050387 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 708/1428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:29 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:30.071948 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6cbf5d6-9fa2-440d-a5f5-d2c06b162fec tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 204 len: 0 microversion: 2.1 time: 0.131101 Jun 18 22:06:30.072741 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 721/1429] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:29 2022] DELETE /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:06:30.081425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:30.082103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:30.088337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.088784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.089653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.090118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.238914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:30.240743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:30.244323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:30.247489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.248017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.248923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.249452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.252776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3064a84d-66c1-4282-8194-4328befd7b2b tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1472 microversion: 2.1 time: 0.175317 Jun 18 22:06:30.253527 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 709/1430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:30 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:30.279395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:30.280092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:30.286761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.287218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.287993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.288435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.443705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:30.452176 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7cc6236a-d48f-4f46-b8a1-49a9d8f07f38 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 200 len: 1470 microversion: 2.1 time: 0.217945 Jun 18 22:06:30.452654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 722/1431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:30 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:30.472969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:30.481652 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1275e764-9af8-456a-b78e-d85d511fd872 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.206465 Jun 18 22:06:30.482257 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 710/1432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:30 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:30.562226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:30.562852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:30.569864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.570314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.571096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.571531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.713886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:30.721897 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-57c18057-11db-436f-a5aa-f68768a4ece5 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1574 microversion: 2.1 time: 0.163753 Jun 18 22:06:30.732911 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 723/1433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:30 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:30.738802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1918996336"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:30.739546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:30.745548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.745999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.746773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.747211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.823107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:30.823691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:30.830625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.831064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.832056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:30.832467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:30.887976 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.security_group_api [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Adding security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b to port 73c17b21-d012-4814-8efe-6acbce0320b1 Jun 18 22:06:31.118129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:31.127779 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ad7ce670-d7cf-4c30-a9f9-a4356d886928 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.308313 Jun 18 22:06:31.128558 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 724/1434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:30 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:31.134795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:31.135731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:31.142502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.143159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.144012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.144462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.363921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:31.372805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-581806ec-a729-406c-9682-3cea67772619 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.242775 Jun 18 22:06:31.382826 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 725/1435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:31 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:31.382826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f94e1a95-40ff-4360-b76c-f8f3b07c34f9 req-55153bb9-1960-4ed3-b3ae-30c5deff3204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69af1d6-c62d-4abf-8063-3db8eac96369", "name": "network-vif-deleted", "tag": "b6f31b95-34e9-45ce-9222-5853a15ec7ca"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:31.390590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f94e1a95-40ff-4360-b76c-f8f3b07c34f9 req-55153bb9-1960-4ed3-b3ae-30c5deff3204 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.391038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f94e1a95-40ff-4360-b76c-f8f3b07c34f9 req-55153bb9-1960-4ed3-b3ae-30c5deff3204 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.487394 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f0c7a82-0e96-476f-89e6-ddc1ecf891c8 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350/action" status: 202 len: 0 microversion: 2.1 time: 0.752220 Jun 18 22:06:31.489446 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 711/1436] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:30 2022] POST /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:31.500699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:31.504243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:31.524885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.526077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.527367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.528036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.725708 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f94e1a95-40ff-4360-b76c-f8f3b07c34f9 req-55153bb9-1960-4ed3-b3ae-30c5deff3204 service nova] Creating event network-vif-deleted:b6f31b95-34e9-45ce-9222-5853a15ec7ca for instance e69af1d6-c62d-4abf-8063-3db8eac96369 on nch2-master-1 Jun 18 22:06:31.730851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f94e1a95-40ff-4360-b76c-f8f3b07c34f9 req-55153bb9-1960-4ed3-b3ae-30c5deff3204 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354430 Jun 18 22:06:31.731634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 726/1437] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:31.736645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:31.737400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:31.743802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.744243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.745044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.745490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.748612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:31.760828 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-31f735b2-8891-46a1-953a-820efdf5eadf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1554 microversion: 2.1 time: 0.270045 Jun 18 22:06:31.762526 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 712/1438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:31 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1554 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:31.775979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:31.776925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:31.790483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.791759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.793167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.793801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.952267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 603306c7-a28f-4251-985a-cc026c0c8c88 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:31.968452 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c999eff-27c0-4685-ad91-ccecddda21fe tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 2343 microversion: 2.25 time: 0.235433 Jun 18 22:06:31.969377 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 727/1439] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:31 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 2343 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:31.973126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:31.974372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:31.975153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: e69af1d6-c62d-4abf-8063-3db8eac96369] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:31.981760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.982678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.983080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:31.983524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:31.986832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90fd968a-e064-437d-8dca-de09df1e65a9 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1472 microversion: 2.1 time: 0.222977 Jun 18 22:06:31.997531 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 713/1440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:31 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:31.997531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4897afd0-b749-46c3-b554-028c94b06d55 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea1438b280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:31.999882 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] HTTP exception thrown: Instance e69af1d6-c62d-4abf-8063-3db8eac96369 could not be found. Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Request method failure captured: Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 HTTP/1.1 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvXPO7YHRddVdH0hDwBD-LLy1UHCR9tyhU23I9wbly48TIZmP1N98UFV3EeLxe0E_o2nrk-IhP_RtTDOFQpDzjIeQmFPjkoNwevf_boNLPCrJ--dgtIhN4E09enEyw3Ry7KXIzgb6iDiqDTVXIHyAAD_ZSoEBOczbO4mnn7Ze1aDY8 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 24245a540466462bb9a908267f505f28 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/24245a540466462bb9a908267f505f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/24245a540466462bb9a908267f505f28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/24245a540466462bb9a908267f505f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_24245a540466462bb9a908267f505f28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 24245a540466462bb9a908267f505f28 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminTestJSON-784907320-project Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: f8783e0de2414f20ade6604bd0089fab Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminTestJSON-784907320-project Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance e69af1d6-c62d-4abf-8063-3db8eac96369 could not be found. Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'e69af1d6-c62d-4abf-8063-3db8eac96369'} Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69af1d6-c62d-4abf-8063-3db8eac96369 could not be found. Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69af1d6-c62d-4abf-8063-3db8eac96369 could not be found. Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:32.001604 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69af1d6-c62d-4abf-8063-3db8eac96369 could not be found. Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Returning 404 to user: Instance e69af1d6-c62d-4abf-8063-3db8eac96369 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:32.005642 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e34142bb-779b-4e43-be29-a2c12def6af6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369" status: 404 len: 111 microversion: 2.1 time: 0.032361 Jun 18 22:06:32.006983 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 728/1441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:31 2022] GET /compute/v2.1/servers/e69af1d6-c62d-4abf-8063-3db8eac96369 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:32.012256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.012746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.019971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.020426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.021257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.021697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.145011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-4897afd0-b749-46c3-b554-028c94b06d55 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use.", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:32.145992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4897afd0-b749-46c3-b554-028c94b06d55 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.145992 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4897afd0-b749-46c3-b554-028c94b06d55 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b HTTP/1.1 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: exception: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'cb92fb13-5c6b-4dab-83ef-a7f9863af22b'} Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:32.148539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] Jun 18 22:06:32.153430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:32.157599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4897afd0-b749-46c3-b554-028c94b06d55 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 400 to user: Security Group cb92fb13-5c6b-4dab-83ef-a7f9863af22b in use. Jun 18 22:06:32.157599 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-e3f10952-0176-4712-a1aa-16e0a481c685'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:32.158709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4897afd0-b749-46c3-b554-028c94b06d55 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b" status: 400 len: 185 microversion: 2.1 time: 0.170271 Jun 18 22:06:32.159596 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 714/1442] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:31 2022] DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b => generated 185 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:06:32.164471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3f44f4bc-bbc4-40ea-ac58-f7077bd03d5b req-f102b13b-5db7-4a5a-9e1d-36242e1db236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bdd659-86ea-4c21-b87a-ecc6cbd22350", "tag": "73c17b21-d012-4814-8efe-6acbce0320b1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:32.177722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3f44f4bc-bbc4-40ea-ac58-f7077bd03d5b req-f102b13b-5db7-4a5a-9e1d-36242e1db236 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.178187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3f44f4bc-bbc4-40ea-ac58-f7077bd03d5b req-f102b13b-5db7-4a5a-9e1d-36242e1db236 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.189177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3f44f4bc-bbc4-40ea-ac58-f7077bd03d5b req-f102b13b-5db7-4a5a-9e1d-36242e1db236 service nova] Creating event network-changed:73c17b21-d012-4814-8efe-6acbce0320b1 for instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 on nch2-master-1 Jun 18 22:06:32.194513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:32.195036 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3f44f4bc-bbc4-40ea-ac58-f7077bd03d5b req-f102b13b-5db7-4a5a-9e1d-36242e1db236 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033826 Jun 18 22:06:32.195428 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 715/1443] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:32.201532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4789f906-2d16-4804-b56f-66a9d27aa98d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.203053 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:32.203053 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:06:32.203668 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eeb4a998-32d0-4527-8ebb-b80d458cf873 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.195605 Jun 18 22:06:32.204192 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 729/1444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:32.204590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4789f906-2d16-4804-b56f-66a9d27aa98d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.205078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4789f906-2d16-4804-b56f-66a9d27aa98d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.205892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4789f906-2d16-4804-b56f-66a9d27aa98d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.206964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4789f906-2d16-4804-b56f-66a9d27aa98d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.217914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.218739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.225662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.226369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.227139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.227803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.233907 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4789f906-2d16-4804-b56f-66a9d27aa98d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036907 Jun 18 22:06:32.237232 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 716/1445] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:06:32.246185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.247040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.255411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:32.257432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.257904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.259306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.260017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.286857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:32.346851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:32.357769 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7862be3b-d52a-4941-9daa-132c356fd6b6 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 204 len: 0 microversion: 2.1 time: 0.151418 Jun 18 22:06:32.358358 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 730/1446] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:32 2022] DELETE /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:32.364145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.364737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.371846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.372493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.373407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.374004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.405128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:32.422315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:32.431912 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c667dae6-3e67-40c9-a2ac-24c82a83752a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.192659 Jun 18 22:06:32.432822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 717/1447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:32.438394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.439151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.445920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.446375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.447164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.447608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.500678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cb8df56-6b14-40cf-967b-365dd938c727 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 204 len: 0 microversion: 2.1 time: 0.140502 Jun 18 22:06:32.501302 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 731/1448] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:32 2022] DELETE /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:32.506329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.507029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.513827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.514287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.515261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.515733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.632072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:32.640058 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1029cb6f-f0b0-478f-9f8d-6c2ae1bec64e tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1467 microversion: 2.1 time: 0.206450 Jun 18 22:06:32.640752 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 718/1449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1467 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:32.645509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.646344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.653058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.653583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.654464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.654960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.682630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:32.691869 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-060330d2-def5-4a9e-8abb-f16694c0d802 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.189402 Jun 18 22:06:32.692680 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 732/1450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:32.778955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:32.779692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:32.786754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.787251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.788124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:32.788600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:32.814564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:32.823360 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-644c73a4-0c35-4822-9023-0dd7b52cc8db tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1649 microversion: 2.1 time: 0.181362 Jun 18 22:06:32.824011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 719/1451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1649 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:32.930060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:32.938395 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7255833-a97d-483c-9c88-42d482eb4bda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1554 microversion: 2.1 time: 0.163392 Jun 18 22:06:32.938970 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 733/1452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:32 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:33.008672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:33.009735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:33.020164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.020911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.022233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.022959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.156817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:33.164450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24f9a5b0-071e-49a0-8e4e-8b3f2556e4c0 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1472 microversion: 2.1 time: 0.162228 Jun 18 22:06:33.164985 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 720/1453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:33 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:33.224663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:33.225581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:33.234559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.235020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.235791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.236222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.369124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:33.377439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-552e9e2a-9961-4247-8554-2790298077d1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.158900 Jun 18 22:06:33.378006 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 734/1454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:33 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:33.453246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:33.453860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:33.463447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.463905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.464718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.465192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.604554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:33.613565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d372d1d-fc03-4043-86a3-dbb19e62d97e tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.167995 Jun 18 22:06:33.614510 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 721/1455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:33 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:33.657791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:33.658953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:33.665275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.665754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.666554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.666987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.667126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f2c433-eb73-4288-b1bb-b962f15c37ce", "device": "/dev/xvdb"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:33.668911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:33.675346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.675879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.676872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.677546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.804242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:33.812402 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1df1c5b0-3d66-444c-9a0d-ba78616d768c tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1467 microversion: 2.1 time: 0.158800 Jun 18 22:06:33.813155 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 735/1456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:33 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1467 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:33.818120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:33.819300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:33.826875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.827324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.828103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:33.828547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:33.986672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:33.994715 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da197839-9410-41a2-853a-04193133dc10 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.180584 Jun 18 22:06:33.995374 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 736/1457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:33 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:33.999852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c47de858-94bb-4ced-b1a4-476969df095f req-5b9042d5-ffe7-47b0-898c-78726ddbf0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3", "name": "network-vif-unplugged", "status": "completed", "tag": "1daf0319-8098-4062-9abb-2e8692b60bc6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:34.008434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c47de858-94bb-4ced-b1a4-476969df095f req-5b9042d5-ffe7-47b0-898c-78726ddbf0f1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.008882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c47de858-94bb-4ced-b1a4-476969df095f req-5b9042d5-ffe7-47b0-898c-78726ddbf0f1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.019926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c47de858-94bb-4ced-b1a4-476969df095f req-5b9042d5-ffe7-47b0-898c-78726ddbf0f1 service nova] Creating event network-vif-unplugged:1daf0319-8098-4062-9abb-2e8692b60bc6 for instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 on nch1-master-1 Jun 18 22:06:34.024772 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c47de858-94bb-4ced-b1a4-476969df095f req-5b9042d5-ffe7-47b0-898c-78726ddbf0f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028232 Jun 18 22:06:34.025384 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 737/1458] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:34.030317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:34.031233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:34.037870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.038324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.039106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.039540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.203326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:34.211169 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08a01c66-889a-4939-9605-c3e3bffca20a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1649 microversion: 2.1 time: 0.184655 Jun 18 22:06:34.211731 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 738/1459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:34 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1649 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:34.216224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:34.216826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:34.222768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.223219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.223997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.224435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.357826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:34.366384 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ce54900b-5695-4f2f-a3ea-65947c5bfec3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1554 microversion: 2.1 time: 0.153691 Jun 18 22:06:34.366944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 739/1460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:34 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:34.371659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:34.372280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:34.378606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.379074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.379886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.380328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.633386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:34.641449 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5c407d7b-9f14-467e-b444-f5b0aa5e9f47 tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1472 microversion: 2.1 time: 0.273497 Jun 18 22:06:34.642107 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 740/1461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:34 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:34.656330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:34.656943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:34.663534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.663913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.664694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.665174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.857533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:34.865926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d11c3ff2-6437-4695-ba44-1e0a06f143aa tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.213444 Jun 18 22:06:34.866702 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 741/1462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:34 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:34.871072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:34.872558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:34.879258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.879711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:34.880475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:34.880919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.077367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:35.085371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62cb7f88-06e2-4da7-9c55-b9d1e3489fbb tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.217827 Jun 18 22:06:35.086057 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 742/1463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:34 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:35.094652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:35.095269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:35.101868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.102322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.103109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.103548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.236572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:35.244511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b8aa085e-03ea-4629-91f5-54161108fb1a tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1467 microversion: 2.1 time: 0.153783 Jun 18 22:06:35.245111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 743/1464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:35 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1467 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:35.249669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:35.250262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:35.256338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.256790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.257594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.258032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.385718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:35.394179 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0678e47a-faa7-431a-9b83-22ffde0bb6b4 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.148055 Jun 18 22:06:35.394754 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 744/1465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:35 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:35.399237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-cdc5c97f-6c66-40c3-9d04-be5bd591e2ab req-70d80009-1195-4dfd-9c26-58ff26adbad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3", "name": "network-vif-deleted", "tag": "1daf0319-8098-4062-9abb-2e8692b60bc6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:35.407529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-cdc5c97f-6c66-40c3-9d04-be5bd591e2ab req-70d80009-1195-4dfd-9c26-58ff26adbad6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.407987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-cdc5c97f-6c66-40c3-9d04-be5bd591e2ab req-70d80009-1195-4dfd-9c26-58ff26adbad6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.419578 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-cdc5c97f-6c66-40c3-9d04-be5bd591e2ab req-70d80009-1195-4dfd-9c26-58ff26adbad6 service nova] Creating event network-vif-deleted:1daf0319-8098-4062-9abb-2e8692b60bc6 for instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 on nch1-master-1 Jun 18 22:06:35.424490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-cdc5c97f-6c66-40c3-9d04-be5bd591e2ab req-70d80009-1195-4dfd-9c26-58ff26adbad6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028599 Jun 18 22:06:35.425073 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 745/1466] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:35.429937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:35.430628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:35.436660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.437154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.437916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.438352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.440917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:35.598537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:35.611944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fd170f4-383b-4722-9ac8-cca500a0d4b2 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1649 microversion: 2.1 time: 0.185667 Jun 18 22:06:35.612727 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 746/1467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:35 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1649 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:35.618124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:35.618764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:35.625175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.625629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.626554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.627040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.711980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:35.728327 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5cb59d0b-521f-47b2-a4bf-b734d71cd989 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 200 len: 1346 microversion: 2.1 time: 0.113978 Jun 18 22:06:35.729317 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 747/1468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:35 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 1346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:35.734647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:35.735322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:35.750780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.752209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.754170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.754615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.830826 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7eac04cd-ce85-4eba-9c5f-3b1fb161da43 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "POST /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 2.167850 Jun 18 22:06:35.833309 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 722/1469] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Jun 18 22:06:33 2022] POST /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-volume_attachments => generated 194 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:06:35.883997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:35.884704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:35.894014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.894664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:35.898169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:35.899147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.040828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:36.053460 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5de6be61-cafa-47bb-8055-0ed2bffaf92a tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1472 microversion: 2.1 time: 0.321687 Jun 18 22:06:36.054068 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 748/1470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:35 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1472 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:36.102797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:36.103437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:36.114577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.115054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.117353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.118821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.286913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:36.296203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ca46493c-5577-4982-b7c6-e7a21d22d1a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.417298 Jun 18 22:06:36.296904 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 723/1471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:35 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:36.302665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-632a7efb-c883-4792-b801-7e4d80669a68 req-b727b93c-1fc6-420c-b22f-16bda7ee3ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f606f0f8-7db0-447e-b67f-ca4a9b2550cf", "name": "network-vif-plugged", "status": "completed", "tag": "532c23d7-17bd-4c20-a044-70c767beb815"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:36.315484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-632a7efb-c883-4792-b801-7e4d80669a68 req-b727b93c-1fc6-420c-b22f-16bda7ee3ace service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.316270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-632a7efb-c883-4792-b801-7e4d80669a68 req-b727b93c-1fc6-420c-b22f-16bda7ee3ace service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.332644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-632a7efb-c883-4792-b801-7e4d80669a68 req-b727b93c-1fc6-420c-b22f-16bda7ee3ace service nova] Creating event network-vif-plugged:532c23d7-17bd-4c20-a044-70c767beb815 for instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf on nch1-master-1 Jun 18 22:06:36.339750 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-632a7efb-c883-4792-b801-7e4d80669a68 req-b727b93c-1fc6-420c-b22f-16bda7ee3ace service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041092 Jun 18 22:06:36.340821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 724/1472] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:36.348640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:36.349707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:36.359399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.360848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.363229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.363844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.662704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:36.676427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64628340-2b37-4679-8ce4-26e85ed744b6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.577727 Jun 18 22:06:36.686493 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 749/1473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:36 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:36.686493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:36.686795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:36.692882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.693375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.694510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.694952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.731188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:36.743015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4070adfa-b5fc-42cc-9202-8ce1d025ff93 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1467 microversion: 2.1 time: 0.400281 Jun 18 22:06:36.744239 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 725/1474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:36 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1467 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:36.759529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:36.760166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:36.771081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.771812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.772985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:36.773727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:36.796714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:37.416286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:37.435475 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b961934e-26f6-4a46-9191-30a0cd1b386b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.753223 Jun 18 22:06:37.445110 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 750/1475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:36 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:37.445110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:37.445110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:37.448026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.448665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.450568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.451013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.468799 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 HTTP/1.1 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3'} Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:37.471141 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:37.475396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-073f7563-e255-4593-92cf-6e3a6a5285e2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 404 len: 111 microversion: 2.1 time: 0.035548 Jun 18 22:06:37.476774 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 751/1476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:37 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:37.483702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:37.484667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:37.492831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.493647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.494836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.495514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.579059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:37.591344 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-74e3f316-4ae4-4ec8-8a84-622904e2f02c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 200 len: 1649 microversion: 2.1 time: 0.835876 Jun 18 22:06:37.592859 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 726/1477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:36 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 1649 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:37.598018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:37.598843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:37.606979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.607837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.608803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.609451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.829056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:37.849705 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-450a111b-333f-451d-84f7-27452931161c tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1472 microversion: 2.1 time: 0.370177 Jun 18 22:06:37.851230 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 752/1478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:37 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:37.858184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:37.860210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:37.873535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.877301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.878935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.879626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.903493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3/os-volume_attachments HTTP/1.1 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': '2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3'} Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:37.908225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5d3df129-9b17-4e05-adee-51ab301bd5e7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060260 Jun 18 22:06:37.915185 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 753/1479] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:06:37 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:37.936506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:37.943987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:37.952296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.952756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:37.953588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:37.954857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.075940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:38.087459 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-500ff63e-dbba-4338-a878-0b7dc687cfc5 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.493035 Jun 18 22:06:38.088333 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 727/1480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:37 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:38.100868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:38.101630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:38.119221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.119915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.121610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.122327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.517536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8783e0de2414f20ade6604bd0089fab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24245a540466462bb9a908267f505f28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:38.531065 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7423d6cf-2af5-4986-91f8-80dcdef0a1c8 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 200 len: 1467 microversion: 2.1 time: 0.441223 Jun 18 22:06:38.531673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 728/1481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:38 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 1467 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:38.541812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e927cf49-1e9a-43c3-8f28-4b5bc60d6752 req-1e9c6f1e-33ad-4617-9507-23e927712192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bdd659-86ea-4c21-b87a-ecc6cbd22350", "name": "network-vif-deleted", "tag": "73c17b21-d012-4814-8efe-6acbce0320b1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:38.562413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:38.564479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e927cf49-1e9a-43c3-8f28-4b5bc60d6752 req-1e9c6f1e-33ad-4617-9507-23e927712192 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.564978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e927cf49-1e9a-43c3-8f28-4b5bc60d6752 req-1e9c6f1e-33ad-4617-9507-23e927712192 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.586502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:38.592291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e927cf49-1e9a-43c3-8f28-4b5bc60d6752 req-1e9c6f1e-33ad-4617-9507-23e927712192 service nova] Creating event network-vif-deleted:73c17b21-d012-4814-8efe-6acbce0320b1 for instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 on nch2-master-1 Jun 18 22:06:38.599113 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2e7fd4b-d884-42e5-ad7b-416bc3f32799 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.666496 Jun 18 22:06:38.602657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 754/1482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:37 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:38.606139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e927cf49-1e9a-43c3-8f28-4b5bc60d6752 req-1e9c6f1e-33ad-4617-9507-23e927712192 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073225 Jun 18 22:06:38.606750 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 729/1483] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:38.620753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c2a586b1-bd2d-438d-945f-55996a4d9b4a req-1e6ea59c-a05b-41c3-b1d7-56d71e2efddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abd77eb-81f7-42a3-aa19-6da045f3cdf4", "name": "network-vif-plugged", "status": "completed", "tag": "eb5ce4c1-7c55-4e8b-a561-329649c8f723"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:38.634448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c2a586b1-bd2d-438d-945f-55996a4d9b4a req-1e6ea59c-a05b-41c3-b1d7-56d71e2efddc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.641058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c2a586b1-bd2d-438d-945f-55996a4d9b4a req-1e6ea59c-a05b-41c3-b1d7-56d71e2efddc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.651925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1586191021", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:38.667219 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c2a586b1-bd2d-438d-945f-55996a4d9b4a req-1e6ea59c-a05b-41c3-b1d7-56d71e2efddc service nova] Creating event network-vif-plugged:eb5ce4c1-7c55-4e8b-a561-329649c8f723 for instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 on nch1-master-1 Jun 18 22:06:38.681578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c2a586b1-bd2d-438d-945f-55996a4d9b4a req-1e6ea59c-a05b-41c3-b1d7-56d71e2efddc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068340 Jun 18 22:06:38.682801 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 730/1484] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:38.776091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:38.838051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-da225cec-3504-4bbf-8c72-e3e8e978526a req-3c17b320-632d-43cb-b2ab-0bc241794f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "name": "network-vif-unplugged", "status": "completed", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:38.862526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-da225cec-3504-4bbf-8c72-e3e8e978526a req-3c17b320-632d-43cb-b2ab-0bc241794f4d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.863850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-da225cec-3504-4bbf-8c72-e3e8e978526a req-3c17b320-632d-43cb-b2ab-0bc241794f4d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.905117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-da225cec-3504-4bbf-8c72-e3e8e978526a req-3c17b320-632d-43cb-b2ab-0bc241794f4d service nova] Creating event network-vif-unplugged:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch1-master-1 Jun 18 22:06:38.917215 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-da225cec-3504-4bbf-8c72-e3e8e978526a req-3c17b320-632d-43cb-b2ab-0bc241794f4d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.231377 Jun 18 22:06:38.919064 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 731/1485] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:38.936552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:38.939674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:38.961927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.965348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:38.966272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:38.969268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.393094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:39.408400 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6c677ee-1f9d-4c0f-bcf1-1b19a412ba9e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1322 microversion: 2.1 time: 0.482826 Jun 18 22:06:39.417461 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 732/1486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:38 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:39.417461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:39.420717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:39.431382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.442083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.444037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.444684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.488685 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 HTTP/1.1 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '42bdd659-86ea-4c21-b87a-ecc6cbd22350'} Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:39.492276 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:39.497189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:39.499649 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8319406a-a821-4270-9ea9-3a99a0a5b06d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 404 len: 111 microversion: 2.1 time: 0.089215 Jun 18 22:06:39.501159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 733/1487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:39 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:39.508391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:39.508993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:39.535542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.536689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.537737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.538345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.585335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.586162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.586692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lazy-loading 'fault' on Instance uuid a2cda02d-382a-44e4-99c8-614e7cf17b1d {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:39.705216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '545b6c16175f418587d6c8649b3ba8b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5285b07988c4c8581f047981271fee1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:39.734411 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-077e30e0-8b37-443a-9522-9ffa5116560f tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 200 len: 1306 microversion: 2.1 time: 0.231735 Jun 18 22:06:39.748668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 734/1488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:39 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 1306 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:39.756379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:39.757532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:39.766491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.767449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.769862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.770604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.926982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:39.928109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:39.928756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:39.929527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:39.930789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:39.942291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.942785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.944001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:39.945544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:39.965671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:39.971300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:39.977195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:39.977763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-20a97290-47c8-4b78-ae51-d1056083575a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.227024 Jun 18 22:06:39.978342 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 735/1489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:39 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:39.983146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1cb4b887-3e17-4e0d-b15b-4abac9acfb64 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea1423bb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:39.998099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:40.000789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:40.054925 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62fcab53-11d1-44b4-be2b-f5ba95c37854 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.450820 Jun 18 22:06:40.056206 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 755/1490] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:40.061335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.062216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] [instance: 8bb4fcc9-fabe-4536-9514-c539642cc9c2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:40.069976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.070679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.071625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.072216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.132755 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] HTTP exception thrown: Instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 could not be found. Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Request method failure captured: Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 HTTP/1.1 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkvXPO7YHRddVdH0hDwBD-LLy1UHCR9tyhU23I9wbly48TIZmP1N98UFV3EeLxe0E_o2nrk-IhP_RtTDOFQpDzjIeQmFPjkoNwevf_boNLPCrJ--dgtIhN4E09enEyw3Ry7KXIzgb6iDiqDTVXIHyAAD_ZSoEBOczbO4mnn7Ze1aDY8 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 24245a540466462bb9a908267f505f28 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/24245a540466462bb9a908267f505f28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/24245a540466462bb9a908267f505f28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/24245a540466462bb9a908267f505f28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_24245a540466462bb9a908267f505f28", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 24245a540466462bb9a908267f505f28 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminTestJSON-784907320 Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminTestJSON-784907320-project Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: f8783e0de2414f20ade6604bd0089fab Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminTestJSON-784907320-project Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 could not be found. Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8bb4fcc9-fabe-4536-9514-c539642cc9c2'} Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 could not be found. Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 could not be found. Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:40.134988 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 could not be found. Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] Returning 404 to user: Instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4308ce88-a5ce-4e7a-bd00-f848343c33e0 tempest-ServersAdminTestJSON-784907320 tempest-ServersAdminTestJSON-784907320-project] 10.222.0.30 "GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2" status: 404 len: 111 microversion: 2.1 time: 0.081188 Jun 18 22:06:40.139765 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 756/1491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:40 2022] GET /compute/v2.1/servers/8bb4fcc9-fabe-4536-9514-c539642cc9c2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:40.148860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.149519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:40.158526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.159317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.160161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.160627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.321980 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1cb4b887-3e17-4e0d-b15b-4abac9acfb64 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99" status: 202 len: 0 microversion: 2.1 time: 0.342372 Jun 18 22:06:40.322944 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 736/1492] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:39 2022] DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:40.337338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de75e2da-9a1e-4123-93c4-c844c65c834a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.337997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de75e2da-9a1e-4123-93c4-c844c65c834a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:40.431426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de75e2da-9a1e-4123-93c4-c844c65c834a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:40.433711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:40.440182 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de75e2da-9a1e-4123-93c4-c844c65c834a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317" status: 200 len: 1215 microversion: 2.1 time: 0.115906 Jun 18 22:06:40.440986 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 737/1493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:40 2022] GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:40.449327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a8659be-c0c8-4dbf-b140-bd312931ea0c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea142ae5e0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.458067 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-113541d8-d627-4e24-9b0f-0c19757cb4a6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1307 microversion: 2.1 time: 0.317469 Jun 18 22:06:40.458708 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 757/1494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:40 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1307 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:40.465024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.465963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:40.473073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.473528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.474494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.474930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.709871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 603306c7-a28f-4251-985a-cc026c0c8c88 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:40.725524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-61ff26e6-a7c4-4fdb-9cee-ea59f41b1a37 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 2421 microversion: 2.25 time: 0.264995 Jun 18 22:06:40.726334 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 758/1495] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:40 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 2421 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:40.731649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.732536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:40.740477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.741124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.742132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.742668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.761006 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0a8659be-c0c8-4dbf-b140-bd312931ea0c tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b" status: 202 len: 0 microversion: 2.1 time: 0.318733 Jun 18 22:06:40.765209 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 738/1496] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:40 2022] DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:40.768510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:40.768896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:40.785408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.786296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.787112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.787550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.819628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:40.830669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.831436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.858691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'flavor' on Instance uuid 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:40.879864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'system_metadata' on Instance uuid 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:40.945021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:40.945930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'metadata' on Instance uuid 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:40.953663 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-27de1a0e-c39e-4c7b-8d8c-b63b3f580dda tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1471 microversion: 2.1 time: 0.226006 Jun 18 22:06:40.965783 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 759/1497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:40 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:40.971634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9213faff-2427-4753-b36b-4e7494a6775b req-b3047c7e-172d-4dbd-8b62-028d3c2257d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2cda02d-382a-44e4-99c8-614e7cf17b1d", "name": "network-vif-deleted", "tag": "a3e1ef97-77e2-445b-90d4-3c9dfe6c5db1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:40.980401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9213faff-2427-4753-b36b-4e7494a6775b req-b3047c7e-172d-4dbd-8b62-028d3c2257d7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:40.980953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9213faff-2427-4753-b36b-4e7494a6775b req-b3047c7e-172d-4dbd-8b62-028d3c2257d7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:40.993068 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9213faff-2427-4753-b36b-4e7494a6775b req-b3047c7e-172d-4dbd-8b62-028d3c2257d7 service nova] Creating event network-vif-deleted:a3e1ef97-77e2-445b-90d4-3c9dfe6c5db1 for instance a2cda02d-382a-44e4-99c8-614e7cf17b1d on nch1-master-1 Jun 18 22:06:40.998940 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9213faff-2427-4753-b36b-4e7494a6775b req-b3047c7e-172d-4dbd-8b62-028d3c2257d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031197 Jun 18 22:06:41.000120 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 760/1498] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:41.007167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:41.008438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:41.015536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:41.016223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:41.017083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:41.017521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:41.046449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'flavor' on Instance uuid 603306c7-a28f-4251-985a-cc026c0c8c88 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:41.060026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Going to try to live migrate instance to nch2-master-1 {{(pid=130903) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:06:41.073794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:41.074404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:41.201414 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b30c9507-c309-4a0a-805e-55307b307028 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317" status: 204 len: 0 microversion: 2.1 time: 0.437962 Jun 18 22:06:41.204583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 739/1499] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:40 2022] DELETE /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:41.211151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:41.212100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] [instance: a2cda02d-382a-44e4-99c8-614e7cf17b1d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:41.219163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:41.219611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:41.220406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:41.220835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:41.235649 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] HTTP exception thrown: Instance a2cda02d-382a-44e4-99c8-614e7cf17b1d could not be found. Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Request method failure captured: Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d HTTP/1.1 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkui1q87MEdvmGi-I2wdyGpr0hcvwife71usZds-DckYEfaf5h7vCpzJloKaDPHLtQ8Gt3_citApg1opi97r0hRTo2eX5hpqLWtYhZRoVzXhb7Mn_-DxpsLZlrsPfcR8YqPxAkIuf2ZWgXIqdAGN_dfH2EUNRRUOYrMwMzKx0ueJodg Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5285b07988c4c8581f047981271fee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5285b07988c4c8581f047981271fee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5285b07988c4c8581f047981271fee1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c5285b07988c4c8581f047981271fee1 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1699204307 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 545b6c16175f418587d6c8649b3ba8b0 Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersOnMultiNodesTest-1699204307-project Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a2cda02d-382a-44e4-99c8-614e7cf17b1d could not be found. Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a2cda02d-382a-44e4-99c8-614e7cf17b1d'} Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2cda02d-382a-44e4-99c8-614e7cf17b1d could not be found. Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2cda02d-382a-44e4-99c8-614e7cf17b1d could not be found. Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:41.237790 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2cda02d-382a-44e4-99c8-614e7cf17b1d could not be found. Jun 18 22:06:41.242667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:41.245980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] Returning 404 to user: Instance a2cda02d-382a-44e4-99c8-614e7cf17b1d could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:41.247050 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e095a948-d9ae-4808-b182-aeb4f5ef67fa tempest-ServersOnMultiNodesTest-1699204307 tempest-ServersOnMultiNodesTest-1699204307-project] 10.222.0.30 "GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d" status: 404 len: 111 microversion: 2.1 time: 0.041055 Jun 18 22:06:41.247822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 740/1500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:41 2022] GET /compute/v2.1/servers/a2cda02d-382a-44e4-99c8-614e7cf17b1d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:41.258900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68a53903-c7a8-4145-b2cc-ea996b33752a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'create', calling method: .version_select at 0x7fea142ae280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-656299136", "description": "tempest-description-217942548"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:41.503923 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68a53903-c7a8-4145-b2cc-ea996b33752a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.250848 Jun 18 22:06:41.504577 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 741/1501] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:06:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:41.515201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9c958d3a-ffb2-44b2-ac44-674bb64a58c7 req-06b8f510-db63-4528-b47c-71b715b2c57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb4fcc9-fabe-4536-9514-c539642cc9c2", "name": "network-vif-deleted", "tag": "5f35a6e4-ed0a-4464-9526-b7258e8cc72d"}, {"name": "network-changed", "server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:41.531896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9c958d3a-ffb2-44b2-ac44-674bb64a58c7 req-06b8f510-db63-4528-b47c-71b715b2c57a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:41.532392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9c958d3a-ffb2-44b2-ac44-674bb64a58c7 req-06b8f510-db63-4528-b47c-71b715b2c57a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:41.555602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9c958d3a-ffb2-44b2-ac44-674bb64a58c7 req-06b8f510-db63-4528-b47c-71b715b2c57a service nova] Creating event network-vif-deleted:5f35a6e4-ed0a-4464-9526-b7258e8cc72d for instance 8bb4fcc9-fabe-4536-9514-c539642cc9c2 on nch2-master-1 Jun 18 22:06:41.556403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9c958d3a-ffb2-44b2-ac44-674bb64a58c7 req-06b8f510-db63-4528-b47c-71b715b2c57a service nova] Creating event network-changed:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch1-master-1 Jun 18 22:06:41.568316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9c958d3a-ffb2-44b2-ac44-674bb64a58c7 req-06b8f510-db63-4528-b47c-71b715b2c57a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062162 Jun 18 22:06:41.573762 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 742/1502] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:42.179530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4325e5a8-766d-4c73-9843-0b95ed068a4c tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:42.180926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4325e5a8-766d-4c73-9843-0b95ed068a4c tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] [instance: 75c4c316-02a0-4b5d-9fcb-c476249fd506] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:42.198942 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4325e5a8-766d-4c73-9843-0b95ed068a4c tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] HTTP exception thrown: Instance 75c4c316-02a0-4b5d-9fcb-c476249fd506 could not be found. Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4325e5a8-766d-4c73-9843-0b95ed068a4c tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Request method failure captured: Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/75c4c316-02a0-4b5d-9fcb-c476249fd506/action HTTP/1.1 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkxZGlFz3Cv5zJUmwVrDmFGPK0y3SKS2Mlsb0ZjYJs99oQvxRrXaXkYxcg52TzdBaD7nRpmeR6jlV9bGCMFSQbH7CtrqKRQpZGRHCGnhKHbwhZn2shvaG1x5sQAfQckT9FWpiCH_4s6fVXYITVO5SaULK6QrQnZ8pttQmGM8YcSHaZ0 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cc1ea33e5234f28a39320c835dca69c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8d0510f569a64acd8d80a58399597124 Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: {"migrate": {}} Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 75c4c316-02a0-4b5d-9fcb-c476249fd506 could not be found. Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '75c4c316-02a0-4b5d-9fcb-c476249fd506', 'body': {'migrate': {}}} Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c4c316-02a0-4b5d-9fcb-c476249fd506 could not be found. Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c4c316-02a0-4b5d-9fcb-c476249fd506 could not be found. Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:42.208153 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:42.213526 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:42.213526 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:42.213526 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:42.213526 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:42.213526 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c4c316-02a0-4b5d-9fcb-c476249fd506 could not be found. Jun 18 22:06:42.213526 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:42.214979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4325e5a8-766d-4c73-9843-0b95ed068a4c tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Returning 404 to user: Instance 75c4c316-02a0-4b5d-9fcb-c476249fd506 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:42.217737 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4325e5a8-766d-4c73-9843-0b95ed068a4c tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/75c4c316-02a0-4b5d-9fcb-c476249fd506/action" status: 404 len: 111 microversion: 2.1 time: 0.642484 Jun 18 22:06:42.219496 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 743/1503] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:41 2022] POST /compute/v2.1/servers/75c4c316-02a0-4b5d-9fcb-c476249fd506/action => generated 111 bytes in 645 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:42.231733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:42.233614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:42.237931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:42.247992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:42.264255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:42.267698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:42.268741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:42.536895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:42.549713 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bf51559-3e6b-4443-bd1e-7a4645370239 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.328704 Jun 18 22:06:42.551348 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 744/1504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:42 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:42.557298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:42.558272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:42.566737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:42.580728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:42.581730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:42.582759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:42.660628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:42.670092 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6248ecb-94c1-4328-828d-279e33429957 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317" status: 200 len: 1219 microversion: 2.1 time: 0.116778 Jun 18 22:06:42.680228 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 745/1505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:42 2022] GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:42.685630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:42.686624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:42.695330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:42.696124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:42.697285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:42.697724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:42.893561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:42.904706 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-82dbdc56-c5e7-47de-a953-90079671d443 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1486 microversion: 2.1 time: 0.223114 Jun 18 22:06:42.909176 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 746/1506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:42 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1486 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:42.917791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30c67e37-92fd-47c8-832a-4b0f7e90a676 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Action: 'update', calling method: .version_select at 0x7fea19dc35e0>, body: {"security_group": {"name": "tempest-sg-hth-396874947", "description": "tempest-description-hth-124861549"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:43.100394 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30c67e37-92fd-47c8-832a-4b0f7e90a676 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/e126d140-60cc-482d-9e98-39eaeb217064" status: 200 len: 216 microversion: 2.1 time: 0.192578 Jun 18 22:06:43.107605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 747/1507] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Jun 18 22:06:42 2022] PUT /compute/v2.1/os-security-groups/e126d140-60cc-482d-9e98-39eaeb217064 => generated 216 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:43.114696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1762166624", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:43.207360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:43.361700 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-97554269-09fe-49c6-b57b-632d46f5e3df tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/action" status: 202 len: 0 microversion: 2.25 time: 2.360054 Jun 18 22:06:43.363396 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 761/1508] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:06:41 2022] POST /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/action => generated 0 bytes in 2362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:43.369777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-779394803"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:43.371012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:43.381825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.382594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.384619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.385646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.589270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:43.589741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:43.590300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:43.590804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:43.591353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:43.607929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.608776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.609888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.610579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.621115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:43.639011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Getting quotas for project 1bd5b89d294a4ce588fc4dd900fe952c. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:43.645792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Getting quotas for user 33ec146b95734dcea62aad13f5105bdd and project 1bd5b89d294a4ce588fc4dd900fe952c. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:43.663071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:43.665940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:43.721450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed005636-266c-4901-8b81-ff4612f4c4c8 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612059 Jun 18 22:06:43.728668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 748/1509] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:43.734430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d28b8d66-42e0-43ab-9f46-1244d3c40f33 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea142aeb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:43.803599 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d28b8d66-42e0-43ab-9f46-1244d3c40f33 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/e126d140-60cc-482d-9e98-39eaeb217064" status: 200 len: 216 microversion: 2.1 time: 0.073286 Jun 18 22:06:43.804195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 749/1510] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:06:43 2022] GET /compute/v2.1/os-security-groups/e126d140-60cc-482d-9e98-39eaeb217064 => generated 216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:43.811572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:43.812513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:43.835043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.835511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.838451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.839999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.861741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:43.915099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b15450db-cb9f-46a7-a786-697853449711 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "POST /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4/action" status: 202 len: 0 microversion: 2.1 time: 0.549862 Jun 18 22:06:43.916115 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 762/1511] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:06:43 2022] POST /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:06:43.922838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:43.924451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:43.933004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.933884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:43.934937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:43.935491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:44.147476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:44.157684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:44.159176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:44.160357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15184b3e-d1cc-4cf3-a830-b3bd6940ccd4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.354607 Jun 18 22:06:44.160922 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 750/1512] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:43 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:44.171850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:44.173228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:44.183796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:44.184259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:44.185082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:44.185714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:44.201864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:44.206316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 HTTP/1.1 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '9473bc11-bdc3-40ed-8e36-8bcb7c78a317'} Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:44.207925 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a73a4664-483c-4caa-b7eb-b70836ab4654 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317" status: 404 len: 111 microversion: 2.1 time: 0.047470 Jun 18 22:06:44.225291 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 751/1513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:44 2022] GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:44.233119 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2186e3a-3935-4d0f-8455-29ccb089c235 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.315180 Jun 18 22:06:44.234635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 763/1514] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:43 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:44.236169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6dcee3d-718a-4721-b949-a2618d826965 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:44.236838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f6dcee3d-718a-4721-b949-a2618d826965 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:44.240204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d58f624d-8667-4641-9216-1132125aa5a9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14377790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:44.352661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f6dcee3d-718a-4721-b949-a2618d826965 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:44.362180 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f6dcee3d-718a-4721-b949-a2618d826965 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1222 microversion: 2.1 time: 0.150336 Jun 18 22:06:44.363313 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 752/1515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:44 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:44.379577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24fe795d-7884-421a-b293-e2aa9dc0d259 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142ae9d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:44.445876 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24fe795d-7884-421a-b293-e2aa9dc0d259 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790" status: 200 len: 1411 microversion: 2.1 time: 0.080283 Jun 18 22:06:44.453456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 753/1516] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:44 2022] GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 => generated 1411 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:44.507126 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d58f624d-8667-4641-9216-1132125aa5a9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e126d140-60cc-482d-9e98-39eaeb217064" status: 202 len: 0 microversion: 2.1 time: 0.270661 Jun 18 22:06:44.511756 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 764/1517] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:44 2022] DELETE /compute/v2.1/os-security-groups/e126d140-60cc-482d-9e98-39eaeb217064 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:44.520025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-502328523", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:44.603621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:44.775870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-611448869", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:44.841462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:06:45.149724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:45.150146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:45.150618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:45.151024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:45.151432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:45.162885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.163223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.164029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.164528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.205742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Getting quotas for project 6a3b4b4b24df43cdb92b0a8206d14ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:45.211909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Getting quotas for user 8097bb116d8f47b2aca3970d51a46030 and project 6a3b4b4b24df43cdb92b0a8206d14ef0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:45.230149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:45.233663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:45.305444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-40cffb17-da9a-49ac-8b3f-73b8cc2635b3 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850706 Jun 18 22:06:45.306380 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 754/1518] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:45.311890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17dc8bff-67cb-4735-bff6-f9c8c62a91e8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142aeb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:45.380992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17dc8bff-67cb-4735-bff6-f9c8c62a91e8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790" status: 200 len: 1411 microversion: 2.1 time: 0.073230 Jun 18 22:06:45.382123 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 755/1519] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:45 2022] GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:45.389021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:45.389737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:45.398479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.398940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.400680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.401159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.416764 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 HTTP/1.1 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '42bdd659-86ea-4c21-b87a-ecc6cbd22350'} Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:45.419039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:45.423319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:45.426702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-caf88b1a-c2c7-4275-9803-1d00043eec13 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 404 len: 111 microversion: 2.1 time: 0.037384 Jun 18 22:06:45.427727 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 756/1520] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:45 2022] DELETE /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:45.434801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:45.435478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:45.443232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.444390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.449506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.450087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.501367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:06:45.501797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:06:45.502363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:06:45.502779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:06:45.503192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:06:45.516277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.516888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.517839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.518309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.574557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:06:45.580211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:06:45.593804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:45.595612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:06:45.598169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:06:45.651441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e262e91-25c5-40ce-9b9e-11a3c61a9f57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140272 Jun 18 22:06:45.652690 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 765/1521] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:06:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:06:45.657721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:45.659178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:45.665936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.666973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.667978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:45.668832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:45.843960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:45.865688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:45.868197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:45.874847 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52857165-3717-49f8-a5aa-8b157b7be4cb tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.444081 Jun 18 22:06:45.879006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 757/1522] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:45 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:45.895948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9535c55b-ebbc-408e-aa3a-234942b72219 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:45.897610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9535c55b-ebbc-408e-aa3a-234942b72219 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:45.974852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:45.990090 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b4f490d-7d3a-48cb-95d2-1483e71dea3f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.335956 Jun 18 22:06:45.990875 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 766/1523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:45 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:46.012786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.013557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:46.033880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.038725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.039954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.041608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.111228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9535c55b-ebbc-408e-aa3a-234942b72219 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:46.118958 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9535c55b-ebbc-408e-aa3a-234942b72219 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1213 microversion: 2.1 time: 0.236058 Jun 18 22:06:46.128905 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 758/1524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:45 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1213 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:46.134624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0db7fa45-8e9e-4359-8bf9-d5a4f82073f6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea19dd19d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.418934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0db7fa45-8e9e-4359-8bf9-d5a4f82073f6 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790" status: 204 len: 0 microversion: 2.1 time: 0.288604 Jun 18 22:06:46.419882 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 759/1525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:46 2022] DELETE /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:46.428850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:46.432387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.433569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 42bdd659-86ea-4c21-b87a-ecc6cbd22350] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:46.446127 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-47e26657-96ba-447e-bccf-596c3906b01b tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.440234 Jun 18 22:06:46.447263 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 767/1526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:45 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:46.454786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.455372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.456118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83829631-05c7-4711-ac72-6473b5df937b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.456769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.456909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83829631-05c7-4711-ac72-6473b5df937b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:46.457832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.493738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 HTTP/1.1 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '42bdd659-86ea-4c21-b87a-ecc6cbd22350'} Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.495920 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. Jun 18 22:06:46.500167 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.502735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Instance 42bdd659-86ea-4c21-b87a-ecc6cbd22350 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:46.503891 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de2b8740-029f-4558-9d6b-8933c0a48b2d tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350" status: 404 len: 111 microversion: 2.1 time: 0.083026 Jun 18 22:06:46.505241 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 760/1527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:46 2022] GET /compute/v2.1/servers/42bdd659-86ea-4c21-b87a-ecc6cbd22350 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:46.553190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83829631-05c7-4711-ac72-6473b5df937b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:46.562220 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83829631-05c7-4711-ac72-6473b5df937b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1214 microversion: 2.1 time: 0.110705 Jun 18 22:06:46.563843 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 768/1528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:46 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:46.585612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0eccb05b-a6ae-442a-b60b-926b2bf208d4 req-e2de861f-9732-4fda-bfa9-d7a05b269e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "name": "network-vif-unplugged", "status": "completed", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:46.610576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0eccb05b-a6ae-442a-b60b-926b2bf208d4 req-e2de861f-9732-4fda-bfa9-d7a05b269e1b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.611587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0eccb05b-a6ae-442a-b60b-926b2bf208d4 req-e2de861f-9732-4fda-bfa9-d7a05b269e1b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.656210 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0eccb05b-a6ae-442a-b60b-926b2bf208d4 req-e2de861f-9732-4fda-bfa9-d7a05b269e1b service nova] Creating event network-vif-unplugged:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch1-master-1 Jun 18 22:06:46.668528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0eccb05b-a6ae-442a-b60b-926b2bf208d4 req-e2de861f-9732-4fda-bfa9-d7a05b269e1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103281 Jun 18 22:06:46.672347 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 769/1529] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:46.718255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ab7b228-f3e9-4c06-a489-ea0c8b76fb5f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea1454eb80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.765344 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0ab7b228-f3e9-4c06-a489-ea0c8b76fb5f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Image not found. Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ab7b228-f3e9-4c06-a489-ea0c8b76fb5f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 HTTP/1.1 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '5df053ab-6472-4cb7-a726-23b98015e790'} Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5df053ab-6472-4cb7-a726-23b98015e790 Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:06:46.770879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5df053ab-6472-4cb7-a726-23b98015e790 could not be found. Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ab7b228-f3e9-4c06-a489-ea0c8b76fb5f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:46.775420 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ab7b228-f3e9-4c06-a489-ea0c8b76fb5f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790" status: 404 len: 62 microversion: 2.1 time: 0.098135 Jun 18 22:06:46.778680 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 770/1530] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:06:46 2022] GET /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:06:46.788900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14e9fe49-1ba5-4f33-bb6e-c1fa57ee6902 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.791000 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:46.791000 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:06:46.792739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e9fe49-1ba5-4f33-bb6e-c1fa57ee6902 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.793179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea145504c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.793652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e9fe49-1ba5-4f33-bb6e-c1fa57ee6902 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.794626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e9fe49-1ba5-4f33-bb6e-c1fa57ee6902 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.796007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e9fe49-1ba5-4f33-bb6e-c1fa57ee6902 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.825995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14e9fe49-1ba5-4f33-bb6e-c1fa57ee6902 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.319330 Jun 18 22:06:46.834476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 761/1531] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:06:46 2022] GET /compute/v2.1/os-services => generated 947 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:46.844056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.845000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:46.866877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:46.879297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.880075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.888193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.888656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.944449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:46.945386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.security_group_api [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b not found {{(pid=130903) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:46.946169 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.946169 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b HTTP/1.1 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: exception: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'cb92fb13-5c6b-4dab-83ef-a7f9863af22b'} Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:46.949470 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] Jun 18 22:06:46.953573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:46.958044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group cb92fb13-5c6b-4dab-83ef-a7f9863af22b does not exist Jun 18 22:06:46.958044 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-f7da3378-3e72-4945-9901-55df14741146'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:46.960213 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d13063d8-ff6c-4f8c-bdb1-2383202345c9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b" status: 404 len: 194 microversion: 2.1 time: 0.180030 Jun 18 22:06:46.961374 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 771/1532] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:46 2022] DELETE /compute/v2.1/os-security-groups/cb92fb13-5c6b-4dab-83ef-a7f9863af22b => generated 194 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:46.974270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c30b57f-0445-49f9-95c5-8f0f763795c8 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:46.976196 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:46.976196 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:46.981320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c30b57f-0445-49f9-95c5-8f0f763795c8 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.982081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c30b57f-0445-49f9-95c5-8f0f763795c8 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:46.983309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c30b57f-0445-49f9-95c5-8f0f763795c8 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:46.983980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c30b57f-0445-49f9-95c5-8f0f763795c8 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.013880 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c30b57f-0445-49f9-95c5-8f0f763795c8 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.050890 Jun 18 22:06:47.015846 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 772/1533] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Jun 18 22:06:46 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:47.028583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:47.032208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:47.040376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.041253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.042964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.045125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.643293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:47.655723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9d734d03-32ee-4c4c-ab6c-666fe142a89d tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1504 microversion: 2.1 time: 0.819392 Jun 18 22:06:47.656500 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 762/1534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:46 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1504 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:47.676341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea19dc3700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:47.712165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:47.724553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:47.724913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:47.725550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:47.726119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.726119 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99 HTTP/1.1 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2cc2a51e-72db-4cb7-b409-1223ae683f99'} Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:47.728703 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 2cc2a51e-72db-4cb7-b409-1223ae683f99 does not exist Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-086e93f8-5de1-404e-ae2f-e715e7963899'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3869dd4c-00f6-48d9-bbda-874fee033495 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99" status: 404 len: 194 microversion: 2.1 time: 0.071720 Jun 18 22:06:47.734457 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 763/1535] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:47 2022] DELETE /compute/v2.1/os-security-groups/2cc2a51e-72db-4cb7-b409-1223ae683f99 => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:47.742035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:47.742035 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a617883-352d-49bc-b7ce-cfc7cfd454dc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.713284 Jun 18 22:06:47.742035 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 773/1536] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:47 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:47.742794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:47.742794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:47.744588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cae6a97a-0da4-4b8f-a2d5-0870ef515516 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:47.744772 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:47.744772 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:47.757122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.758058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.759219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.759990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.760225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae6a97a-0da4-4b8f-a2d5-0870ef515516 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.760685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae6a97a-0da4-4b8f-a2d5-0870ef515516 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.764964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae6a97a-0da4-4b8f-a2d5-0870ef515516 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.767009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae6a97a-0da4-4b8f-a2d5-0870ef515516 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.804627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cae6a97a-0da4-4b8f-a2d5-0870ef515516 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064213 Jun 18 22:06:47.811531 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 774/1537] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:06:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:47.818148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:47.818775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:47.825797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.826257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.827095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.827530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.912953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:47.921385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-99123de8-c1e0-4e98-a380-5472140755ff tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1271 microversion: 2.1 time: 0.108542 Jun 18 22:06:47.921982 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 775/1538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:47 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:47.926800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:47.927706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:47.934469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.935265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.936488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:47.937258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:47.990639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:48.001322 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64733bb3-dfdc-4598-9252-50f870408b96 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.268914 Jun 18 22:06:48.002149 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 764/1539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:47 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:48.012432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.014543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:48.026490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.027476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.028924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.029735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.120808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:48.129073 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2cf27762-a894-48d1-852a-bc12b6947325 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1272 microversion: 2.1 time: 0.125642 Jun 18 22:06:48.129672 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 765/1540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:48 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:48.136146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea19e35040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.143620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:48.152441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3e830a4-cae1-498b-897c-db561e76db3e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.229178 Jun 18 22:06:48.153015 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 776/1541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:47 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:48.157792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-345a2daa-1c65-410d-9b26-bacf886732f1 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.158964 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:48.158964 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:48.160645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-345a2daa-1c65-410d-9b26-bacf886732f1 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.161113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-345a2daa-1c65-410d-9b26-bacf886732f1 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.162076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-345a2daa-1c65-410d-9b26-bacf886732f1 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.162675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-345a2daa-1c65-410d-9b26-bacf886732f1 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.166494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:48.167102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 197bdacb-21d1-454c-921b-aa54ef220f8b not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:48.167638 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.167638 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b HTTP/1.1 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '197bdacb-21d1-454c-921b-aa54ef220f8b'} Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:48.169504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 197bdacb-21d1-454c-921b-aa54ef220f8b does not exist Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-a139149f-964f-4de6-9e0a-63df5feb8b8c'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3db68b5e-0b13-460f-b438-a0db2efec4b3 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b" status: 404 len: 194 microversion: 2.1 time: 0.040068 Jun 18 22:06:48.173874 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 766/1542] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:48 2022] DELETE /compute/v2.1/os-security-groups/197bdacb-21d1-454c-921b-aa54ef220f8b => generated 194 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:48.180188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14526a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.195053 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-345a2daa-1c65-410d-9b26-bacf886732f1 tempest-ServicesAdminTestJSON-1908980870 tempest-ServicesAdminTestJSON-1908980870-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.040629 Jun 18 22:06:48.195833 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 777/1543] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:06:48 2022] GET /compute/v2.1/os-services => generated 947 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:48.215265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:48.216474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 61e082f0-c880-4dfe-baef-fca3c32b5037 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:48.216827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.216827 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037 HTTP/1.1 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '61e082f0-c880-4dfe-baef-fca3c32b5037'} Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:48.218983 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] Jun 18 22:06:48.223200 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.227182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 61e082f0-c880-4dfe-baef-fca3c32b5037 does not exist Jun 18 22:06:48.227182 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-2a38c2ef-d9af-4990-ae85-4b3b80c1d851'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:48.228323 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-956c43af-afc9-46de-9894-decaa92c8129 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037" status: 404 len: 194 microversion: 2.1 time: 0.052145 Jun 18 22:06:48.232275 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 767/1544] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:48 2022] DELETE /compute/v2.1/os-security-groups/61e082f0-c880-4dfe-baef-fca3c32b5037 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:48.238452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea14550ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.263242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:48.264202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.security_group_api [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group d74acec4-ebbf-49aa-835e-df320edebc49 not found {{(pid=130903) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:48.264743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.264743 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49 HTTP/1.1 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: exception: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd74acec4-ebbf-49aa-835e-df320edebc49'} Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:48.266922 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] Jun 18 22:06:48.271555 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.275602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group d74acec4-ebbf-49aa-835e-df320edebc49 does not exist Jun 18 22:06:48.275602 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-53a4be2d-a06b-4f7a-9eb0-bb84e8902c14'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:48.276735 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56bfb8e5-cbe9-4cac-986c-43bfb97dff78 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49" status: 404 len: 194 microversion: 2.1 time: 0.042744 Jun 18 22:06:48.277365 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 778/1545] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:48 2022] DELETE /compute/v2.1/os-security-groups/d74acec4-ebbf-49aa-835e-df320edebc49 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:48.285934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea19e35550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.313582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:06:48.314315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Neutron security group 2f3522be-240c-45e3-a894-0f3d19b31edf not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:06:48.315029 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.315029 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf HTTP/1.1 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2f3522be-240c-45e3-a894-0f3d19b31edf'} Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:06:48.317062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Security group 2f3522be-240c-45e3-a894-0f3d19b31edf does not exist Jun 18 22:06:48.322098 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-f9cdbcf1-6814-4a67-930f-468a39d4644b'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:48.325671 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aaf6fe8e-0bfa-4c3a-80d2-0f6f069392ad tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf" status: 404 len: 194 microversion: 2.1 time: 0.042814 Jun 18 22:06:48.326456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 768/1546] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:48 2022] DELETE /compute/v2.1/os-security-groups/2f3522be-240c-45e3-a894-0f3d19b31edf => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:06:48.334562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.335064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:48.343520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.344380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.345580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.346128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.374659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:48.488789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee41e74f-7f03-4456-9090-afeb1f5eb799 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 204 len: 0 microversion: 2.1 time: 0.158096 Jun 18 22:06:48.492480 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 779/1547] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:48 2022] DELETE /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:06:48.498059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.498709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:48.506129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.506576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.507353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.507783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.674165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.674941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:48.684360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.685145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.686294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.686983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.723947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:48.736287 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a552a467-ab53-40fa-a485-a1d40128f64f tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1647 microversion: 2.1 time: 0.242156 Jun 18 22:06:48.737566 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 769/1548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:48 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1647 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:48.750684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-05b91bd1-e6d8-41ff-bb9b-61c7d2ff0194 req-438c45d6-5e4e-4229-9fe0-bc10b91c0ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb4d72e-b423-48b3-aa53-de6ffc4b0b8c", "tag": "56b4df7d-c972-405f-9332-4091cf5bd967"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:48.761543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-05b91bd1-e6d8-41ff-bb9b-61c7d2ff0194 req-438c45d6-5e4e-4229-9fe0-bc10b91c0ad4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.762341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-05b91bd1-e6d8-41ff-bb9b-61c7d2ff0194 req-438c45d6-5e4e-4229-9fe0-bc10b91c0ad4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.777388 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-05b91bd1-e6d8-41ff-bb9b-61c7d2ff0194 req-438c45d6-5e4e-4229-9fe0-bc10b91c0ad4 service nova] Creating event network-changed:56b4df7d-c972-405f-9332-4091cf5bd967 for instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c on nch2-master-1 Jun 18 22:06:48.783641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-05b91bd1-e6d8-41ff-bb9b-61c7d2ff0194 req-438c45d6-5e4e-4229-9fe0-bc10b91c0ad4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038952 Jun 18 22:06:48.784845 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 770/1549] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:48.791762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:48.792806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:48.801211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.801894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:48.803022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:48.803455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.024975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.037550 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6603806-cf51-4b75-9555-33117f72b875 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1504 microversion: 2.1 time: 0.367512 Jun 18 22:06:49.049058 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 780/1550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:48 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:49.049058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:49.049058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:49.056472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.056862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.057705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.058172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.085140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.099045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.104973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.107397 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a5fffc3-85c0-425c-8ea0-8a17aa1bf0fc tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.321182 Jun 18 22:06:49.108557 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 771/1551] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:48 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:49.114469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:49.115380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:49.124717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.125500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.126367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.126800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.150646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.158432 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-927410a6-de46-4931-87ca-f51207f7a69a tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1271 microversion: 2.1 time: 0.117196 Jun 18 22:06:49.169600 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 781/1552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:49 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:49.174741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:49.175488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:49.182129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.182812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.183722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.184250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.284755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.293499 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34a63136-911f-44f7-b211-b7643bce9ca9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1272 microversion: 2.1 time: 0.122422 Jun 18 22:06:49.294119 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 782/1553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:49 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:49.299162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:49.299917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:49.306441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.306961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.308007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.308620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.406575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.416528 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-71968e9e-ddc0-4814-89d5-e5d6dc0d9d3a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1719 microversion: 2.1 time: 0.306482 Jun 18 22:06:49.417140 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 772/1554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:49 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1719 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:49.499868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:49.514184 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51ad3d45-ceab-4798-a435-9a913eb889b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.218778 Jun 18 22:06:49.515326 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 783/1555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:49 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:49.758202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:49.760462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:49.773596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.774582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:49.775736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:49.776354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.056444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:50.057768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:50.066800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.067894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.069423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.070090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.138095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.147775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-87a4854a-211b-47d4-ad06-947aa04bf146 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1647 microversion: 2.1 time: 0.396693 Jun 18 22:06:50.162436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 773/1556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:49 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1647 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:50.167626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:50.168256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:50.190463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.190929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.191718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.192160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.516331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.527148 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-851d6478-4c67-4965-b411-e755ccfb2f5a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1504 microversion: 2.1 time: 0.474856 Jun 18 22:06:50.528238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 784/1557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:50 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:50.529375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.534888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:50.535579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:50.540438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.542239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.543636 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b0c9dbf-694f-48e0-8d6d-131e04bea883 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.380086 Jun 18 22:06:50.544345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.544969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.545635 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 774/1558] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:50 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:50.550007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.552449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.562537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:50.563488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:50.570367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.571104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.572089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.572717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.888754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.891711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:50.900252 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef1f345a-c9a2-4d5a-9e1c-fd5bf0a00765 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.370765 Jun 18 22:06:50.903183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:50.910655 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 785/1559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:50 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:50.917193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:50.917193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:50.924419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.924868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.925695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.926117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d625d7c-9083-416e-bd4a-17cd6838ebe4 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.378949 Jun 18 22:06:50.926240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.927727 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 775/1560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:50 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:50.936294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:50.937101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:50.950167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.950663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:50.951577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:50.952006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.233404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:51.238842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:51.243977 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f79394c-ef21-4631-98e6-d32e429d85bf tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.314692 Jun 18 22:06:51.246351 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 776/1561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:50 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:51.253010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:51.253894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:51.261732 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c76be116-b3ce-4b01-bd61-332b75b6551a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1709 microversion: 2.1 time: 0.349852 Jun 18 22:06:51.262644 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 786/1562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:50 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1709 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:51.262884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.263485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.264486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.265124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.278950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-562d28da-f4ad-47ae-9cb7-3dbb8cefac10 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '.version_select at 0x7fea1454f670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:51.294717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-562d28da-f4ad-47ae-9cb7-3dbb8cefac10 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.295820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-562d28da-f4ad-47ae-9cb7-3dbb8cefac10 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.330505 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-562d28da-f4ad-47ae-9cb7-3dbb8cefac10 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2315 microversion: 2.1 time: 0.055587 Jun 18 22:06:51.332222 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 787/1563] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:06:51 2022] GET /compute/v2.1/os-migrations => generated 2315 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:51.353674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:51.354669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:51.372503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.373854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.378950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.381453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.386807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035a5cccca15429e845012dd629d5038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3c1a33ed1449bdbec74fb4d3c0784f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:51.399765 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee722750-b197-4839-9dea-5a9548662069 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 200 len: 1468 microversion: 2.1 time: 0.151481 Jun 18 22:06:51.401106 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 777/1564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:51 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:51.522638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-855182cd-afa2-477d-bfc6-2548d0eaf2cc req-27f44b82-64dc-467a-90bd-b81420fad725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d436e95-9552-4166-af2f-4299bfcce1d4", "name": "network-vif-deleted", "tag": "87ec2284-fa7d-4ce6-8978-c5e46a70d113"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:51.537763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-855182cd-afa2-477d-bfc6-2548d0eaf2cc req-27f44b82-64dc-467a-90bd-b81420fad725 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.538923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-855182cd-afa2-477d-bfc6-2548d0eaf2cc req-27f44b82-64dc-467a-90bd-b81420fad725 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.563936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-855182cd-afa2-477d-bfc6-2548d0eaf2cc req-27f44b82-64dc-467a-90bd-b81420fad725 service nova] Creating event network-vif-deleted:87ec2284-fa7d-4ce6-8978-c5e46a70d113 for instance 8d436e95-9552-4166-af2f-4299bfcce1d4 on nch1-master-1 Jun 18 22:06:51.578139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-855182cd-afa2-477d-bfc6-2548d0eaf2cc req-27f44b82-64dc-467a-90bd-b81420fad725 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059268 Jun 18 22:06:51.581376 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 778/1565] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:06:51.589893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:51.596887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:51.607317 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-96faf351-6640-4fa4-a8d4-9c845fff50a0 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1860 microversion: 2.1 time: 0.265894 Jun 18 22:06:51.608497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 788/1566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:51 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1860 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:51.608733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.609516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.610867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.611487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.627593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:51.630162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:51.637480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.638196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:51.639344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:51.639968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.039854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:52.049725 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72a3c61a-d9d9-485e-b663-8f192b3cf39a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1504 microversion: 2.1 time: 0.465012 Jun 18 22:06:52.051512 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 779/1567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:51 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:52.064826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:52.070295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:52.088557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.089463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.090565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.102282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.122666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:52.222010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:52.231132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:52.232666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:52.233985 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-153df46e-58e3-4e37-bb19-972940958fa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.613741 Jun 18 22:06:52.234554 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 789/1568] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:51 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:52.252632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:52.255919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:52.264691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.267561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.279547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.280701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.472773 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90c44478-f0d0-40eb-a776-ae966ea4b6bd tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1860 microversion: 2.1 time: 0.418528 Jun 18 22:06:52.473488 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 780/1569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:52 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1860 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:52.482645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:52.483978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:52.492987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.503466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.510344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.510853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.584377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:52.594736 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8e7ff950-459c-4435-bacf-683fe4e4f1e9 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.346695 Jun 18 22:06:52.595539 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 790/1570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:52 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:52.804148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:52.816166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0e2f3951-7ef8-49cc-9def-27f5b0033624 req-e9f0e91b-d7f4-4f19-ac8a-07415d8830b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abd77eb-81f7-42a3-aa19-6da045f3cdf4", "name": "network-vif-plugged", "status": "completed", "tag": "eb5ce4c1-7c55-4e8b-a561-329649c8f723"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:52.841852 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f864b37-cd6a-404c-a19b-d3aac8348435 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.359050 Jun 18 22:06:52.856459 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 781/1571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:52 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:52.865339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0e2f3951-7ef8-49cc-9def-27f5b0033624 req-e9f0e91b-d7f4-4f19-ac8a-07415d8830b7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.866783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0e2f3951-7ef8-49cc-9def-27f5b0033624 req-e9f0e91b-d7f4-4f19-ac8a-07415d8830b7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.870574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:52.872071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:52.890922 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0e2f3951-7ef8-49cc-9def-27f5b0033624 req-e9f0e91b-d7f4-4f19-ac8a-07415d8830b7 service nova] Creating event network-vif-plugged:eb5ce4c1-7c55-4e8b-a561-329649c8f723 for instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 on nch1-master-1 Jun 18 22:06:52.894401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.895073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.896182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.896897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.915296 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0e2f3951-7ef8-49cc-9def-27f5b0033624 req-e9f0e91b-d7f4-4f19-ac8a-07415d8830b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317690 Jun 18 22:06:52.916373 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 791/1572] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:52.923854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:52.925299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] [instance: 8d436e95-9552-4166-af2f-4299bfcce1d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:52.945476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.946189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.947497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:52.948936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:52.975417 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] HTTP exception thrown: Instance 8d436e95-9552-4166-af2f-4299bfcce1d4 could not be found. Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Request method failure captured: Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 HTTP/1.1 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwj9f_Q6U0_0aE58CAvrG8zHwHHW07ox_gZUUsSeyDve15PJpTzC3jSfOkh5rcFJdVsrgOpca15V1cHQPYlCAu7OB5fbZ6ziSA3gtiHIlHly7M4HLh3xdBP1KLix5rjzl_BD_mkm4M4Mzhy5ywI2pAWJNzIUblOtbvppEwLPOGapEM Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1d3c1a33ed1449bdbec74fb4d3c0784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1d3c1a33ed1449bdbec74fb4d3c0784f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1d3c1a33ed1449bdbec74fb4d3c0784f Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-551847825 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 035a5cccca15429e845012dd629d5038 Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsTestJSON-551847825-project Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8d436e95-9552-4166-af2f-4299bfcce1d4 could not be found. Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8d436e95-9552-4166-af2f-4299bfcce1d4'} Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d436e95-9552-4166-af2f-4299bfcce1d4 could not be found. Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d436e95-9552-4166-af2f-4299bfcce1d4 could not be found. Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:52.984309 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d436e95-9552-4166-af2f-4299bfcce1d4 could not be found. Jun 18 22:06:52.989288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:52.992209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Returning 404 to user: Instance 8d436e95-9552-4166-af2f-4299bfcce1d4 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:52.995447 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-74e163f4-69a7-4b3c-b8b3-ea05d2acd22a tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4" status: 404 len: 111 microversion: 2.1 time: 0.077824 Jun 18 22:06:52.997716 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 792/1573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:52 2022] GET /compute/v2.1/servers/8d436e95-9552-4166-af2f-4299bfcce1d4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:06:53.005254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.007451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:53.027161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.030364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.032860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.037967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.168378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:53.180281 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-622ff84e-86e7-4fce-80db-55dd3aa8592f tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.319253 Jun 18 22:06:53.181295 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 782/1574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:52 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:53.186481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ff381587-0407-4957-a042-63b2854ad655 req-275f12ac-dc66-4af4-b3e6-1e97d90324e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c40c8e-787d-457f-b4d9-db8efe1b08ca", "tag": "32fc5f27-6c79-4382-aa32-2e9603c51247"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:53.196982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ff381587-0407-4957-a042-63b2854ad655 req-275f12ac-dc66-4af4-b3e6-1e97d90324e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.197775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ff381587-0407-4957-a042-63b2854ad655 req-275f12ac-dc66-4af4-b3e6-1e97d90324e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.212978 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ff381587-0407-4957-a042-63b2854ad655 req-275f12ac-dc66-4af4-b3e6-1e97d90324e6 service nova] Creating event network-changed:32fc5f27-6c79-4382-aa32-2e9603c51247 for instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca on nch1-master-1 Jun 18 22:06:53.222226 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ff381587-0407-4957-a042-63b2854ad655 req-275f12ac-dc66-4af4-b3e6-1e97d90324e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039521 Jun 18 22:06:53.224901 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 783/1575] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:53.230768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab55c070-008f-4b78-a06c-2aa09ed27aef tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea1423bee0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.265443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lazy-loading 'services' on Instance uuid 2bb05746-912a-4d02-97e9-03847508282d {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:06:53.420467 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2cf5be62-103b-4a4c-ac83-00e3e48b8108 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments/2b4e05a3-834c-4089-a905-b3e5772b00c7" status: 202 len: 0 microversion: 2.1 time: 0.419823 Jun 18 22:06:53.426103 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 793/1576] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:06:52 2022] DELETE /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments/2b4e05a3-834c-4089-a905-b3e5772b00c7 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:53.466067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.467176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:53.477555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.478548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.480042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.480796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.585398 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab55c070-008f-4b78-a06c-2aa09ed27aef tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/182ddbb3-0a7a-4617-94ec-6a507d336c65" status: 202 len: 0 microversion: 2.1 time: 0.358932 Jun 18 22:06:53.587014 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 784/1577] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:53 2022] DELETE /compute/v2.1/os-security-groups/182ddbb3-0a7a-4617-94ec-6a507d336c65 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:53.594781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.595997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:53.622789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.624312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.625578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.627636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.679876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:53.692534 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66ec82e3-1455-425e-a309-7442622ee09a tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1486 microversion: 2.1 time: 0.241077 Jun 18 22:06:53.693775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 794/1578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:53 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1486 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:53.700041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.710227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:53.716676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.717433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.718448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.719036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.779203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c31f27b-070a-4d21-a79a-069c38b8bbb9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083738 Jun 18 22:06:53.780217 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 795/1579] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:06:53 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:53.785571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc800b39-1564-41dc-a1e7-4c9dc634aef9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] Calling method '.version_select at 0x7fea145a1670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.865153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:53.883307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:53.885380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:53.886988 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64260061-1fd2-4d88-bf6a-1efb516ba7ba tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.298576 Jun 18 22:06:53.897703 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 785/1580] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:53 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:53.897703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:53.897703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:53.901383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.902105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:53.902870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:53.903378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.115279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:54.125347 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6fb64b8a-3dee-4b2b-a73c-d02be307e34c tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.235649 Jun 18 22:06:54.125923 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 786/1581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:53 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:54.131120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:54.131873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:54.138840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.139299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.140117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.140582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.168949 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fc800b39-1564-41dc-a1e7-4c9dc634aef9 tempest-SecurityGroupsTestJSON-551847825 tempest-SecurityGroupsTestJSON-551847825-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/7098ed53-0267-4ba7-8020-b7e0a419346d" status: 202 len: 0 microversion: 2.1 time: 0.387422 Jun 18 22:06:54.169735 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 796/1582] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:06:53 2022] DELETE /compute/v2.1/os-security-groups/7098ed53-0267-4ba7-8020-b7e0a419346d => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:06:54.175096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:54.288336 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f72a124-4baa-4be9-9e8f-d076857fc298 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 204 len: 0 microversion: 2.1 time: 0.158278 Jun 18 22:06:54.291051 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 787/1583] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:54 2022] DELETE /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:54.300184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:54.302357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:54.312060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.314070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.315510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.316418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.488386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Action: 'update', calling method: .version_select at 0x7fea141fe0d0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:54.490470 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:54.490470 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:54.492548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.493334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.511891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.514909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.534437 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] HTTP exception thrown: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Request method failure captured: Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a HTTP/1.1 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 56 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkx90IIRe2U0eOJAVID3ATKQxlzNuq-YjFlP1mMWUzH_fqtB9Ly1k2Us33_HalrkI1QthGykrifD2gtqKc54Nthxe1TCnFTETkH_U4aICNTWtikqcYznTEfP5cjGoEK1C7tBRh_3i37qFQ6wx5_X9aIUgId9RV1oZlamEbpZOjJJiCQ Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.53 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 0fc3e2c4154e4629bbc63486a960d8c1 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0fc3e2c4154e4629bbc63486a960d8c1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 0fc3e2c4154e4629bbc63486a960d8c1 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8286097bc8b6404589fd9206809f32e3 Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: exception: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '4a2ef571-497a-421a-82ac-455a522d341a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:54.541142 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.546568 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.548615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Returning 404 to user: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:54.550001 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f8e44e84-2c2f-4194-83fe-329aa5cc9f8d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a" status: 404 len: 110 microversion: 2.53 time: 0.378946 Jun 18 22:06:54.550960 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 797/1584] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Jun 18 22:06:54 2022] PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a => generated 110 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:06:54.560493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:54.566050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:54.581714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.582613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.583616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.584277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.778338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:54.786563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e34e7818-7ff2-4616-b580-71e87698ae2f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.492802 Jun 18 22:06:54.787422 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 788/1585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:54 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:54.792262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-283feefc-6ceb-48af-9bf0-1ffde373a4e1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea19dc3820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:54.836007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:54.845057 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e80d7435-f1c2-478a-a08f-c570b3385f81 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.292260 Jun 18 22:06:54.855048 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 798/1586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:54 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:54.860006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Action: 'update', calling method: .version_select at 0x7fea1454e550>, body: {"status": "disabled"} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:54.861400 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:54.861400 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:54.862493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.862950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.868921 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-283feefc-6ceb-48af-9bf0-1ffde373a4e1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Image not found. Jun 18 22:06:54.869722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.870181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-283feefc-6ceb-48af-9bf0-1ffde373a4e1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 HTTP/1.1 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: exception: Image not found. Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '5df053ab-6472-4cb7-a726-23b98015e790'} Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5df053ab-6472-4cb7-a726-23b98015e790 to delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5df053ab-6472-4cb7-a726-23b98015e790 could not be found. Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.872041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.881569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-283feefc-6ceb-48af-9bf0-1ffde373a4e1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Image not found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:54.883275 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] HTTP exception thrown: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.883364 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-283feefc-6ceb-48af-9bf0-1ffde373a4e1 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790" status: 404 len: 62 microversion: 2.1 time: 0.090359 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Request method failure captured: Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a HTTP/1.1 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 22 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkx90IIRe2U0eOJAVID3ATKQxlzNuq-YjFlP1mMWUzH_fqtB9Ly1k2Us33_HalrkI1QthGykrifD2gtqKc54Nthxe1TCnFTETkH_U4aICNTWtikqcYznTEfP5cjGoEK1C7tBRh_3i37qFQ6wx5_X9aIUgId9RV1oZlamEbpZOjJJiCQ Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.53 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 0fc3e2c4154e4629bbc63486a960d8c1 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0fc3e2c4154e4629bbc63486a960d8c1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 0fc3e2c4154e4629bbc63486a960d8c1 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8286097bc8b6404589fd9206809f32e3 Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: {"status": "disabled"} Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: exception: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '4a2ef571-497a-421a-82ac-455a522d341a', 'body': {'status': 'disabled'}} Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:54.883449 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.892367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.894673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 789/1587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:54 2022] DELETE /compute/v2.1/images/5df053ab-6472-4cb7-a726-23b98015e790 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:06:54.894810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Returning 404 to user: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:54.894810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31ed5719-20c1-4b31-a16a-228bab291c2b tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a" status: 404 len: 110 microversion: 2.53 time: 0.024796 Jun 18 22:06:54.894810 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 799/1588] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Jun 18 22:06:54 2022] PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:06:54.894810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:54.894810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:54.897917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:54.898943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.899801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:54.899974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.900169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.900696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.910746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.911199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.912000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.912436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.934576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:06:54.952030 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1820acc3-e3a2-4b2f-a520-d6cf7490d323 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062116 Jun 18 22:06:54.953236 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 790/1589] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:06:54 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:06:54.959758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Action: 'update', calling method: .version_select at 0x7fea19dc35e0>, body: {"status": "enabled"} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:54.966172 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:54.966172 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:06:54.969364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.971696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.978666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:54.979130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:54.986999 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] HTTP exception thrown: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Request method failure captured: Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a HTTP/1.1 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 21 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkx90IIRe2U0eOJAVID3ATKQxlzNuq-YjFlP1mMWUzH_fqtB9Ly1k2Us33_HalrkI1QthGykrifD2gtqKc54Nthxe1TCnFTETkH_U4aICNTWtikqcYznTEfP5cjGoEK1C7tBRh_3i37qFQ6wx5_X9aIUgId9RV1oZlamEbpZOjJJiCQ Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.53 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 0fc3e2c4154e4629bbc63486a960d8c1 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fc3e2c4154e4629bbc63486a960d8c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0fc3e2c4154e4629bbc63486a960d8c1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 0fc3e2c4154e4629bbc63486a960d8c1 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8286097bc8b6404589fd9206809f32e3 Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: {"status": "enabled"} Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: exception: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '4a2ef571-497a-421a-82ac-455a522d341a', 'body': {'status': 'enabled'}} Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:06:54.989442 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Returning 404 to user: Service 4a2ef571-497a-421a-82ac-455a522d341a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab501c19-4593-4e03-9800-428ea3ca4d6d tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a" status: 404 len: 110 microversion: 2.53 time: 0.036865 Jun 18 22:06:54.994515 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 791/1590] 10.222.0.30 () {62 vars in 1308 bytes} [Sat Jun 18 22:06:54 2022] PUT /compute/v2.1/os-services/4a2ef571-497a-421a-82ac-455a522d341a => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:06:55.000504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.001219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:55.008286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.009022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.009867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.010312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.090172 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.api [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Instance is already in deleting state, ignoring this request Jun 18 22:06:55.091066 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1133aeee-ea76-4c69-b85f-dd722ae88564 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 204 len: 0 microversion: 2.1 time: 0.206281 Jun 18 22:06:55.091898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 800/1591] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:06:54 2022] DELETE /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:06:55.096820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7c65df3-302f-440f-916a-fe6feba51cf3 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.098226 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:55.098226 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:55.099779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c65df3-302f-440f-916a-fe6feba51cf3 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.100689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c65df3-302f-440f-916a-fe6feba51cf3 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.101967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c65df3-302f-440f-916a-fe6feba51cf3 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.102559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c65df3-302f-440f-916a-fe6feba51cf3 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.145142 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7c65df3-302f-440f-916a-fe6feba51cf3 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.051930 Jun 18 22:06:55.152899 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 801/1592] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:55.158343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.159177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:55.167145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.167838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.168792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.169418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.373305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:55.384959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:55.386879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:55.388452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b5d05d4-85cb-4e6e-b4db-20fbf8de4463 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.395288 Jun 18 22:06:55.399769 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 792/1593] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:54 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:55.405483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.406761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:55.413426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.414114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.415550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.416150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.522128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:55.534962 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e85bdbd-1b24-426c-af40-ee26da790f30 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1492 microversion: 2.1 time: 0.380463 Jun 18 22:06:55.536510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 802/1594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1492 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:55.544114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3240d531-91eb-4414-bdfe-be1ea41dce0f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.547131 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:55.547131 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:55.548789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3240d531-91eb-4414-bdfe-be1ea41dce0f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.549500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3240d531-91eb-4414-bdfe-be1ea41dce0f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.550563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3240d531-91eb-4414-bdfe-be1ea41dce0f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.551331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3240d531-91eb-4414-bdfe-be1ea41dce0f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.590133 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3240d531-91eb-4414-bdfe-be1ea41dce0f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.051735 Jun 18 22:06:55.598219 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 803/1595] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:55.602801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-da3ad0d0-3635-49a7-b4e6-843131d067f0 req-7dcc8d3a-6c28-4f6e-87c0-239d5885d334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8265e105-3c88-4fa3-a004-6b7932b7c60a", "tag": "974c80c6-d6db-4c5c-acd6-ec7a57774d03"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:55.616096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-da3ad0d0-3635-49a7-b4e6-843131d067f0 req-7dcc8d3a-6c28-4f6e-87c0-239d5885d334 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.616716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-da3ad0d0-3635-49a7-b4e6-843131d067f0 req-7dcc8d3a-6c28-4f6e-87c0-239d5885d334 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.634981 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-da3ad0d0-3635-49a7-b4e6-843131d067f0 req-7dcc8d3a-6c28-4f6e-87c0-239d5885d334 service nova] Creating event network-changed:974c80c6-d6db-4c5c-acd6-ec7a57774d03 for instance 8265e105-3c88-4fa3-a004-6b7932b7c60a on nch1-master-1 Jun 18 22:06:55.642478 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-da3ad0d0-3635-49a7-b4e6-843131d067f0 req-7dcc8d3a-6c28-4f6e-87c0-239d5885d334 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049517 Jun 18 22:06:55.643630 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 804/1596] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:55.651705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67d4122a-786f-47ed-9e16-84bd865bc70a tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.655105 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:55.655105 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:55.657255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67d4122a-786f-47ed-9e16-84bd865bc70a tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.658971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67d4122a-786f-47ed-9e16-84bd865bc70a tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.660072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67d4122a-786f-47ed-9e16-84bd865bc70a tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.660983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67d4122a-786f-47ed-9e16-84bd865bc70a tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.669194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:55.689499 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0665310e-350e-4d88-aba3-ec547cd6674b tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.288246 Jun 18 22:06:55.690136 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 793/1597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:55.726371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67d4122a-786f-47ed-9e16-84bd865bc70a tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.081202 Jun 18 22:06:55.727432 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 805/1598] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:55.739222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cda613a2-0fc2-4547-82a8-2b6743f53e1f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.741419 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:55.741419 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:06:55.742731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cda613a2-0fc2-4547-82a8-2b6743f53e1f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.743191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cda613a2-0fc2-4547-82a8-2b6743f53e1f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.744078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cda613a2-0fc2-4547-82a8-2b6743f53e1f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.744867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cda613a2-0fc2-4547-82a8-2b6743f53e1f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.780924 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cda613a2-0fc2-4547-82a8-2b6743f53e1f tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.045925 Jun 18 22:06:55.783092 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 794/1599] 10.222.0.30 () {60 vars in 1236 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:55.796618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9ea5006-d174-4e15-9ca6-d6f1d9579010 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.798476 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:55.798476 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:55.800066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9ea5006-d174-4e15-9ca6-d6f1d9579010 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.803832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9ea5006-d174-4e15-9ca6-d6f1d9579010 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.804900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9ea5006-d174-4e15-9ca6-d6f1d9579010 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.807793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9ea5006-d174-4e15-9ca6-d6f1d9579010 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.811683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.820815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:55.847956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.848420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.853985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.854445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.906864 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9ea5006-d174-4e15-9ca6-d6f1d9579010 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.114588 Jun 18 22:06:55.919306 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 806/1600] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:55.938202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:55.938971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:55.961653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.962418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:55.963572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:55.964301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.118340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=18 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:56.258523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:56.268958 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0a0a5428-b02a-4edd-a27f-fa4dad117c1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.467482 Jun 18 22:06:56.269844 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 795/1601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:56.277381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27add92e-b10e-4d0a-ab14-9a7cb8cb0cb8 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:56.283444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:56.293181 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:56.293181 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:06:56.295690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27add92e-b10e-4d0a-ab14-9a7cb8cb0cb8 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.297313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f519db3-e83a-4c2f-be6a-a1467914b02a tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.376768 Jun 18 22:06:56.298116 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 807/1602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:55 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:56.300493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27add92e-b10e-4d0a-ab14-9a7cb8cb0cb8 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.304043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27add92e-b10e-4d0a-ab14-9a7cb8cb0cb8 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.305208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27add92e-b10e-4d0a-ab14-9a7cb8cb0cb8 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.316320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c3005faf-fa22-4d78-80d8-ea0fea45a93b req-4d45d2dd-7059-4a4d-8728-69f84d968a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abd77eb-81f7-42a3-aa19-6da045f3cdf4", "name": "network-vif-unplugged", "status": "completed", "tag": "eb5ce4c1-7c55-4e8b-a561-329649c8f723"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:56.332034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c3005faf-fa22-4d78-80d8-ea0fea45a93b req-4d45d2dd-7059-4a4d-8728-69f84d968a82 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.332493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c3005faf-fa22-4d78-80d8-ea0fea45a93b req-4d45d2dd-7059-4a4d-8728-69f84d968a82 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.337559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:56.348485 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c3005faf-fa22-4d78-80d8-ea0fea45a93b req-4d45d2dd-7059-4a4d-8728-69f84d968a82 service nova] Creating event network-vif-unplugged:eb5ce4c1-7c55-4e8b-a561-329649c8f723 for instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 on nch1-master-1 Jun 18 22:06:56.355532 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c3005faf-fa22-4d78-80d8-ea0fea45a93b req-4d45d2dd-7059-4a4d-8728-69f84d968a82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053385 Jun 18 22:06:56.356172 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 808/1603] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:56.361760 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27add92e-b10e-4d0a-ab14-9a7cb8cb0cb8 tempest-ServicesAdminNegativeV253TestJSON-116289976 tempest-ServicesAdminNegativeV253TestJSON-116289976-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.090626 Jun 18 22:06:56.362990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 796/1604] 10.222.0.30 () {60 vars in 1238 bytes} [Sat Jun 18 22:06:56 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:56.410907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:56.411584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:56.428472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.429267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.429858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.430431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.559864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:56.586214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-019aaa53-4f7d-4e1a-b1ea-0cc4f7145e92 tempest-ServicesAdminNegativeV253TestJSON-1787876334 tempest-ServicesAdminNegativeV253TestJSON-1787876334-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:56.588433 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:06:56.588433 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:06:56.590800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-019aaa53-4f7d-4e1a-b1ea-0cc4f7145e92 tempest-ServicesAdminNegativeV253TestJSON-1787876334 tempest-ServicesAdminNegativeV253TestJSON-1787876334-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'dfe8a7c180bc42fca23b130984d7ef14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08e600159f44a07a1f3550bc30474ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-019aaa53-4f7d-4e1a-b1ea-0cc4f7145e92 tempest-ServicesAdminNegativeV253TestJSON-1787876334 tempest-ServicesAdminNegativeV253TestJSON-1787876334-project] Request method failure captured: Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkx8rnkXGC-VY5DDRjFC8Iolom12V_DChExZ2NCMquTIXGP2fHuNMkQFafNhiDj3l0SzuBLzo4jvo3ymoLHRBrIQ3XbrK7I9sOTGQSox7CXS6InUwBGgJoivEXBkuvXUdVKCnGLS9yHJsXYkxd91EZMnUr5UYUuANCTcsKF1jNNHg8Q Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.53 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c08e600159f44a07a1f3550bc30474ec Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1787876334 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c08e600159f44a07a1f3550bc30474ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c08e600159f44a07a1f3550bc30474ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c08e600159f44a07a1f3550bc30474ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c08e600159f44a07a1f3550bc30474ec", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1787876334 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c08e600159f44a07a1f3550bc30474ec Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1787876334 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1787876334-project Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: dfe8a7c180bc42fca23b130984d7ef14 Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1787876334-project Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: action_args: {} Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 18 22:06:56.595936 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 18 22:06:56.601234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:06:56.602217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-019aaa53-4f7d-4e1a-b1ea-0cc4f7145e92 tempest-ServicesAdminNegativeV253TestJSON-1787876334 tempest-ServicesAdminNegativeV253TestJSON-1787876334-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:06:56.603075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-019aaa53-4f7d-4e1a-b1ea-0cc4f7145e92 tempest-ServicesAdminNegativeV253TestJSON-1787876334 tempest-ServicesAdminNegativeV253TestJSON-1787876334-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.232887 Jun 18 22:06:56.607983 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 809/1605] 10.222.0.30 () {60 vars in 1177 bytes} [Sat Jun 18 22:06:56 2022] GET /compute/v2.1/os-services => generated 112 bytes in 235 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:06:56.627706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:56.634494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:56.643318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:56.673220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.673689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.674483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.674997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.907953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:56.923909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:56.925881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:56.927714 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3852aa50-6816-44c8-8fb4-989121a9ebc6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.523062 Jun 18 22:06:56.928413 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 797/1606] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:56 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:06:56.942845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:56.943939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:56.952797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.953833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:56.955013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:56.955952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:57.060957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:57.070904 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49f20518-fe7d-4527-b87d-1e9232c21bf0 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1492 microversion: 2.1 time: 0.465146 Jun 18 22:06:57.071806 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 810/1607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:56 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1492 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:57.286778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:57.287441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:57.298673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:57.299692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:57.300858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:57.301927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:57.562042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:57.580460 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39ef9d26-b440-4ca6-a889-b72b3f963738 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.649241 Jun 18 22:06:57.583303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 798/1608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:56 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:57.608265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:57.609169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:57.627759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:57.628483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:57.632169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:57.633435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:57.664364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:57.673317 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f15e5a24-5ee3-409c-81fc-0f7b0c1a8fb5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.390579 Jun 18 22:06:57.673916 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 811/1609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:57 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:57.877120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:57.880399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:06:57.894423 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-04106503-86c8-4256-a13f-471fceb3f8e5 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.305297 Jun 18 22:06:57.895191 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 799/1610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:57 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:57.949531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:57.950238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:57.973057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:57.973537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:57.978300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:57.985402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.088729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:58.089418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:58.109454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.109931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.111002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.111472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.677277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:58.690860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6991794-2169-4ca0-bb5e-ba549e58d0f3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1492 microversion: 2.1 time: 0.606454 Jun 18 22:06:58.697480 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 800/1611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:58 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1492 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:58.707492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:58.712459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-69a6e69e-00e5-486e-b1f3-6b082319c199 req-0fcb8f8c-2526-4e10-b4d1-e90378d1ff1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb4d72e-b423-48b3-aa53-de6ffc4b0b8c", "name": "network-vif-plugged", "status": "completed", "tag": "56b4df7d-c972-405f-9332-4091cf5bd967"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:58.726566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-69a6e69e-00e5-486e-b1f3-6b082319c199 req-0fcb8f8c-2526-4e10-b4d1-e90378d1ff1c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.728508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-69a6e69e-00e5-486e-b1f3-6b082319c199 req-0fcb8f8c-2526-4e10-b4d1-e90378d1ff1c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.734328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:58.736967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:58.740453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-21adba66-91ab-4e23-a3c9-629cf290e28c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.796551 Jun 18 22:06:58.751754 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 812/1612] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:57 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:06:58.764730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-69a6e69e-00e5-486e-b1f3-6b082319c199 req-0fcb8f8c-2526-4e10-b4d1-e90378d1ff1c service nova] Creating event network-vif-plugged:56b4df7d-c972-405f-9332-4091cf5bd967 for instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c on nch2-master-1 Jun 18 22:06:58.766293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:58.766924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:58.791335 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-69a6e69e-00e5-486e-b1f3-6b082319c199 req-0fcb8f8c-2526-4e10-b4d1-e90378d1ff1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085414 Jun 18 22:06:58.794847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.795345 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 801/1613] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:06:58.795913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.796808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.797292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.802626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:58.808921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:58.835600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.838470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:58.839710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:58.845883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.358882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:59.370318 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c8d9dd79-8252-40d8-991c-cf2d666d8761 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.617101 Jun 18 22:06:59.380478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:59.381274 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 813/1614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:58 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:59.387176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:59.388278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:59.393350 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce791e88-e7da-4bb1-adcc-75ca99a1c663 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.591082 Jun 18 22:06:59.395585 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 802/1615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:58 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:59.405610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.406354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.408577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.415637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.714241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:59.714962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:59.733351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.734098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.735080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.735923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.819110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:59.843482 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d10e3336-dcea-40e4-9fd8-c4d1f677b834 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.460561 Jun 18 22:06:59.846468 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 814/1616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:59 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:06:59.870813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:06:59.872762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:06:59.889947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:06:59.903703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.906418 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-107f707e-a548-4696-9104-c2dee941ade8 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1450 microversion: 2.1 time: 0.197168 Jun 18 22:06:59.907706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.908361 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 803/1617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:06:59 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1450 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:06:59.910688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.913569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.923113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2b8af7e5-c03d-46fe-b8c8-e22eb79993df req-4468c718-c968-413b-853e-68574061ad77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abd77eb-81f7-42a3-aa19-6da045f3cdf4", "name": "network-vif-deleted", "tag": "eb5ce4c1-7c55-4e8b-a561-329649c8f723"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:06:59.944961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2b8af7e5-c03d-46fe-b8c8-e22eb79993df req-4468c718-c968-413b-853e-68574061ad77 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:06:59.950232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2b8af7e5-c03d-46fe-b8c8-e22eb79993df req-4468c718-c968-413b-853e-68574061ad77 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:06:59.994875 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2b8af7e5-c03d-46fe-b8c8-e22eb79993df req-4468c718-c968-413b-853e-68574061ad77 service nova] Creating event network-vif-deleted:eb5ce4c1-7c55-4e8b-a561-329649c8f723 for instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 on nch1-master-1 Jun 18 22:07:00.012745 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2b8af7e5-c03d-46fe-b8c8-e22eb79993df req-4468c718-c968-413b-853e-68574061ad77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102781 Jun 18 22:07:00.017181 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 804/1618] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:00.196765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0bbb54e5-e7b5-4829-8aed-7e452388d397 req-0a7f4164-cdc6-413a-8d53-1b5e68194167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "name": "network-vif-unplugged", "status": "completed", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:00.220159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0bbb54e5-e7b5-4829-8aed-7e452388d397 req-0a7f4164-cdc6-413a-8d53-1b5e68194167 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:00.220646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0bbb54e5-e7b5-4829-8aed-7e452388d397 req-0a7f4164-cdc6-413a-8d53-1b5e68194167 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:00.262834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0bbb54e5-e7b5-4829-8aed-7e452388d397 req-0a7f4164-cdc6-413a-8d53-1b5e68194167 service nova] Creating event network-vif-unplugged:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch1-master-1 Jun 18 22:07:00.277448 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0bbb54e5-e7b5-4829-8aed-7e452388d397 req-0a7f4164-cdc6-413a-8d53-1b5e68194167 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086116 Jun 18 22:07:00.281970 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 805/1619] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:00.297252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:00.312421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:00.315109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:00.317064 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d10c874e-dd01-4cf5-8fb2-c8be8a74f0dd tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.466739 Jun 18 22:07:00.318469 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 815/1620] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:06:59 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:00.389493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:00.390877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:00.398571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:00.399381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:00.400584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:00.401564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:00.412751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:00.413927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:00.436519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:00.438496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:00.442223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:00.445026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:00.971560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:00.986721 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f1b051e-c511-402d-9220-6e15164fe73e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.579353 Jun 18 22:07:00.996112 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 816/1621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:00 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:01.001217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:01.002128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:01.009881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:01.010594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:01.011590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:01.012201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:01.043879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:01.063173 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50f56ea1-417d-459e-b1e8-22006a476cbb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.675457 Jun 18 22:07:01.072581 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 806/1622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:00 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:01.101963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:01.103388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:01.124187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:01.124674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:01.131963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:01.132647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:01.507727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eef98c56e744064b2b5f131c3766c0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df7809024c414efd8534cefdecd980cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:01.522383 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45ad45a7-4ae8-471e-9108-598e5c2f21a5 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 200 len: 1450 microversion: 2.1 time: 0.446768 Jun 18 22:07:01.522911 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 807/1623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:01 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 1450 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:01.536398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:01.537402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:01.553214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:01.553985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:01.572998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:01.573790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:01.598638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:01.611710 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c135abd6-72a6-4ad6-8dd0-3e23f8c419b1 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1322 microversion: 2.1 time: 0.611968 Jun 18 22:07:01.613976 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 817/1624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:00 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:01.963216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:01.973392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:01.975820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:01.977597 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-506cec0f-7876-4c76-b052-7a6a22c7ac2d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.453339 Jun 18 22:07:01.978418 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 808/1625] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:01 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:02.003231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:02.004642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:02.018625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.019448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.020502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.021185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.083042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:02.084525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:02.111156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.111833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.112819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.113441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.695112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:02.711603 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee388ef6-55c6-42bc-99d6-181924069a6e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.710564 Jun 18 22:07:02.714218 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 818/1626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:01 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:02.726370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:02.736777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9e335ea5-6147-4e48-84b4-8fd7e3bfee5d req-6e85c81a-5caf-4abf-bdf7-89cb944fda95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:02.738179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-523af95c-64ff-4d27-9d84-23cc6051c758 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.658972 Jun 18 22:07:02.752949 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 809/1627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:02 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:02.768324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:02.769111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 7abd77eb-81f7-42a3-aa19-6da045f3cdf4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:02.784515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.784961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.787099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9e335ea5-6147-4e48-84b4-8fd7e3bfee5d req-6e85c81a-5caf-4abf-bdf7-89cb944fda95 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.788745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9e335ea5-6147-4e48-84b4-8fd7e3bfee5d req-6e85c81a-5caf-4abf-bdf7-89cb944fda95 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.792208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.792939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.825397 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 could not be found. Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 HTTP/1.1 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 could not be found. Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7abd77eb-81f7-42a3-aa19-6da045f3cdf4'} Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 could not be found. Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 could not be found. Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.827768 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.833254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:02.833254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:02.833254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:02.833254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:02.833254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 could not be found. Jun 18 22:07:02.833254 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.834329 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9e335ea5-6147-4e48-84b4-8fd7e3bfee5d req-6e85c81a-5caf-4abf-bdf7-89cb944fda95 service nova] Creating event network-changed:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch1-master-1 Jun 18 22:07:02.835183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance 7abd77eb-81f7-42a3-aa19-6da045f3cdf4 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:02.836258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f4126fd-cbfc-4ed4-8806-ffdeec10e02c tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4" status: 404 len: 111 microversion: 2.1 time: 0.081954 Jun 18 22:07:02.837641 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 810/1628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:02 2022] GET /compute/v2.1/servers/7abd77eb-81f7-42a3-aa19-6da045f3cdf4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:02.843049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:02.844136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:02.850476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9e335ea5-6147-4e48-84b4-8fd7e3bfee5d req-6e85c81a-5caf-4abf-bdf7-89cb944fda95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134117 Jun 18 22:07:02.852136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 819/1629] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:02.854464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.855116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.856330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.856987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.868689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9cfaa7e-1688-4506-955a-a29fa4034a2f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea14949160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:02.917103 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f9cfaa7e-1688-4506-955a-a29fa4034a2f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Image not found. Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9cfaa7e-1688-4506-955a-a29fa4034a2f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 HTTP/1.1 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '5825eb63-0401-4ad9-8d88-3d1e1cf884f9'} Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5825eb63-0401-4ad9-8d88-3d1e1cf884f9 to delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5825eb63-0401-4ad9-8d88-3d1e1cf884f9 could not be found. Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.919080 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9cfaa7e-1688-4506-955a-a29fa4034a2f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:02.924537 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9cfaa7e-1688-4506-955a-a29fa4034a2f tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9" status: 404 len: 62 microversion: 2.1 time: 0.067086 Jun 18 22:07:02.926497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 820/1630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:02 2022] DELETE /compute/v2.1/images/5825eb63-0401-4ad9-8d88-3d1e1cf884f9 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:07:02.937425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:02.938761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:02.958156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.958639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:02.959462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:02.962861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.020063 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae HTTP/1.1 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '869eea9f-3a55-41e5-a036-656377f664ae'} Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:03.022983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.028026 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.030920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:03.032005 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-535a1dbb-9e68-406b-98a2-01412b418ddf tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 404 len: 111 microversion: 2.1 time: 0.104582 Jun 18 22:07:03.045642 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 821/1631] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:02 2022] DELETE /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:03.055095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.056517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.066391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.067122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.068112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.073058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.420382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:03.432491 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-91b66b66-bb60-494f-9feb-f344833ff068 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1472 microversion: 2.1 time: 0.591078 Jun 18 22:07:03.433708 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 811/1632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:02 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1472 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:03.442326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.443190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 869eea9f-3a55-41e5-a036-656377f664ae] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.458399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.460144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.462824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.464410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.487742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae HTTP/1.1 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '869eea9f-3a55-41e5-a036-656377f664ae'} Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.489570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.494743 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.494743 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.494743 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:03.494743 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:03.494743 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. Jun 18 22:07:03.494743 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.496921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance 869eea9f-3a55-41e5-a036-656377f664ae could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:03.498084 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f81f4239-2d84-48d6-b149-fadf4affb0ec tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae" status: 404 len: 111 microversion: 2.1 time: 0.061347 Jun 18 22:07:03.499427 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 812/1633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:03 2022] GET /compute/v2.1/servers/869eea9f-3a55-41e5-a036-656377f664ae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:03.507312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:03.508091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.532780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.536729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.538037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.538629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.570790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:03.580402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:03.581974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:03.583211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc7c5bf6-91b9-4202-9e5a-03e63f3bd8d2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.536211 Jun 18 22:07:03.588439 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 822/1634] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:03 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:03.599335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a2c37ce4-a2ab-4a5b-9d42-03824b4f78d9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea147e4f70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.606079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lazy-loading 'flavor' on Instance uuid feb4d72e-b423-48b3-aa53-de6ffc4b0b8c {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:03.644363 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a2c37ce4-a2ab-4a5b-9d42-03824b4f78d9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Image not found. Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a2c37ce4-a2ab-4a5b-9d42-03824b4f78d9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 HTTP/1.1 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c41bf365-3861-4fbe-af10-1cba1c4628a3'} Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c41bf365-3861-4fbe-af10-1cba1c4628a3 to delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c41bf365-3861-4fbe-af10-1cba1c4628a3 could not be found. Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.646335 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a2c37ce4-a2ab-4a5b-9d42-03824b4f78d9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:03.651489 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a2c37ce4-a2ab-4a5b-9d42-03824b4f78d9 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3" status: 404 len: 62 microversion: 2.1 time: 0.058010 Jun 18 22:07:03.653815 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 823/1635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:03 2022] DELETE /compute/v2.1/images/c41bf365-3861-4fbe-af10-1cba1c4628a3 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:07:03.656893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.662415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.676863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.679455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.680345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.680802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.709815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 HTTP/1.1 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '678d2a2b-9907-4e75-8cc7-424583f5cca7'} Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:03.711471 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:03.715814 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-68dc6709-cc4a-46c4-b439-e87b16bf7d5b tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 404 len: 111 microversion: 2.1 time: 0.059860 Jun 18 22:07:03.717176 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 824/1636] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:03 2022] DELETE /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:03.740375 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6cd375e6-4a4d-4cc8-a2dd-f17d3aea9654 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c/action" status: 202 len: 0 microversion: 2.1 time: 0.238841 Jun 18 22:07:03.741608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.742281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: 678d2a2b-9907-4e75-8cc7-424583f5cca7] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.742760 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 813/1637] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:07:03 2022] POST /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:07:03.750039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.751975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.756309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:03.764345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.765427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.769600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.772883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.792647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.795683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.802671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.807248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.895185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 HTTP/1.1 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '678d2a2b-9907-4e75-8cc7-424583f5cca7'} Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.901262 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:03.907234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance 678d2a2b-9907-4e75-8cc7-424583f5cca7 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:03.910187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d656164-f983-4b94-a79f-11ff3442f6f4 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7" status: 404 len: 111 microversion: 2.1 time: 0.184052 Jun 18 22:07:03.913713 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 825/1638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:03 2022] GET /compute/v2.1/servers/678d2a2b-9907-4e75-8cc7-424583f5cca7 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:03.926454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:03.939874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:03.962079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.962506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:03.963332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:03.963776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:04.515693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:04.524812 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba2a0566-1115-4b40-a5a7-9ac031df9a75 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.780442 Jun 18 22:07:04.537413 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 814/1639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:03 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:04.543032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:04.544107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:04.556002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:04.556759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:04.560174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:04.560797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:04.913661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:04.949346 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d67ffca8-3ad8-4622-8733-4fd9371276b2 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.407077 Jun 18 22:07:04.952474 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 815/1640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:04 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:04.970192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a06ad29-dd1a-4e03-88ba-6b116b63c0a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '.version_select at 0x7fea142aee50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:04.975111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8cb597a2-302d-4090-8768-9d5cb19c4290 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1631 microversion: 2.1 time: 1.060183 Jun 18 22:07:04.975683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 826/1641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:03 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1631 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:04.994695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-53ce5ab0-ab49-41bb-a3b8-2136b7c9241c req-f408ae00-563d-4ed7-8a50-822644358c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c40c8e-787d-457f-b4d9-db8efe1b08ca", "name": "network-vif-plugged", "status": "completed", "tag": "32fc5f27-6c79-4382-aa32-2e9603c51247"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:05.004410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-53ce5ab0-ab49-41bb-a3b8-2136b7c9241c req-f408ae00-563d-4ed7-8a50-822644358c23 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.005215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-53ce5ab0-ab49-41bb-a3b8-2136b7c9241c req-f408ae00-563d-4ed7-8a50-822644358c23 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.019165 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-53ce5ab0-ab49-41bb-a3b8-2136b7c9241c req-f408ae00-563d-4ed7-8a50-822644358c23 service nova] Creating event network-vif-plugged:32fc5f27-6c79-4382-aa32-2e9603c51247 for instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca on nch1-master-1 Jun 18 22:07:05.025373 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-53ce5ab0-ab49-41bb-a3b8-2136b7c9241c req-f408ae00-563d-4ed7-8a50-822644358c23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035682 Jun 18 22:07:05.026578 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 827/1642] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:05.032086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:05.033018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:05.040037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.040750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.041786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.042599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.048826 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0a06ad29-dd1a-4e03-88ba-6b116b63c0a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Image not found. Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a06ad29-dd1a-4e03-88ba-6b116b63c0a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b HTTP/1.1 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: exception: Image not found. Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '300e33cd-40ab-4e8b-b1ad-a11052a0bf2b'} Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 300e33cd-40ab-4e8b-b1ad-a11052a0bf2b to delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 300e33cd-40ab-4e8b-b1ad-a11052a0bf2b could not be found. Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.051564 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a06ad29-dd1a-4e03-88ba-6b116b63c0a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Image not found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:05.056720 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0a06ad29-dd1a-4e03-88ba-6b116b63c0a3 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b" status: 404 len: 62 microversion: 2.1 time: 0.091429 Jun 18 22:07:05.058658 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 816/1643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:04 2022] DELETE /compute/v2.1/images/300e33cd-40ab-4e8b-b1ad-a11052a0bf2b => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:07:05.066464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:05.067401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:05.081208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.082076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.082899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.085247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.145949 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 HTTP/1.1 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e67d33e4-d613-42be-8321-005a5ef130f0'} Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:05.147568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-529ca53c-c1d9-4534-bf22-8a5a09ae13bc tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 404 len: 111 microversion: 2.1 time: 0.086917 Jun 18 22:07:05.153073 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 817/1644] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:05 2022] DELETE /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:07:05.157678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:05.158296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] [instance: e67d33e4-d613-42be-8321-005a5ef130f0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:05.183170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.183628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.184791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.185428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.200316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] HTTP exception thrown: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Request method failure captured: Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 HTTP/1.1 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkuYwpnf_75ACMGHHXMAyMXC4v9m8VquywPYKYGjhI0cjYyIJZstMoH6n-ar2ym2rqOMZzFk7n4OzszC_qFZBCO6q5qBtUH0JGQVN3g1aynTV_eYLxV7TI7Zc7ladPs49KVpz6vgme1RvU-TBA4c-huKl9BbX38eh5vp1cNpd-jV_KE Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df7809024c414efd8534cefdecd980cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df7809024c414efd8534cefdecd980cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df7809024c414efd8534cefdecd980cf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: df7809024c414efd8534cefdecd980cf Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesTestJSON-967437489 Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4eef98c56e744064b2b5f131c3766c0c Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesTestJSON-967437489-project Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e67d33e4-d613-42be-8321-005a5ef130f0'} Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.215039 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:05.220353 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:05.220353 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:05.220353 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:05.220353 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:05.220353 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. Jun 18 22:07:05.220353 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:05.221558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] Returning 404 to user: Instance e67d33e4-d613-42be-8321-005a5ef130f0 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:05.222433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd1faeeb-dd82-4b1d-b23f-2f6d8fe0e599 tempest-ImagesTestJSON-967437489 tempest-ImagesTestJSON-967437489-project] 10.222.0.30 "GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0" status: 404 len: 111 microversion: 2.1 time: 0.068527 Jun 18 22:07:05.223009 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 818/1645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:05 2022] GET /compute/v2.1/servers/e67d33e4-d613-42be-8321-005a5ef130f0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:05.465138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:05.479386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:05.484798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:05.492984 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b32551c-df45-49be-b76d-8aa0f338bf50 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.464966 Jun 18 22:07:05.504209 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 828/1646] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:05 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:05.544183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:05.545774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:05.566303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.567063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.568078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.568675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:05.916946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:05.938479 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c6a96aa-f097-41fa-8376-3bcdb7f97f54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.398468 Jun 18 22:07:05.939725 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 819/1647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:05 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:05.975401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:05.976771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:05.984192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=22 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:05.986214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:05.992787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:05.994481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:06.005216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.007313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.008336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.018194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.025019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.026626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.032485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.084490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:06.326446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:06.495665 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0edf2a05-42e9-4153-b356-ec1b93c04faf tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1614 microversion: 2.1 time: 0.507267 Jun 18 22:07:06.498012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 820/1648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:05 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1614 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:06.516925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:06.517874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:06.535188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.536969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.538209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.538944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.578402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:06.597130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-499a47e0-294e-4b34-8052-39ef9efe562e tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1313 microversion: 2.1 time: 0.627185 Jun 18 22:07:06.598834 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 829/1649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:05 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:06.623803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:06.624849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:06.640638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.642236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.644829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.645584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.780376 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] HTTP exception thrown: Cannot 'migrate' instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c while it is in vm_state suspended Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Request method failure captured: Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c/action HTTP/1.1 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 15 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxZGlFz3Cv5zJUmwVrDmFGPK0y3SKS2Mlsb0ZjYJs99oQvxRrXaXkYxcg52TzdBaD7nRpmeR6jlV9bGCMFSQbH7CtrqKRQpZGRHCGnhKHbwhZn2shvaG1x5sQAfQckT9FWpiCH_4s6fVXYITVO5SaULK6QrQnZ8pttQmGM8YcSHaZ0 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cc1ea33e5234f28a39320c835dca69c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d0510f569a64acd8d80a58399597124 Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: {"migrate": {}} Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'migrate' instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c while it is in vm_state suspended Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'feb4d72e-b423-48b3-aa53-de6ffc4b0b8c', 'body': {'migrate': {}}} Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c in vm_state suspended. Cannot resize while the instance is in this state. Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:06.782636 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c while it is in vm_state suspended Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c while it is in vm_state suspended Jun 18 22:07:06.787654 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.791759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Returning 409 to user: Cannot 'migrate' instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c while it is in vm_state suspended {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:06.792854 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73cb45dd-bdff-4aa0-97a5-08d0a80d67d3 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c/action" status: 409 len: 148 microversion: 2.1 time: 0.177127 Jun 18 22:07:06.795266 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 830/1650] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:07:06 2022] POST /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c/action => generated 148 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:07:06.820706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8321e08-922b-40d2-86d6-588f7e1e6789 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8321e08-922b-40d2-86d6-588f7e1e6789 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Request method failure captured: Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf/action HTTP/1.1 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 39 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxZGlFz3Cv5zJUmwVrDmFGPK0y3SKS2Mlsb0ZjYJs99oQvxRrXaXkYxcg52TzdBaD7nRpmeR6jlV9bGCMFSQbH7CtrqKRQpZGRHCGnhKHbwhZn2shvaG1x5sQAfQckT9FWpiCH_4s6fVXYITVO5SaULK6QrQnZ8pttQmGM8YcSHaZ0 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cc1ea33e5234f28a39320c835dca69c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d0510f569a64acd8d80a58399597124 Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: {"os-resetState": {"state": "invalid"}} Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f606f0f8-7db0-447e-b67f-ca4a9b2550cf', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'invalid' Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:07:06.823751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8321e08-922b-40d2-86d6-588f7e1e6789 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:06.828350 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d8321e08-922b-40d2-86d6-588f7e1e6789 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf/action" status: 400 len: 144 microversion: 2.1 time: 0.016137 Jun 18 22:07:06.832376 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 831/1651] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:07:06 2022] POST /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:07:06.838559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c557800-b1da-47e1-b7eb-c7557dd6f320 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c557800-b1da-47e1-b7eb-c7557dd6f320 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Request method failure captured: Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf/action HTTP/1.1 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 31 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxZGlFz3Cv5zJUmwVrDmFGPK0y3SKS2Mlsb0ZjYJs99oQvxRrXaXkYxcg52TzdBaD7nRpmeR6jlV9bGCMFSQbH7CtrqKRQpZGRHCGnhKHbwhZn2shvaG1x5sQAfQckT9FWpiCH_4s6fVXYITVO5SaULK6QrQnZ8pttQmGM8YcSHaZ0 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cc1ea33e5234f28a39320c835dca69c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d0510f569a64acd8d80a58399597124 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: {"os-resetState": {"state": 1}} Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f606f0f8-7db0-447e-b67f-ca4a9b2550cf', 'body': {'os-resetState': {'state': 1}}} Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 1 Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 18 22:07:06.841811 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c557800-b1da-47e1-b7eb-c7557dd6f320 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:06.847679 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c557800-b1da-47e1-b7eb-c7557dd6f320 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf/action" status: 400 len: 120 microversion: 2.1 time: 0.009789 Jun 18 22:07:06.851954 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 832/1652] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:07:06 2022] POST /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf/action => generated 120 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:07:06.863607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0176c06-eae5-481d-9b92-9e5a7fa3a9c5 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:06.866668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0176c06-eae5-481d-9b92-9e5a7fa3a9c5 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Failed to fetch instance by id 999 {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:07:06.871559 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f0176c06-eae5-481d-9b92-9e5a7fa3a9c5 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0176c06-eae5-481d-9b92-9e5a7fa3a9c5 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Request method failure captured: Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 37 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxZGlFz3Cv5zJUmwVrDmFGPK0y3SKS2Mlsb0ZjYJs99oQvxRrXaXkYxcg52TzdBaD7nRpmeR6jlV9bGCMFSQbH7CtrqKRQpZGRHCGnhKHbwhZn2shvaG1x5sQAfQckT9FWpiCH_4s6fVXYITVO5SaULK6QrQnZ8pttQmGM8YcSHaZ0 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3cc1ea33e5234f28a39320c835dca69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3cc1ea33e5234f28a39320c835dca69c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 3cc1ea33e5234f28a39320c835dca69c Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-851536264 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d0510f569a64acd8d80a58399597124 Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminNegativeTestJSON-851536264-project-admin Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: {"os-resetState": {"state": "error"}} Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 999 could not be found. Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:06.875609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:06.880957 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:06.880957 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 18 22:07:06.880957 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:06.903941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0176c06-eae5-481d-9b92-9e5a7fa3a9c5 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:06.908470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0176c06-eae5-481d-9b92-9e5a7fa3a9c5 tempest-ServersAdminNegativeTestJSON-851536264 tempest-ServersAdminNegativeTestJSON-851536264-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.055262 Jun 18 22:07:06.914026 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 833/1653] 10.222.0.30 () {60 vars in 1178 bytes} [Sat Jun 18 22:07:06 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:07:06.931403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:06.933150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:06.961489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.963674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:06.965936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:06.967807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:07.042794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:07:07.091637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:07.211137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:07.232133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:07.236914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:07.244962 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c81ef5c-9c64-4644-bbd5-dbfe9a57a3a5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.735050 Jun 18 22:07:07.253134 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 821/1654] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:06 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:07.276479 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3555b190-3ff2-4fb5-81df-17382723f3ad tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 204 len: 0 microversion: 2.1 time: 0.351804 Jun 18 22:07:07.276479 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 834/1655] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:06 2022] DELETE /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:07:07.284956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-90df1590-7aac-46f0-9f93-4452c998b313 req-54adeabf-6716-4304-8191-8731ab488366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8265e105-3c88-4fa3-a004-6b7932b7c60a", "name": "network-vif-plugged", "status": "completed", "tag": "974c80c6-d6db-4c5c-acd6-ec7a57774d03"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:07.289800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:07.291141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:07.296014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-90df1590-7aac-46f0-9f93-4452c998b313 req-54adeabf-6716-4304-8191-8731ab488366 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:07.296562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-90df1590-7aac-46f0-9f93-4452c998b313 req-54adeabf-6716-4304-8191-8731ab488366 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:07.317866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:07.318329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:07.319146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:07.319585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:07.325603 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-90df1590-7aac-46f0-9f93-4452c998b313 req-54adeabf-6716-4304-8191-8731ab488366 service nova] Creating event network-vif-plugged:974c80c6-d6db-4c5c-acd6-ec7a57774d03 for instance 8265e105-3c88-4fa3-a004-6b7932b7c60a on nch1-master-1 Jun 18 22:07:07.338340 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-90df1590-7aac-46f0-9f93-4452c998b313 req-54adeabf-6716-4304-8191-8731ab488366 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062769 Jun 18 22:07:07.340857 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 835/1656] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:07.347137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:07.347845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:07.356452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:07.356452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:07.357609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:07.358085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.026238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:08.046557 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-96806938-5aa8-44fb-b4e9-306234813b87 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.784566 Jun 18 22:07:08.057663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 822/1657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:07 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:08.117468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:08.139998 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6ce9180-bd65-4108-9a0f-9e909ef78ac7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1469 microversion: 2.1 time: 0.797663 Jun 18 22:07:08.143130 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 836/1658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:07 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1469 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:08.167452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:08.168336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:08.191889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.195406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.199711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.204638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.412637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dd98aa9a-0c56-4c56-9e15-5bc702a3691d tempest-AZV2TestJSON-928144597 tempest-AZV2TestJSON-928144597-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:08.414998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd98aa9a-0c56-4c56-9e15-5bc702a3691d tempest-AZV2TestJSON-928144597 tempest-AZV2TestJSON-928144597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.415660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd98aa9a-0c56-4c56-9e15-5bc702a3691d tempest-AZV2TestJSON-928144597 tempest-AZV2TestJSON-928144597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.417674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd98aa9a-0c56-4c56-9e15-5bc702a3691d tempest-AZV2TestJSON-928144597 tempest-AZV2TestJSON-928144597-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.418315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd98aa9a-0c56-4c56-9e15-5bc702a3691d tempest-AZV2TestJSON-928144597 tempest-AZV2TestJSON-928144597-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.475941 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dd98aa9a-0c56-4c56-9e15-5bc702a3691d tempest-AZV2TestJSON-928144597 tempest-AZV2TestJSON-928144597-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.416856 Jun 18 22:07:08.478147 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 823/1659] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Jun 18 22:07:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:07:08.494794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:08.502315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:08.527475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.530494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.534854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.536318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.591033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:08.601664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cb5c20c-a03d-472c-a6f2-4573ac8d1aeb tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1463 microversion: 2.1 time: 0.457350 Jun 18 22:07:08.608137 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 837/1660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:08 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1463 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:08.618526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-10552bb6-1c88-4ae0-ac45-5735a27de0f8 req-ee70740f-e754-4225-969b-ef645e219ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "name": "network-vif-unplugged", "status": "completed", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:08.657454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-10552bb6-1c88-4ae0-ac45-5735a27de0f8 req-ee70740f-e754-4225-969b-ef645e219ef6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:08.664935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-10552bb6-1c88-4ae0-ac45-5735a27de0f8 req-ee70740f-e754-4225-969b-ef645e219ef6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:08.698929 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-10552bb6-1c88-4ae0-ac45-5735a27de0f8 req-ee70740f-e754-4225-969b-ef645e219ef6 service nova] Creating event network-vif-unplugged:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch1-master-1 Jun 18 22:07:08.713130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-10552bb6-1c88-4ae0-ac45-5735a27de0f8 req-ee70740f-e754-4225-969b-ef645e219ef6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103028 Jun 18 22:07:08.714137 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 838/1661] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:09.073789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7e05adce-07da-46b3-9bfc-7ec4a0325b37 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Calling method '.version_select at 0x7fea1493f8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:09.113284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e05adce-07da-46b3-9bfc-7ec4a0325b37 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:09.114296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e05adce-07da-46b3-9bfc-7ec4a0325b37 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:09.166295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e05adce-07da-46b3-9bfc-7ec4a0325b37 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:09.167012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e05adce-07da-46b3-9bfc-7ec4a0325b37 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:09.199952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7e05adce-07da-46b3-9bfc-7ec4a0325b37 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/6a3b4b4b24df43cdb92b0a8206d14ef0?start=2022-06-17T22%3A07%3A08.611716&end=2022-06-19T22%3A07%3A08.611716" status: 200 len: 694 microversion: 2.1 time: 0.480311 Jun 18 22:07:09.201214 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 839/1662] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Jun 18 22:07:08 2022] GET /compute/v2.1/os-simple-tenant-usage/6a3b4b4b24df43cdb92b0a8206d14ef0?start=2022-06-17T22%3A07%3A08.611716&end=2022-06-19T22%3A07%3A08.611716 => generated 694 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:09.206338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:09.209354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:09.223509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:09.224777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:09.226206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:09.226910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:09.847476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:09.866366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:09.869138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:09.877020 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27ccdc7c-ac9b-4ef0-a0d1-99079dd2503a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 1.392948 Jun 18 22:07:09.879345 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 824/1663] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:08 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:09.887256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:09.888478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:09.899644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:09.900578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:09.902465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:09.904646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.172868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:10.187046 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9df9dca-3122-44cf-80f7-c23ee53d2c9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1314 microversion: 2.1 time: 0.984184 Jun 18 22:07:10.189132 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 840/1664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:09 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:10.217271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6af0cb6e-4d8a-4907-b416-9e1fa27290c1 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '.version_select at 0x7fea147e4670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:10.238622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af0cb6e-4d8a-4907-b416-9e1fa27290c1 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.240214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af0cb6e-4d8a-4907-b416-9e1fa27290c1 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.260718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af0cb6e-4d8a-4907-b416-9e1fa27290c1 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.261749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af0cb6e-4d8a-4907-b416-9e1fa27290c1 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.289253 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6af0cb6e-4d8a-4907-b416-9e1fa27290c1 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/6a3b4b4b24df43cdb92b0a8206d14ef0?start=2022-06-17T22%3A07%3A08.611716&end=2022-06-19T22%3A07%3A08.611716" status: 200 len: 693 microversion: 2.1 time: 0.098270 Jun 18 22:07:10.301313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 841/1665] 10.222.0.30 () {58 vars in 1411 bytes} [Sat Jun 18 22:07:10 2022] GET /compute/v2.1/os-simple-tenant-usage/6a3b4b4b24df43cdb92b0a8206d14ef0?start=2022-06-17T22%3A07%3A08.611716&end=2022-06-19T22%3A07%3A08.611716 => generated 693 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:10.306841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8746a935-dc73-40b2-9715-ec6828ceb361 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Calling method '.version_select at 0x7fea140c7ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:10.327317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8746a935-dc73-40b2-9715-ec6828ceb361 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.328096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8746a935-dc73-40b2-9715-ec6828ceb361 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.350125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8746a935-dc73-40b2-9715-ec6828ceb361 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.350872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8746a935-dc73-40b2-9715-ec6828ceb361 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.421682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:10.432066 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ad2a721-7b54-436a-9eb4-157306b2d766 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1469 microversion: 2.1 time: 0.549203 Jun 18 22:07:10.447774 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 825/1666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:09 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1469 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:10.495818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8746a935-dc73-40b2-9715-ec6828ceb361 tempest-TenantUsagesTestJSON-1674033221 tempest-TenantUsagesTestJSON-1674033221-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-17T22%3A07%3A08.611716&end=2022-06-19T22%3A07%3A08.611716&detailed=1" status: 200 len: 20969 microversion: 2.1 time: 0.193130 Jun 18 22:07:10.496898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 842/1667] 10.222.0.30 () {58 vars in 1334 bytes} [Sat Jun 18 22:07:10 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-17T22%3A07%3A08.611716&end=2022-06-19T22%3A07%3A08.611716&detailed=1 => generated 20969 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:07:10.525501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:10.526185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:10.537595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.539433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.542708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.543354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.616868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:07:10.803469 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f001c33-237f-4fa7-96fd-a4e1fe12c0c7 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 204 len: 0 microversion: 2.1 time: 0.280878 Jun 18 22:07:10.805997 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 826/1668] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:10 2022] DELETE /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:07:10.813880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:10.816105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:10.834324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.835365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.836383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.836985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.903781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:10.904948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:10.914456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.914913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:10.915945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:10.916385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:11.291767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:11.302357 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b68916d-f4bb-415d-b289-77add5383f25 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1469 microversion: 2.1 time: 0.492028 Jun 18 22:07:11.304838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 843/1669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:10 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1469 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:11.330965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:11.332098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:11.360091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:11.360849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:11.362134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:11.363054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:11.399648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:11.433246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:11.452464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:11.453906 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-28788b2d-0d4d-49b9-84fd-12d9b8acafb7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.557500 Jun 18 22:07:11.468647 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 827/1670] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:10 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:07:11.484155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:11.484804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:11.537951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:11.544477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:11.545368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:11.545955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:11.919503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:11.939388 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-402b50dc-47b3-438e-90fb-88b99d183409 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 200 len: 1298 microversion: 2.1 time: 0.468121 Jun 18 22:07:11.943639 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 828/1671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:11 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 1298 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:11.979837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-498a9b65-c582-40d2-bead-fae194cc2d3b req-ec72ccb5-1f03-4c28-9d52-e94aca03f2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb4d72e-b423-48b3-aa53-de6ffc4b0b8c", "name": "network-vif-deleted", "tag": "56b4df7d-c972-405f-9332-4091cf5bd967"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:12.005665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-498a9b65-c582-40d2-bead-fae194cc2d3b req-ec72ccb5-1f03-4c28-9d52-e94aca03f2cd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.007857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-498a9b65-c582-40d2-bead-fae194cc2d3b req-ec72ccb5-1f03-4c28-9d52-e94aca03f2cd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:12.061235 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-498a9b65-c582-40d2-bead-fae194cc2d3b req-ec72ccb5-1f03-4c28-9d52-e94aca03f2cd service nova] Creating event network-vif-deleted:56b4df7d-c972-405f-9332-4091cf5bd967 for instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c on nch2-master-1 Jun 18 22:07:12.079213 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-498a9b65-c582-40d2-bead-fae194cc2d3b req-ec72ccb5-1f03-4c28-9d52-e94aca03f2cd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131818 Jun 18 22:07:12.082045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 829/1672] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:12.266231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:12.281641 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d74ab17-fc7d-4b6f-b310-4db16bde0a80 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1500 microversion: 2.1 time: 0.970502 Jun 18 22:07:12.283924 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 844/1673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:11 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1500 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:12.306975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:12.310286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:12.323604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:12.325078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:12.347098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.348177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.348564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:12.350899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.351639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:12.353824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.354546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:12.355968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:12.536606 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6ba54268-d47a-4d9c-88bf-1feb4a723ec2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a/action" status: 202 len: 0 microversion: 2.1 time: 0.235147 Jun 18 22:07:12.538704 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 830/1674] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:07:12 2022] POST /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:07:12.547515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:12.548677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:12.559355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.560442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:12.561510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:12.562095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.048473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:13.061426 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-86342819-8d21-4878-855e-6bcbd09f7d92 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1469 microversion: 2.1 time: 0.743822 Jun 18 22:07:13.075752 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 845/1675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:12 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1469 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:13.086347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:13.087179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:13.093844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.094565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.096616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.098220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.182134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:13.200254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:13.202588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:13.203807 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aff01a9a-9ae6-4002-b846-f08445e6457c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1813 microversion: 2.25 time: 0.663851 Jun 18 22:07:13.208854 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 831/1676] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:12 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1813 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:13.222013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:13.223084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: feb4d72e-b423-48b3-aa53-de6ffc4b0b8c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:13.239516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.239942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.240797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.241263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.270260 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] HTTP exception thrown: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c could not be found. Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Request method failure captured: Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c HTTP/1.1 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkxYUTnXA5RHjdLwWELcR2_r52zykilCyFz486ev0pLR-Jnq5saQP2PRkcRM81cyDvca0By6k_U9mZlXV-uRUhhiVvVE4NEZ_3OkRqtSqmNvfr_tFV-PwDvqQiEHqOTsVjLrsJlurB2DrlZV-ezDnTEjjvfiCrDQA62J6BcGVNO5FbQ Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1bd5b89d294a4ce588fc4dd900fe952c Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-292695100 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1bd5b89d294a4ce588fc4dd900fe952c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bd5b89d294a4ce588fc4dd900fe952c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bd5b89d294a4ce588fc4dd900fe952c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1bd5b89d294a4ce588fc4dd900fe952c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAdminNegativeTestJSON-292695100 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1bd5b89d294a4ce588fc4dd900fe952c Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-292695100 Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAdminNegativeTestJSON-292695100-project Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 33ec146b95734dcea62aad13f5105bdd Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAdminNegativeTestJSON-292695100-project Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c could not be found. Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'feb4d72e-b423-48b3-aa53-de6ffc4b0b8c'} Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c could not be found. Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c could not be found. Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:13.271956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c could not be found. Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Returning 404 to user: Instance feb4d72e-b423-48b3-aa53-de6ffc4b0b8c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:13.276589 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f6d6b61-b9ea-43ca-88c9-a6058bd40158 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c" status: 404 len: 111 microversion: 2.1 time: 0.060611 Jun 18 22:07:13.289973 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 832/1677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:13 2022] GET /compute/v2.1/servers/feb4d72e-b423-48b3-aa53-de6ffc4b0b8c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:13.307543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:13.308059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:13.316875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.317361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.322285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.322772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.379042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:07:13.542203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f7ff01be-6fd4-4fad-bd72-0fbd769a3a5e tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 204 len: 0 microversion: 2.1 time: 0.250762 Jun 18 22:07:13.542799 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 833/1678] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:13 2022] DELETE /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:07:13.551747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:13.553701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:13.569062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.569759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.571084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.571717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.820691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:13.830276 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2047183c-9699-4193-bf7b-983498def491 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1485 microversion: 2.1 time: 0.753020 Jun 18 22:07:13.843362 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 846/1679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:13 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1485 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:13.849779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:13.850961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:13.868690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.869394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.870609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:13.871219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:13.962500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:07:14.029285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:14.031818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:14.043219 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-086973d4-7a81-4dbc-b3d7-c5da02cc6d86 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1477 microversion: 2.1 time: 0.495702 Jun 18 22:07:14.050731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 834/1680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:13 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1477 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:14.080019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:14.080697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:14.094219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:14.094670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:14.095465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:14.095895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:14.169928 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-78a54d01-5072-4429-9511-bbdc87b095f7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 204 len: 0 microversion: 2.1 time: 0.324710 Jun 18 22:07:14.174633 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 847/1681] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:07:13 2022] DELETE /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:07:14.181232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:14.182616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:14.190787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:14.191567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:14.192358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:14.192794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:15.159216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:15.174397 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a57840e-ec60-4e08-88aa-05b110ee03cd tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1469 microversion: 2.1 time: 1.096924 Jun 18 22:07:15.178916 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 835/1682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:14 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1469 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:15.194107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:15.195631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:15.210865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:15.211890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:15.212931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:15.213599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:15.409015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:15.427465 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9b54dbf-3b31-481f-ba3b-4f17727a9cf3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1491 microversion: 2.1 time: 1.250897 Jun 18 22:07:15.443223 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 848/1683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:14 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1491 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:15.666196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-92cf4c08-d32e-4188-94c2-08d5b9106d6a tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Action: 'create', calling method: .version_select at 0x7fea147af820>, body: {"pool": null} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:15.821444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:15.831850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:15.843133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:15.844690 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a2e32d8d-d03c-4af8-bed3-b75b017c8171 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1803 microversion: 2.25 time: 0.663696 Jun 18 22:07:15.845870 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 836/1684] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:15 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1803 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:15.852791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:15.855857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:15.876736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:15.883549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:15.884852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:15.885350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:16.946826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:16.956390 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b26c218-0ec7-47fd-bf22-8f65b7147286 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1477 microversion: 2.1 time: 1.109263 Jun 18 22:07:16.957009 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 837/1685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:15 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1477 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:16.975508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2f046803-1f93-4eb2-b53d-a9202e13d85f req-6bffae41-9283-4c3a-8e49-edea73698a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c40c8e-787d-457f-b4d9-db8efe1b08ca", "name": "network-vif-deleted", "tag": "32fc5f27-6c79-4382-aa32-2e9603c51247"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:16.994734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2f046803-1f93-4eb2-b53d-a9202e13d85f req-6bffae41-9283-4c3a-8e49-edea73698a81 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:16.995194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2f046803-1f93-4eb2-b53d-a9202e13d85f req-6bffae41-9283-4c3a-8e49-edea73698a81 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:17.032146 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2f046803-1f93-4eb2-b53d-a9202e13d85f req-6bffae41-9283-4c3a-8e49-edea73698a81 service nova] Creating event network-vif-deleted:32fc5f27-6c79-4382-aa32-2e9603c51247 for instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca on nch1-master-1 Jun 18 22:07:17.051602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2f046803-1f93-4eb2-b53d-a9202e13d85f req-6bffae41-9283-4c3a-8e49-edea73698a81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093325 Jun 18 22:07:17.056197 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 838/1686] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:17.096276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43c02139-3ef3-4bd1-93a9-21af0412bf9e tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '.version_select at 0x7fea19d4b9d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:17.102654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43c02139-3ef3-4bd1-93a9-21af0412bf9e tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:17.106739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43c02139-3ef3-4bd1-93a9-21af0412bf9e tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:17.135688 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43c02139-3ef3-4bd1-93a9-21af0412bf9e tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2536 microversion: 2.25 time: 0.073924 Jun 18 22:07:17.136950 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 839/1687] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Jun 18 22:07:17 2022] GET /compute/v2.1/os-migrations => generated 2536 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:17.142971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:17.144421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:17.153420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:17.154381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:17.155698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:17.156516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:17.233002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:17.233880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:17.234635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lazy-loading 'fault' on Instance uuid 53c40c8e-787d-457f-b4d9-db8efe1b08ca {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:17.601881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8097bb116d8f47b2aca3970d51a46030', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a3b4b4b24df43cdb92b0a8206d14ef0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:17.611565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ff91b4c-1769-4d0f-b43b-b0daaa9a55c5 tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 200 len: 1303 microversion: 2.1 time: 0.473017 Jun 18 22:07:17.612677 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 840/1688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:17 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 1303 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:17.617407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:17.618147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:17.626584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:17.627547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:17.633535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:17.634163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:18.373737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:18.396774 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aab897b2-58b1-4e12-aca1-26fbaadd047f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 200 len: 1491 microversion: 2.1 time: 0.782746 Jun 18 22:07:18.401365 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 841/1689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:17 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 1491 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:18.414825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:18.417988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:18.442928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:18.450562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:18.452007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:18.453636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:18.454588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:18.814359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 603306c7-a28f-4251-985a-cc026c0c8c88 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:18.852267 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-901a1ede-0c84-4e77-8133-4fbe12f2f8ad tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 2421 microversion: 2.25 time: 0.447586 Jun 18 22:07:18.853325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 842/1690] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:18 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 2421 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:18.864103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:18.867187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:18.880716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:18.883830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:18.886307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:18.886981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.029150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.029150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.029150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lazy-loading 'fault' on Instance uuid f606f0f8-7db0-447e-b67f-ca4a9b2550cf {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:19.290052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ec146b95734dcea62aad13f5105bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd5b89d294a4ce588fc4dd900fe952c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:19.300645 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e8dd716-8a83-4a6c-b755-dc56ec1c13b7 tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 200 len: 1312 microversion: 2.1 time: 0.445894 Jun 18 22:07:19.305920 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 843/1691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:18 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:19.311209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4780e437-753c-47b8-a597-7ce83401a508 req-0f4ef9eb-4ff6-4910-82e2-e0c7932d5bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8265e105-3c88-4fa3-a004-6b7932b7c60a", "name": "network-vif-deleted", "tag": "974c80c6-d6db-4c5c-acd6-ec7a57774d03"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:19.335308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4780e437-753c-47b8-a597-7ce83401a508 req-0f4ef9eb-4ff6-4910-82e2-e0c7932d5bea service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.336073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4780e437-753c-47b8-a597-7ce83401a508 req-0f4ef9eb-4ff6-4910-82e2-e0c7932d5bea service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.360877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4780e437-753c-47b8-a597-7ce83401a508 req-0f4ef9eb-4ff6-4910-82e2-e0c7932d5bea service nova] Creating event network-vif-deleted:974c80c6-d6db-4c5c-acd6-ec7a57774d03 for instance 8265e105-3c88-4fa3-a004-6b7932b7c60a on nch1-master-1 Jun 18 22:07:19.379539 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4780e437-753c-47b8-a597-7ce83401a508 req-0f4ef9eb-4ff6-4910-82e2-e0c7932d5bea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071935 Jun 18 22:07:19.381475 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 844/1692] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:19.394850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:19.395957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] [instance: 53c40c8e-787d-457f-b4d9-db8efe1b08ca] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:19.409106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.413353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.415893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.418193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.452738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] HTTP exception thrown: Instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca could not be found. Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Request method failure captured: Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca HTTP/1.1 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkxybqdOuM13az-NGnflPuRx7ucpk0ifiCPhWUDyXP_ESM8-xEXgbwbclb8GE4dV6tXJjzMd_ISqXqeXytvLPv0rJfuOidOny5MfzG-KAcQ_894fC6nDihNrzF6nxl3J2xCEMl1qn3CPt00nG57KqEy3xBCDecl25od-SBHZCt6rnIs Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6a3b4b4b24df43cdb92b0a8206d14ef0 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TenantUsagesTestJSON-1125112471 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6a3b4b4b24df43cdb92b0a8206d14ef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6a3b4b4b24df43cdb92b0a8206d14ef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6a3b4b4b24df43cdb92b0a8206d14ef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6a3b4b4b24df43cdb92b0a8206d14ef0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TenantUsagesTestJSON-1125112471 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6a3b4b4b24df43cdb92b0a8206d14ef0 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1125112471 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TenantUsagesTestJSON-1125112471-project Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8097bb116d8f47b2aca3970d51a46030 Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TenantUsagesTestJSON-1125112471-project Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca could not be found. Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '53c40c8e-787d-457f-b4d9-db8efe1b08ca'} Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca could not be found. Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca could not be found. Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:19.458984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca could not be found. Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:19.464793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] Returning 404 to user: Instance 53c40c8e-787d-457f-b4d9-db8efe1b08ca could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:19.467569 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ef5e405-8f5c-4c33-928f-c4db745d805d tempest-TenantUsagesTestJSON-1125112471 tempest-TenantUsagesTestJSON-1125112471-project] 10.222.0.30 "GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca" status: 404 len: 111 microversion: 2.1 time: 0.080748 Jun 18 22:07:19.468763 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 845/1693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:19 2022] GET /compute/v2.1/servers/53c40c8e-787d-457f-b4d9-db8efe1b08ca => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:19.479601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:19.483172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:19.504326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.505155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.509929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.511080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:19.903203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 603306c7-a28f-4251-985a-cc026c0c8c88 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:19.933123 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0570fcb7-19ef-4a5d-b67c-2332412e9a14 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 2421 microversion: 2.25 time: 0.462840 Jun 18 22:07:19.941932 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 846/1694] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:19 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 2421 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:19.952374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-dcbecbe0-e246-44d5-9526-7cc98dfc8f1a req-6c45e3df-b212-4640-99e9-19e78ff454e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f606f0f8-7db0-447e-b67f-ca4a9b2550cf", "name": "network-vif-deleted", "tag": "532c23d7-17bd-4c20-a044-70c767beb815"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:19.978204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dcbecbe0-e246-44d5-9526-7cc98dfc8f1a req-6c45e3df-b212-4640-99e9-19e78ff454e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:19.985966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dcbecbe0-e246-44d5-9526-7cc98dfc8f1a req-6c45e3df-b212-4640-99e9-19e78ff454e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.030944 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-dcbecbe0-e246-44d5-9526-7cc98dfc8f1a req-6c45e3df-b212-4640-99e9-19e78ff454e6 service nova] Creating event network-vif-deleted:532c23d7-17bd-4c20-a044-70c767beb815 for instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf on nch1-master-1 Jun 18 22:07:20.042571 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-dcbecbe0-e246-44d5-9526-7cc98dfc8f1a req-6c45e3df-b212-4640-99e9-19e78ff454e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099051 Jun 18 22:07:20.047182 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 847/1695] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:20.067146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:20.068019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:20.093297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:20.096610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.098686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:20.103177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.160988 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a HTTP/1.1 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8265e105-3c88-4fa3-a004-6b7932b7c60a'} Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:20.163137 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:07:20.168022 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.171159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:20.172410 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bbc72f97-b1d4-4dfc-a0dc-64f022140ebb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 404 len: 111 microversion: 2.1 time: 0.123307 Jun 18 22:07:20.174811 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 848/1696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:20 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:20.186990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:20.188165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:20.197461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:20.198397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.204418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:20.205208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.343607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:20.395939 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-92cf4c08-d32e-4188-94c2-08d5b9106d6a tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.950934 Jun 18 22:07:20.396557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 849/1697] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:07:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:20.401906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:20.403238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] [instance: f606f0f8-7db0-447e-b67f-ca4a9b2550cf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:20.438999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:20.441332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.442573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:20.443310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:20.464393 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] HTTP exception thrown: Instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf could not be found. Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Request method failure captured: Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf HTTP/1.1 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkxYUTnXA5RHjdLwWELcR2_r52zykilCyFz486ev0pLR-Jnq5saQP2PRkcRM81cyDvca0By6k_U9mZlXV-uRUhhiVvVE4NEZ_3OkRqtSqmNvfr_tFV-PwDvqQiEHqOTsVjLrsJlurB2DrlZV-ezDnTEjjvfiCrDQA62J6BcGVNO5FbQ Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1bd5b89d294a4ce588fc4dd900fe952c Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-292695100 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1bd5b89d294a4ce588fc4dd900fe952c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bd5b89d294a4ce588fc4dd900fe952c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bd5b89d294a4ce588fc4dd900fe952c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1bd5b89d294a4ce588fc4dd900fe952c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminNegativeTestJSON-292695100 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1bd5b89d294a4ce588fc4dd900fe952c Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-292695100 Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminNegativeTestJSON-292695100-project Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 33ec146b95734dcea62aad13f5105bdd Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminNegativeTestJSON-292695100-project Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf could not be found. Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f606f0f8-7db0-447e-b67f-ca4a9b2550cf'} Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf could not be found. Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf could not be found. Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:20.467010 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf could not be found. Jun 18 22:07:20.472106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:20.473930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] Returning 404 to user: Instance f606f0f8-7db0-447e-b67f-ca4a9b2550cf could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:20.476167 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-addc222d-2bc7-4347-ae29-669ad97e90cc tempest-ServersAdminNegativeTestJSON-292695100 tempest-ServersAdminNegativeTestJSON-292695100-project] 10.222.0.30 "GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf" status: 404 len: 111 microversion: 2.1 time: 0.077979 Jun 18 22:07:20.477433 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 850/1698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:20 2022] GET /compute/v2.1/servers/f606f0f8-7db0-447e-b67f-ca4a9b2550cf => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:07:20.483896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-426799373", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:20.559806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lazy-loading 'services' on Instance uuid 603306c7-a28f-4251-985a-cc026c0c8c88 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:20.592533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:07:20.815112 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e817e84-479a-4d8f-bd48-909a594d72f5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-volume_attachments/68f2c433-eb73-4288-b1bb-b962f15c37ce" status: 202 len: 0 microversion: 2.25 time: 0.638062 Jun 18 22:07:20.821556 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 849/1699] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Jun 18 22:07:20 2022] DELETE /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-volume_attachments/68f2c433-eb73-4288-b1bb-b962f15c37ce => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:07:20.838812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35bc3b64-a71d-47d0-ac2f-69fbe1ec68a1 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Action: 'create', calling method: .version_select at 0x7fea14526a60>, body: {"pool": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:22.372925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:07:22.373551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:07:22.374591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:07:22.375981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:07:22.376326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:07:22.396619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:22.401204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:22.404340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:22.405807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:22.486827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:07:22.511993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:07:22.536999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:07:22.539899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:07:22.611804 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12f93cb3-800b-4a53-a5e7-18c4ba756eb1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132949 Jun 18 22:07:22.616022 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 851/1700] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:07:22.627451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:22.631879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:22.661665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:22.662607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:22.666477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:22.667368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:22.729550 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9fbd9717-0ce0-49da-87ac-8df97e8801d0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.111858 Jun 18 22:07:22.738285 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 852/1701] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Jun 18 22:07:22 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:22.769421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5f9a065d-2e78-44f4-84a6-820a71a44e9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:22.772094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5f9a065d-2e78-44f4-84a6-820a71a44e9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:22.795976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:23.229390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5f9a065d-2e78-44f4-84a6-820a71a44e9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:23.240425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5f9a065d-2e78-44f4-84a6-820a71a44e9e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1214 microversion: 2.1 time: 0.503793 Jun 18 22:07:23.243412 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 853/1702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:22 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1214 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:24.261076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:24.261942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:24.282017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:24.282700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:24.285312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:24.286027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:24.466307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:24.486310 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-50a98d89-3091-427c-909d-251fbef24dbf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1210 microversion: 2.1 time: 0.227253 Jun 18 22:07:24.489652 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 854/1703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:24 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1210 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:07:25.507889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:25.508508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:25.534984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:25.535436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:25.544647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:25.545130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:25.558825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:26.052343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:26.064142 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-863a2db9-45c5-4764-bae2-cebb198cf558 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1272 microversion: 2.1 time: 0.560688 Jun 18 22:07:26.075666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 855/1704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:25 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1272 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:26.944405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-235e32f0-db87-4a1f-92e8-3496db790449 tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:26.973427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-235e32f0-db87-4a1f-92e8-3496db790449 tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.296660 Jun 18 22:07:26.979726 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 856/1705] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:07:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:07:27.081876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:27.082841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:27.097059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:27.098038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:27.101691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:27.102598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:27.265574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35bc3b64-a71d-47d0-ac2f-69fbe1ec68a1 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.442250 Jun 18 22:07:27.266905 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 850/1706] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:07:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:27.278386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de0a59f7-1e05-4a72-8fef-7261e88a48e8 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Action: 'create', calling method: .version_select at 0x7fea1423db80>, body: {"pool": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:27.574483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:27.585325 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58b15b88-68bb-4cd3-ad2c-917d04b9fc0c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1272 microversion: 2.1 time: 0.508391 Jun 18 22:07:27.598447 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 857/1707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:27 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1272 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:27.912125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b41d55c-1153-4cd4-a2b4-3d3ef82bc9ab tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1832249915", "imageRef": "51af763b-d822-4ea8-a813-73bcf547fc81", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:28.004880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-1b41d55c-1153-4cd4-a2b4-3d3ef82bc9ab tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:07:30.192833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:30.449065 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-1b41d55c-1153-4cd4-a2b4-3d3ef82bc9ab tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b41d55c-1153-4cd4-a2b4-3d3ef82bc9ab tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] Request method failure captured: Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 143 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyenPTyW1jQGVG1aM4UxXgc7o4lV3kDz2u_lpdnau_8HxJ_Tll-sb9yKLfPTG8pVPy0kDgGoU9o0SMvhjdC2vSbUBYMVrUAb4kL-qVrVDtrKAZgMZnMBVltnIpGJOpQAFTQUrLmt-zA0GMbOl74NTo-IPIe_v7fCSDCBLu8z3VDUBc Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a632e920b1a9473780187e280f6403db Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FlavorsV2NegativeTest-809029570 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a632e920b1a9473780187e280f6403db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a632e920b1a9473780187e280f6403db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a632e920b1a9473780187e280f6403db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a632e920b1a9473780187e280f6403db", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FlavorsV2NegativeTest-809029570 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a632e920b1a9473780187e280f6403db Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-809029570 Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FlavorsV2NegativeTest-809029570-project Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: fa2ca694acec4a07963aeeb2cd1b007c Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FlavorsV2NegativeTest-809029570-project Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1832249915", "imageRef": "51af763b-d822-4ea8-a813-73bcf547fc81", "flavorRef": "452"}} Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: exception: Flavor's memory is too small for requested image. Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1832249915', 'imageRef': '51af763b-d822-4ea8-a813-73bcf547fc81', 'flavorRef': '452'}}} Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:07:30.450814 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b41d55c-1153-4cd4-a2b4-3d3ef82bc9ab tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:07:30.458014 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b41d55c-1153-4cd4-a2b4-3d3ef82bc9ab tempest-FlavorsV2NegativeTest-809029570 tempest-FlavorsV2NegativeTest-809029570-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 2.544949 Jun 18 22:07:30.460374 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 858/1708] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:07:27 2022] POST /compute/v2.1/servers => generated 93 bytes in 2552 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:07:30.463796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:30.480613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:30.510383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:30.510844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:30.511654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:30.512101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:30.762272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:31.318412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:31.339855 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9496a7cf-f72f-43dc-b829-d751f8289af6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 0.879795 Jun 18 22:07:31.340418 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 859/1709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:30 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:31.940342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1079297021", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "673307c5-760f-4780-9688-b6119455b2a6"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:32.124916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] validate_networks() for [('673307c5-760f-4780-9688-b6119455b2a6', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:07:32.456085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:33.138460 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de0a59f7-1e05-4a72-8fef-7261e88a48e8 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.864936 Jun 18 22:07:33.140086 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 851/1710] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:07:27 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:33.146418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:33.148241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:33.175475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:33.178034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:33.179563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:33.183320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:33.235593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:33.915347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:33.940264 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9c142a7e-f743-4e8a-9c08-230af932b8de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 0.798567 Jun 18 22:07:33.950741 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 852/1711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:33 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:33.990605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c261ffe1-8765-42b7-a776-b5caa01ecf33 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Action: 'create', calling method: .version_select at 0x7fea19da08b0>, body: {"pool": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:34.615581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:07:34.616117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:07:34.617375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:07:34.617903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:07:34.618413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:07:34.635351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:34.638042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:34.639083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:34.641969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:34.713630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Getting quotas for project e25c9a06b279434b8c8f262a3c0a968b. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:07:34.729504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Getting quotas for user 86d98b6f30884d13a94ea2d4cabff826 and project e25c9a06b279434b8c8f262a3c0a968b. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:07:34.780990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:07:34.793721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:07:34.968718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4bc9cf60-07f8-43a3-aa96-a6b25161977f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.620960 Jun 18 22:07:34.969906 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 860/1712] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:07:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:07:34.987380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:34.988485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:35.068227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:35.073970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:35.078987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:35.079446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:38.106166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:38.151622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83097ef3-5008-4025-bf5e-cf991ca39560 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 3.179822 Jun 18 22:07:38.154639 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 861/1713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:34 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 3184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:38.188393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:38.189185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:38.216555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:38.218626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:38.221301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:38.223064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:38.585179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:38.600566 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-131f0ea0-5a45-4b16-8a13-796e4f109f4e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1276 microversion: 2.1 time: 0.440514 Jun 18 22:07:38.601265 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 862/1714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:38 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:38.958668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1489818787", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:39.114505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:07:39.853584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:07:39.854006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:07:39.854685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:07:39.855262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:07:39.855839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:07:39.884219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:39.884681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:39.892277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:39.892888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:39.961105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Getting quotas for project 0f681d806f354b8682bdae077a9ece40. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:07:39.974976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Getting quotas for user dd075f9744d644e38be2333789563d12 and project 0f681d806f354b8682bdae077a9ece40. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:07:40.010687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:07:40.020316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:07:40.182504 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41a6b3ff-9145-4f69-869a-84541cb61cc4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580006 Jun 18 22:07:40.193307 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 863/1715] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:07:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:07:40.199103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-02645de8-2f3c-459c-beee-0df967082606 req-50024a2d-fcef-4349-9f5c-11afbf91f7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a462d18-117e-4b5d-965c-4f16125395e8", "tag": "7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:40.211773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-02645de8-2f3c-459c-beee-0df967082606 req-50024a2d-fcef-4349-9f5c-11afbf91f7ff service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:40.212610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-02645de8-2f3c-459c-beee-0df967082606 req-50024a2d-fcef-4349-9f5c-11afbf91f7ff service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:40.253635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-02645de8-2f3c-459c-beee-0df967082606 req-50024a2d-fcef-4349-9f5c-11afbf91f7ff service nova] Creating event network-changed:7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5 for instance 2a462d18-117e-4b5d-965c-4f16125395e8 on nch1-master-1 Jun 18 22:07:40.274838 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-02645de8-2f3c-459c-beee-0df967082606 req-50024a2d-fcef-4349-9f5c-11afbf91f7ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079613 Jun 18 22:07:40.287072 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 864/1716] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:40.303724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:40.307056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:40.340221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:40.341149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:40.347106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:40.347559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:40.961225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:40.974236 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a75bbc6-bab4-438a-9ed6-a426bb726fea tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 0.685566 Jun 18 22:07:40.975120 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 865/1717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:40 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:40.992430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:40.993257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:41.000469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:41.007768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:41.008677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:41.009185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:41.413061 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c261ffe1-8765-42b7-a776-b5caa01ecf33 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.454661 Jun 18 22:07:41.419274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 853/1718] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:07:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:41.424916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:41.425725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:41.454947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:41.455653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:41.456239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:41.456670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:41.641087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:41.649551 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3786d783-e077-4692-b849-bd1057c64034 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1221 microversion: 2.1 time: 0.229086 Jun 18 22:07:41.656349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 854/1719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:41 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1221 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:41.672946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0c1079d-a2e1-4ff6-bcd3-1ebec9aecfc0 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea19d42af0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:41.704914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:41.750509 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c3d3d00-d817-45de-a1a0-05a233320b60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1318 microversion: 2.1 time: 0.771962 Jun 18 22:07:41.772890 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 866/1720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:40 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:41.992337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:41.993327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:42.005947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:42.006703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:42.009454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:42.011613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:42.216189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0c1079d-a2e1-4ff6-bcd3-1ebec9aecfc0 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/3b6d8500-d3a7-4c11-891c-280366f6b277" status: 200 len: 141 microversion: 2.1 time: 0.546925 Jun 18 22:07:42.217247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 855/1721] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:07:41 2022] GET /compute/v2.1/os-floating-ips/3b6d8500-d3a7-4c11-891c-280366f6b277 => generated 141 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:42.230035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-554ff5f6-002a-4119-bdef-00eeffa79bfb tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea19cbf550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:42.758967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:42.768458 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f7b60b0a-8273-41cd-b61f-d5b86f8979de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 0.781096 Jun 18 22:07:42.775211 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 867/1722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:41 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:42.788787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:42.789429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:42.806815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:42.807271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:42.808253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:42.808941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:43.022644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:43.046453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9fee8125-160c-4e70-8f44-b6fedbb8e163 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1275 microversion: 2.1 time: 0.260955 Jun 18 22:07:43.049375 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 868/1723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:42 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:43.070358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:43.074501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:43.123293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:43.125806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:43.127882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:43.132141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:44.194856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:44.207891 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fda0b34f-e7a5-4d02-8eeb-75ed9c949c19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1318 microversion: 2.1 time: 1.156981 Jun 18 22:07:44.208923 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 869/1724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:43 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1318 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:44.693126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2078515782", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "739254b4-0b9e-4570-96ec-dfd475b9db29"}], "block_device_mapping_v2": [{"uuid": "aa66e756-7e7b-41ce-aa13-407ac178ec3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:44.777956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] validate_networks() for [('739254b4-0b9e-4570-96ec-dfd475b9db29', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:07:45.368087 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-554ff5f6-002a-4119-bdef-00eeffa79bfb tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/3b6d8500-d3a7-4c11-891c-280366f6b277" status: 202 len: 0 microversion: 2.1 time: 3.143612 Jun 18 22:07:45.369005 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 856/1725] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:07:42 2022] DELETE /compute/v2.1/os-floating-ips/3b6d8500-d3a7-4c11-891c-280366f6b277 => generated 0 bytes in 3146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:07:45.377927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:45.379335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:45.391149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:45.391601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:45.392386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:45.392814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:45.826043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:45.836930 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9393022c-2c3d-4465-bf11-6265b99cfb4a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 0.465747 Jun 18 22:07:45.838000 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 857/1726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:45 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:45.849827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:45.850727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:45.869508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:45.870341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:45.871325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:45.871921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:45.966816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:07:45.967446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:07:45.967780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:07:45.968262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:07:45.968682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:07:45.978791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:45.979558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:45.980541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:45.981734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:46.003793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:07:46.018673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Getting quotas for user 681cfb0e560145b4abef98dbd417f3e0 and project 5c35ef36a81442b69cd93edc50ecb5bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:07:46.161180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:07:46.165473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa66e756-7e7b-41ce-aa13-407ac178ec3c',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:07:46.398581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:46.406950 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d0d26331-4257-4f05-bcec-256d1072bfa3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.567433 Jun 18 22:07:46.412235 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 858/1727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:45 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:46.434732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3f3b8979-af1e-406e-b70d-1403dd4c9dcd req-47d4902c-70f6-4108-8712-a366af2ffbbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711f5bc4-2480-4399-a4f3-77068704a9b8", "tag": "c8f50426-7fae-40e9-bc9a-64735fd86c94"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:46.455895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3f3b8979-af1e-406e-b70d-1403dd4c9dcd req-47d4902c-70f6-4108-8712-a366af2ffbbd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:46.456729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3f3b8979-af1e-406e-b70d-1403dd4c9dcd req-47d4902c-70f6-4108-8712-a366af2ffbbd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:46.498584 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3f3b8979-af1e-406e-b70d-1403dd4c9dcd req-47d4902c-70f6-4108-8712-a366af2ffbbd service nova] Creating event network-changed:c8f50426-7fae-40e9-bc9a-64735fd86c94 for instance 711f5bc4-2480-4399-a4f3-77068704a9b8 on nch2-master-1 Jun 18 22:07:46.515810 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3f3b8979-af1e-406e-b70d-1403dd4c9dcd req-47d4902c-70f6-4108-8712-a366af2ffbbd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101865 Jun 18 22:07:46.524034 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-45a1166f-7203-4505-a4d3-17e9cb38b963 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309231 Jun 18 22:07:46.525505 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 870/1728] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:07:46.536004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1691783859", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "39432198-5051-484b-846b-d7e8994b5707"}], "block_device_mapping_v2": [{"uuid": "f7ddbb47-4767-4642-b519-69ecfb1831d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:46.537396 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 859/1729] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:46.547894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:46.567452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:46.586104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:46.586873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:46.590054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:46.590739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:46.737818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] validate_networks() for [('39432198-5051-484b-846b-d7e8994b5707', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:07:47.624167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:47.663768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf3e7752-b98b-480f-92d9-c63d2d29fd9d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1318 microversion: 2.1 time: 1.119968 Jun 18 22:07:47.667989 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 860/1730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:46 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1318 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:47.684422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f75113a1-e624-44f0-ae05-b9b6bab991b8 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea142ae700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:48.600418 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f75113a1-e624-44f0-ae05-b9b6bab991b8 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.928230 Jun 18 22:07:48.601797 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 861/1731] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Jun 18 22:07:47 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:07:48.607464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a0d479f8-f337-46d3-b471-b717bcae07fd req-93dcb0c3-a37d-4ea0-82cc-37e2c57b93cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a462d18-117e-4b5d-965c-4f16125395e8", "name": "network-vif-plugged", "status": "completed", "tag": "7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:48.674726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a0d479f8-f337-46d3-b471-b717bcae07fd req-93dcb0c3-a37d-4ea0-82cc-37e2c57b93cf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:48.676583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a0d479f8-f337-46d3-b471-b717bcae07fd req-93dcb0c3-a37d-4ea0-82cc-37e2c57b93cf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:48.723245 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a0d479f8-f337-46d3-b471-b717bcae07fd req-93dcb0c3-a37d-4ea0-82cc-37e2c57b93cf service nova] Creating event network-vif-plugged:7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5 for instance 2a462d18-117e-4b5d-965c-4f16125395e8 on nch1-master-1 Jun 18 22:07:48.746511 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a0d479f8-f337-46d3-b471-b717bcae07fd req-93dcb0c3-a37d-4ea0-82cc-37e2c57b93cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142694 Jun 18 22:07:48.751461 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 862/1732] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:48.792888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:48.793737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:48.814426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:48.816728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:48.818368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:48.818824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:49.072194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:49.120936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a09f126b-7862-4b25-8d5d-b48b5774edd9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1169 microversion: 2.1 time: 0.365566 Jun 18 22:07:49.123814 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 863/1733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:48 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1169 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:49.131996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:49.132901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:49.142636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:49.143834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:49.146654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:49.147578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:50.321731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:50.342304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e44cd172-52fc-4b60-83b6-c346e46a0b3b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1314 microversion: 2.1 time: 1.213164 Jun 18 22:07:50.343029 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 864/1734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:49 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1314 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:50.386049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:50.386775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:50.397803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:50.398570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:50.399784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:50.400460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:50.706698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:07:50.707721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:07:50.708397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:07:50.708985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:07:50.709598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:07:50.723739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:50.739282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:50.740540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:50.741184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:50.785968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:07:50.801795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Getting quotas for user 76897f7be7494bb589de747493240449 and project 9f0a0c26a5b846f0a657fa8810da9d71. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:07:50.923361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:50.940067 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-755d09cd-3f02-4d9e-9308-8e515cde9c6a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.585559 Jun 18 22:07:50.940686 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 865/1735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:50 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:50.962776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f22c5d41-54d3-4940-894c-56ba08efc4c5 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea19dc31f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:51.615471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:07:51.617813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7ddbb47-4767-4642-b519-69ecfb1831d9',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:07:51.849987 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f22c5d41-54d3-4940-894c-56ba08efc4c5 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.905976 Jun 18 22:07:51.850710 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 866/1736] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:07:50 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:51.859607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:51.859607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:51.868664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-015dafa0-2b65-4838-a545-bc36b1e4e411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 5.341702 Jun 18 22:07:51.869983 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 871/1737] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:07:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 5344 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:07:51.877344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0a9ba972-373b-4d7d-b87b-16f82b38d302 req-4ca1f2f0-5bd1-435d-86a1-2ec693263d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:51.881097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:51.887196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:51.888188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:51.888318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0a9ba972-373b-4d7d-b87b-16f82b38d302 req-4ca1f2f0-5bd1-435d-86a1-2ec693263d3f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:51.888637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0a9ba972-373b-4d7d-b87b-16f82b38d302 req-4ca1f2f0-5bd1-435d-86a1-2ec693263d3f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:51.892404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:51.900886 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0a9ba972-373b-4d7d-b87b-16f82b38d302 req-4ca1f2f0-5bd1-435d-86a1-2ec693263d3f service nova] Creating event network-changed:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:07:51.907840 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0a9ba972-373b-4d7d-b87b-16f82b38d302 req-4ca1f2f0-5bd1-435d-86a1-2ec693263d3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 Jun 18 22:07:51.909237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 872/1738] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:51.914849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:51.915773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:51.923431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:51.924219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:51.925921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:51.926699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:52.312716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:52.320923 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24c65b98-daaa-4c5b-b255-ee19d00b59a3 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 0.410280 Jun 18 22:07:52.325756 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 873/1739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:51 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:52.331232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:52.337679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:52.340220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:52.343583 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff121cc5-ea9a-492f-b861-830e7d7ea7ca tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1318 microversion: 2.1 time: 0.490329 Jun 18 22:07:52.346574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:52.355684 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 867/1740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:51 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:52.361635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:52.362626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:52.365188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:52.367149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:52.367627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02590e7e-6cc6-4328-ba85-9bfe755ea39a tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea19cacc10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:52.809248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:52.836585 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-711a0360-9a3f-49cd-9c9f-947ed82e5bf0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1501 microversion: 2.1 time: 0.508154 Jun 18 22:07:52.852125 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 874/1741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:52 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1501 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:52.861754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:52.862805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:52.885622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:52.886784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:52.888720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:52.890593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:53.019406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:53.036921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:53.040026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:53.042273 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c74482cb-4bd3-4de8-be50-aa53e388f039 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1185 microversion: 2.25 time: 0.188879 Jun 18 22:07:53.043060 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 875/1742] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:52 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:53.085442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:53.088495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:53.109707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:53.111086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:53.112117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:53.112718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:53.437993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:53.449338 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7509acc7-a180-4879-a0de-8059978872cc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.379302 Jun 18 22:07:53.449937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 876/1743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:53 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:53.466144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:53.466773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:53.475204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:53.475863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:53.480361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:53.480838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:53.513181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'flavor' on Instance uuid 2a462d18-117e-4b5d-965c-4f16125395e8 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:07:53.572355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:53.872450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02590e7e-6cc6-4328-ba85-9bfe755ea39a tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/f5a9444b-f8ea-421f-a42b-d25bbd8c83bb" status: 202 len: 0 microversion: 2.1 time: 1.515735 Jun 18 22:07:53.873051 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 868/1744] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:07:52 2022] DELETE /compute/v2.1/os-floating-ips/f5a9444b-f8ea-421f-a42b-d25bbd8c83bb => generated 0 bytes in 1517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:07:53.879729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:53.880812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:53.894591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:53.896192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:53.897205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:53.897919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:54.003286 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ded73371-c140-4595-a96d-364f22d7b9cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8/action" status: 202 len: 0 microversion: 2.1 time: 0.548040 Jun 18 22:07:54.009638 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 877/1745] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:07:53 2022] POST /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:07:54.022768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:54.031528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:54.044585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:54.045391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:54.046521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:54.047938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:54.186401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:54.207478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-89954ecd-c6b5-4291-96fd-e553c3a47730 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 0.332798 Jun 18 22:07:54.209364 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 869/1746] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:53 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:54.224082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a8209e04-5314-42af-b995-a4b4d8bf8f69 req-e8359136-9a58-47a5-a74b-0aa962c8370a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711f5bc4-2480-4399-a4f3-77068704a9b8", "name": "network-vif-plugged", "status": "completed", "tag": "c8f50426-7fae-40e9-bc9a-64735fd86c94"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:54.242428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a8209e04-5314-42af-b995-a4b4d8bf8f69 req-e8359136-9a58-47a5-a74b-0aa962c8370a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:54.243063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a8209e04-5314-42af-b995-a4b4d8bf8f69 req-e8359136-9a58-47a5-a74b-0aa962c8370a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:54.252408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:54.260357 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-620b9ed7-f529-44a1-97af-78cb2c48a9e0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1318 microversion: 2.1 time: 0.247969 Jun 18 22:07:54.270219 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 878/1747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:54 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:54.275110 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a8209e04-5314-42af-b995-a4b4d8bf8f69 req-e8359136-9a58-47a5-a74b-0aa962c8370a service nova] Creating event network-vif-plugged:c8f50426-7fae-40e9-bc9a-64735fd86c94 for instance 711f5bc4-2480-4399-a4f3-77068704a9b8 on nch2-master-1 Jun 18 22:07:54.275632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-68bd8b34-b46a-4061-98f8-3030e8740ce1 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea19e008b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:54.303655 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a8209e04-5314-42af-b995-a4b4d8bf8f69 req-e8359136-9a58-47a5-a74b-0aa962c8370a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091955 Jun 18 22:07:54.308143 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 870/1748] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:54.334685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8cbd0a68-bbec-4504-b62d-ef4b4383d2ad req-e317f279-fe96-422c-a18a-687144b4d05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfbbf33-04a0-46d3-82ce-51afe2d4eae9", "tag": "6052a204-9eb6-4695-a8bc-55524ef614d9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:07:54.354800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8cbd0a68-bbec-4504-b62d-ef4b4383d2ad req-e317f279-fe96-422c-a18a-687144b4d05f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:54.355519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8cbd0a68-bbec-4504-b62d-ef4b4383d2ad req-e317f279-fe96-422c-a18a-687144b4d05f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:54.379883 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8cbd0a68-bbec-4504-b62d-ef4b4383d2ad req-e317f279-fe96-422c-a18a-687144b4d05f service nova] Creating event network-changed:6052a204-9eb6-4695-a8bc-55524ef614d9 for instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 on nch2-master-1 Jun 18 22:07:54.386577 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8cbd0a68-bbec-4504-b62d-ef4b4383d2ad req-e317f279-fe96-422c-a18a-687144b4d05f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068453 Jun 18 22:07:54.388946 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 871/1749] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:07:54.394725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:54.395728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:54.404166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:54.404950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:54.406000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:54.406607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:55.760080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:55.778848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-716b7a00-184c-4453-9d13-a3aa2b769047 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 1.388389 Jun 18 22:07:55.779844 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 872/1750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:54 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:55.786875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:55.787885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:55.794924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:55.795757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:55.796857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:55.797580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:56.005627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:56.015301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:56.016956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:56.019417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-40ea37ef-1a49-43c4-83d2-0c3492d5019e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1251 microversion: 2.25 time: 0.238191 Jun 18 22:07:56.044332 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 873/1751] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:55 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1251 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:56.072446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:56.073670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:56.088506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:56.089086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:56.090580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:56.090580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:56.553022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:56.563220 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-701b877d-eabb-4beb-8324-0688ac720b82 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.517451 Jun 18 22:07:56.566232 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 874/1752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:56 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:56.574469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:56.582217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:56.600270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:56.600726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:56.601553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:56.601994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.194910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:57.216754 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38dffe4d-3a3e-47d7-9d73-95c088dc5e73 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 0.649334 Jun 18 22:07:57.226112 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 875/1753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:56 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:57.226112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:57.226112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:57.240506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:57.240956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.241769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:57.242205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.519469 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-68bd8b34-b46a-4061-98f8-3030e8740ce1 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/6598b82b-c3e6-4a88-a42b-5f16edfcadc8" status: 202 len: 0 microversion: 2.1 time: 3.247423 Jun 18 22:07:57.523288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 879/1754] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:07:54 2022] DELETE /compute/v2.1/os-floating-ips/6598b82b-c3e6-4a88-a42b-5f16edfcadc8 => generated 0 bytes in 3250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:07:57.544961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:57.547371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:57.569169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:57.569793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.570712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:57.573216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.623028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:57.634035 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0a34899b-4c1a-4d4f-85cd-709fe529d6a4 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1508 microversion: 2.1 time: 0.415085 Jun 18 22:07:57.642303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 876/1755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:57 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:57.653315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:57.655934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:57.673084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:57.673512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.674502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:57.675103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:57.680211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:07:57.966813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:57.983068 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a0034770-10a1-433b-a556-5a17400c9b25 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.455483 Jun 18 22:07:57.998220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 880/1756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:57 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:58.003737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b336de32-1e13-4784-8abe-78a065bd1430 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] Calling method '.version_select at 0x7fea19e00af0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:58.051952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:58.064888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:58.067060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:58.073068 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d511b76c-3026-4274-8b16-4deb1e808b3f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.427842 Jun 18 22:07:58.073940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 877/1757] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:57 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:07:58.078819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:58.079894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:58.086564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:58.087222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:58.088179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:58.088807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:58.856288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:58.873197 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a53e8d2-a8e5-4b73-b737-e5a0829a8256 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.797899 Jun 18 22:07:58.874170 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 878/1758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:58 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:58.892413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:58.894452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:58.906752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:58.907714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:58.908838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:58.909614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:59.512105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:59.520767 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-188fb105-6688-4999-bf9c-e8c161bdea94 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1508 microversion: 2.1 time: 0.645174 Jun 18 22:07:59.531782 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 879/1759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:58 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1508 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:59.531782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:59.538245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:59.556878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:59.557369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:59.558189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:59.558644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:59.590828 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b336de32-1e13-4784-8abe-78a065bd1430 tempest-FloatingIPDetailsTestJSON-838844042 tempest-FloatingIPDetailsTestJSON-838844042-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/c58e28c9-bbcd-44f3-a0e5-0762e8a93b56" status: 202 len: 0 microversion: 2.1 time: 1.590892 Jun 18 22:07:59.596560 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 881/1760] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:07:57 2022] DELETE /compute/v2.1/os-floating-ips/c58e28c9-bbcd-44f3-a0e5-0762e8a93b56 => generated 0 bytes in 1597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:07:59.602293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:59.603043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:59.626704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:59.631857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:59.633497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:59.635480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:59.935959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:07:59.946158 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5655a985-b41b-455a-822d-36bc347f3cc4 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 0.418947 Jun 18 22:07:59.947128 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 880/1761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:59 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:07:59.965563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:07:59.967534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:07:59.981999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:59.985013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:07:59.988897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:07:59.990087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.085346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:00.097774 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e50b34b-e968-4ac8-9a94-8e765a28e03b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.499944 Jun 18 22:08:00.102123 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 882/1762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:07:59 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:00.116055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-81d0b923-70c9-46df-8f45-ea7d07578bd1 req-3b20ac0a-c959-4eaa-a61c-d1fc77f60983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "name": "network-vif-plugged", "status": "completed", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:00.145351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-81d0b923-70c9-46df-8f45-ea7d07578bd1 req-3b20ac0a-c959-4eaa-a61c-d1fc77f60983 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.146099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-81d0b923-70c9-46df-8f45-ea7d07578bd1 req-3b20ac0a-c959-4eaa-a61c-d1fc77f60983 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.170328 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-81d0b923-70c9-46df-8f45-ea7d07578bd1 req-3b20ac0a-c959-4eaa-a61c-d1fc77f60983 service nova] Creating event network-vif-plugged:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:08:00.189813 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-81d0b923-70c9-46df-8f45-ea7d07578bd1 req-3b20ac0a-c959-4eaa-a61c-d1fc77f60983 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084451 Jun 18 22:08:00.197296 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 883/1763] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:00.209647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:00.212627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:00.223484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.224146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.225481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.226091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.314202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:00.329647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:00.338220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:00.341953 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-36736b89-6d7e-493f-b09b-7804b3797dc0 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.385786 Jun 18 22:08:00.349062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 881/1764] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:07:59 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:00.370984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:08:00.372982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:08:00.373948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:08:00.377102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:08:00.379235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:08:00.533113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:00.544402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.544861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.547541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.548960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.631856 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f42fb105-4490-4e02-b244-2185865cc971 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "POST /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8/action" status: 202 len: 1110 microversion: 2.1 time: 0.433116 Jun 18 22:08:00.634831 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 884/1765] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:08:00 2022] POST /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8/action => generated 1110 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 18 22:08:00.646334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:00.647289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:00.661920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.662382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.663179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:00.674152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:00.767965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:00.821234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=24 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:00.861910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2faf7fb7-c2f1-4a4c-aac0-46610360dc30 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Action: 'create', calling method: .version_select at 0x7fea19cac160>, body: {"keypair": {"name": "tempest-keypair-522621009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItJBJ2MFngE03mf3HI/WehkjZG8Vp9VwFLdyGQifglTcF65x6gU8XZ33vUUxCVH5xbIdNEcHPjFtn9v1ge6F9saSt/xkKC6udboLo/PbrhHhUohwFMNEgaNU3kyriJ7xQ=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:00.871716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=49 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:00.885998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2faf7fb7-c2f1-4a4c-aac0-46610360dc30 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Getting quotas for project 4643e24233bd4af1a0c020e4d9a474fb. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:00.891915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2faf7fb7-c2f1-4a4c-aac0-46610360dc30 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Getting quotas for user cf9fa8d3d2bc4f9fa12fab743b7090ad and project 4643e24233bd4af1a0c020e4d9a474fb. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:00.955564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2faf7fb7-c2f1-4a4c-aac0-46610360dc30 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.602767 Jun 18 22:08:00.956251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 882/1766] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:08:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:01.130814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-881a10de-f3bf-4918-a890-efa3f9aca066 req-ea8811ba-04c6-4642-852c-0c5edead87de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243a6f2b-0c2c-43f8-8e7e-5336fafa5f76", "tag": "d9b7cbe4-2618-4090-ad3c-05ac7dce53ae"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:01.169506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-881a10de-f3bf-4918-a890-efa3f9aca066 req-ea8811ba-04c6-4642-852c-0c5edead87de service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.170213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-881a10de-f3bf-4918-a890-efa3f9aca066 req-ea8811ba-04c6-4642-852c-0c5edead87de service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.192069 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-881a10de-f3bf-4918-a890-efa3f9aca066 req-ea8811ba-04c6-4642-852c-0c5edead87de service nova] Creating event network-changed:d9b7cbe4-2618-4090-ad3c-05ac7dce53ae for instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 on nch1-master-1 Jun 18 22:08:01.199960 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-881a10de-f3bf-4918-a890-efa3f9aca066 req-ea8811ba-04c6-4642-852c-0c5edead87de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242484 Jun 18 22:08:01.202281 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 883/1767] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:01.212607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:01.213712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:01.222937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.223592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.230768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:01.231914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.232588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.244672 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-088ea2c6-aa35-422e-8e9e-a1ca507377c7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.605854 Jun 18 22:08:01.245927 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 885/1768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:00 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:01.258102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:01.258733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:01.287250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.293023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.293940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.294345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.718707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:01.729371 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bd85335-aed0-4e9b-bfdf-6dbf3147d4c3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.522622 Jun 18 22:08:01.735347 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 884/1769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:01 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:01.745439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:01.746177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:01.758932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.759891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.760679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.761372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.762020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:01.771505 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d48ca503-4d5b-48e3-aedb-edc4d6d84ae0 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 0.524407 Jun 18 22:08:01.772328 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 886/1770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:01 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:01.787935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:01.788739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:01.798401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.799147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:01.800205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:01.800951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:02.085370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:02.089755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:02.137314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:02.138702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7486bd0a-7129-4423-85b3-85d3d5fff43f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.392600 Jun 18 22:08:02.140152 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 885/1771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:01 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:02.144900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:02.146620 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d7f2eda-4e26-429d-836b-b2b25d48adc4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.371175 Jun 18 22:08:02.147774 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 887/1772] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:01 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:02.261988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:02.262699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:02.268936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:02.269651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:02.270614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:02.271221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:02.492535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:02.503922 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b34bcaf-9947-4d2e-8c05-218056dbfb11 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1317 microversion: 2.1 time: 0.245459 Jun 18 22:08:02.504891 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 886/1773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:02 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:02.747538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:02.748377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:02.765308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:02.766447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:02.767422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:02.768031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:02.793098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:02.794005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:02.811004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:02.811459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:02.812358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:02.812808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:03.797603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:03.810074 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d91d7ce-0733-48a7-bbc5-15484f11e5bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 1.066447 Jun 18 22:08:03.825137 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 888/1774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:02 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:03.834160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:03.835594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:03.844743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:03.845582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:03.847384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:03.848220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:04.098325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:04.135470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc62d9a5-e6a9-47d2-9d88-d01048c37a80 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 1.342391 Jun 18 22:08:04.136127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 887/1775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:02 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:04.160751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:04.169706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:04.189763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:04.192786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:04.195471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:04.197144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:04.433250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:04.445734 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0acbf185-c89f-467b-8996-e7513fbf2ba6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.618670 Jun 18 22:08:04.461606 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 889/1776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:03 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:04.466719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:04.479618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:04.517657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:04.518305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:04.534971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:04.535566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:04.943848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:04.957094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:04.961098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:04.963555 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4989f156-1f5e-45f2-bf8a-6228e54a2aa6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.806922 Jun 18 22:08:04.997750 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 888/1777] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:04 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:05.039737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:05.040367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:05.061188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:05.062012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:05.063014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:05.063630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:05.252759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:05.267037 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90afaf4b-f200-4f82-a402-a010928cdfc0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1467 microversion: 2.1 time: 0.804100 Jun 18 22:08:05.294169 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 890/1778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:04 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1467 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:05.311256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:05.318354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:05.340524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:05.353712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:05.354699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:05.355151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:05.930692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:05.977582 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-472e030d-b379-4f39-a091-07938d53302d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.971387 Jun 18 22:08:05.980219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 889/1779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:04 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:05.997838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-645703950", "metadata": {"image_type": "test"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:06.000979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:06.021640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.022877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.025898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.027896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.158040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Getting quotas for project 0f681d806f354b8682bdae077a9ece40. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:06.177349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Getting quotas for user dd075f9744d644e38be2333789563d12 and project 0f681d806f354b8682bdae077a9ece40. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:06.500635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:06.522336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4268b679-d0b6-4e9f-a5bc-340747502f75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 1.225418 Jun 18 22:08:06.523215 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 891/1780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:05 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:06.537947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:06.539663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:06.549769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.550766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.555515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.556767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.671386 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-01cc12c1-0af7-4af3-9b11-c79d6f17c17d tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "POST /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8/action" status: 202 len: 0 microversion: 2.1 time: 0.685828 Jun 18 22:08:06.673377 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 890/1781] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:08:05 2022] POST /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:08:06.684391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ad065fb7-1816-4dda-b1d5-66e4457c47d4 req-8d0e817f-64cc-4ca0-aa25-f9f10ad00006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfbbf33-04a0-46d3-82ce-51afe2d4eae9", "name": "network-vif-plugged", "status": "completed", "tag": "6052a204-9eb6-4695-a8bc-55524ef614d9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:06.717627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ad065fb7-1816-4dda-b1d5-66e4457c47d4 req-8d0e817f-64cc-4ca0-aa25-f9f10ad00006 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.717970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ad065fb7-1816-4dda-b1d5-66e4457c47d4 req-8d0e817f-64cc-4ca0-aa25-f9f10ad00006 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.741737 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ad065fb7-1816-4dda-b1d5-66e4457c47d4 req-8d0e817f-64cc-4ca0-aa25-f9f10ad00006 service nova] Creating event network-vif-plugged:6052a204-9eb6-4695-a8bc-55524ef614d9 for instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 on nch2-master-1 Jun 18 22:08:06.747788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ad065fb7-1816-4dda-b1d5-66e4457c47d4 req-8d0e817f-64cc-4ca0-aa25-f9f10ad00006 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072659 Jun 18 22:08:06.748509 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 891/1782] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:06.755106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:06.755813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:06.765130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.766419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.767624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:06.768051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:06.838651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:06.853307 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7706e181-bd3e-41d5-8eb3-661ab826824b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.328441 Jun 18 22:08:06.857527 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 892/1783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:06 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:06.865091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eb7943fb-5975-40b2-8435-d42bb60a2661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d12040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:06.985304 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eb7943fb-5975-40b2-8435-d42bb60a2661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.126357 Jun 18 22:08:06.987260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 893/1784] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:06 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:07.001645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2108296244", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "31ac6f3e-51b9-4607-9ecf-0c908a61f330"}], "security_groups": [{"name": "tempest-securitygroup--1088232119"}], "key_name": "tempest-keypair-522621009", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:07.067397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:07.079157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:07.080671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:07.081844 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c6411b7-ab2a-4734-972c-15e282350cc1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.331761 Jun 18 22:08:07.086313 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 892/1785] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:06 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:07.100957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:07.108757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:07.128528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:07.128992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:07.154564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:07.155050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:07.219651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] validate_networks() for [('31ac6f3e-51b9-4607-9ecf-0c908a61f330', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:08:07.500998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:07.519635 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c6715fb-5695-4edf-b09b-aeb968748f95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.432190 Jun 18 22:08:07.520231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 893/1786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:07 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:07.541726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:07.543553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:07.565144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:07.565595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:07.566382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:07.566805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:07.584087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:08.010616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:08.021168 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-78412ff5-5776-43d4-aba6-83ea95640220 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1199 microversion: 2.1 time: 0.483347 Jun 18 22:08:08.030794 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 894/1787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:07 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1199 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:08.043921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:08.044549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:08.062553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.063005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.063786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.064221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.454460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:08.456356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:08:08.457190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:08:08.457924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:08:08.458430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:08:08.458954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:08:08.466826 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c4290522-6347-476c-9a88-1ecd1b32ee59 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.426576 Jun 18 22:08:08.468262 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 895/1788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:08 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:08.470601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.471150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.472040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.472565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.474068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e34b7c9e-7da2-48a0-8637-c8a0fd106fca tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19ca24c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:08.481464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:08.534136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Getting quotas for project 4643e24233bd4af1a0c020e4d9a474fb. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:08.560367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Getting quotas for user cf9fa8d3d2bc4f9fa12fab743b7090ad and project 4643e24233bd4af1a0c020e4d9a474fb. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:08.561823 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e34b7c9e-7da2-48a0-8637-c8a0fd106fca tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.089434 Jun 18 22:08:08.567261 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 896/1789] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:08 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:08.579684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:08.580756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:08.591739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.592642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.594149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.594760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.595599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:08:08.600000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:08:08.701000 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e8d3cb97-d030-4a7a-b053-334c5b501e2c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.709334 Jun 18 22:08:08.702190 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 894/1790] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:08:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:08:08.715659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:08.742486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:08.752441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.753174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.754132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:08.754759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:08.839850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:08.849983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:08.851733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:08.852818 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0a8c920-105a-44bc-8649-d1eb7304085c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.284174 Jun 18 22:08:08.856615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 897/1791] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:08 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:08.867796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da1f6076-d6ce-4d69-ae20-1d9b2c9401ff tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:08.868701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da1f6076-d6ce-4d69-ae20-1d9b2c9401ff tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:09.047634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da1f6076-d6ce-4d69-ae20-1d9b2c9401ff tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:09.066514 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da1f6076-d6ce-4d69-ae20-1d9b2c9401ff tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1241 microversion: 2.1 time: 0.208443 Jun 18 22:08:09.076749 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 898/1792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:08 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1241 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:09.082041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:09.087115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:09.091723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:09.101008 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79eff661-a58b-430a-9940-85e450705b55 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.397250 Jun 18 22:08:09.103267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.103937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 895/1793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:08 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:09.104823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.111859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.112603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.299558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:09.315360 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-195fa989-9982-4d0c-9322-c23dd3f2d2e6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1382 microversion: 2.1 time: 0.237207 Jun 18 22:08:09.318560 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 899/1794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:09 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1382 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:09.486461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:09.486461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:09.512247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.512914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.515685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.516227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.716065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:09.727843 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bcfdd0e8-2673-4b2d-b367-8f9ef09594bb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.247376 Jun 18 22:08:09.729170 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 900/1795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:09 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:09.742029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-04658605-0d04-4ed1-be17-27f252b347a6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19cbf0d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:09.765539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:09.766159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:09.774413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.774864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.776521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.776975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.823654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-04658605-0d04-4ed1-be17-27f252b347a6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.093053 Jun 18 22:08:09.830404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 901/1796] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:09 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:09.880000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:09.881333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:09.890428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.891089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.892089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.892495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:09.962423 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65cd8c74-6aad-450a-a9a8-dca6039d9797 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1533 microversion: 2.1 time: 0.630824 Jun 18 22:08:09.963488 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 896/1797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:09 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1533 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:09.968640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8b5467ef-d1fc-40ac-b5a8-ba58f7d97ed1 req-1816f829-1a04-4ec2-89cd-dd8c659adf6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243a6f2b-0c2c-43f8-8e7e-5336fafa5f76", "name": "network-vif-plugged", "status": "completed", "tag": "d9b7cbe4-2618-4090-ad3c-05ac7dce53ae"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:09.977590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8b5467ef-d1fc-40ac-b5a8-ba58f7d97ed1 req-1816f829-1a04-4ec2-89cd-dd8c659adf6f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:09.978291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8b5467ef-d1fc-40ac-b5a8-ba58f7d97ed1 req-1816f829-1a04-4ec2-89cd-dd8c659adf6f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.008062 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8b5467ef-d1fc-40ac-b5a8-ba58f7d97ed1 req-1816f829-1a04-4ec2-89cd-dd8c659adf6f service nova] Creating event network-vif-plugged:d9b7cbe4-2618-4090-ad3c-05ac7dce53ae for instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 on nch1-master-1 Jun 18 22:08:10.024884 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8b5467ef-d1fc-40ac-b5a8-ba58f7d97ed1 req-1816f829-1a04-4ec2-89cd-dd8c659adf6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059955 Jun 18 22:08:10.025536 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 897/1798] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:10.032834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.033922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:10.042425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.043059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.044065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.044717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.102048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:10.116069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:10.118179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:10.120185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-178fc3ff-5bc0-4274-ae3a-80efde405696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.247887 Jun 18 22:08:10.121564 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 902/1799] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:09 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:08:10.126989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.127837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:10.138572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.140467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.142286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.143450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.268710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:10.284090 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6db72b21-72a7-40a3-b422-f46a066759fe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1293 microversion: 2.1 time: 0.158976 Jun 18 22:08:10.285056 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 903/1800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1293 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:10.291493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.292371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:10.299777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.300462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.301464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.302067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.415002 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22c22aaa-3b8b-40c4-ac39-e25df5abd1f8 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1533 microversion: 2.1 time: 0.388255 Jun 18 22:08:10.415905 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 898/1801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1533 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:10.477801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:10.485846 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd3cb334-f0c7-4e38-859a-40b9c12f27e9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.198292 Jun 18 22:08:10.486432 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 904/1802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:10.499768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1660232-af93-4672-ae9b-0f1589c02304 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.501211 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:08:10.501211 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:08:10.502422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1660232-af93-4672-ae9b-0f1589c02304 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.502881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1660232-af93-4672-ae9b-0f1589c02304 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.503671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1660232-af93-4672-ae9b-0f1589c02304 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.504151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1660232-af93-4672-ae9b-0f1589c02304 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.529617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1660232-af93-4672-ae9b-0f1589c02304 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033397 Jun 18 22:08:10.530243 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 905/1803] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:10.541149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:10.542799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:10.547569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16e9e277-2073-4692-9777-677f6d0a3349 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea140e89d0>, body: {"keypair": {"name": "tempest-keypair-1275725339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwNzBK69H+YQDhXUIr7QtsfRlwr+MvnWv3qyPosTvUezIYXN3xi1akpn9Zcivg50iow8K9SLl1xvBJyA81hgCh8x8WW3zmB6jLvZCEqcEQrzlbHpCiDHIos1+C0A4rQmQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:10.549452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.550091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.550912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.551452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.564167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-16e9e277-2073-4692-9777-677f6d0a3349 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:10.569503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-16e9e277-2073-4692-9777-677f6d0a3349 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:10.578600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lazy-loading 'flavor' on Instance uuid cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:08:10.591277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Going to try to live migrate instance to nch1-master-1 {{(pid=130902) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:08:10.597194 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16e9e277-2073-4692-9777-677f6d0a3349 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.180115 Jun 18 22:08:10.598435 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 899/1804] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:08:10.610911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-63aa9b1a-1137-40ce-afeb-f36474871765 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea140a04c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.620118 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-63aa9b1a-1137-40ce-afeb-f36474871765 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1275725339" status: 200 len: 513 microversion: 2.2 time: 0.014584 Jun 18 22:08:10.621451 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 900/1805] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1275725339 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:10.633867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a36f4598-acca-4788-adc5-56a5cfff055c tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea14128c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.661471 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a36f4598-acca-4788-adc5-56a5cfff055c tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275725339" status: 204 len: 0 microversion: 2.2 time: 0.032627 Jun 18 22:08:10.662619 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 901/1806] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Jun 18 22:08:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275725339 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:10.678004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d81af41-8e3b-4010-83e0-37686444f0e9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea19dbc8b0>, body: {"keypair": {"name": "tempest-keypair-677253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6KqvhOI/UwyfIOmjUOpn/YIcHXMA0rb4cpbhhEaQPW5RmMCQv0KP5+yvDzZ4/rx58aIZfhoaNXEkNkuX1KdQJnxZaphtVoBc2i3mh3pP3QDfmbSXvkFecdQ4PhDmT8og=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:10.699498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-8d81af41-8e3b-4010-83e0-37686444f0e9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:10.710440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-8d81af41-8e3b-4010-83e0-37686444f0e9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:10.740397 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d81af41-8e3b-4010-83e0-37686444f0e9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 397 microversion: 2.2 time: 0.069437 Jun 18 22:08:10.741476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 902/1807] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:08:10.746884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.747989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:10.754894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.755348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.756134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:10.756573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:10.908251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:10.922319 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fd0906a4-38ba-43c9-9a84-165bdfdb7743 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.179724 Jun 18 22:08:10.923037 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 903/1808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:10.929342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3ef429a-f332-4456-88cc-c2c3f18f95b0 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea147afa60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:10.951433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3ef429a-f332-4456-88cc-c2c3f18f95b0 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677253" status: 204 len: 0 microversion: 2.2 time: 0.026629 Jun 18 22:08:10.956809 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 904/1809] 10.222.0.30 () {60 vars in 1248 bytes} [Sat Jun 18 22:08:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677253 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:10.961834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b998477-993e-4e1a-8f93-babbc977f280 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dbc700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:11.015187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8b998477-993e-4e1a-8f93-babbc977f280 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.057045 Jun 18 22:08:11.015971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 905/1810] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:10 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:11.022771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77c08b5c-de8c-493d-8b95-909c014f2b43 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea14854a60>, body: {"keypair": {"name": "tempest-keypair-1752223654", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:11.033815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:11.051946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-77c08b5c-de8c-493d-8b95-909c014f2b43 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:11.058190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-77c08b5c-de8c-493d-8b95-909c014f2b43 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:11.085841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77c08b5c-de8c-493d-8b95-909c014f2b43 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.068470 Jun 18 22:08:11.089146 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 906/1811] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:11 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:08:11.100346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc5d16b2-9185-45a2-805e-142419f67268 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea1493fdc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:11.121105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc5d16b2-9185-45a2-805e-142419f67268 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752223654" status: 204 len: 0 microversion: 2.2 time: 0.026975 Jun 18 22:08:11.122106 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 907/1812] 10.222.0.30 () {60 vars in 1260 bytes} [Sat Jun 18 22:08:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752223654 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:11.135640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-607a28a5-f551-4a4b-9951-1f01e7294d1d tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea19dbc280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1164302216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCn2QHj8rZ0CJ1HEkC6puAVoEafFzOUFdXtvIfn+u3Bh0hG2x8/wIlQjmOd1W5EENeNROEE4E75j7k9DScmVQdUEWCf7Xqm3WIlmdJQrhiSXkNvVMm8aTzWxYHYKNcEFJA=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:11.156139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-607a28a5-f551-4a4b-9951-1f01e7294d1d tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:11.161942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-607a28a5-f551-4a4b-9951-1f01e7294d1d tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:11.189201 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-607a28a5-f551-4a4b-9951-1f01e7294d1d tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.058936 Jun 18 22:08:11.193261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 908/1813] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 18 22:08:11.201159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:11.201826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:11.208569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:11.208975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:11.209792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:11.211100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:11.456932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:11.468822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:11.471651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:11.473272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d81245b9-a127-4d28-9cc7-2be8dc69d407 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1281 microversion: 2.25 time: 0.281876 Jun 18 22:08:11.476979 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 909/1814] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:11 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1281 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:11.483950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ed7e040-1894-4b51-9ab5-b60132aa5d08 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea19d129d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-619240436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUptGj3rKltLtXwU0lld+FZL8EQ89AxaP9EuOtJXWLLKvJe+DCf/LBnw29i7a1YZK7woVRP6KWwQBhhe42x2Y0hb1bmJE5twnOZqARYWDNjo0ZhRL7J3UMFIsyk/5LGJQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:11.505169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-1ed7e040-1894-4b51-9ab5-b60132aa5d08 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:11.511961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-1ed7e040-1894-4b51-9ab5-b60132aa5d08 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:11.540230 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ed7e040-1894-4b51-9ab5-b60132aa5d08 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.061173 Jun 18 22:08:11.541104 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 910/1815] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:08:11.545851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:11.546652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:11.553743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:11.554416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:11.555357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:11.556340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:11.683539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:11.697784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-458430be-9379-40f2-bb0e-22968e83e3c4 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1299 microversion: 2.1 time: 0.155534 Jun 18 22:08:11.698802 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 911/1816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:11 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:11.715525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:11.716223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:11.723256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:11.723699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:11.724614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:11.725172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:11.891687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:11.924707 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9c981956-a9b0-4bd9-9c40-1b1955829c95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.215594 Jun 18 22:08:11.926646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 912/1817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:11 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:11.952306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f627add-ecaf-4d04-a6f6-4e3b7a93d813 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea19d88790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1062457429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjKFSuss4CHLiT05VgR3XidbZwt6A5KujpXVt4qhstUUGy2pRMU4+/Lvz//pzerJBgSp0a6FrwMBzbgl+WMiH+shCjKEiOe+v/A0fSxEVV+2fygPh1pW94G1C3J11psjw=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:11.997180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7f627add-ecaf-4d04-a6f6-4e3b7a93d813 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:12.009271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7f627add-ecaf-4d04-a6f6-4e3b7a93d813 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:12.070033 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f627add-ecaf-4d04-a6f6-4e3b7a93d813 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.127755 Jun 18 22:08:12.070808 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 913/1818] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:08:12.079995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.087603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:12.094229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.094635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.095593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.096191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.264480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:12.272840 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12473d91-27cf-463a-bbac-c30933faef27 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.199699 Jun 18 22:08:12.282149 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 914/1819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:12.287596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-92d504ec-403a-4696-b946-83599c501b92 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea14a55670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.341852 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-92d504ec-403a-4696-b946-83599c501b92 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.058567 Jun 18 22:08:12.342647 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 915/1820] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:12.347545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-44ceb2df-6d94-4ce1-a74b-609617c9f8fb tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19d9f3a0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.350714 ncdv-master-1 devstack@n-api.service[130903]: WARNING oslo_db.sqlalchemy.utils [None req-44ceb2df-6d94-4ce1-a74b-609617c9f8fb tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 18 22:08:12.356360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-44ceb2df-6d94-4ce1-a74b-609617c9f8fb tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.012394 Jun 18 22:08:12.357006 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 916/1821] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:12.367566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-432a6fc2-933b-46db-934b-9ae096ae8479 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19d88790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.390243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-432a6fc2-933b-46db-934b-9ae096ae8479 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1062457429" status: 204 len: 0 microversion: 2.2 time: 0.026209 Jun 18 22:08:12.391641 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 917/1822] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Jun 18 22:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1062457429 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:12.400251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab6a3a73-9fb9-4a43-a8c7-0694ebbe2b46 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19df9040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.419665 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab6a3a73-9fb9-4a43-a8c7-0694ebbe2b46 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-619240436" status: 204 len: 0 microversion: 2.2 time: 0.023759 Jun 18 22:08:12.420394 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 918/1823] 10.222.0.30 () {60 vars in 1317 bytes} [Sat Jun 18 22:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-619240436 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:12.428534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9cbf8603-8152-4f55-978c-c460739e079a tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19d88310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.446173 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9cbf8603-8152-4f55-978c-c460739e079a tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1164302216" status: 204 len: 0 microversion: 2.2 time: 0.021253 Jun 18 22:08:12.447096 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 919/1824] 10.222.0.30 () {60 vars in 1320 bytes} [Sat Jun 18 22:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1164302216 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:08:12.459058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd6d3085-de36-4c5e-b1ed-db7cc89fb3fc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea19d12280>, body: {"keypair": {"name": "tempest-keypair-995829577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC12TDH9oP1aWrGunDU/nlsNtHYS3XoiSQekTs6GkGzZWVmLBGpU5yDz2mkfsXd4sNNbuR9JdfIxf9DJVrcBji9Ye3twSywe8htfS+y/m2UYjNybq/FnPgRcHUEkNONz7A=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:12.473405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cd6d3085-de36-4c5e-b1ed-db7cc89fb3fc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:12.478565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cd6d3085-de36-4c5e-b1ed-db7cc89fb3fc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:12.503070 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd6d3085-de36-4c5e-b1ed-db7cc89fb3fc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.047806 Jun 18 22:08:12.503747 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 920/1825] 10.222.0.30 () {62 vars in 1198 bytes} [Sat Jun 18 22:08:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:08:12.510316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.511140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:12.517380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.517858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.518643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.519068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.650836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:12.659344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:12.660953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:12.662231 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aeb4cb9f-516b-4c60-b4ec-66cfc4554d0f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1476 microversion: 2.25 time: 0.156120 Jun 18 22:08:12.662912 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 921/1826] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:12.667385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82eee4b7-f5c2-4d3b-be51-aec31d263811 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19d88e50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.675076 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82eee4b7-f5c2-4d3b-be51-aec31d263811 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-995829577" status: 200 len: 512 microversion: 2.2 time: 0.010964 Jun 18 22:08:12.675861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 922/1827] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-995829577 => generated 512 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:12.685482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.686166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:12.694283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.695162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.696038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.697539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.839149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:08:12.855363 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1b75188-663d-429a-b747-e948bd55e6c7 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1969 microversion: 2.25 time: 0.174706 Jun 18 22:08:12.856264 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 923/1828] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1969 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:12.861597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-055f21e4-6676-4ffa-90da-a3895a7d180f tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea1493f820>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.865237 ncdv-master-1 devstack@n-api.service[130903]: WARNING oslo_db.sqlalchemy.utils [None req-055f21e4-6676-4ffa-90da-a3895a7d180f tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 18 22:08:12.871512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-055f21e4-6676-4ffa-90da-a3895a7d180f tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.013806 Jun 18 22:08:12.872391 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 924/1829] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:12.878159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:12.878802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:12.885376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.885832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:12.886620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:12.887060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:13.030197 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5f52f82c-8c4c-44ba-b166-8568ecd19d22 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9/action" status: 202 len: 0 microversion: 2.1 time: 2.492608 Jun 18 22:08:13.031908 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 906/1830] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:08:10 2022] POST /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9/action => generated 0 bytes in 2495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:08:13.039782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:13.042516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:13.062092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:13.064337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:13.066593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:13.068717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:13.407360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:13.418500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d1e44b6-2f4f-498e-af9e-00b7300fb977 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.544344 Jun 18 22:08:13.427799 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 925/1831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:12 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:13.429283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8e1a4e8-790f-4b33-b517-a69ae02c1a1e tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19dfcaf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:13.468444 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a8e1a4e8-790f-4b33-b517-a69ae02c1a1e tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995829577" status: 204 len: 0 microversion: 2.2 time: 0.047556 Jun 18 22:08:13.469122 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 926/1832] 10.222.0.30 () {60 vars in 1257 bytes} [Sat Jun 18 22:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995829577 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:13.479195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:08:13.489630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:13.490405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:13.495751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:13.498458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:13.500102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:13.500897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:13.501413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:13.514068 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-caa38016-9d7a-4b68-b5b7-2d4263a16d70 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1969 microversion: 2.25 time: 0.480619 Jun 18 22:08:13.517240 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 907/1833] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:13 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1969 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:13.539097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:13.539727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:13.563258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:13.564039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:13.565056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:13.565501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.168556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:14.180335 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dbf2b2c7-b3cc-4b87-a2c1-37feca9f88e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.710052 Jun 18 22:08:14.180943 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 927/1834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:13 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:14.185998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:14.186865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:14.197497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.197954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.198753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.199185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.298125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:14.306546 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c49f267-7f02-4131-a84a-5659a04f7a55 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.774176 Jun 18 22:08:14.307136 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 908/1835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:13 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:14.312613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-db134f16-b85d-43ef-b787-0d982301d7e2 req-ce34c766-f0b7-41a7-925d-75a7eae03cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4", "tag": "26600d51-5817-4750-bb7c-c78f6322072b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:14.322194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-db134f16-b85d-43ef-b787-0d982301d7e2 req-ce34c766-f0b7-41a7-925d-75a7eae03cc4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.322937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-db134f16-b85d-43ef-b787-0d982301d7e2 req-ce34c766-f0b7-41a7-925d-75a7eae03cc4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.334960 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-db134f16-b85d-43ef-b787-0d982301d7e2 req-ce34c766-f0b7-41a7-925d-75a7eae03cc4 service nova] Creating event network-changed:26600d51-5817-4750-bb7c-c78f6322072b for instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 on nch1-master-1 Jun 18 22:08:14.341062 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-db134f16-b85d-43ef-b787-0d982301d7e2 req-ce34c766-f0b7-41a7-925d-75a7eae03cc4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032279 Jun 18 22:08:14.341687 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 909/1836] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:14.347462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9d1fff5b-8069-4ed4-968e-4cc121ab1da8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bc5d30>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:14.399847 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9d1fff5b-8069-4ed4-968e-4cc121ab1da8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.056680 Jun 18 22:08:14.400433 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 910/1837] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:14 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:14.406074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Action: 'create', calling method: .version_select at 0x7fea19c288b0>, body: {"keypair": {"name": "tempest-keypair-58063247", "type": "x509"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:14.422018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:14.430413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:14.448760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.processutils [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp18q8dppg/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp18q8dppg/temp.key -subj /CN=ed68324e9fed4eb2885bfc608e009af2 -extensions v3_req_client {{(pid=130902) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:14.472242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:14.480184 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d49c0707-2aca-4deb-9698-fc865e09fe0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.297796 Jun 18 22:08:14.480910 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 928/1838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:14 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:14.625673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e2ef699-2d44-464d-baa8-091dfcff59d6 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:14.638258 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:08:14.638258 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:08:14.640736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e2ef699-2d44-464d-baa8-091dfcff59d6 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.641980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e2ef699-2d44-464d-baa8-091dfcff59d6 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.643443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e2ef699-2d44-464d-baa8-091dfcff59d6 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.644539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e2ef699-2d44-464d-baa8-091dfcff59d6 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.674064 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e2ef699-2d44-464d-baa8-091dfcff59d6 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.187636 Jun 18 22:08:14.675054 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 929/1839] 10.222.0.30 () {60 vars in 1216 bytes} [Sat Jun 18 22:08:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:08:14.680968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-28550f81-b985-49ed-a24b-91b2c381dffa req-c56cd2e8-5afc-4410-aca7-08bbafa4ca50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "name": "network-vif-plugged", "status": "completed", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:14.692368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-28550f81-b985-49ed-a24b-91b2c381dffa req-c56cd2e8-5afc-4410-aca7-08bbafa4ca50 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.693691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-28550f81-b985-49ed-a24b-91b2c381dffa req-c56cd2e8-5afc-4410-aca7-08bbafa4ca50 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.708664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-28550f81-b985-49ed-a24b-91b2c381dffa req-c56cd2e8-5afc-4410-aca7-08bbafa4ca50 service nova] Creating event network-vif-plugged:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:08:14.714480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-28550f81-b985-49ed-a24b-91b2c381dffa req-c56cd2e8-5afc-4410-aca7-08bbafa4ca50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038087 Jun 18 22:08:14.716230 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 930/1840] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:14.724055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:14.726035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:14.733341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.734352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.735380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:14.736084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:14.857519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.processutils [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp18q8dppg/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp18q8dppg/temp.key -subj /CN=ed68324e9fed4eb2885bfc608e009af2 -extensions v3_req_client" returned: 0 in 0.408s {{(pid=130902) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:14.859448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.processutils [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp18q8dppg/temp.key -password pass: {{(pid=130902) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 18 22:08:14.919466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.processutils [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp18q8dppg/temp.key -password pass:" returned: 0 in 0.059s {{(pid=130902) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 18 22:08:14.989251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:14.998399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Getting quotas for user ed68324e9fed4eb2885bfc608e009af2 and project 8c1692835c294cf0b1173710c33b748d. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:15.025083 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44a85341-aa5e-4adf-a64c-c96dcb871db9 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.621709 Jun 18 22:08:15.033019 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 911/1841] 10.222.0.30 () {62 vars in 1197 bytes} [Sat Jun 18 22:08:14 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 631 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:15.044735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:15.048256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:15.059181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:15.060125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:15.061466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:15.069005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:15.077623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:15.088718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b14dfb24-8e0e-49e1-b96e-d68174d4468a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.370964 Jun 18 22:08:15.089666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 931/1842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:14 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:15.094462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bd81aea-f11f-4d0e-9135-8ed2317296af tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19dfcaf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:15.114386 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1bd81aea-f11f-4d0e-9135-8ed2317296af tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-58063247" status: 200 len: 1532 microversion: 2.2 time: 0.023520 Jun 18 22:08:15.119949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 932/1843] 10.222.0.30 () {60 vars in 1251 bytes} [Sat Jun 18 22:08:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-58063247 => generated 1532 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:15.126361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7368b314-1984-4b59-83e0-d16d790ec8cc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19dd1d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:15.129504 ncdv-master-1 devstack@n-api.service[130903]: WARNING oslo_db.sqlalchemy.utils [None req-7368b314-1984-4b59-83e0-d16d790ec8cc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 18 22:08:15.138190 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7368b314-1984-4b59-83e0-d16d790ec8cc tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.016018 Jun 18 22:08:15.141575 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 933/1844] 10.222.0.30 () {60 vars in 1176 bytes} [Sat Jun 18 22:08:15 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:15.145809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'flavor' on Instance uuid 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:08:15.166903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Going to try to live migrate instance to nch2-master-1 {{(pid=130902) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:08:15.173403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ae8573b-68cd-4c49-9162-78bff45c3886 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] Calling method '.version_select at 0x7fea19ccd790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:15.180538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:15.230643 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8ae8573b-68cd-4c49-9162-78bff45c3886 tempest-KeyPairsV22TestJSON-906977025 tempest-KeyPairsV22TestJSON-906977025-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58063247" status: 204 len: 0 microversion: 2.2 time: 0.083001 Jun 18 22:08:15.231909 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 934/1845] 10.222.0.30 () {60 vars in 1254 bytes} [Sat Jun 18 22:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58063247 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:08:15.237664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:15.238650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:15.246932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:15.247734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:15.248750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:15.250932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:15.322835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:15.962220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:15.972858 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-deb5bc11-9916-4d28-85e6-a18140ec02b5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.739551 Jun 18 22:08:15.984737 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 935/1846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:15 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:16.005398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:16.006823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:16.032182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:16.033731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:16.035309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:16.036166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:16.043539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:16.371142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:16.387100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6279d05c-003e-4aff-a5ca-a7b313cbbe57 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.391709 Jun 18 22:08:16.387903 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 936/1847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:15 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:16.400303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c8bdf6c-6bbd-4ef4-b438-05a9ab21e3b5 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dbcc10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:16.510759 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c8bdf6c-6bbd-4ef4-b438-05a9ab21e3b5 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.117585 Jun 18 22:08:16.517117 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 937/1848] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:16 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:16.533481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:16.535751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:16.551409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:16.551873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:16.552678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:16.553150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:16.876554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:16.892131 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0a469b7-b357-4ce2-8b45-925649c4a7a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.373559 Jun 18 22:08:16.896395 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 938/1849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:16 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:16.914018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:16.915079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:16.928394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:16.935427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:16.936861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:16.937784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:17.199851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:17.208625 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6960d483-8618-4e8c-a001-2ac1366af7a8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.300411 Jun 18 22:08:17.210433 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 939/1850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:16 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:17.217411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:17.218333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:17.226857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:17.227524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:17.228321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:17.228753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:17.513789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:17.543265 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a0161e0a-1dd5-4897-b78e-de8e42e63e98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.330593 Jun 18 22:08:17.544648 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 940/1851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:17 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:17.550905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:17.552791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:17.577641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:17.579018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:17.580248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:17.582083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:17.887686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:17.898862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff63626b-7ff7-4fef-8dda-aee7573d5d0a tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.351429 Jun 18 22:08:17.911465 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 941/1852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:17 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:17.917856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7dd3d62f-e461-48bc-83c7-8996940132d6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19ccd0d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:18.010451 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7dd3d62f-e461-48bc-83c7-8996940132d6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.097720 Jun 18 22:08:18.011128 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 942/1853] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:17 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:18.022261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:18.023609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:18.037246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:18.040269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:18.043541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:18.044005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:18.458837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:18.473724 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55e4af8a-e215-48b6-b5d7-0dd5ac9cb32d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.459807 Jun 18 22:08:18.475180 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 943/1854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:18 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:18.490233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:18.493077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:18.511258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:18.513367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:18.516801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:18.518281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:18.558785 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e2007fda-6212-4662-b425-5a1566cc5b3d tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76/action" status: 202 len: 0 microversion: 2.25 time: 3.523828 Jun 18 22:08:18.559695 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 912/1855] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:08:15 2022] POST /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76/action => generated 0 bytes in 3526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:18.568028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:18.571876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:18.616641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:18.617524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:18.618590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:18.619260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:19.360505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:19.386500 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd475194-ddb0-4450-90de-4d4932ab99b3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.823612 Jun 18 22:08:19.390415 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 913/1856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:18 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:19.407020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:19.408430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:19.411379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:19.416581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:19.417306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:19.418720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:19.419329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:19.429228 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d0b29b04-2fd4-4204-8c7f-c33c4ae6ade5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.948389 Jun 18 22:08:19.431802 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 944/1857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:18 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:19.446757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:19.452178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:19.476066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:19.478534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:19.481663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:19.482740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:19.786624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:19.816928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:19.818790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:19.821546 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bd4473d-6d4a-4645-bb3e-9563f2513a06 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.425562 Jun 18 22:08:19.828172 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 914/1858] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:19 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:19.841108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0e08903-05a4-4206-ab8a-d27921357217 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Action: 'create', calling method: .version_select at 0x7fea19bc58b0>, body: {"keypair": {"name": "tempest-keypair-1951429247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuPZ+j8KfV17AVK7n7RhMbedR4Gtn4BAktUeMOp5JgtkrSXlCnzqoZ+e22M1hu1iqii/1uXWpoo8CQa2NP6R2noUf8O4qRXABYOCqbfKW9NoGherYtZ8PjyKQJk8PGDgg=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:19.888426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-a0e08903-05a4-4206-ab8a-d27921357217 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Getting quotas for project 637c113ab85b43cb815b1e6e2d868a29. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:19.900559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:19.903249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-a0e08903-05a4-4206-ab8a-d27921357217 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Getting quotas for user 1b0598fbccf348148fda392a40bf0078 and project 637c113ab85b43cb815b1e6e2d868a29. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:19.912944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41ed68fc-5684-48d9-b208-cd75179df1e7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.477687 Jun 18 22:08:19.914600 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 945/1859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:19 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:19.923853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34c3a709-755a-4ce1-8ce9-d5d35fbc9301 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dbcee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:19.952883 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0e08903-05a4-4206-ab8a-d27921357217 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.122809 Jun 18 22:08:19.954117 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 915/1860] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:08:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:08:19.972750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:19.976312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:20.005439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34c3a709-755a-4ce1-8ce9-d5d35fbc9301 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.089544 Jun 18 22:08:20.006344 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 946/1861] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:19 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:20.020772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.036467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.039995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.040823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.338984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:20.360023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f494b625-1cf3-45f2-b2d2-8926f6d023b7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.404500 Jun 18 22:08:20.360666 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 916/1862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:19 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:20.408111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:20.409541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:20.426114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.428790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.430905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.431615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.449962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:20.451305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:20.471543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.475776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.478351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.479344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.558126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:20.785146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:20.800335 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a4148016-fec0-4a39-a559-68767473574c tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.352416 Jun 18 22:08:20.814767 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 917/1863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:20 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:20.848431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:20.849634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:20.866698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.867712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:20.871731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:20.873523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:21.242625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:21.254592 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a209376a-e12d-4b6b-80cc-b98d4ecb3212 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.850737 Jun 18 22:08:21.255537 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 947/1864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:20 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:21.270465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:21.271338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:21.293020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:21.299898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:21.301213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:21.301958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:21.440276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:21.461173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:21.466783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:21.469544 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1513d6f-9f69-486f-9e89-e13990c39902 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.626735 Jun 18 22:08:21.474751 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 918/1865] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:20 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:21.487192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a9e7d832-e706-4157-91c4-4ed7ea5bae5a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c28430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:21.589885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a9e7d832-e706-4157-91c4-4ed7ea5bae5a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.113796 Jun 18 22:08:21.590849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 919/1866] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:21 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:21.600342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:21.605591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:21.620726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:21.622216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:21.624119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:21.624870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:21.809348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:21.819598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-05100314-76d5-40f5-b7e4-b0117c6b0501 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.562259 Jun 18 22:08:21.823691 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 948/1867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:21 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:21.832891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:21.840443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:21.862625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:21.863411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:21.866377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:21.869183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:22.122523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:22.137224 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed28e152-b131-453e-9393-ee94698181e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.545057 Jun 18 22:08:22.138093 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 920/1868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:21 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:22.183606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:22.198975 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a105070f-0bd9-424b-a33f-99a205970ebe tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.372766 Jun 18 22:08:22.213193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 949/1869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:21 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:22.274106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:22.274753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:22.286383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:22.286757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:22.287554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:22.287992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:22.394523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b70d906d-d0e2-47f2-98cf-73c72bbb7b61 req-cc93113d-f0b0-4d6c-b11b-c169c08d8e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4", "name": "network-vif-plugged", "status": "completed", "tag": "26600d51-5817-4750-bb7c-c78f6322072b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:22.452277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b70d906d-d0e2-47f2-98cf-73c72bbb7b61 req-cc93113d-f0b0-4d6c-b11b-c169c08d8e00 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:22.454388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b70d906d-d0e2-47f2-98cf-73c72bbb7b61 req-cc93113d-f0b0-4d6c-b11b-c169c08d8e00 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:22.499708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=34 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:22.524914 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b70d906d-d0e2-47f2-98cf-73c72bbb7b61 req-cc93113d-f0b0-4d6c-b11b-c169c08d8e00 service nova] Creating event network-vif-plugged:26600d51-5817-4750-bb7c-c78f6322072b for instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 on nch1-master-1 Jun 18 22:08:22.551099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b70d906d-d0e2-47f2-98cf-73c72bbb7b61 req-cc93113d-f0b0-4d6c-b11b-c169c08d8e00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164185 Jun 18 22:08:22.553757 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 950/1870] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:22.566259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:22.569709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:22.589968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:22.591770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:22.592850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:22.593859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:22.902434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:22.916302 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d7dd624-4e74-4ca8-9d15-7c9a9f1b6a39 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.646393 Jun 18 22:08:22.916947 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 921/1871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:22 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:22.925724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-564f278c-467a-44b5-adbf-32032cea3b1e tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dc31f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:22.981335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:22.996321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:23.004209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:23.006841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f01578be-ffde-4f9f-8a5c-ff19ac9981a4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.448063 Jun 18 22:08:23.020052 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 951/1872] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:22 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:23.020273 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-564f278c-467a-44b5-adbf-32032cea3b1e tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.093603 Jun 18 22:08:23.020273 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 922/1873] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:22 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:23.041622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:23.042443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:23.061790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.063371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.064756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.065523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.154335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:23.154968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:23.172878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.173892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.177240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.178026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.574800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:23.603055 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7a9042e-871f-45cc-b0f0-5f50c7deada9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.592113 Jun 18 22:08:23.612480 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 952/1874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:23 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:23.617907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:23.619009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:23.633003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.633477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.642482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.643227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.725817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:23.762721 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95e9aed8-fbdc-4e86-994c-d7aac0441dda tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.612501 Jun 18 22:08:23.763992 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 923/1875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:23 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:23.769411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8c46fe24-1e4f-4679-ad7d-13c542d26de1 req-1a6899cc-730c-4579-b3c9-17c29ee7de96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfbbf33-04a0-46d3-82ce-51afe2d4eae9", "name": "network-vif-unplugged", "status": "completed", "tag": "6052a204-9eb6-4695-a8bc-55524ef614d9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:23.779338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8c46fe24-1e4f-4679-ad7d-13c542d26de1 req-1a6899cc-730c-4579-b3c9-17c29ee7de96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.780084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8c46fe24-1e4f-4679-ad7d-13c542d26de1 req-1a6899cc-730c-4579-b3c9-17c29ee7de96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.810992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8c46fe24-1e4f-4679-ad7d-13c542d26de1 req-1a6899cc-730c-4579-b3c9-17c29ee7de96 service nova] Creating event network-vif-unplugged:6052a204-9eb6-4695-a8bc-55524ef614d9 for instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 on nch2-master-1 Jun 18 22:08:23.817495 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8c46fe24-1e4f-4679-ad7d-13c542d26de1 req-1a6899cc-730c-4579-b3c9-17c29ee7de96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051617 Jun 18 22:08:23.818640 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 924/1876] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:23.936204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:23.938951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:23.963857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.964696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:23.966501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:23.967227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:24.341527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:24.356931 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86279688-4a56-4e5b-8d64-932925c02820 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.426004 Jun 18 22:08:24.362306 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 925/1877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:23 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:24.372746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:24.373414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:24.402018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:24.402574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:24.413063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:24.417825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:24.428059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:24.444182 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b0ed593-2d8a-41b6-b5ba-368fac526f53 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1367 microversion: 2.1 time: 0.823459 Jun 18 22:08:24.444838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 953/1878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:23 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1367 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:24.463547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0a77ebb-6799-4021-bb2e-01da9eac22e2 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19ccd9d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:24.521470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0a77ebb-6799-4021-bb2e-01da9eac22e2 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.074127 Jun 18 22:08:24.522704 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 954/1879] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:24 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:24.630881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:24.631635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:24.646126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:24.649261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:24.652043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:24.654685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:24.656589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:25.267856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:25.282804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:25.285800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:25.292801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5fc89384-7e18-49fd-8d0a-51ffd39b075a tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.929303 Jun 18 22:08:25.310907 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 926/1880] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:24 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:25.316346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:25.321664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:25.335804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:25.341838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:25.345535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:25.348551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:25.736845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:25.765581 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d38745c3-1214-48f6-8a90-6b467dbdc3bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 1.138417 Jun 18 22:08:25.766206 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 955/1881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:24 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:25.779423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:25.780048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:25.786818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:25.787116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:25.787904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:25.788330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:26.132623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:26.151956 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44e7f712-9288-4985-ae14-54946dc6bd57 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1507 microversion: 2.1 time: 0.835065 Jun 18 22:08:26.154751 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 927/1882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:25 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1507 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:26.171381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:26.175839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:26.192809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:26.193294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:26.194182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:26.194627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:26.237069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:26.248901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11724d45-e91a-4586-8d93-0944dfee7dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.479960 Jun 18 22:08:26.250728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 956/1883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:25 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:26.257537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f30c8d07-94a7-402c-9abe-fa0009af66a6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dfc9d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:26.366401 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f30c8d07-94a7-402c-9abe-fa0009af66a6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.112764 Jun 18 22:08:26.367407 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 957/1884] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:26 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:26.387637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-95573511-fae3-4be1-920a-b09e47a76303 req-ac38c944-9a71-4591-8e08-16ebc8cf5a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfbbf33-04a0-46d3-82ce-51afe2d4eae9", "tag": "6052a204-9eb6-4695-a8bc-55524ef614d9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:26.400825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-95573511-fae3-4be1-920a-b09e47a76303 req-ac38c944-9a71-4591-8e08-16ebc8cf5a58 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:26.401584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-95573511-fae3-4be1-920a-b09e47a76303 req-ac38c944-9a71-4591-8e08-16ebc8cf5a58 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:26.427148 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-95573511-fae3-4be1-920a-b09e47a76303 req-ac38c944-9a71-4591-8e08-16ebc8cf5a58 service nova] Creating event network-changed:6052a204-9eb6-4695-a8bc-55524ef614d9 for instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 on nch2-master-1 Jun 18 22:08:26.470070 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-95573511-fae3-4be1-920a-b09e47a76303 req-ac38c944-9a71-4591-8e08-16ebc8cf5a58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094929 Jun 18 22:08:26.476286 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 958/1885] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:26.503942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1066183170", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "48fc61e8-bfb7-425a-a591-48050bc73ab8"}, {"port": "d0e4b550-68d2-4471-a8ac-9a423214fa64", "tag": "port-1"}, {"port": "a7f7354f-e621-46bf-8827-3e2bff0d2ff4", "tag": "port-2"}, {"uuid": "ce330f2f-6c66-4b1e-b76a-48328a4de532", "tag": "net-1"}, {"uuid": "ce330f2f-6c66-4b1e-b76a-48328a4de532"}, {"uuid": "2ba5dca3-2d8d-4678-a70f-d261a6b08895", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2ba5dca3-2d8d-4678-a70f-d261a6b08895", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "cf0825c5-efd0-466f-b40a-5de8da952467", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1b01b938-d2cd-4134-a6f2-3145c57622ca", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--663343506"}], "key_name": "tempest-keypair-1951429247", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:26.554233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:26.581075 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-85e6acf9-d723-4246-9341-34688f0403bf tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1558 microversion: 2.1 time: 0.420244 Jun 18 22:08:26.582418 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 928/1886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:26 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1558 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:26.590481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:26.591161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:26.620530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:26.622696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:26.624619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:26.625615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:26.859924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] validate_networks() for [('48fc61e8-bfb7-425a-a591-48050bc73ab8', None, None, None, None, None), (None, None, 'd0e4b550-68d2-4471-a8ac-9a423214fa64', None, None, None), (None, None, 'a7f7354f-e621-46bf-8827-3e2bff0d2ff4', None, None, None), ('ce330f2f-6c66-4b1e-b76a-48328a4de532', None, None, None, None, None), ('ce330f2f-6c66-4b1e-b76a-48328a4de532', None, None, None, None, None), ('2ba5dca3-2d8d-4678-a70f-d261a6b08895', '10.2.2.100', None, None, None, None), ('2ba5dca3-2d8d-4678-a70f-d261a6b08895', '10.2.2.200', None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:08:27.349164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:27.368388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:27.372054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:27.384074 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-89107557-abfa-4853-9774-239f5e700d0d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.799870 Jun 18 22:08:27.385491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 929/1887] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:26 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:27.398434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:27.408329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:27.423262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:27.433110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:27.435305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:27.442228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:28.669433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8d8e3e3-0ca9-4e8a-99b1-f965a61624e3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.274523 Jun 18 22:08:28.670227 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 930/1888] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:08:27 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-interface => generated 285 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:28.683747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:28.687543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:28.710602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:28.712051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:28.713499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:28.714774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:29.690327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:29.705268 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d628d471-1ab4-46b3-8410-577ffe5f7a7b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 1.030699 Jun 18 22:08:29.715978 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 931/1889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:28 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:29.729415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:29.731868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:29.748960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:29.755102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:29.756132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:29.756740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:29.921180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=18 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:30.243690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:30.273601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37d18b56-aa25-49d0-a465-6fa2343ed4ce tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.554703 Jun 18 22:08:30.277340 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 932/1890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:29 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:30.314743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:30.315859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:30.343344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:30.349140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:30.353366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:30.354614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:30.404647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:31.061188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:31.077979 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-09aca31b-bddb-4c8a-8944-11ad59678aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1515 microversion: 2.1 time: 0.782127 Jun 18 22:08:31.079028 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 933/1891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:30 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1515 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:31.094213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e3ad3e6-63bd-4356-8ab6-1c48ff947754 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bc58b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:31.196731 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e3ad3e6-63bd-4356-8ab6-1c48ff947754 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.106756 Jun 18 22:08:31.198083 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 934/1892] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:31 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:31.211211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:31.212261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:31.219512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:31.220242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:31.221303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:31.221939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:31.566002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:31.577021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:31.578571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:31.579730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ae3e5fa-d969-4747-8d1b-f2869fa49de2 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.380311 Jun 18 22:08:31.580494 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 935/1893] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:31 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:31.601231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-38b2b394-7898-4bb4-b41f-6ab9db129e11 req-a1b5814c-677b-4801-b851-7e7de62ccc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243a6f2b-0c2c-43f8-8e7e-5336fafa5f76", "name": "network-vif-unplugged", "status": "completed", "tag": "d9b7cbe4-2618-4090-ad3c-05ac7dce53ae"}, {"name": "network-changed", "server_uuid": "243a6f2b-0c2c-43f8-8e7e-5336fafa5f76", "tag": "d9b7cbe4-2618-4090-ad3c-05ac7dce53ae"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:31.622724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38b2b394-7898-4bb4-b41f-6ab9db129e11 req-a1b5814c-677b-4801-b851-7e7de62ccc35 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:31.623467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38b2b394-7898-4bb4-b41f-6ab9db129e11 req-a1b5814c-677b-4801-b851-7e7de62ccc35 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:31.653531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-38b2b394-7898-4bb4-b41f-6ab9db129e11 req-a1b5814c-677b-4801-b851-7e7de62ccc35 service nova] Creating event network-vif-unplugged:d9b7cbe4-2618-4090-ad3c-05ac7dce53ae for instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 on nch1-master-1 Jun 18 22:08:31.656559 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-38b2b394-7898-4bb4-b41f-6ab9db129e11 req-a1b5814c-677b-4801-b851-7e7de62ccc35 service nova] Creating event network-changed:d9b7cbe4-2618-4090-ad3c-05ac7dce53ae for instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 on nch1-master-1 Jun 18 22:08:31.666861 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-38b2b394-7898-4bb4-b41f-6ab9db129e11 req-a1b5814c-677b-4801-b851-7e7de62ccc35 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.085320 Jun 18 22:08:31.672543 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 936/1894] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:31.680703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:31.690080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:31.702889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:31.708181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:31.709381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:31.710051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:32.213686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:32.222790 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a4eaedfa-2b9b-4904-8e88-d6c95c1fbc75 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.548199 Jun 18 22:08:32.223852 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 937/1895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:31 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:32.229231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:32.229900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:32.240822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:32.241307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:32.242134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:32.242583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:33.086177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:33.103573 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61f96365-ad17-4c7c-b8bd-287b24c67f6a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.878563 Jun 18 22:08:33.115396 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 938/1896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:32 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:33.320852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86b619a8-c58d-4601-aa15-991934f6cdeb tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Action: 'create', calling method: .version_select at 0x7fea19bd9f70>, body: {"keypair": {"name": "tempest-keypair-1964832939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoti9/H2PUH2sUKnGrlovw98tRYFTny48TwHG+FkQAMpQp7SVtCNnoCRMrdC6QoMkdhv0Zg5Pov/79rCDkKHeA8hNGeColDZ35BlNu+CATLRz5URvP8qT2dK3XGdGF54w=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:33.353802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-86b619a8-c58d-4601-aa15-991934f6cdeb tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Getting quotas for project a0f349f2feda450cbe24f0a17b186798. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:33.365288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-86b619a8-c58d-4601-aa15-991934f6cdeb tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Getting quotas for user a3022aec60f643b2a66492ad8f8d7e96 and project a0f349f2feda450cbe24f0a17b186798. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:33.447215 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86b619a8-c58d-4601-aa15-991934f6cdeb tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338844 Jun 18 22:08:33.455779 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 939/1897] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:08:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:33.467411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:33.469510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:33.478915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:33.479785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:33.481692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:33.482348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:33.886689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:33.906563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aaf2bd6e-4a3d-4c92-8eab-888906c84adb tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.446621 Jun 18 22:08:33.909626 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 940/1898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:33 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:33.929977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c5a99465-d83d-4142-9fd4-1f6997ac49e8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bdf280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:34.030489 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c5a99465-d83d-4142-9fd4-1f6997ac49e8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.117248 Jun 18 22:08:34.031189 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 941/1899] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:33 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:34.063751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a9cb1eb2-9cf0-452c-aff3-fdb0ea474f33 req-d3fef053-fe0f-407a-a3bd-7aa436ce4ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a462d18-117e-4b5d-965c-4f16125395e8", "name": "network-vif-plugged", "status": "completed", "tag": "7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:34.079298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a9cb1eb2-9cf0-452c-aff3-fdb0ea474f33 req-d3fef053-fe0f-407a-a3bd-7aa436ce4ace service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:34.081887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a9cb1eb2-9cf0-452c-aff3-fdb0ea474f33 req-d3fef053-fe0f-407a-a3bd-7aa436ce4ace service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:34.113677 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a9cb1eb2-9cf0-452c-aff3-fdb0ea474f33 req-d3fef053-fe0f-407a-a3bd-7aa436ce4ace service nova] Creating event network-vif-plugged:7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5 for instance 2a462d18-117e-4b5d-965c-4f16125395e8 on nch1-master-1 Jun 18 22:08:34.125120 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a9cb1eb2-9cf0-452c-aff3-fdb0ea474f33 req-d3fef053-fe0f-407a-a3bd-7aa436ce4ace service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091418 Jun 18 22:08:34.129065 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 942/1900] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:34.199924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:34.206174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:34.236747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:34.249084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:34.249930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:34.250709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:34.652649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:34.661693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:34.663290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:34.664478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e9b331e-720c-426e-a87d-43cc2fb000f6 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.524947 Jun 18 22:08:34.682330 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 943/1901] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:34 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:34.691634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:34.695744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:34.712364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:34.712364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:34.712679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:34.712988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.072129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:35.089684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db04aa0c-57f5-4357-b575-daaa433e939c tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.406013 Jun 18 22:08:35.090913 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 944/1902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:34 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:35.095893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-54fee73d-aa78-4f54-9b34-3050c2254fc2 req-e751ba59-1b65-4122-84a0-f2f8fa2d1fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4", "tag": "26600d51-5817-4750-bb7c-c78f6322072b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:35.120678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-54fee73d-aa78-4f54-9b34-3050c2254fc2 req-e751ba59-1b65-4122-84a0-f2f8fa2d1fd9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.127637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-54fee73d-aa78-4f54-9b34-3050c2254fc2 req-e751ba59-1b65-4122-84a0-f2f8fa2d1fd9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.147142 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-54fee73d-aa78-4f54-9b34-3050c2254fc2 req-e751ba59-1b65-4122-84a0-f2f8fa2d1fd9 service nova] Creating event network-changed:26600d51-5817-4750-bb7c-c78f6322072b for instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 on nch1-master-1 Jun 18 22:08:35.162322 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-54fee73d-aa78-4f54-9b34-3050c2254fc2 req-e751ba59-1b65-4122-84a0-f2f8fa2d1fd9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065180 Jun 18 22:08:35.169914 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 945/1903] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:35.183466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:35.184858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:35.190504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:08:35.191082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:08:35.191524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:08:35.191994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:08:35.192533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:08:35.212966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.213435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.214495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.214891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.219162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.219960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.220973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.221741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.257082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:35.287772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Getting quotas for project 637c113ab85b43cb815b1e6e2d868a29. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:35.298565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Getting quotas for user 1b0598fbccf348148fda392a40bf0078 and project 637c113ab85b43cb815b1e6e2d868a29. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:35.534037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:35.559081 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-132cea3f-d11e-4aa3-822d-436bed5e69e8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.384204 Jun 18 22:08:35.571937 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 946/1904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:35 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:35.582941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:35.585927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:35.598323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.598813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.612852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:35.613804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:35.657573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:08:35.660691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='cf0825c5-efd0-466f-b40a-5de8da952467',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1b01b938-d2cd-4134-a6f2-3145c57622ca',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f02ff6c6-66f3-4bc3-b968-c381a1c0ce4b',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:08:35.878890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:35.897622 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cb8d9efa-110b-4c10-9993-c5454ff6c11b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.324176 Jun 18 22:08:35.908054 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 947/1905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:35 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:35.915114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90c1abbe-bda1-4ec7-8103-ac136a618d53 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bedaf0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:35.996740 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90c1abbe-bda1-4ec7-8103-ac136a618d53 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.087231 Jun 18 22:08:36.003957 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 948/1906] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:35 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:36.010858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:36.011869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:36.024363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.025418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.026677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.027421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.289097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.306601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.308509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.316885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2e6ad86-e70b-40a4-89e0-9445ef53a696 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.311032 Jun 18 22:08:36.328663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 949/1907] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:36 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:36.328663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:36.328663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:36.334370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.334887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.335697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.336143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.458926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b7f8f36-615a-4e37-a537-6e198b75b99f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.978065 Jun 18 22:08:36.469477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 959/1908] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Jun 18 22:08:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 9992 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:08:36.485939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dd6f9f92-b379-4590-a875-03776b56bbb1 req-61106e96-128a-46e4-bb12-5f8bf1ddac1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243a6f2b-0c2c-43f8-8e7e-5336fafa5f76", "name": "network-vif-unplugged", "status": "completed", "tag": "d9b7cbe4-2618-4090-ad3c-05ac7dce53ae"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:36.507491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dd6f9f92-b379-4590-a875-03776b56bbb1 req-61106e96-128a-46e4-bb12-5f8bf1ddac1f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.508341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dd6f9f92-b379-4590-a875-03776b56bbb1 req-61106e96-128a-46e4-bb12-5f8bf1ddac1f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.531985 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dd6f9f92-b379-4590-a875-03776b56bbb1 req-61106e96-128a-46e4-bb12-5f8bf1ddac1f service nova] Creating event network-vif-unplugged:d9b7cbe4-2618-4090-ad3c-05ac7dce53ae for instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 on nch1-master-1 Jun 18 22:08:36.547239 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dd6f9f92-b379-4590-a875-03776b56bbb1 req-61106e96-128a-46e4-bb12-5f8bf1ddac1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076352 Jun 18 22:08:36.548528 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 960/1909] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:36.556089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-02c79ef3-d413-4acc-99f8-00f4dd3e5623 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:36.557666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-02c79ef3-d413-4acc-99f8-00f4dd3e5623 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:36.624183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.634116 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38c70fa9-29e7-4089-a214-e9c03eca4210 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.314427 Jun 18 22:08:36.644296 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 950/1910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:36 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:36.646517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:36.660338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:36.685832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.692848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.694142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.695349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.722083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-02c79ef3-d413-4acc-99f8-00f4dd3e5623 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.735145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-02c79ef3-d413-4acc-99f8-00f4dd3e5623 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.745393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-02c79ef3-d413-4acc-99f8-00f4dd3e5623 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:36.753783 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-02c79ef3-d413-4acc-99f8-00f4dd3e5623 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1286 microversion: 2.32 time: 0.196729 Jun 18 22:08:36.758014 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 961/1911] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:36 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:36.917047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:36.918326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:36.927379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.930393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:36.932344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:36.933952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:37.170623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:37.185684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff888062-357c-4e33-8d16-2119a13f6fd5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.545368 Jun 18 22:08:37.186893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 951/1912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:36 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:37.194259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4f91cad-22cb-4a7d-af33-720c5e999194 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bed550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:37.284627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4f91cad-22cb-4a7d-af33-720c5e999194 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.095882 Jun 18 22:08:37.303684 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 952/1913] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:37 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:37.336682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:37.337608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:37.358735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:37.359695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:37.360706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:37.361331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:37.406549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:37.420800 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9320a98e-1306-4dc6-9044-4d933d157d03 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.508814 Jun 18 22:08:37.424035 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 962/1914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:36 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:37.440662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1574177535", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "6fc0e447-9bcf-4bd0-8b72-cd8bee265ec4"}], "security_groups": [{"name": "tempest-securitygroup--262786966"}], "key_name": "tempest-keypair-1964832939", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:37.691037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:37.702397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:37.704011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:37.708339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] validate_networks() for [('6fc0e447-9bcf-4bd0-8b72-cd8bee265ec4', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:08:37.719212 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dcd52862-aabe-41d7-83ad-694f52667cf4 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.372425 Jun 18 22:08:37.720037 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 953/1915] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:37 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:37.747339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:37.748040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:37.756374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:37.756912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:37.757768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:37.758337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.051670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:38.063199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83b4d224-a3d9-430a-aee0-104001bb50d6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.320718 Jun 18 22:08:38.065222 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 954/1916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:37 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:38.072240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:38.076551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:38.100414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.107860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.109122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.110554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.318747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:38.348262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:38.350155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:38.357484 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90caefb8-0eb9-4676-9231-c22ee191eb31 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1520 microversion: 2.32 time: 0.290955 Jun 18 22:08:38.383241 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 955/1917] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:38 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:38.388698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:38.389546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:38.405896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.406907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.407914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.409931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.553069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Getting quotas for project a0f349f2feda450cbe24f0a17b186798. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:38.559567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Getting quotas for user a3022aec60f643b2a66492ad8f8d7e96 and project a0f349f2feda450cbe24f0a17b186798. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:38.585555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:08:38.586334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:08:38.587088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:08:38.587675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:08:38.588277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:08:38.600091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:38.601458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.602482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.605008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.605716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.609851 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5691c45-99ef-4e97-ba8d-9f8a66c93ea6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.224961 Jun 18 22:08:38.610893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 956/1918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:38 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:38.619843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00c69332-614c-469f-a2e8-791a0f0f2fd8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bcce50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:38.644740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Getting quotas for project a0f349f2feda450cbe24f0a17b186798. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:38.653993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:38.655505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Getting quotas for user a3022aec60f643b2a66492ad8f8d7e96 and project a0f349f2feda450cbe24f0a17b186798. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:38.677690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:08:38.681287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:08:38.690458 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-00c69332-614c-469f-a2e8-791a0f0f2fd8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.078394 Jun 18 22:08:38.691216 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 957/1919] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:38 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:38.697764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:38.698848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:38.708162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.708945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.710117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.710758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.716143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:38.792626 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7222d38-a456-42c0-bb57-3beb8f63d8b9 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.346990 Jun 18 22:08:38.794497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 963/1920] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:08:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:08:38.813357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7fed7fa6-7741-4c05-a78f-1b47292cdb7d req-e4938822-07d7-4294-850d-73b27aadd7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711f5bc4-2480-4399-a4f3-77068704a9b8", "name": "network-vif-unplugged", "status": "completed", "tag": "c8f50426-7fae-40e9-bc9a-64735fd86c94"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:38.858288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7fed7fa6-7741-4c05-a78f-1b47292cdb7d req-e4938822-07d7-4294-850d-73b27aadd7ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:38.863126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7fed7fa6-7741-4c05-a78f-1b47292cdb7d req-e4938822-07d7-4294-850d-73b27aadd7ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:38.930835 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7fed7fa6-7741-4c05-a78f-1b47292cdb7d req-e4938822-07d7-4294-850d-73b27aadd7ed service nova] Creating event network-vif-unplugged:c8f50426-7fae-40e9-bc9a-64735fd86c94 for instance 711f5bc4-2480-4399-a4f3-77068704a9b8 on nch2-master-1 Jun 18 22:08:38.979387 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7fed7fa6-7741-4c05-a78f-1b47292cdb7d req-e4938822-07d7-4294-850d-73b27aadd7ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171453 Jun 18 22:08:38.981562 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 964/1921] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:39.004613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:39.010070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:39.022000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.022557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.023659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.024221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.030043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.062426 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7626f99c-32f1-497c-a071-a79650b45eb7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.366206 Jun 18 22:08:39.064190 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 958/1922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:38 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:39.085850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b260b06-8b8b-403d-956c-0bc4f3ead284 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:39.087846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b260b06-8b8b-403d-956c-0bc4f3ead284 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:39.103768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:39.298867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5b260b06-8b8b-403d-956c-0bc4f3ead284 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.310210 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b260b06-8b8b-403d-956c-0bc4f3ead284 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1278 microversion: 2.1 time: 0.241495 Jun 18 22:08:39.312347 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 959/1923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:39 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:39.324860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:39.328053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:39.337229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.339225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.340488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.341370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.431792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.446650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.462527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.466742 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2abb6a03-1a03-446e-a717-a130b164f067 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.483910 Jun 18 22:08:39.472364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 965/1924] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:38 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:39.487277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:39.497349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:39.519645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.520272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.521958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.522530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.774891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.780975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.787334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.788978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:39.790412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0169684a-e1c2-4375-bd97-0eafbbe5bc9b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1594 microversion: 2.32 time: 0.313931 Jun 18 22:08:39.791083 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 966/1925] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:39 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1594 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:39.792650 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-abd0c036-54a2-4672-bad2-f98b242c2913 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.478463 Jun 18 22:08:39.793886 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 960/1926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:39 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:39.806827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:39.809742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:39.818513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e85a779-ae8c-4f2b-bfdf-72ea3112e4c3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19beddc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:39.836599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.837358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.840325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:39.841784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:39.927170 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e85a779-ae8c-4f2b-bfdf-72ea3112e4c3 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.131839 Jun 18 22:08:39.927906 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 961/1927] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:39 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:40.089236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:40.097985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:40.111126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:40.150254 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-093028c0-ce85-499e-bad4-943fe01623dc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.357672 Jun 18 22:08:40.157978 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 967/1928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:39 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:40.164172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.165692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.168462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.171793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.335069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:40.335953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:40.353529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.361750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.363621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.364494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.591593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:40.615915 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-224482a5-b1ac-4d88-b9fa-a1937ebae794 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1282 microversion: 2.1 time: 0.287643 Jun 18 22:08:40.627615 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 968/1929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:40 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1282 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:40.644575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:40.651786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:40.664360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:40.672965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1e45ffc-0e8e-4bc8-b901-8734d0e0ecb0 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.592120 Jun 18 22:08:40.675620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 962/1930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:40 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:40.714945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.715679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.716577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.717059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.851221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:40.852394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:40.861308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.861862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.862514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:40.867258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:40.973969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.001472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.008902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.012610 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0eeda979-c3b9-4510-8598-471b6b414c16 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.381900 Jun 18 22:08:41.031583 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 969/1931] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:40 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:41.047339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:41.047977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:41.082247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.082543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.092850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.093716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.210558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.230690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.235344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.236565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8045eeeb-d04f-48f1-895d-be66589f84bc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1661 microversion: 2.32 time: 0.389539 Jun 18 22:08:41.255940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 963/1932] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:40 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1661 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:41.280220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d7f20ee-4dfa-4cc1-a1b3-561be80560c9 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea141b2040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:41.367217 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d7f20ee-4dfa-4cc1-a1b3-561be80560c9 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1421 microversion: 2.1 time: 0.108179 Jun 18 22:08:41.368616 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 964/1933] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:41 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1421 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:41.391461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c61f0c09-dbd3-4731-80ac-1bb7841f3308 req-394825f4-8ba0-494d-8c33-eea418f4e246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711f5bc4-2480-4399-a4f3-77068704a9b8", "name": "network-vif-plugged", "status": "completed", "tag": "c8f50426-7fae-40e9-bc9a-64735fd86c94"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:41.404530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.417112 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b891ce1c-40db-4720-b20b-0590e4a5afce tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.384890 Jun 18 22:08:41.419355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c61f0c09-dbd3-4731-80ac-1bb7841f3308 req-394825f4-8ba0-494d-8c33-eea418f4e246 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.420845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c61f0c09-dbd3-4731-80ac-1bb7841f3308 req-394825f4-8ba0-494d-8c33-eea418f4e246 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.428711 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 970/1934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:41 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:41.437273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:41.439376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:41.445351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c61f0c09-dbd3-4731-80ac-1bb7841f3308 req-394825f4-8ba0-494d-8c33-eea418f4e246 service nova] Creating event network-vif-plugged:c8f50426-7fae-40e9-bc9a-64735fd86c94 for instance 711f5bc4-2480-4399-a4f3-77068704a9b8 on nch2-master-1 Jun 18 22:08:41.449367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.450047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.451054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.451658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.456815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c61f0c09-dbd3-4731-80ac-1bb7841f3308 req-394825f4-8ba0-494d-8c33-eea418f4e246 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080065 Jun 18 22:08:41.457591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 965/1935] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:41.635532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:41.636547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:41.647323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.648836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.650590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.651271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.665698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.674958 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd8743df-17d7-4cae-afdb-cf78d664b31d tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.244833 Jun 18 22:08:41.675866 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 971/1936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:41 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:41.704712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:41.708242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:41.719157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.720087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.721607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:41.722356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:41.741078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.751705 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7c861860-8d1a-4f5d-89b0-78970d2efcd1 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1282 microversion: 2.1 time: 0.121068 Jun 18 22:08:41.752709 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 966/1937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:41 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:41.938369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:41.977471 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5adb615-1f1e-4689-86d8-1d4ca7769840 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.285707 Jun 18 22:08:41.983730 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 972/1938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:41 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:42.042232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.043258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:42.052754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.054105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.055686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.056353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.258780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.259544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:42.268888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.271776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.272869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.274879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.332882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.343700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.348486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.350208 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fea8c7a2-ee6c-4dc3-9ea0-43bea9eb8e92 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.315082 Jun 18 22:08:42.353847 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 967/1939] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:42.381560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-430d7f82-3902-412c-b001-451f8359dcf8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bcc8b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.440199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-430d7f82-3902-412c-b001-451f8359dcf8 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1430 microversion: 2.1 time: 0.062437 Jun 18 22:08:42.441284 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 968/1940] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1430 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:42.446357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.447276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:42.456132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.457339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.458621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.459660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.573419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.585446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.587569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.588387 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fd4a81c6-6fd5-4fa6-864a-ab4b57278a48 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1707 microversion: 2.32 time: 0.333290 Jun 18 22:08:42.588669 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 973/1941] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1707 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:42.603696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f687d3e7-a74a-4d43-ab09-4ffbde31ef94 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19cbe1f0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.656837 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f687d3e7-a74a-4d43-ab09-4ffbde31ef94 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 200 len: 1430 microversion: 2.1 time: 0.067164 Jun 18 22:08:42.658255 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 974/1942] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 1430 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:42.671890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.673114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:42.682164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.683282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.684512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.685236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.688529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:42.699500 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b28f238-3720-4403-a766-5524f999c644 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.256656 Jun 18 22:08:42.700770 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 969/1943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:42.706861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:42.709885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:42.720787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.721303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.723335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:42.723964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:42.991997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.007295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7348e83-6935-44de-a169-8ceda98d1070 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1480 microversion: 2.1 time: 0.338876 Jun 18 22:08:43.008625 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 975/1944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1480 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:43.022312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.025072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:43.025704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:43.032760 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9cfc860f-1d17-438f-b598-4e83959a35cc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.330824 Jun 18 22:08:43.033136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.033624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.034031 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 970/1945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:42 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:43.034414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.039013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:43.039839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:43.041009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.049514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.050205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.050986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.051594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.171288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.184185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c4ad0696-0056-4802-8f63-78f97cdafd0d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1282 microversion: 2.1 time: 0.163181 Jun 18 22:08:43.184732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 976/1946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:43 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:43.313384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.321820 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4f38ed9-351a-4bf6-b130-5b6c078c5aa1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1521 microversion: 2.1 time: 0.286361 Jun 18 22:08:43.326045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 971/1947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:43 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:43.375224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:43.375846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:43.384310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.385130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.386157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.386826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.576161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.588465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.590146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.591437 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d9c92803-6071-4406-8f21-8bf282e9978f tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.223209 Jun 18 22:08:43.594494 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 977/1948] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:43 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:43.607711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:43.608338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:43.616205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.617083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.618050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.618569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.720886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:43.722066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:43.732372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.732944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.733770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:43.734546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:43.866384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.879926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.881670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.883121 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-974e3ec9-bf31-4f2d-b0d5-21acefb043ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1753 microversion: 2.32 time: 0.279523 Jun 18 22:08:43.884409 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 972/1949] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:43 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1753 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:43.963682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:43.975563 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b181067e-bac2-477e-81b1-4e557e96f0a7 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.260850 Jun 18 22:08:43.976200 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 978/1950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:43 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:44.027957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.029519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.044975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.045768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.052866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.054925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.056013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.056568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.075071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.076112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.078282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.079180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.346224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.356682 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4055c0ee-2ecb-4760-8e02-6c1239858513 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.308650 Jun 18 22:08:44.359345 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 979/1951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:44.364087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.364871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.379476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.380061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.380936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.381499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.400964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:44.416040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.434306 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d1ad820-2c3f-452a-a88f-1cf1db3b288f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1480 microversion: 2.1 time: 0.410905 Jun 18 22:08:44.444686 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 973/1952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1480 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:44.455187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.456009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.463342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.463854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.464956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.465732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.485536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.508418 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c4d6944c-bfae-4a7b-953e-a094a08abb8a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1282 microversion: 2.1 time: 0.148080 Jun 18 22:08:44.509683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 980/1953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:44.623094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.625024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.637792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.638398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.639315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.639755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.654182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.668211 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1804376f-c149-4be3-845d-937ed7b2ffb5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1506 microversion: 2.1 time: 0.221362 Jun 18 22:08:44.670183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 974/1954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:44.692249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.693010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.701653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.702119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.702628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.704127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.888912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.906625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.909366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.912413 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-807867d2-8880-4dda-a333-3221bc7306cf tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.301354 Jun 18 22:08:44.914915 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 981/1955] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:44.924932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.926015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.929713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:44.936089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.936713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.937926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.938573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.938866 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-935987e3-730f-4e8c-bc19-54180d347670 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 200 len: 1506 microversion: 2.1 time: 0.255442 Jun 18 22:08:44.939723 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 975/1956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:44.957634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:44.958485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:44.980076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.982331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:44.983333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:44.984008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:45.023423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:08:45.168501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83f8f873-fd99-4837-8f00-c3e74b0a6b5b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "DELETE /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 204 len: 0 microversion: 2.1 time: 0.215409 Jun 18 22:08:45.169379 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 976/1957] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:08:44 2022] DELETE /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:45.181548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:45.181548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:45.200363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:45.205185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:45.206781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:45.207139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:45.232673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:45.247410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:45.249091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:45.251404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0924f54e-f902-41de-ae7d-4075c464453f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1833 microversion: 2.32 time: 0.334601 Jun 18 22:08:45.264574 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 982/1958] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:44 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1833 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:45.379280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:45.380337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:45.409983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:45.410522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:45.411228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:45.413968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:45.420977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:45.421141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:45.430087 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d04ef19f-6569-4493-8391-f7f6ac67a8b9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1392 microversion: 2.1 time: 0.259083 Jun 18 22:08:45.431265 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 977/1959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:45 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:45.436729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1068832566", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "673307c5-760f-4780-9688-b6119455b2a6"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:45.515786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] validate_networks() for [('673307c5-760f-4780-9688-b6119455b2a6', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:08:45.746455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:45.755908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-72f329be-0cd9-48ea-aba7-8137e2a3fb7c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.385393 Jun 18 22:08:45.769971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 983/1960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:45 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:45.791300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:45.792200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:45.814264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:45.815748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:45.819073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:45.820513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.112888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:46.124849 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0614d03-bd47-44d3-a5f1-f726035f0b0c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1480 microversion: 2.1 time: 0.353063 Jun 18 22:08:46.129429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 984/1961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:45 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1480 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:46.139382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:46.140357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:46.149187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.150730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.153533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.154724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.208853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:08:46.209755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:08:46.210425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:08:46.210879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:08:46.211381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:08:46.228420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.228872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.230079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.230789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.254855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:46.258921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Getting quotas for project e25c9a06b279434b8c8f262a3c0a968b. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:08:46.266451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Getting quotas for user 86d98b6f30884d13a94ea2d4cabff826 and project e25c9a06b279434b8c8f262a3c0a968b. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:08:46.275344 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5dbe8009-89cc-4af7-a952-afb8d49dc882 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1282 microversion: 2.1 time: 0.144382 Jun 18 22:08:46.282087 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 985/1962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:46 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:46.289954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:08:46.292800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:08:46.302895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:46.303952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:46.318618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.319170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.320027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.320546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.396410 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61a4a973-9754-4d1f-ba4f-0d71f5dfcd95 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962688 Jun 18 22:08:46.400910 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 978/1963] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:08:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:08:46.414829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d2986f32-0811-4dcd-b22d-577c5030825e req-887c7ff8-43d9-45f2-a803-ecd9ae1658eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "76c427aa-55d9-476e-888c-c83eaf8976e0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:46.439539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d2986f32-0811-4dcd-b22d-577c5030825e req-887c7ff8-43d9-45f2-a803-ecd9ae1658eb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.440184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d2986f32-0811-4dcd-b22d-577c5030825e req-887c7ff8-43d9-45f2-a803-ecd9ae1658eb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.456228 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d2986f32-0811-4dcd-b22d-577c5030825e req-887c7ff8-43d9-45f2-a803-ecd9ae1658eb service nova] Creating event network-changed:76c427aa-55d9-476e-888c-c83eaf8976e0 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:08:46.462278 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d2986f32-0811-4dcd-b22d-577c5030825e req-887c7ff8-43d9-45f2-a803-ecd9ae1658eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058859 Jun 18 22:08:46.463578 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 979/1964] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:46.472369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:46.473555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:46.483179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.483633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:46.484815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:46.486075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:47.032360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.042590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.059328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.061211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36b13faf-8fe0-4f68-bfc4-5c312cb3bf04 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.776147 Jun 18 22:08:47.073074 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 986/1965] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:46 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:47.077524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.079178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:47.079813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:47.087086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:47.087792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:47.088868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:47.089706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:47.092718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.096100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.097494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55fa891d-226c-4618-b426-68b6e2b8cee9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1833 microversion: 2.32 time: 0.632243 Jun 18 22:08:47.098430 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 980/1966] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:46 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1833 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:47.124983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:47.126314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:47.135636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:47.136261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:47.137297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:47.137960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:47.226464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:47.246944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2d37779-0715-4a04-8c91-44bd80d664e8 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1222 microversion: 2.1 time: 0.172407 Jun 18 22:08:47.248197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 987/1967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:47 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1222 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:47.255140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:47.256955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:47.270265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:47.271496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:47.272740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:47.273468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.096166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:48.110641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-666d20da-fc9c-4d8a-b02c-741fd237b9ff tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1382 microversion: 2.1 time: 1.011052 Jun 18 22:08:48.114117 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 981/1968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:47 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1382 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:48.145174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:48.165002 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-26a55c69-54d9-4145-9b6f-f5284b94d078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1528 microversion: 2.1 time: 0.915102 Jun 18 22:08:48.169546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:48.170093 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 988/1969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:47 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1528 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:48.184994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:48.185632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:48.186277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:48.200494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.201580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.203016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.204859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.227662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.232661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.234330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.235975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.510561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:48.533306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b50bbf86-9c51-451a-b915-14a941b76dcf tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1336 microversion: 2.1 time: 0.360535 Jun 18 22:08:48.538325 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 989/1970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:48 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1336 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:48.563531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:48.569516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:48.622702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.632572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.648751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.650724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.653736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:48.743454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=18 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:48.770653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:48.804266 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c90fd73c-661d-45b5-90c0-bcdf1f033224 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1467 microversion: 2.1 time: 0.660525 Jun 18 22:08:48.810136 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 982/1971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:48 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1467 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:48.826591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:48.830046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:48.842479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.843154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:48.844405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:48.845615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.397940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.412816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.416241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.421524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a9bb7b4-2256-4c7d-9106-c8ddb890c411 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.880381 Jun 18 22:08:49.425374 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 990/1972] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:48 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:49.439006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c45844f4-eea7-493d-8b58-1f56d7ba552e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '.version_select at 0x7fea19c114c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:49.449021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c45844f4-eea7-493d-8b58-1f56d7ba552e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.450099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c45844f4-eea7-493d-8b58-1f56d7ba552e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.484281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c45844f4-eea7-493d-8b58-1f56d7ba552e tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3084 microversion: 2.1 time: 0.056429 Jun 18 22:08:49.486649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 991/1973] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:08:49 2022] GET /compute/v2.1/os-migrations => generated 3084 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:49.502447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:49.504867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:49.521759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.524086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.524831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.526481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.527783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.536580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.539540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.541804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a571c07d-91cf-4352-a19a-fc97dcafbd54 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1854 microversion: 2.32 time: 0.729409 Jun 18 22:08:49.543171 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 983/1974] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:48 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1854 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:49.548786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4c6f0ec4-cdb3-4ab9-8fac-03237630998a req-e8bd6f9c-4610-45b1-9064-cc0744d74804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711f5bc4-2480-4399-a4f3-77068704a9b8", "name": "network-vif-deleted", "tag": "c8f50426-7fae-40e9-bc9a-64735fd86c94"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:49.562831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4c6f0ec4-cdb3-4ab9-8fac-03237630998a req-e8bd6f9c-4610-45b1-9064-cc0744d74804 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.563635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4c6f0ec4-cdb3-4ab9-8fac-03237630998a req-e8bd6f9c-4610-45b1-9064-cc0744d74804 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.602232 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4c6f0ec4-cdb3-4ab9-8fac-03237630998a req-e8bd6f9c-4610-45b1-9064-cc0744d74804 service nova] Creating event network-vif-deleted:c8f50426-7fae-40e9-bc9a-64735fd86c94 for instance 711f5bc4-2480-4399-a4f3-77068704a9b8 on nch2-master-1 Jun 18 22:08:49.637554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4c6f0ec4-cdb3-4ab9-8fac-03237630998a req-e8bd6f9c-4610-45b1-9064-cc0744d74804 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092538 Jun 18 22:08:49.640959 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 984/1975] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:49.651016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5d813ddd-6a4e-4bfc-868f-1ce31e72293b tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19cac3a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:49.664954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:49.678149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41c60a98-3e79-4367-b9d2-63932b5a6c93 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1276 microversion: 2.1 time: 0.186915 Jun 18 22:08:49.681606 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 992/1976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:49 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:49.688911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:49.689837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:49.717049 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5d813ddd-6a4e-4bfc-868f-1ce31e72293b tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad" status: 200 len: 784 microversion: 2.1 time: 0.071803 Jun 18 22:08:49.717470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.717850 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 985/1977] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:49 2022] GET /compute/v2.1/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:49.718649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.722476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:49.723217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:49.723418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.724053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.742474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.742933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:49.743742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:49.744176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.036576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:50.054164 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2af23e9e-4719-4650-910f-844f82d22670 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.370886 Jun 18 22:08:50.056075 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 993/1978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:49 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:50.066657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:50.069287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:50.091090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.091647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.096130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.096618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.216444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be8c242c-82de-4eda-a3fe-ea870a37ebf3 tempest-LiveMigrationTest-1049720124 tempest-LiveMigrationTest-1049720124-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1533 microversion: 2.1 time: 0.496867 Jun 18 22:08:50.227391 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 986/1979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:49 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1533 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:50.246179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-79978136-6d6c-449a-8ade-c57e4b73b149 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:50.293976 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-79978136-6d6c-449a-8ade-c57e4b73b149 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.065060 Jun 18 22:08:50.296591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 987/1980] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:08:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:50.311270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:50.313431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:50.316309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:50.325142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.326199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.327346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.327856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.329665 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-087b622a-96c1-4ecd-aa54-5398714c0f92 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1336 microversion: 2.1 time: 0.272045 Jun 18 22:08:50.333096 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 994/1981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:50 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1336 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:50.346805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1a8ef3bb-5b5a-474e-b182-dde50cb6248e tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19cbeb80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:50.368670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:08:50.592983 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed11f570-6b0b-413f-aab8-f8530da45a1b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 204 len: 0 microversion: 2.1 time: 0.294832 Jun 18 22:08:50.600039 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 988/1982] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:08:50 2022] DELETE /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:50.604628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-632e2733-a507-4b91-a85f-5d33f80d34df req-a7d95c24-bf65-4c23-ba4b-41a3b25d7628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "name": "network-vif-unplugged", "status": "completed", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:50.629822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-632e2733-a507-4b91-a85f-5d33f80d34df req-a7d95c24-bf65-4c23-ba4b-41a3b25d7628 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.630805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-632e2733-a507-4b91-a85f-5d33f80d34df req-a7d95c24-bf65-4c23-ba4b-41a3b25d7628 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.652259 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-632e2733-a507-4b91-a85f-5d33f80d34df req-a7d95c24-bf65-4c23-ba4b-41a3b25d7628 service nova] Creating event network-vif-unplugged:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:08:50.671571 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-632e2733-a507-4b91-a85f-5d33f80d34df req-a7d95c24-bf65-4c23-ba4b-41a3b25d7628 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075760 Jun 18 22:08:50.676724 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 989/1983] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:50.687869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:50.690264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:50.705499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.706488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:50.707840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:50.708627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.059546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.082511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.091933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.093745 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-420a2a15-2489-4b74-b073-0f706925fd00 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.415442 Jun 18 22:08:51.094584 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 990/1984] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:50 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:51.104097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:51.110092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:51.119700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.120500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.122819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.123562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.257971 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1a8ef3bb-5b5a-474e-b182-dde50cb6248e tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "DELETE /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 204 len: 0 microversion: 2.1 time: 0.925989 Jun 18 22:08:51.258598 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 995/1985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:50 2022] DELETE /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:08:51.268659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:51.270879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:51.289560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.291131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.294589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.295406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.613545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.627309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.639734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.644682 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f8ed686-a3d5-4f05-a001-b3a0e53ea22c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.543769 Jun 18 22:08:51.652411 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 991/1986] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:51 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:51.657813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:51.658440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:51.671903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.683402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.684449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.685777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:51.686553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.699668 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8b9a41db-af2e-4f60-98a7-1464286c3b82 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1388 microversion: 2.1 time: 0.439441 Jun 18 22:08:51.700208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 996/1987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:51 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1388 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:51.712082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:51.714735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:51.735507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.736206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:51.737249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:51.737854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.176040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.186224 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69975901-7e3c-4d06-a0f2-d2458e6311be tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.532296 Jun 18 22:08:52.186822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 992/1988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:51 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:52.191408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2db0da03-bd56-485a-9dab-662f44c95a74 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bccc10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:52.194217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.213678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fe9ccbae-2f6f-47c7-83f5-2ca8e47572f5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.511497 Jun 18 22:08:52.217265 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 997/1989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:51 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:52.240003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:52.241137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:52.251394 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2db0da03-bd56-485a-9dab-662f44c95a74 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] HTTP exception thrown: Image not found. Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2db0da03-bd56-485a-9dab-662f44c95a74 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Request method failure captured: Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 HTTP/1.1 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkypCB4vdSBuEcZURhpgOUh-H32lGMmAIaHbH8tEDBbxlmDypt4y9it63klELyO5k-O3DqUxe76emTLPI0LEI6hcsZ733TJYauOGYh4dduUebzO-sMPh_34G95m2YBn7nAAOOA5Yp29MzwLr_jTUKxZVyqKRAyi-rxhh1zG8ppuvJKA Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 0f681d806f354b8682bdae077a9ece40 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f681d806f354b8682bdae077a9ece40", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 0f681d806f354b8682bdae077a9ece40 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerTestJSON-738529669-project Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: dd075f9744d644e38be2333789563d12 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerTestJSON-738529669-project Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: exception: Image not found. Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd655fd40-24c9-4462-9728-5bb82395efd5'} Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d655fd40-24c9-4462-9728-5bb82395efd5 Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:08:52.253527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d655fd40-24c9-4462-9728-5bb82395efd5 could not be found. Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2db0da03-bd56-485a-9dab-662f44c95a74 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Returning 404 to user: Image not found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2db0da03-bd56-485a-9dab-662f44c95a74 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 404 len: 62 microversion: 2.1 time: 0.067213 Jun 18 22:08:52.262404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 993/1990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:52 2022] GET /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:08:52.267235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.267707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.268495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b89b1aa1-8210-4d7f-92a4-3eb5277b1e02 req-02361743-d37b-458f-8a60-9b53507aa18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "d0e4b550-68d2-4471-a8ac-9a423214fa64"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:52.268709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.269970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.293391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b89b1aa1-8210-4d7f-92a4-3eb5277b1e02 req-02361743-d37b-458f-8a60-9b53507aa18a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.293724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b89b1aa1-8210-4d7f-92a4-3eb5277b1e02 req-02361743-d37b-458f-8a60-9b53507aa18a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.324837 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b89b1aa1-8210-4d7f-92a4-3eb5277b1e02 req-02361743-d37b-458f-8a60-9b53507aa18a service nova] Creating event network-changed:d0e4b550-68d2-4471-a8ac-9a423214fa64 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:08:52.332080 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b89b1aa1-8210-4d7f-92a4-3eb5277b1e02 req-02361743-d37b-458f-8a60-9b53507aa18a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075311 Jun 18 22:08:52.332875 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 994/1991] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:52.342235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:52.343017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:52.366931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.369843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.370660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.371098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.508821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.524325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:52.530281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-507cfd68-3078-4a74-b07b-82183123aaac tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.310042 Jun 18 22:08:52.545784 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 998/1992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:52 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:52.557052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-35355344"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:52.563753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:52.580499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.581430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.582514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.583126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.594179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.604544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.610257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.612089 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fe6d880-e821-4648-b745-286aa84bda9e tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.274285 Jun 18 22:08:52.612949 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 995/1993] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:52 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:52.671522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:52.673669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:52.687443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.688639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.689745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:52.690461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:52.957151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.971337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.973342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:52.976017 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-826c5a9d-4552-4bb8-8100-99f51b308a08 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.310198 Jun 18 22:08:52.992522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 996/1994] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:52 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:53.000636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:53.001590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:53.009069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.009825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.010904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.011505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.113519 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b64c2e10-b264-4514-ad14-ccb322818935 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "POST /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8/action" status: 202 len: 0 microversion: 2.1 time: 0.564310 Jun 18 22:08:53.118572 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 999/1995] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:08:52 2022] POST /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:08:53.130643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-68866619-88d0-4f54-be7d-3950f003225c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d12dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:53.189219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.202263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6836c709-df4f-4cb6-a032-10a4bb6c0d13 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1388 microversion: 2.1 time: 0.206699 Jun 18 22:08:53.203731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 997/1996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:52 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1388 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:53.220975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:53.221850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:53.222904 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-68866619-88d0-4f54-be7d-3950f003225c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.099907 Jun 18 22:08:53.224766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1000/1997] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:53 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:53.230333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.230871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.231811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.232603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.240848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:53.243576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:53.264316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.266079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.267075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.269442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.496667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.512403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c4fa96e2-14ba-4f1a-9830-ee4e2bb6ff0e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.307240 Jun 18 22:08:53.514676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 998/1998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:53 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:53.535996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.548885 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a814da8-2f34-4a3e-a7cb-2085b9676205 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.317676 Jun 18 22:08:53.563689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:53.564937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1001/1999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:53 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:53.565820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:53.573815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.574602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.575642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.576335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.604171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:53.632960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:53.633960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:53.644373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.649005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.650087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:53.650750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:53.834476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.843832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4fb6e2d3-7e27-4041-9fd7-016c92c770af tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.297795 Jun 18 22:08:53.857322 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 999/2000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:53 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:53.896906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.908018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.910708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:53.912445 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a9cb70d-df78-446b-b24f-a7fccebe759c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.284665 Jun 18 22:08:53.914108 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1002/2001] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:53 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:08:53.999120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:54.000019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:54.002187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:54.009958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.017694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.018628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.019091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.221523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:54.222615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:54.235837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.238796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.241099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.242940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.633445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:54.645856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:54.658226 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1c148f4-fa42-4a37-be9d-4125f1283e04 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1388 microversion: 2.1 time: 0.442133 Jun 18 22:08:54.658833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:54.659653 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1003/2002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:54 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1388 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:54.664659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b3a1c77b-093c-49c0-9824-4045c130b099 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19ccd5e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:54.676643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:54.678327 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee8b4b4f-c690-4974-a687-44190d69aa5d tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.683552 Jun 18 22:08:54.680105 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1000/2003] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:53 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:54.694584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cc465646-c570-4f6c-9f58-7565eda13c9e req-878a36ec-9239-4e26-836c-800b1693783c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfbbf33-04a0-46d3-82ce-51afe2d4eae9", "name": "network-vif-unplugged", "status": "completed", "tag": "6052a204-9eb6-4695-a8bc-55524ef614d9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:54.715880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cc465646-c570-4f6c-9f58-7565eda13c9e req-878a36ec-9239-4e26-836c-800b1693783c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.716448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cc465646-c570-4f6c-9f58-7565eda13c9e req-878a36ec-9239-4e26-836c-800b1693783c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.729584 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b3a1c77b-093c-49c0-9824-4045c130b099 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.068545 Jun 18 22:08:54.731173 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1004/2004] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:54 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:54.735064 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cc465646-c570-4f6c-9f58-7565eda13c9e req-878a36ec-9239-4e26-836c-800b1693783c service nova] Creating event network-vif-unplugged:6052a204-9eb6-4695-a8bc-55524ef614d9 for instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 on nch1-master-1 Jun 18 22:08:54.741075 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cc465646-c570-4f6c-9f58-7565eda13c9e req-878a36ec-9239-4e26-836c-800b1693783c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059557 Jun 18 22:08:54.742022 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1001/2005] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:54.750056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "a7f7354f-e621-46bf-8827-3e2bff0d2ff4"}, {"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "f8b3e4e4-8c18-4595-9154-6af81f221d72"}, {"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "6a0a73d3-2b87-4e05-a042-2a9468fbabf2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:54.759217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:54.760138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:54.762063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.762717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.768526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.768968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.769828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.770272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.782274 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] Creating event network-changed:a7f7354f-e621-46bf-8827-3e2bff0d2ff4 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:08:54.783222 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] Creating event network-changed:f8b3e4e4-8c18-4595-9154-6af81f221d72 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:08:54.783953 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] Creating event network-changed:6a0a73d3-2b87-4e05-a042-2a9468fbabf2 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:08:54.795694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ff6dd735-b25f-4475-97de-692c5e25aefe req-2b2e90b9-791b-4f59-abbf-704a02c41056 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.059626 Jun 18 22:08:54.798499 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1005/2006] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:54.807653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:54.809003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:54.818782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.819604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.820717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:54.821369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:54.989880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:55.002941 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c774be2b-ec67-417d-9161-eca90042c316 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.259179 Jun 18 22:08:55.005292 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1002/2007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:54 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:55.013078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:55.018691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:55.028649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.033691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.034818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.035518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.171730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:55.182793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8ddd3a57-9477-4679-b1f3-fb006a7f068b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.382222 Jun 18 22:08:55.194570 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1006/2008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:54 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:55.204705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:55.205402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:55.223158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.223704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.224565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.225056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.301706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:55.314978 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90ea8bd3-a921-4ec1-a611-5b379a633515 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.308360 Jun 18 22:08:55.325514 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1003/2009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:55 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:55.492193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:55.505755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:55.507277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:55.508435 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2751d2e-175d-409b-88f4-6832c9b0c589 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.312637 Jun 18 22:08:55.508999 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1007/2010] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:55 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:55.678026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:55.680261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:55.704155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:55.705920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:55.713702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.716126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.719232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.720531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.722938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.723822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:55.726160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:55.727200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.163694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:56.176860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eaab8699-4372-42bc-a4f9-3f795cac05cf tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1388 microversion: 2.1 time: 0.504632 Jun 18 22:08:56.187510 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1004/2011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:55 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1388 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:56.195405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb48f86c-e91e-4060-98e9-0fbbb6d59dd9 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea141aadc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:56.197437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:56.218240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:56.221360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:56.223540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5112d480-c5be-4b6f-8e75-a26d7218ef4b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.525235 Jun 18 22:08:56.234108 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1008/2012] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:55 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:08:56.234108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:56.234108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:56.244508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:56.281059 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb48f86c-e91e-4060-98e9-0fbbb6d59dd9 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.091851 Jun 18 22:08:56.282040 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1005/2013] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:56 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:56.285616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.287660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.288092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:56.289282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:56.291256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.293193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.296630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:56.299532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.300259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.301410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.302010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.619290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:56.631133 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57c1dc4c-1815-4a37-b8c6-96902e2a6c0a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.347420 Jun 18 22:08:56.651271 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1006/2014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:56 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:56.651271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:56.651271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:56.670769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.674119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.675214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.676323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.784595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:56.803868 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60dd4dba-552f-419a-aa15-ab2ca1f8444b tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.578268 Jun 18 22:08:56.804498 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1009/2015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:56 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:56.816633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:56.825875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:56.840923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.849649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:56.850615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:56.861560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.086543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.096654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.104336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.108036 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4f5d7bf-f2e1-40bf-99f5-5bb6f1fb6ba8 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.302201 Jun 18 22:08:57.108794 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1010/2016] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:56 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:57.131463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0fce3e6c-3839-4baa-a9b5-aa9022de9a22 req-50d44845-f513-4891-944e-9e95af5e153e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "62d82a0f-55bf-4aaa-a72b-0128a6ac91ad"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:08:57.144161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.149412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0fce3e6c-3839-4baa-a9b5-aa9022de9a22 req-50d44845-f513-4891-944e-9e95af5e153e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.150624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0fce3e6c-3839-4baa-a9b5-aa9022de9a22 req-50d44845-f513-4891-944e-9e95af5e153e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.154266 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88f517ca-ccd8-45f0-a3dc-04aa0966b8e7 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.514073 Jun 18 22:08:57.155426 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1007/2017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:56 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:57.174839 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0fce3e6c-3839-4baa-a9b5-aa9022de9a22 req-50d44845-f513-4891-944e-9e95af5e153e service nova] Creating event network-changed:62d82a0f-55bf-4aaa-a72b-0128a6ac91ad for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:08:57.181780 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0fce3e6c-3839-4baa-a9b5-aa9022de9a22 req-50d44845-f513-4891-944e-9e95af5e153e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069736 Jun 18 22:08:57.183389 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1011/2018] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:08:57.210874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:57.211587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:57.232102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.233414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.234743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.235224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.249129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:57.249129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:57.264687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.265195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.265991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.266467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.671241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.681390 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c940758a-1464-47b5-90e3-82f7aa74be53 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1388 microversion: 2.1 time: 0.490233 Jun 18 22:08:57.693126 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1008/2019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:57 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1388 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:57.699393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-861532de-9e8d-4f6f-8a66-49d588edfe2b tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea141a5700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:57.757300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.767840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.768950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:57.770165 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3a9c64af-bd19-4cb8-8da3-1e4996c0e371 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.529521 Jun 18 22:08:57.781308 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1012/2020] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:57 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:08:57.781308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:57.781308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:57.788912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.790188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.806100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-861532de-9e8d-4f6f-8a66-49d588edfe2b tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.110887 Jun 18 22:08:57.806692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1009/2021] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:57 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:57.808582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.809245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.824596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:57.829590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:57.846953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.848915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:57.851843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:57.852742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:58.204490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:58.225241 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6d312c6-a308-437c-8c9f-f24b1f925a73 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.449298 Jun 18 22:08:58.235740 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1013/2022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:57 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:58.262590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:58.263541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:58.296267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:08:58.304272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:58.304734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:58.305568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:58.306018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:58.649703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:58.651939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:58.667102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:58.668914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:58.670372 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-639f564b-58a1-46fd-952f-4ffb005c06d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.433405 Jun 18 22:08:58.684841 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-552c10a7-b9ec-46b2-afbe-b48fa0fd0cc5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.850114 Jun 18 22:08:58.684841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1010/2023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:57 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:58.685829 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1014/2024] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:58 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:08:58.686899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:58.688771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:58.699032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:58.700038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:58.704829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:58.706105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:58.708298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:58.710562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:58.711315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:58.711742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:58.712675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:58.713103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.048346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:59.066965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-332be3b8-40dc-4b48-a38f-cd0a64239e5f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.386619 Jun 18 22:08:59.068080 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1011/2025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:58 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:59.073523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:59.074368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:59.091631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:59.092079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.093106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:59.095453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.103600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:59.114053 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cde5254e-e2a0-4fa5-b9ef-4b466eb74ea9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1388 microversion: 2.1 time: 0.419004 Jun 18 22:08:59.124737 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1015/2026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:58 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1388 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:59.142971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5fe915a-95bf-4e1a-aa22-83af4e475ba6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bc5c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:59.231090 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5fe915a-95bf-4e1a-aa22-83af4e475ba6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.104837 Jun 18 22:08:59.239151 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1016/2027] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:08:59 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:08:59.250892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:59.252056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:59.264270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:59.265109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.268570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:59.271086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.861347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:08:59.878747 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ade37fc-2d7c-4874-99f9-a62bb3a55875 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.635602 Jun 18 22:08:59.891893 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1017/2028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:59 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:08:59.907456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:08:59.908972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:08:59.935193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:59.936930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.939650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:08:59.947383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:08:59.987111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:00.004128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.035188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.041956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.044002 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7e2df487-ac7e-4489-bb17-ac6a545ab6fb tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.974552 Jun 18 22:09:00.048730 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1012/2029] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:08:59 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:00.063371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:00.063991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:00.087544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.088278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.089608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.090335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.278941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.290951 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e39ec0e9-42c4-418a-959f-930ff2384536 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.395558 Jun 18 22:09:00.291618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1018/2030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:08:59 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:00.302784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:00.303620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:00.310863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.311660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.312650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.313274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.508451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.535797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.543957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.554763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1968829-5d8b-4f51-972a-f5e13679628d tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.492226 Jun 18 22:09:00.556359 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1013/2031] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:00 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:00.563734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:00.564762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:00.572327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.573706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.575377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.576608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.616861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.629899 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9ce0202-a9fc-4aaa-b9ac-bec2a2d39e3f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.331039 Jun 18 22:09:00.642179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1019/2032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:00 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:00.644242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1e411a1-8623-4f66-82cc-2a01a80099db tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c6a820>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:00.740113 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1e411a1-8623-4f66-82cc-2a01a80099db tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.103308 Jun 18 22:09:00.741378 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1020/2033] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:00 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:00.755726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:00.793117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bd088304-ee37-442e-bcae-8654d1794339 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 200 len: 1346 microversion: 2.1 time: 0.234870 Jun 18 22:09:00.798348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-27533d51-b802-442e-ad9e-fc354ade2794 req-f78bcc86-d2cc-4f83-af64-4e8b71eacd68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "5d49787b-1805-487b-be9d-36fcc5e21b70"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:00.800247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1014/2034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:00 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 1346 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:00.816448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-27533d51-b802-442e-ad9e-fc354ade2794 req-f78bcc86-d2cc-4f83-af64-4e8b71eacd68 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.817812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-27533d51-b802-442e-ad9e-fc354ade2794 req-f78bcc86-d2cc-4f83-af64-4e8b71eacd68 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.854008 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-27533d51-b802-442e-ad9e-fc354ade2794 req-f78bcc86-d2cc-4f83-af64-4e8b71eacd68 service nova] Creating event network-changed:5d49787b-1805-487b-be9d-36fcc5e21b70 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:00.861211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-27533d51-b802-442e-ad9e-fc354ade2794 req-f78bcc86-d2cc-4f83-af64-4e8b71eacd68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078153 Jun 18 22:09:00.867010 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1021/2035] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:00.900662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:00.901459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:00.914746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.915719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:00.920165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:00.923603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.070073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:01.071186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:01.079788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.080682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.081830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.082500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.285124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:01.300520 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-26c53ce8-c817-4ba0-ae9f-b289c93bd89f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.404045 Jun 18 22:09:01.314679 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1015/2036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:00 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:01.328770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:01.333649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:01.357731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.358681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.361915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.362576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.708881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:01.733112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:01.738671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:01.744626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a77c525b-85ce-4c0c-8aad-db58da056ced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.427912 Jun 18 22:09:01.750585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:01.753829 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1016/2037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:01 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:01.755585 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-faf27b73-014d-4711-a2ef-c678c18b2d1e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.688487 Jun 18 22:09:01.773434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:01.774343 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1022/2038] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:01 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:01.782371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:01.782886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:01.784511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:01.803338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.805055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.805766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.806712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.807128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.807811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:01.812954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:01.820938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.299362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:02.308754 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f1ca772-1432-48fd-b563-eb02695a2216 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.532988 Jun 18 22:09:02.313814 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1023/2039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:01 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:02.319435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:02.329409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:02.336648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:02.338490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0471f259-ef07-4fbe-ad1b-1def1b5f7e5b tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bd5c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:02.343370 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa207f7d-39f1-4a0a-984d-0f7f8b41e33b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.588266 Jun 18 22:09:02.345426 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1017/2040] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:01 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:02.350854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:02.351765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: cdfbbf33-04a0-46d3-82ce-51afe2d4eae9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:02.361824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.362636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.364247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.364720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.384767 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] HTTP exception thrown: Instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 could not be found. Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Request method failure captured: Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 HTTP/1.1 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirktuYSmUqqaMyB3KW00wA8d5Z4VYCUbnuiMJIyDx0xCR0aZJ_VEODfu912VmZZ99pyDMKZO0EIXU_BeEHiXtyKfqjLGGjp3SWeGQULbxgmdjxxXwi7kbfCtIuLJvzN2YgXWwRQdoWEu-6ETLGTAINCXuW9HEMIHaDQXV823VjYENHiQ Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5c35ef36a81442b69cd93edc50ecb5bf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-LiveMigrationTest-536907989 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 681cfb0e560145b4abef98dbd417f3e0 Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 could not be found. Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'cdfbbf33-04a0-46d3-82ce-51afe2d4eae9'} Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 could not be found. Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 could not be found. Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:02.388508 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:02.395112 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:02.395112 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:02.395112 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:02.395112 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:02.395112 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 could not be found. Jun 18 22:09:02.395112 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:02.397577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Returning 404 to user: Instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:02.399203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a89ee051-381c-4c21-bd2d-2593aab0f700 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9" status: 404 len: 111 microversion: 2.1 time: 0.052365 Jun 18 22:09:02.403166 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1018/2041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:02 2022] GET /compute/v2.1/servers/cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:02.409648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:02.410342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:02.426752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.427803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.439903 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0471f259-ef07-4fbe-ad1b-1def1b5f7e5b tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.108907 Jun 18 22:09:02.440345 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1024/2042] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:02 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:02.441352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.441819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.448654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:02.719422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:02.731159 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2757e778-607e-4f0a-98a7-28c896d02078 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.328175 Jun 18 22:09:02.732330 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1019/2043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:02 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:02.777118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:02.778828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:02.788000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:02.790214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:02.795012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.796092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.797396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.798121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.840941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.844214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:02.850115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:02.850580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.347639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.368688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.373736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.375291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa8b0305-9a3c-4e17-8147-ba975e62cf25 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.603076 Jun 18 22:09:03.381991 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1020/2044] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:02 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:03.390179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfbbf33-04a0-46d3-82ce-51afe2d4eae9", "name": "network-vif-deleted", "tag": "6052a204-9eb6-4695-a8bc-55524ef614d9"}, {"name": "network-changed", "server_uuid": "f6f2e22e-50e0-4ce6-a216-f49f927fa6d8", "tag": "8cc0d016-5899-4de2-b140-bc2656bcb49c"}, {"name": "network-changed", "server_uuid": "317af96c-4307-42c7-bc40-fb9e18ad31bf", "tag": "99632f5c-c3a7-4cf2-8ff7-920ee86c9f73"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:03.412399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.427661 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55fc0c9a-12b8-45bf-aa33-79fd752ae273 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.657908 Jun 18 22:09:03.439875 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1025/2045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:02 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:03.449491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.451564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.459126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:03.461074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:03.481140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.481878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.485783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.486624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.497081 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] Creating event network-vif-deleted:6052a204-9eb6-4695-a8bc-55524ef614d9 for instance cdfbbf33-04a0-46d3-82ce-51afe2d4eae9 on nch1-master-1 Jun 18 22:09:03.498664 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] Creating event network-changed:8cc0d016-5899-4de2-b140-bc2656bcb49c for instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 on nch1-master-1 Jun 18 22:09:03.504043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] Creating event network-changed:99632f5c-c3a7-4cf2-8ff7-920ee86c9f73 for instance 317af96c-4307-42c7-bc40-fb9e18ad31bf on nch1-master-1 Jun 18 22:09:03.533197 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3d150536-861d-46b1-82e5-50e1e67553a1 req-ca892609-f96f-4f85-b566-d5703a2b0146 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.149551 Jun 18 22:09:03.535898 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1021/2046] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:03.553959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:03.555451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:03.574972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.576102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.578711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.579835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.777451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.790453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6da5952e-283a-4a8f-8355-fcaf6cfd9daa tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.348409 Jun 18 22:09:03.796041 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1026/2047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:03 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:03.802565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85329ca3-b650-4271-95a0-f9f5e0089249 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bdcee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:03.878735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.893208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.895622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:03.897782 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b02e206-2cb6-4c9f-ad34-9855459055c3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1486 microversion: 2.25 time: 0.358917 Jun 18 22:09:03.899240 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1022/2048] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:03 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1486 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:03.912540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85329ca3-b650-4271-95a0-f9f5e0089249 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.114194 Jun 18 22:09:03.922738 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1027/2049] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:03 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:03.924291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:03.924818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:03.929679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:03.930762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:03.956390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.958290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.961145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.962021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.969208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.970747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:03.972642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:03.977538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:04.068020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:04.219608 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5465c8f5-e03f-4fec-ada9-9ff115358091 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 204 len: 0 microversion: 2.1 time: 0.317389 Jun 18 22:09:04.222367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1023/2050] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:09:03 2022] DELETE /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:09:04.251449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:04.252698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:04.268968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:04.270428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:04.271743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:04.272007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:04.419437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:04.438057 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-010dee6d-7a37-4475-ad75-91cceaab0a14 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.511352 Jun 18 22:09:04.462360 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1028/2051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:03 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:04.475880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:04.479775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:04.498950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:04.503495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:04.503495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:04.503495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:04.659493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:04.675868 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c64da2da-25e5-4c07-ab1a-da173b535a70 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1669 microversion: 2.1 time: 0.434347 Jun 18 22:09:04.681760 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1024/2052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:04 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1669 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:04.692872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:04.694947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:04.716271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:04.716953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:04.719393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:04.721128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:05.192625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:05.211806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:05.216360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:05.221586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0fc4348d-678e-437b-9350-a2d5580dc219 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.756674 Jun 18 22:09:05.223051 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1029/2053] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:04 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:05.232212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:05.233851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:05.247276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:05.248590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:05.249850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:05.250533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:05.284415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:05.296578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5cf8021d-43dd-45d7-a76c-9b471d24bac1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.612635 Jun 18 22:09:05.297196 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1025/2054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:04 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:05.311318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:05.311899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:05.328858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:05.329355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:05.330130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:05.330577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.009760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.021625 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32c9c42d-5c4e-43a0-b8c1-aaf4d10ea2cd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.795796 Jun 18 22:09:06.022508 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1030/2055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:05 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:06.031777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-014b699a-852c-4475-a5d1-29c43ae53996 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d88790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:06.062662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.081980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.083572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.084799 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a08f2a39-7a13-4252-8cca-bf435a7d1bac tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1476 microversion: 2.25 time: 0.786658 Jun 18 22:09:06.104066 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-014b699a-852c-4475-a5d1-29c43ae53996 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.080422 Jun 18 22:09:06.104647 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1031/2056] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:06.114622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:06.115167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:06.116581 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1026/2057] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:05 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1476 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:06.121522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:06.122148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:06.133545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.134263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.135222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.135826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.141429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.147294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.148338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.149069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.563101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.571192 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-daa80c22-7fe2-4442-b773-b53d1fdfb52b tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1669 microversion: 2.1 time: 0.453389 Jun 18 22:09:06.581470 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1027/2058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1669 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:06.586287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83a1d815-d561-42b6-9fb0-bf593f67a9b5 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '.version_select at 0x7fea19cb3ee0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:06.588834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a1d815-d561-42b6-9fb0-bf593f67a9b5 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.589310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a1d815-d561-42b6-9fb0-bf593f67a9b5 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.600753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83a1d815-d561-42b6-9fb0-bf593f67a9b5 tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3200 microversion: 2.25 time: 0.018004 Jun 18 22:09:06.609529 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1028/2059] 10.222.0.30 () {60 vars in 1183 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/os-migrations => generated 3200 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:06.609529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:06.609529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:06.615339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.615868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.617005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.617204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.635305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.648847 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-50ab4d91-be1c-4597-aa5a-d20a5dbd6402 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.537481 Jun 18 22:09:06.650030 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1032/2060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:06.655835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:06.656513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:06.664467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.664935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.666603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.667309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:06.965634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.975980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.977626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.979325 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-362b8330-112b-465a-8af8-12bf54a3a2fa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.375836 Jun 18 22:09:06.979603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1029/2061] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:06.983529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:06.984202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-dc219c35-1c52-43c4-82e7-0e51990e6559 req-104a5074-7e73-46f9-8b98-fb6921d5fda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "name": "network-vif-plugged", "status": "completed", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:06.992717 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-df8c1776-09f2-42e1-ac92-7364439c3d82 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.341577 Jun 18 22:09:06.993196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dc219c35-1c52-43c4-82e7-0e51990e6559 req-104a5074-7e73-46f9-8b98-fb6921d5fda1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:06.993331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1033/2062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:06.993851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dc219c35-1c52-43c4-82e7-0e51990e6559 req-104a5074-7e73-46f9-8b98-fb6921d5fda1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.003699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.003699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:07.004623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.005113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.007257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.007641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-dc219c35-1c52-43c4-82e7-0e51990e6559 req-104a5074-7e73-46f9-8b98-fb6921d5fda1 service nova] Creating event network-vif-plugged:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:09:07.008283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.014625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-dc219c35-1c52-43c4-82e7-0e51990e6559 req-104a5074-7e73-46f9-8b98-fb6921d5fda1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Jun 18 22:09:07.016007 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1030/2063] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:07.044206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.055777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:07.065478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.067594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.069687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.071498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.377388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:07.377682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] Lazy-loading 'services' on Instance uuid 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:09:07.394791 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-07842419-4891-4bef-8c52-6ccefd691bab tempest-LiveAutoBlockMigrationV225Test-1069095063 tempest-LiveAutoBlockMigrationV225Test-1069095063-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1969 microversion: 2.25 time: 0.400191 Jun 18 22:09:07.395380 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1034/2064] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:06 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1969 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:07.405245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f976b228-298d-4d6d-b1ea-d527fb54d8e6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c04940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.405408 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d8dcc584-e063-4528-a73a-ef40e877f502 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.364870 Jun 18 22:09:07.414887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1031/2065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:07 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:07.444196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.444644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:07.478047 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f976b228-298d-4d6d-b1ea-d527fb54d8e6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.081407 Jun 18 22:09:07.478908 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1035/2066] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:07 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:07.489483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.489965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.490909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.491435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.547497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:07.589103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.589585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:07.605335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.605814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.606926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.607313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.656336 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b690bf7f-1991-48db-9925-1deac6114694 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 204 len: 0 microversion: 2.25 time: 0.221618 Jun 18 22:09:07.660361 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1032/2067] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:09:07 2022] DELETE /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:09:07.663292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-98409de7-d6c2-4b2d-b241-87b491102c7c req-c9ce329d-bd17-425d-a7bb-4c438ac34124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb05746-912a-4d02-97e9-03847508282d", "name": "network-vif-deleted", "tag": "b8a4cbe2-3d2d-48cf-b995-aed9139583a5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:07.674366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-98409de7-d6c2-4b2d-b241-87b491102c7c req-c9ce329d-bd17-425d-a7bb-4c438ac34124 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.675056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-98409de7-d6c2-4b2d-b241-87b491102c7c req-c9ce329d-bd17-425d-a7bb-4c438ac34124 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.689775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-98409de7-d6c2-4b2d-b241-87b491102c7c req-c9ce329d-bd17-425d-a7bb-4c438ac34124 service nova] Creating event network-vif-deleted:b8a4cbe2-3d2d-48cf-b995-aed9139583a5 for instance 2bb05746-912a-4d02-97e9-03847508282d on nch2-master-1 Jun 18 22:09:07.696555 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-98409de7-d6c2-4b2d-b241-87b491102c7c req-c9ce329d-bd17-425d-a7bb-4c438ac34124 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 Jun 18 22:09:07.698707 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1033/2068] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:07.704549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:07.709589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.711221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:07.718829 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85a02183-7960-4d76-895e-c8fd7519e29d tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 200 len: 1601 microversion: 2.1 time: 0.132947 Jun 18 22:09:07.719753 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1036/2069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:07 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 1601 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:07.722605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.722605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.723833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.724388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.731036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:07.731837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:07.740862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.741424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:07.742394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:07.742792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.026665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.037900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.038055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.040021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.041575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82e707c9-c50b-433e-8a89-fb2cd94289d1 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1482 microversion: 2.25 time: 0.320851 Jun 18 22:09:08.042337 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1037/2070] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:07 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1482 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:08.050458 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-774f337b-8d8b-458c-8264-c79295103561 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.350147 Jun 18 22:09:08.051377 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1034/2071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:07 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:08.053809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:08.054633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:08.057124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:08.057826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:08.061931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.062604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.063430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.063920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.065304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.066549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.071241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.071241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.091873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:08.360544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.368573 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64b2b784-46ad-4955-b2a5-fb5042413211 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.315476 Jun 18 22:09:08.369187 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1035/2072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:08 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:08.393765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.403055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.404543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.406031 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80e59e42-5c51-4985-9228-98ea073266aa tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.362485 Jun 18 22:09:08.416887 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1038/2073] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:08 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:08.419841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:08.420466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:08.427119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.427568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.428337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.428771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.492606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-128f992c-5666-4742-8851-a7ad88841954 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c10940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:08.549123 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-128f992c-5666-4742-8851-a7ad88841954 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.060995 Jun 18 22:09:08.550145 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1039/2074] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:08 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:08.601274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:08.611054 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3783bdd2-7544-483c-b079-8c203a7e7040 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.195108 Jun 18 22:09:08.611917 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1036/2075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:08 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:08.737408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:08.738733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2bb05746-912a-4d02-97e9-03847508282d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:08.752136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.753110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.754746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:08.755253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:08.806268 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] HTTP exception thrown: Instance 2bb05746-912a-4d02-97e9-03847508282d could not be found. Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Request method failure captured: Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d HTTP/1.1 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktuYSmUqqaMyB3KW00wA8d5Z4VYCUbnuiMJIyDx0xCR0aZJ_VEODfu912VmZZ99pyDMKZO0EIXU_BeEHiXtyKfqjLGGjp3SWeGQULbxgmdjxxXwi7kbfCtIuLJvzN2YgXWwRQdoWEu-6ETLGTAINCXuW9HEMIHaDQXV823VjYENHiQ Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5c35ef36a81442b69cd93edc50ecb5bf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveMigrationTest-536907989 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 681cfb0e560145b4abef98dbd417f3e0 Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2bb05746-912a-4d02-97e9-03847508282d could not be found. Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2bb05746-912a-4d02-97e9-03847508282d'} Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb05746-912a-4d02-97e9-03847508282d could not be found. Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb05746-912a-4d02-97e9-03847508282d could not be found. Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:08.809739 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb05746-912a-4d02-97e9-03847508282d could not be found. Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Returning 404 to user: Instance 2bb05746-912a-4d02-97e9-03847508282d could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:08.821396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2abb51f-1512-4085-8c0d-6480abe165de tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d" status: 404 len: 111 microversion: 2.1 time: 0.078004 Jun 18 22:09:08.824586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-34c360ff-59f9-42c1-a1cf-c4db0f801271 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '.version_select at 0x7fea19cb33a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:08.826739 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1040/2076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:08 2022] GET /compute/v2.1/servers/2bb05746-912a-4d02-97e9-03847508282d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:08.855684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-34c360ff-59f9-42c1-a1cf-c4db0f801271 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-328138441" status: 202 len: 0 microversion: 2.1 time: 0.038059 Jun 18 22:09:08.856070 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1037/2077] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:09:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-328138441 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:09.060670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:09.062408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:09.076355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:09.077054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:09.099495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.099959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.100767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.102366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.105725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.106651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.108269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.112091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.471058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.477519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.479916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.481577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.482911 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03261952-6917-4e3b-9fab-49ad4b8931ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1482 microversion: 2.25 time: 0.426903 Jun 18 22:09:09.483581 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1041/2078] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:09 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1482 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:09.488823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:09.489699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:09.495376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4eac11b8-6681-48d7-8285-3d5a7d032042 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.425035 Jun 18 22:09:09.496908 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1038/2079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:09 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:09.498251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.499038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.500098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.500763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.503372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:09.504231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:09.504383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:09.516730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.517731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.518544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.518988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.885652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.892566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.902629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.905320 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e4334c6-9cbf-41e1-af0f-0af4e00e1dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.418268 Jun 18 22:09:09.905962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:09.906514 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1042/2080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:09 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:09.907742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d7fdfa2-e045-437e-88b7-267a93740445 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.409466 Jun 18 22:09:09.919668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1039/2081] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:09 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:09.921445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af72d369-39d5-4bc5-a67a-22bc5582fc32 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19beb280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:09.926189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:09.927199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:09.934033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.934417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.935699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:09.936107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:09.976824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af72d369-39d5-4bc5-a67a-22bc5582fc32 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.069143 Jun 18 22:09:09.977743 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1043/2082] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:09 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:09.985696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e21792c4-dc31-4baf-ba49-7a105e80b6b9 req-227166e3-996d-4b24-a6c1-58332be091a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243a6f2b-0c2c-43f8-8e7e-5336fafa5f76", "name": "network-vif-deleted", "tag": "d9b7cbe4-2618-4090-ad3c-05ac7dce53ae"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:09.999619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e21792c4-dc31-4baf-ba49-7a105e80b6b9 req-227166e3-996d-4b24-a6c1-58332be091a9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.000175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e21792c4-dc31-4baf-ba49-7a105e80b6b9 req-227166e3-996d-4b24-a6c1-58332be091a9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.013324 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e21792c4-dc31-4baf-ba49-7a105e80b6b9 req-227166e3-996d-4b24-a6c1-58332be091a9 service nova] Creating event network-vif-deleted:d9b7cbe4-2618-4090-ad3c-05ac7dce53ae for instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 on nch2-master-1 Jun 18 22:09:10.018976 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e21792c4-dc31-4baf-ba49-7a105e80b6b9 req-227166e3-996d-4b24-a6c1-58332be091a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039746 Jun 18 22:09:10.019652 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1044/2083] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:10.071643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:10.072094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:10.081010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.081684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.082527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.083115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.131973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:10.145242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:10.158044 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6ce5393-e7e8-43f7-a2fe-465a7e02adb4 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.236881 Jun 18 22:09:10.159569 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1040/2084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:09 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:10.283556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60b2e590-baa1-4be7-8252-62bd86edcbd6 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 204 len: 0 microversion: 2.1 time: 0.216532 Jun 18 22:09:10.284516 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1045/2085] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:09:10 2022] DELETE /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:09:10.295694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:10.296382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:10.309162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.309626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.310439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.310884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.472503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:10.481142 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35f2e5fa-2f48-43d5-98a4-c62a55cb66bb tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1485 microversion: 2.1 time: 0.192397 Jun 18 22:09:10.481771 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1041/2086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:10 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1485 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:10.503318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:10.504264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:10.511402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.511875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.512736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:10.512864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.513305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.514083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:10.521231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.521931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.522930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.523523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.550656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.551178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.551781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lazy-loading 'fault' on Instance uuid 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:09:10.642455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:10.654859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:10.656944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:10.658615 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-576d882f-d3d3-4f8d-bdb9-279a4e44f3a7 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 200 len: 1271 microversion: 2.25 time: 0.160667 Jun 18 22:09:10.659874 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1046/2087] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:10 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:10.718955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:10.727247 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-708efbcf-67b4-4331-841f-a325cd413dd7 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1523 microversion: 2.1 time: 0.219382 Jun 18 22:09:10.727898 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1042/2088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:10 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:10.923445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:10.924721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:10.926638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:10.927301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:10.931887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.932349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.933262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.933732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.934500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.934948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:10.935858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:10.936825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.126988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:11.139989 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-19a632f4-b34f-41ad-bd01-1f03dd736e25 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.221036 Jun 18 22:09:11.157433 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1047/2089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:10 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:11.165801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca5e83b5-c617-4912-b6b9-4449071f2666 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bc54c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:11.294968 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca5e83b5-c617-4912-b6b9-4449071f2666 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.135586 Jun 18 22:09:11.295865 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1048/2090] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:11 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:11.307081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:11.313447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:11.323652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.324113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.326212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.326660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.447737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:11.467690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:11.481909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:11.485351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-021dc416-0f57-4681-a682-dca123ff79f8 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.561805 Jun 18 22:09:11.487268 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1043/2091] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:10 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:11.510178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:11.511045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:11.523162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.523620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.526371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.526850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.734728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:11.743256 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5731048-6fe7-4dcf-912d-c93045423d7d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.446077 Jun 18 22:09:11.743850 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1049/2092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:11 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:11.757465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:11.758235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:11.767093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.767845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.768814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.769448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.769774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:11.780869 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f8e8122-9abb-41da-9a26-9658cc648116 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1485 microversion: 2.1 time: 0.286197 Jun 18 22:09:11.782844 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1044/2093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:11 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1485 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:11.787032 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] HTTP exception thrown: Instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 could not be found. Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Request method failure captured: Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 HTTP/1.1 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkt1buvZZgwsO_AkfFuNBm_cg8qMk1M1NuoVKe13WaZm-TLLNcDoereiu743uy02ws7MbYm1DwPM9LXFIJvdVLQ9-fubmu5uJfOMqbvzh3ltilVMwt91SsWnHSlwpFjL1C2L42y74P6Ajjfgi9MWcSiPmne_41GHE6bT9C_a8TzgNeY Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.25 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9f0a0c26a5b846f0a657fa8810da9d71", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 76897f7be7494bb589de747493240449 Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 could not be found. Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '243a6f2b-0c2c-43f8-8e7e-5336fafa5f76'} Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 could not be found. Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 could not be found. Jun 18 22:09:11.788910 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 could not be found. Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Returning 404 to user: Instance 243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-461646e4-9430-4370-9a45-5fd348df7fe5 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76" status: 404 len: 111 microversion: 2.25 time: 0.041025 Jun 18 22:09:11.795330 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1050/2094] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:11 2022] GET /compute/v2.1/servers/243a6f2b-0c2c-43f8-8e7e-5336fafa5f76 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:09:11.804659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:11.805589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:11.823548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.824430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:11.825562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:11.826240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.137923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:12.166830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:12.167559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:12.169320 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9305b944-d9ef-485b-bc5c-a027eb6bbb1c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1505 microversion: 2.1 time: 0.385003 Jun 18 22:09:12.170165 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1045/2095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:11 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:12.184824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:12.185609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.186700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:12.187631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.311226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c60290a0-c213-4827-9be2-ecbac61132bc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d1f9d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:12.413578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c60290a0-c213-4827-9be2-ecbac61132bc tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.108274 Jun 18 22:09:12.422551 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1046/2096] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:12 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:12.430383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:12.441771 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4856aa9d-ad9c-4416-b861-0bb7664ec610 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.280829 Jun 18 22:09:12.442978 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1051/2097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:12 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:12.506729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:12.507439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:12.520076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:12.536451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:12.538609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.541422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:12.542621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.760393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:12.761289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:12.779599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:12.782408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.783405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:12.783849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:12.967686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:12.983100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:12.998158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:13.008908 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d213515d-8409-41a3-ba4c-1b31da581f06 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.508227 Jun 18 22:09:13.027067 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1047/2098] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:12 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:13.040225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:13.041202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:13.064899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.065333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.066568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.067249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.184394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:13.196391 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-87fd4bab-e12a-4b63-96b6-bd998ba5020f tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.440121 Jun 18 22:09:13.200416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1052/2099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:12 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:13.208186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9b0a39ae-4625-40f2-b040-69d0a2d19105 req-aa5e3dde-d33e-4985-a44b-df9b6c3a3b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317af96c-4307-42c7-bc40-fb9e18ad31bf", "name": "network-vif-plugged", "status": "completed", "tag": "99632f5c-c3a7-4cf2-8ff7-920ee86c9f73"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:13.229640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9b0a39ae-4625-40f2-b040-69d0a2d19105 req-aa5e3dde-d33e-4985-a44b-df9b6c3a3b95 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.230206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9b0a39ae-4625-40f2-b040-69d0a2d19105 req-aa5e3dde-d33e-4985-a44b-df9b6c3a3b95 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.255257 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9b0a39ae-4625-40f2-b040-69d0a2d19105 req-aa5e3dde-d33e-4985-a44b-df9b6c3a3b95 service nova] Creating event network-vif-plugged:99632f5c-c3a7-4cf2-8ff7-920ee86c9f73 for instance 317af96c-4307-42c7-bc40-fb9e18ad31bf on nch1-master-1 Jun 18 22:09:13.266166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9b0a39ae-4625-40f2-b040-69d0a2d19105 req-aa5e3dde-d33e-4985-a44b-df9b6c3a3b95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064280 Jun 18 22:09:13.269718 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1053/2100] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:13.275658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:13.278200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:13.294471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.297679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.299650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.300204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.334824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:13.348032 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37023b3d-383a-4782-bddb-7f2589bb0026 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1485 microversion: 2.1 time: 0.319651 Jun 18 22:09:13.348979 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1048/2101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:13 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1485 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:13.349490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:13.361516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:13.362155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:13.378748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.385943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.387200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.387986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.521376 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d97b227d-f952-427d-b0c5-1b45b773ac17 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 204 len: 0 microversion: 2.25 time: 0.249660 Jun 18 22:09:13.521980 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1054/2102] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:09:13 2022] DELETE /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:09:13.533230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-daab3eb8-46a8-450c-92ec-7f617f94c8da tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d88d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:13.622969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-daab3eb8-46a8-450c-92ec-7f617f94c8da tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.096061 Jun 18 22:09:13.623848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1055/2103] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:13 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:13.627515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:13.629844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:13.631299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:13.638636 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73642c90-09a5-4b64-afa2-f8fe8691a647 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1505 microversion: 2.1 time: 0.282877 Jun 18 22:09:13.639440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.640073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.641420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.642517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.652159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1049/2104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:13 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:13.657751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:13.658387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:13.665146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.665874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.666839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:13.667453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:13.934381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:13.944716 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ee23835-b4bb-41cf-8a58-eb56652051ff tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.318939 Jun 18 22:09:13.944716 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1056/2105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:13 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:13.980536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:13.988753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1f6d3ff4-50cb-4a6e-9ab0-b850744d155f req-205bdda9-0dcd-4083-b632-8b16503c0537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2915c85a-6454-4b71-9078-0375b4fbdc7e", "name": "network-vif-deleted", "tag": "b9ec270a-bd87-4e67-83fd-6757c8bfb188"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:13.998876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.001494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1f6d3ff4-50cb-4a6e-9ab0-b850744d155f req-205bdda9-0dcd-4083-b632-8b16503c0537 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.002631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1f6d3ff4-50cb-4a6e-9ab0-b850744d155f req-205bdda9-0dcd-4083-b632-8b16503c0537 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.003353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.004671 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4ec3f5d-498f-4f8f-9222-a06321892f67 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1731 microversion: 2.25 time: 0.351269 Jun 18 22:09:14.005264 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1050/2106] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:13 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:14.017546 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1f6d3ff4-50cb-4a6e-9ab0-b850744d155f req-205bdda9-0dcd-4083-b632-8b16503c0537 service nova] Creating event network-vif-deleted:b9ec270a-bd87-4e67-83fd-6757c8bfb188 for instance 2915c85a-6454-4b71-9078-0375b4fbdc7e on nch2-master-1 Jun 18 22:09:14.024749 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1f6d3ff4-50cb-4a6e-9ab0-b850744d155f req-205bdda9-0dcd-4083-b632-8b16503c0537 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038287 Jun 18 22:09:14.032238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1057/2107] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:09:14.042566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:14.043222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:14.064454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.065288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.067997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.068443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.217659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:14.219075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:14.232646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.233381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.234400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.237638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.360268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.380881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.384993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.388775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27982074-2ba6-463d-af5c-6e5c0dfa8456 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.350503 Jun 18 22:09:14.392182 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1051/2108] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:14 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:14.399460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:14.400352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:14.409016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.409798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.411104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.411715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.468379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.469427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.470643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lazy-loading 'fault' on Instance uuid 2915c85a-6454-4b71-9078-0375b4fbdc7e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:09:14.528963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.542939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.546299 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-026ba1a7-f37c-486f-bafd-aa7742135938 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.333995 Jun 18 22:09:14.558639 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1058/2109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:14 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:14.567427 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f332d20-e985-4517-8157-ef84f9ccc2a2 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 200 len: 1300 microversion: 2.1 time: 0.173070 Jun 18 22:09:14.583042 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1052/2110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:14 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:14.636401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e74839a3-1126-408b-9bd9-0a34f3fd1ba9 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bc5d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:14.659677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:14.660983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:14.674628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.680219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.681354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.681539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.696691 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e74839a3-1126-408b-9bd9-0a34f3fd1ba9 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.064472 Jun 18 22:09:14.697594 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1059/2111] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:14 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:14.728675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:14.962600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:14.963228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:14.972001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.972772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.973871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:14.974796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:14.975349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:14.989331 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88d12d7b-12c6-44ec-8b50-918e53c4cb0f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1505 microversion: 2.1 time: 0.328170 Jun 18 22:09:14.999692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1053/2112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:14 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:15.029576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:15.036511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:15.048473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.058231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:15.060387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.061942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:15.186118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:15.201865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:15.203831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:15.205358 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ce4f404-b86a-4eaa-b94d-fc0f3b845b2b tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 200 len: 1664 microversion: 2.25 time: 0.186539 Jun 18 22:09:15.206131 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1054/2113] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:15 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:09:15.244580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:15.253212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed984b5f-4e52-499e-bbf6-4d2b26632708 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.295170 Jun 18 22:09:15.257350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1060/2114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:14 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:15.348878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6161b70b-e461-4b4f-aff7-a7982729550f req-1e5cf7ce-a57f-42a5-b2c0-0ad01e4b5992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2e22e-50e0-4ce6-a216-f49f927fa6d8", "name": "network-vif-plugged", "status": "completed", "tag": "8cc0d016-5899-4de2-b140-bc2656bcb49c"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:15.360006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6161b70b-e461-4b4f-aff7-a7982729550f req-1e5cf7ce-a57f-42a5-b2c0-0ad01e4b5992 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.360483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6161b70b-e461-4b4f-aff7-a7982729550f req-1e5cf7ce-a57f-42a5-b2c0-0ad01e4b5992 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:15.379814 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6161b70b-e461-4b4f-aff7-a7982729550f req-1e5cf7ce-a57f-42a5-b2c0-0ad01e4b5992 service nova] Creating event network-vif-plugged:8cc0d016-5899-4de2-b140-bc2656bcb49c for instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 on nch1-master-1 Jun 18 22:09:15.389815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6161b70b-e461-4b4f-aff7-a7982729550f req-1e5cf7ce-a57f-42a5-b2c0-0ad01e4b5992 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043303 Jun 18 22:09:15.391636 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1055/2115] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:15.409741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:15.410394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:15.422998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.423759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:15.424720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.425340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:15.586469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:15.587410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:15.618586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.623531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:15.625873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:15.626345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.411124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:16.415274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:16.438360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:16.444590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:16.446533 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4b07fb8-e4c7-4e4f-bcaf-1528672b054c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 1.040903 Jun 18 22:09:16.449629 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1061/2116] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:15 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:16.470090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:16.474141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 2915c85a-6454-4b71-9078-0375b4fbdc7e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:16.489933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.491087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.495133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.496013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.539795 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] HTTP exception thrown: Instance 2915c85a-6454-4b71-9078-0375b4fbdc7e could not be found. Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Request method failure captured: Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e HTTP/1.1 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktuYSmUqqaMyB3KW00wA8d5Z4VYCUbnuiMJIyDx0xCR0aZJ_VEODfu912VmZZ99pyDMKZO0EIXU_BeEHiXtyKfqjLGGjp3SWeGQULbxgmdjxxXwi7kbfCtIuLJvzN2YgXWwRQdoWEu-6ETLGTAINCXuW9HEMIHaDQXV823VjYENHiQ Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5c35ef36a81442b69cd93edc50ecb5bf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveMigrationTest-536907989 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 681cfb0e560145b4abef98dbd417f3e0 Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2915c85a-6454-4b71-9078-0375b4fbdc7e could not be found. Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2915c85a-6454-4b71-9078-0375b4fbdc7e'} Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2915c85a-6454-4b71-9078-0375b4fbdc7e could not be found. Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2915c85a-6454-4b71-9078-0375b4fbdc7e could not be found. Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.542064 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:16.547673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:16.547673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:16.547673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:16.547673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:16.547673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2915c85a-6454-4b71-9078-0375b4fbdc7e could not be found. Jun 18 22:09:16.547673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.551252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Returning 404 to user: Instance 2915c85a-6454-4b71-9078-0375b4fbdc7e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:16.555961 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-805fea1f-817e-4dde-a5ea-3b83301f50e9 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e" status: 404 len: 111 microversion: 2.1 time: 0.104528 Jun 18 22:09:16.560130 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1062/2117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:16 2022] GET /compute/v2.1/servers/2915c85a-6454-4b71-9078-0375b4fbdc7e => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:16.573835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b8611b1-49bd-4896-9c8d-f695f03f7f8e tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c964c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:16.596707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:16.609776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c76eba0-4819-49d2-bfb2-67d5b30cb1dd tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 1.046377 Jun 18 22:09:16.610839 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1056/2118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:15 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:16.616703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:16.617633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:16.625295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.625802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.626600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.627040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.650517 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b8611b1-49bd-4896-9c8d-f695f03f7f8e tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.088765 Jun 18 22:09:16.651415 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1063/2119] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:16 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:16.657766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8e84170c-57d1-4798-a57b-a9c94541f9c3 req-8577770c-c145-4ec2-8ffa-999d6b96a176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "603306c7-a28f-4251-985a-cc026c0c8c88", "name": "network-vif-deleted", "tag": "963a24d1-6bea-4f74-9e48-b072afd4e070"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:16.670852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8e84170c-57d1-4798-a57b-a9c94541f9c3 req-8577770c-c145-4ec2-8ffa-999d6b96a176 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.671547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8e84170c-57d1-4798-a57b-a9c94541f9c3 req-8577770c-c145-4ec2-8ffa-999d6b96a176 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.691594 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8e84170c-57d1-4798-a57b-a9c94541f9c3 req-8577770c-c145-4ec2-8ffa-999d6b96a176 service nova] Creating event network-vif-deleted:963a24d1-6bea-4f74-9e48-b072afd4e070 for instance 603306c7-a28f-4251-985a-cc026c0c8c88 on nch2-master-1 Jun 18 22:09:16.705966 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8e84170c-57d1-4798-a57b-a9c94541f9c3 req-8577770c-c145-4ec2-8ffa-999d6b96a176 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052591 Jun 18 22:09:16.706589 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1064/2120] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:16.713267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:16.718408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: 603306c7-a28f-4251-985a-cc026c0c8c88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:16.731545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.732281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.733307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.733984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.781167 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] HTTP exception thrown: Instance 603306c7-a28f-4251-985a-cc026c0c8c88 could not be found. Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Request method failure captured: Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 HTTP/1.1 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkt1buvZZgwsO_AkfFuNBm_cg8qMk1M1NuoVKe13WaZm-TLLNcDoereiu743uy02ws7MbYm1DwPM9LXFIJvdVLQ9-fubmu5uJfOMqbvzh3ltilVMwt91SsWnHSlwpFjL1C2L42y74P6Ajjfgi9MWcSiPmne_41GHE6bT9C_a8TzgNeY Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.25 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9f0a0c26a5b846f0a657fa8810da9d71", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 76897f7be7494bb589de747493240449 Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 603306c7-a28f-4251-985a-cc026c0c8c88 could not be found. Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '603306c7-a28f-4251-985a-cc026c0c8c88'} Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 603306c7-a28f-4251-985a-cc026c0c8c88 could not be found. Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 603306c7-a28f-4251-985a-cc026c0c8c88 could not be found. Jun 18 22:09:16.783018 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 603306c7-a28f-4251-985a-cc026c0c8c88 could not be found. Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Returning 404 to user: Instance 603306c7-a28f-4251-985a-cc026c0c8c88 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:16.789415 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a906e4c7-28e7-4cf3-b8f8-1885da24a2b3 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88" status: 404 len: 111 microversion: 2.25 time: 0.076045 Jun 18 22:09:16.793204 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1065/2121] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:16 2022] GET /compute/v2.1/servers/603306c7-a28f-4251-985a-cc026c0c8c88 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:09:16.805520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:16.806265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:16.815596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.816205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.817232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.817795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.856943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:16.869878 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72ae2940-9460-4edf-853d-808ceaac1843 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1505 microversion: 2.1 time: 0.256123 Jun 18 22:09:16.877105 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1057/2122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:16 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:16.881188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:16.881720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:16.889070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.900781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.901719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:16.902160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:16.961955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:17.051145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:17.074574 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12836eba-3589-4b04-af1f-3d68a337fced tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.277792 Jun 18 22:09:17.075175 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1066/2123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:16 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:17.087408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-283d1fcc-afd3-448d-88d6-f42fdbcdf1ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '.version_select at 0x7fea19bd5940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:17.126196 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-283d1fcc-afd3-448d-88d6-f42fdbcdf1ef tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502729623" status: 204 len: 0 microversion: 2.25 time: 0.049669 Jun 18 22:09:17.127730 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1067/2124] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502729623 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:09:17.171621 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed37df08-a7ed-4840-9c33-c211b6c021da tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 204 len: 0 microversion: 2.1 time: 0.296829 Jun 18 22:09:17.172920 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1058/2125] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:09:16 2022] DELETE /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:09:17.181479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:17.182382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:17.193783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:17.196029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.201404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:17.203924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.209647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:17.421463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:17.430827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec5dd7ff-63e0-4693-a413-7cd5bd65cb17 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1499 microversion: 2.1 time: 0.253674 Jun 18 22:09:17.432756 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1068/2126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:17 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1499 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:17.469610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:17.470517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:17.566937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.566937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:17.570764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8dc3baad-6116-4af3-8f5a-0331ce36f4eb req-74b85351-e0ce-4f89-9d8c-376e251450d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a462d18-117e-4b5d-965c-4f16125395e8", "name": "network-vif-unplugged", "status": "completed", "tag": "7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:17.571240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.571240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:17.582671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8dc3baad-6116-4af3-8f5a-0331ce36f4eb req-74b85351-e0ce-4f89-9d8c-376e251450d9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.583286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8dc3baad-6116-4af3-8f5a-0331ce36f4eb req-74b85351-e0ce-4f89-9d8c-376e251450d9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:17.648772 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8dc3baad-6116-4af3-8f5a-0331ce36f4eb req-74b85351-e0ce-4f89-9d8c-376e251450d9 service nova] Creating event network-vif-unplugged:7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5 for instance 2a462d18-117e-4b5d-965c-4f16125395e8 on nch1-master-1 Jun 18 22:09:17.661289 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8dc3baad-6116-4af3-8f5a-0331ce36f4eb req-74b85351-e0ce-4f89-9d8c-376e251450d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.183596 Jun 18 22:09:17.665143 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1069/2127] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:17.675889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:17.676595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:17.701842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.702299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:17.703573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:17.703573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.321787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:18.336143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:18.338181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:18.339629 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6fa4dba5-3801-40e9-8e96-c53c720fc1ad tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.876051 Jun 18 22:09:18.340421 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1059/2128] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:17 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:18.345990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de4c427a-6abf-442d-8313-60e016f6fa8c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d0e0d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:18.386415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:18.399046 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4a4d43de-5efd-4a49-aacb-46beaa49f0ad tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1403 microversion: 2.1 time: 0.730388 Jun 18 22:09:18.401259 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1070/2129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:17 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1403 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:18.406135 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de4c427a-6abf-442d-8313-60e016f6fa8c tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.064221 Jun 18 22:09:18.410171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:18.412171 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1060/2130] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:18 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:18.413057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:18.418162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:18.419050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:18.427011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.427700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.428693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.429219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.429777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.430040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.430789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.431276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.658315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:18.661947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:18.671582 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-feb7d856-16a6-4355-8dd6-3c55701cc805 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 200 len: 1508 microversion: 2.1 time: 0.269081 Jun 18 22:09:18.673088 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1071/2131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:18 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:18.674114 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a20c6ee-0c0c-4fe4-91a7-8b7081aa6c60 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.260293 Jun 18 22:09:18.683496 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1061/2132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:18 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:18.683496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:18.683496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:18.688589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:18.689392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.689876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:18.690027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.690897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.691523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.697803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.698946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.700042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.700820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.726745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:18.861524 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b3ad408-1253-4ad8-bb62-631024b0a71c tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 204 len: 0 microversion: 2.25 time: 0.184500 Jun 18 22:09:18.866159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1062/2133] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:09:18 2022] DELETE /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:09:18.881477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:18.882038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:18.893098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.893513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.894331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:18.894770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:18.941826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:18.949277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.api [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Working on deleting snapshot 95a37b27-81b9-4f08-b0a5-b64733a1cac0 from shelved instance... Jun 18 22:09:19.030448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.042875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d0df8c3e-4ab4-4627-968b-474db440d617 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1499 microversion: 2.1 time: 0.368335 Jun 18 22:09:19.043607 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1072/2134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:18 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1499 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:19.050251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:19.050907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:19.059423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.059876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.060666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.061147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.230007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.246646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.252218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.253713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9f45817-e7fc-4b59-94fb-372811ed5e40 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 200 len: 1547 microversion: 2.25 time: 0.208605 Jun 18 22:09:19.255135 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1073/2135] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:19 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 1547 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:19.359718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:19.360348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:19.375292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.375744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.376529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.377182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.825465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.841691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.843719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:19.848180 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9127f96d-3484-4c10-91e7-bf3a12b64382 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.493828 Jun 18 22:09:19.851904 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1074/2136] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:19 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:09:19.865135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:19.871350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:19.881337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.882158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.883240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.884675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.933974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Doing local delete in cell d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=130902) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 18 22:09:19.939093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:19.939697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:19.940272 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.api [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 18 22:09:19.949957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] deallocate_for_instance() {{(pid=130902) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 18 22:09:20.495778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:20.506600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a658a915-bf12-4c6e-af0b-7f31dcd57f58 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1589 microversion: 2.1 time: 0.653329 Jun 18 22:09:20.507453 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1075/2137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:19 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1589 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:20.516831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-42358209-b1ea-43e7-bbb1-f8086ab9d911 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c10820>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:20.604266 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-42358209-b1ea-43e7-bbb1-f8086ab9d911 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.091254 Jun 18 22:09:20.604780 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1076/2138] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:20 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:20.621625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:20.622774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:20.635050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:20.641695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:20.643039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:20.643680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:20.924972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:20.937197 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08eba040-f534-44e0-a71b-64a16b7a7151 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.329449 Jun 18 22:09:20.938378 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1077/2139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:20 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:20.943920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:20.944760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:20.951863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:20.952585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:20.953650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:20.955331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.053067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:21.064358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a786fa91-3143-4a48-9fb2-7336c4f6638f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1457 microversion: 2.1 time: 0.124333 Jun 18 22:09:21.078550 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1078/2140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:20 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1457 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:21.087868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.089559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:21.108487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.109656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.111652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.112322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.143512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] HTTP exception thrown: Instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 could not be found. Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Request method failure captured: Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 HTTP/1.1 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkt1buvZZgwsO_AkfFuNBm_cg8qMk1M1NuoVKe13WaZm-TLLNcDoereiu743uy02ws7MbYm1DwPM9LXFIJvdVLQ9-fubmu5uJfOMqbvzh3ltilVMwt91SsWnHSlwpFjL1C2L42y74P6Ajjfgi9MWcSiPmne_41GHE6bT9C_a8TzgNeY Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.25 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9f0a0c26a5b846f0a657fa8810da9d71", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 76897f7be7494bb589de747493240449 Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 could not be found. Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79'} Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 could not be found. Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 could not be found. Jun 18 22:09:21.145677 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 could not be found. Jun 18 22:09:21.151127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.153005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Returning 404 to user: Instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:21.154106 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-593d399d-2131-43b9-a7f6-708129bbfd21 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79" status: 404 len: 111 microversion: 2.25 time: 0.073992 Jun 18 22:09:21.174864 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1079/2141] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/servers/c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:09:21.186968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-76c42f76-8903-44f8-83ee-eb1a281a438e req-4e039390-6e04-4dc5-84d9-56dd5549131c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79", "name": "network-vif-deleted", "tag": "bd8a15a9-02da-4737-bf34-0f1ed6541286"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:21.204190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-76c42f76-8903-44f8-83ee-eb1a281a438e req-4e039390-6e04-4dc5-84d9-56dd5549131c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.205467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-76c42f76-8903-44f8-83ee-eb1a281a438e req-4e039390-6e04-4dc5-84d9-56dd5549131c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.229551 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-76c42f76-8903-44f8-83ee-eb1a281a438e req-4e039390-6e04-4dc5-84d9-56dd5549131c service nova] Creating event network-vif-deleted:bd8a15a9-02da-4737-bf34-0f1ed6541286 for instance c9f8f8c4-ac65-49c9-89d3-6c1befc3ca79 on nch2-master-1 Jun 18 22:09:21.235784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-76c42f76-8903-44f8-83ee-eb1a281a438e req-4e039390-6e04-4dc5-84d9-56dd5549131c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059444 Jun 18 22:09:21.236974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1080/2142] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:21.243989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.245009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:21.253335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.254049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.255162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.261591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.300882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Updating instance_info_cache with network_info: [] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:09:21.385606 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7dccb8e4-261f-4018-87a9-5bbbd4227716 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146980 Jun 18 22:09:21.386561 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1081/2143] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:21.410067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ab4da283-62d5-4edb-af8b-0fb632328bbe req-6084561c-bd12-4f85-adb9-70c4a9587656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a20c148-622e-4917-8183-cd467bf2a83b", "name": "network-vif-deleted", "tag": "b627e490-670e-4ea0-8156-cc7b8534fc17"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:21.435825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ab4da283-62d5-4edb-af8b-0fb632328bbe req-6084561c-bd12-4f85-adb9-70c4a9587656 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.437186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ab4da283-62d5-4edb-af8b-0fb632328bbe req-6084561c-bd12-4f85-adb9-70c4a9587656 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.459393 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ab4da283-62d5-4edb-af8b-0fb632328bbe req-6084561c-bd12-4f85-adb9-70c4a9587656 service nova] Creating event network-vif-deleted:b627e490-670e-4ea0-8156-cc7b8534fc17 for instance 6a20c148-622e-4917-8183-cd467bf2a83b on nch1-master-1 Jun 18 22:09:21.488321 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ab4da283-62d5-4edb-af8b-0fb632328bbe req-6084561c-bd12-4f85-adb9-70c4a9587656 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100222 Jun 18 22:09:21.491370 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1082/2144] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:21.507261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.509717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:21.521536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.522098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.523814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.524394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.713744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=10,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:21.756830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:21.762630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06323f72-c8f6-47cd-accc-73a466433946 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 204 len: 0 microversion: 2.1 time: 2.894477 Jun 18 22:09:21.763647 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1063/2145] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:09:18 2022] DELETE /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 0 bytes in 2897 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:09:21.768978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-861a7fe7-7407-4f41-a1e3-20de0dc75790 req-6b953d25-bd1a-4c51-8488-50bdf3c1ccc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "a7f7354f-e621-46bf-8827-3e2bff0d2ff4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:21.772540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:21.774243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:21.775602 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be5ff3b9-6772-4e1d-af82-cdb08fe97636 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.281687 Jun 18 22:09:21.786974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1083/2146] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:21.792006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-861a7fe7-7407-4f41-a1e3-20de0dc75790 req-6b953d25-bd1a-4c51-8488-50bdf3c1ccc3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.792772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-861a7fe7-7407-4f41-a1e3-20de0dc75790 req-6b953d25-bd1a-4c51-8488-50bdf3c1ccc3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.793694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.794823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:21.804989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.805545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.806558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.807221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.811502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-861a7fe7-7407-4f41-a1e3-20de0dc75790 req-6b953d25-bd1a-4c51-8488-50bdf3c1ccc3 service nova] Creating event network-vif-plugged:a7f7354f-e621-46bf-8827-3e2bff0d2ff4 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:21.817490 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-861a7fe7-7407-4f41-a1e3-20de0dc75790 req-6b953d25-bd1a-4c51-8488-50bdf3c1ccc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052265 Jun 18 22:09:21.819099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1064/2147] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:21.826494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7af94063-5eaa-402c-ba3b-8f9ae2cb136a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19da0f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.848810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:21.881786 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7af94063-5eaa-402c-ba3b-8f9ae2cb136a tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.061284 Jun 18 22:09:21.887778 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1065/2148] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:21.893304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.894281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:21.902613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.903165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.904040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.904559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.923738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 HTTP/1.1 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2a462d18-117e-4b5d-965c-4f16125395e8'} Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:21.925918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:09:21.931701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:21.932291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:21.932769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:21.932769 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d2f53214-5635-46de-840a-1db690175a64 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 404 len: 111 microversion: 2.1 time: 0.039043 Jun 18 22:09:21.935307 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1066/2149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:21.963735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.965123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:21.971146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10276ace-7afb-4bf7-8e57-21e9bab45717 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "DELETE /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 204 len: 0 microversion: 2.25 time: 0.192817 Jun 18 22:09:21.975170 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1084/2150] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:09:21 2022] DELETE /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:09:21.980057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.980493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.981363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:21.981831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:21.991167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:21.992140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:22.010034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.012220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.013490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.014139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.213564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:22.227392 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4478c9ad-0fa4-4aaa-a3eb-20d7bcc7d250 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.271832 Jun 18 22:09:22.230516 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1067/2151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:22.237459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:22.238101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:22.245268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.245910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.246746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.247180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.253989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:22.265749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:22.267862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:22.269966 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d816d9e7-757f-436f-836f-4228f6840a01 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1563 microversion: 2.25 time: 0.288709 Jun 18 22:09:22.282225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1085/2152] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:21 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1563 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:22.301237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-249943581", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:22.332935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:22.351148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0622b3d-5e24-4225-af5e-1f22a2264cc1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1457 microversion: 2.1 time: 0.118804 Jun 18 22:09:22.352296 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1068/2153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:22 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1457 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:22.378845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:09:22.795177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:22.796016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:22.808680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.810302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.811344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.818209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.949987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:09:22.952575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:09:22.952718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:09:22.953295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:09:22.954842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:09:22.969060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.969521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.970326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:22.970753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:22.995330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:09:23.001389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:09:23.018396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:09:23.021235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:09:23.108534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.122029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.123788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.125244 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e57a40c9-1b2c-4072-9aa5-17e2881015ba tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.334213 Jun 18 22:09:23.126359 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1069/2154] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:22 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:09:23.129295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7429eb8a-59cb-4f48-bc10-d92adc287bb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844924 Jun 18 22:09:23.134560 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1086/2155] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:09:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:09:23.134713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e41b1c83-2ea0-418f-8692-d696d01d1269 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dcb4c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:23.154242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ad17635-4f4a-4a5f-99d8-ffa2015a7842 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:23.158796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2ad17635-4f4a-4a5f-99d8-ffa2015a7842 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:23.179221 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e41b1c83-2ea0-418f-8692-d696d01d1269 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.051347 Jun 18 22:09:23.180678 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1070/2156] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:23 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:23.240773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ad17635-4f4a-4a5f-99d8-ffa2015a7842 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.246502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:23.247308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:23.252873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ad17635-4f4a-4a5f-99d8-ffa2015a7842 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1214 microversion: 2.1 time: 0.104335 Jun 18 22:09:23.253823 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1087/2157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:23 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:23.258503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.259039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.261907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.262429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.299236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:23.300670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:23.313009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.313765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.314733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.315351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.591180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.609971 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fb8fa97-c2a1-4432-a4cf-4452c8078694 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.367298 Jun 18 22:09:23.612000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.621537 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1071/2158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:23 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:23.621537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:23.621537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:23.621856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.622386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76897f7be7494bb589de747493240449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0a0c26a5b846f0a657fa8810da9d71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.641882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.642353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.643175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.645691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.645940 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-13db6c71-ee4d-476c-9837-e35108817161 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 200 len: 1563 microversion: 2.25 time: 0.360089 Jun 18 22:09:23.654395 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1088/2159] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:23 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 1563 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:23.685586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-61a0710e-9452-4eb8-9a2a-e2af46f25def req-bcdf792a-963f-417e-bcfa-1d77df5e7b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a462d18-117e-4b5d-965c-4f16125395e8", "name": "network-vif-deleted", "tag": "7b2615ee-bfe0-4d33-9b10-af2c27c9e5a5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:23.727755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61a0710e-9452-4eb8-9a2a-e2af46f25def req-bcdf792a-963f-417e-bcfa-1d77df5e7b1b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.728238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61a0710e-9452-4eb8-9a2a-e2af46f25def req-bcdf792a-963f-417e-bcfa-1d77df5e7b1b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.780552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_external_events [req-61a0710e-9452-4eb8-9a2a-e2af46f25def req-bcdf792a-963f-417e-bcfa-1d77df5e7b1b service nova] Unable to find a host for instance 2a462d18-117e-4b5d-965c-4f16125395e8. Dropping event network-vif-deleted {{(pid=130903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 22:09:23.791281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-61a0710e-9452-4eb8-9a2a-e2af46f25def req-bcdf792a-963f-417e-bcfa-1d77df5e7b1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.135554 Jun 18 22:09:23.794678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:23.795953 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1089/2160] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 141 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 18 22:09:23.809624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0333a74b-0db2-4de5-88b8-6d46db48eb33 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1457 microversion: 2.1 time: 0.193581 Jun 18 22:09:23.812893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:23.813728 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1072/2161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:23 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1457 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:23.827736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:23.838498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.838498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.839335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.839822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.845200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6ff0875a-9572-4051-bb80-024f0537ba4f req-eea3dc84-ff61-4d0a-ac81-79f12fdff3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317af96c-4307-42c7-bc40-fb9e18ad31bf", "tag": "99632f5c-c3a7-4cf2-8ff7-920ee86c9f73"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:23.857847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6ff0875a-9572-4051-bb80-024f0537ba4f req-eea3dc84-ff61-4d0a-ac81-79f12fdff3aa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:23.864425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6ff0875a-9572-4051-bb80-024f0537ba4f req-eea3dc84-ff61-4d0a-ac81-79f12fdff3aa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:23.900760 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6ff0875a-9572-4051-bb80-024f0537ba4f req-eea3dc84-ff61-4d0a-ac81-79f12fdff3aa service nova] Creating event network-changed:99632f5c-c3a7-4cf2-8ff7-920ee86c9f73 for instance 317af96c-4307-42c7-bc40-fb9e18ad31bf on nch1-master-1 Jun 18 22:09:23.914974 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6ff0875a-9572-4051-bb80-024f0537ba4f req-eea3dc84-ff61-4d0a-ac81-79f12fdff3aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085602 Jun 18 22:09:23.917543 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1073/2162] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:24.089233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:24.097212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-96a3c7e0-c8ac-40e4-bada-bb7c63fb2c64 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1589 microversion: 2.1 time: 0.300084 Jun 18 22:09:24.110484 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1090/2163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:23 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1589 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:24.133948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d842a65f-e1a3-416a-b10f-9a9680075292 req-692616bd-da8f-4bc8-bdb3-603b918a025c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "6a0a73d3-2b87-4e05-a042-2a9468fbabf2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:24.150833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:24.151448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:24.177763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d842a65f-e1a3-416a-b10f-9a9680075292 req-692616bd-da8f-4bc8-bdb3-603b918a025c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.178376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d842a65f-e1a3-416a-b10f-9a9680075292 req-692616bd-da8f-4bc8-bdb3-603b918a025c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.194731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.212819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.213921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.214378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.230542 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d842a65f-e1a3-416a-b10f-9a9680075292 req-692616bd-da8f-4bc8-bdb3-603b918a025c service nova] Creating event network-vif-plugged:6a0a73d3-2b87-4e05-a042-2a9468fbabf2 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:24.242948 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d842a65f-e1a3-416a-b10f-9a9680075292 req-692616bd-da8f-4bc8-bdb3-603b918a025c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115425 Jun 18 22:09:24.246392 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1074/2164] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:24.262299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63b99984-3319-4c1c-871e-cd0b60553af7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19da08b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:24.345841 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-63b99984-3319-4c1c-871e-cd0b60553af7 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.096983 Jun 18 22:09:24.350103 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1075/2165] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:24 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:24.379216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:24.381593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:24.400421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.400421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.409302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.411232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.685124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:24.700951 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-734dddf8-0540-411d-bbe9-ab72932af1f3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1266 microversion: 2.1 time: 0.345589 Jun 18 22:09:24.704329 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1076/2166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:24 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:24.717563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:24.726167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:24.752734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.753264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.756485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.762442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.864845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:24.883692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:24.889944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:24.897443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ec58ef2-3a44-4efc-a39f-f445c1db64f5 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.756552 Jun 18 22:09:24.902735 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1091/2167] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:24 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:24.920551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:24.928038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] [instance: afb0ac13-8caa-4624-a0d1-bbc8e938f068] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:24.953734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.955432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:24.959860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:24.960564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.004881 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] HTTP exception thrown: Instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 could not be found. Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Request method failure captured: Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 HTTP/1.1 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkt1buvZZgwsO_AkfFuNBm_cg8qMk1M1NuoVKe13WaZm-TLLNcDoereiu743uy02ws7MbYm1DwPM9LXFIJvdVLQ9-fubmu5uJfOMqbvzh3ltilVMwt91SsWnHSlwpFjL1C2L42y74P6Ajjfgi9MWcSiPmne_41GHE6bT9C_a8TzgNeY Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.25 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9f0a0c26a5b846f0a657fa8810da9d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9f0a0c26a5b846f0a657fa8810da9d71", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 9f0a0c26a5b846f0a657fa8810da9d71 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 76897f7be7494bb589de747493240449 Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1058311696-project Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 could not be found. Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'afb0ac13-8caa-4624-a0d1-bbc8e938f068'} Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 could not be found. Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 could not be found. Jun 18 22:09:25.015500 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 could not be found. Jun 18 22:09:25.020946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:25.031348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] Returning 404 to user: Instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:25.034658 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9dd2a874-deb0-492a-a52a-3510120a1872 tempest-LiveAutoBlockMigrationV225Test-1058311696 tempest-LiveAutoBlockMigrationV225Test-1058311696-project] 10.222.0.30 "GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068" status: 404 len: 111 microversion: 2.25 time: 0.128993 Jun 18 22:09:25.042080 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1092/2168] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:24 2022] GET /compute/v2.1/servers/afb0ac13-8caa-4624-a0d1-bbc8e938f068 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:09:25.061085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:25.063988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:25.081244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.089225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.092026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.094604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.380903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:25.394902 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c20f9331-954b-4db6-881f-9c518f6fed65 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.686919 Jun 18 22:09:25.399663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1077/2169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:24 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:25.409422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:25.424329 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a76a46fe-c968-49ec-9d1e-bbd20459c34f tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1457 microversion: 2.1 time: 0.379222 Jun 18 22:09:25.428350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1093/2170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:25 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1457 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:25.429957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-352ed3a9-ca5e-435a-ae7d-dae3612c6618 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea1423d430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:25.503355 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-352ed3a9-ca5e-435a-ae7d-dae3612c6618 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.102280 Jun 18 22:09:25.512620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1078/2171] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:25 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:25.721383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:25.722335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:25.736890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.737764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.738751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.739381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.914138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:25.926102 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9955b4c4-803a-4eed-9ed0-b568419232b8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1272 microversion: 2.1 time: 0.208874 Jun 18 22:09:25.926966 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1094/2172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:25 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:25.932209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:25.932915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:25.941637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.942380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.943179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.943620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:25.960232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6101f391-766d-454a-847d-c89cd6dcc8ee req-44743417-8412-4181-b701-b1595ea5cad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0ac13-8caa-4624-a0d1-bbc8e938f068", "name": "network-vif-deleted", "tag": "3ffec254-22f3-4483-b4ed-5f41380ce50c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:25.983917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6101f391-766d-454a-847d-c89cd6dcc8ee req-44743417-8412-4181-b701-b1595ea5cad9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:25.985611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6101f391-766d-454a-847d-c89cd6dcc8ee req-44743417-8412-4181-b701-b1595ea5cad9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.014398 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6101f391-766d-454a-847d-c89cd6dcc8ee req-44743417-8412-4181-b701-b1595ea5cad9 service nova] Creating event network-vif-deleted:3ffec254-22f3-4483-b4ed-5f41380ce50c for instance afb0ac13-8caa-4624-a0d1-bbc8e938f068 on nch2-master-1 Jun 18 22:09:26.035139 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6101f391-766d-454a-847d-c89cd6dcc8ee req-44743417-8412-4181-b701-b1595ea5cad9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086806 Jun 18 22:09:26.039225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1095/2173] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:26.333137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "76c427aa-55d9-476e-888c-c83eaf8976e0"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "f8b3e4e4-8c18-4595-9154-6af81f221d72"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "5d49787b-1805-487b-be9d-36fcc5e21b70"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:26.360806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.367552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.399481 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] Creating event network-vif-plugged:76c427aa-55d9-476e-888c-c83eaf8976e0 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:26.402885 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] Creating event network-vif-plugged:f8b3e4e4-8c18-4595-9154-6af81f221d72 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:26.408382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] Creating event network-vif-plugged:5d49787b-1805-487b-be9d-36fcc5e21b70 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:26.420175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5b06c302-029f-4077-be4e-69bdf689bf39 req-a850760e-c8b6-4440-a10a-cded076418ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.093019 Jun 18 22:09:26.421199 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1096/2174] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:09:26.432842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:26.434236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:26.448045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.450163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.451958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.452641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.722643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:26.736708 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bcafa981-108b-490b-b400-21feef972198 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1318 microversion: 2.1 time: 0.314006 Jun 18 22:09:26.743361 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1097/2175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:26 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:26.753518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:26.754650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:26.765322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.766056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.767042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.767646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.818809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:26.835695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:26.839252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:26.840850 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88802f21-3969-469d-9323-3850cdb77336 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.923601 Jun 18 22:09:26.841142 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1079/2176] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:25 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:09:26.861829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf29efbd-70e9-451a-9f87-501a6d04bb08 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d1fb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:26.863042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.863676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.864431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lazy-loading 'fault' on Instance uuid 6a20c148-622e-4917-8183-cd467bf2a83b {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:09:26.942397 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf29efbd-70e9-451a-9f87-501a6d04bb08 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.090480 Jun 18 22:09:26.942942 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1080/2177] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:26 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:26.955317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:26.955952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:26.962975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681cfb0e560145b4abef98dbd417f3e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c35ef36a81442b69cd93edc50ecb5bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:26.975021 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77c3e954-89ab-464a-9b6d-d2c2321624bc tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 200 len: 1300 microversion: 2.1 time: 0.230094 Jun 18 22:09:26.982203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.982688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.985378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:26.985854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:26.986920 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1098/2178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:26 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 1300 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:27.219357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:27.227543 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d760d08-7fc0-47a9-b095-ceea713f158b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.278102 Jun 18 22:09:27.228133 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1081/2179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:26 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:27.762521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:27.764032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:27.782397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:27.789768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:27.795098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:27.808620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:27.864520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:27.869321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:27.924748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:27.925476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:27.927428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:27.932788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:28.980001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:28.997664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55fdc2d4-58c0-4f53-98a7-953e04c36b84 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1507 microversion: 2.1 time: 1.241695 Jun 18 22:09:29.009177 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1099/2180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:27 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1507 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:29.025294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98e5d639-9f27-472f-afc3-98750cd110f0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19c815e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:29.081868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:29.099487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:29.099974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98e5d639-9f27-472f-afc3-98750cd110f0 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.089373 Jun 18 22:09:29.101347 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1100/2181] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:29 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:29.106105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:29.107372 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc9fe56f-97bf-48e0-aecc-2b44c9b25181 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 1.251937 Jun 18 22:09:29.110329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:29.111928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] [instance: 6a20c148-622e-4917-8183-cd467bf2a83b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:29.113267 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1082/2182] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:27 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:29.122366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e595d538-268c-4fc1-b12d-e8c9decb6c3a req-48ae85f7-40f4-4083-8ca8-a999b6e9bfec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4543c2-b1ba-4e6c-8f6c-95c6621054fd", "tag": "43f6447f-9a81-4394-8c6e-2d915eecc788"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:29.122665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.123291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.124736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.125369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.147551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e595d538-268c-4fc1-b12d-e8c9decb6c3a req-48ae85f7-40f4-4083-8ca8-a999b6e9bfec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.148006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e595d538-268c-4fc1-b12d-e8c9decb6c3a req-48ae85f7-40f4-4083-8ca8-a999b6e9bfec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.150150 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] HTTP exception thrown: Instance 6a20c148-622e-4917-8183-cd467bf2a83b could not be found. Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Request method failure captured: Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b HTTP/1.1 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirktuYSmUqqaMyB3KW00wA8d5Z4VYCUbnuiMJIyDx0xCR0aZJ_VEODfu912VmZZ99pyDMKZO0EIXU_BeEHiXtyKfqjLGGjp3SWeGQULbxgmdjxxXwi7kbfCtIuLJvzN2YgXWwRQdoWEu-6ETLGTAINCXuW9HEMIHaDQXV823VjYENHiQ Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c35ef36a81442b69cd93edc50ecb5bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5c35ef36a81442b69cd93edc50ecb5bf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-LiveMigrationTest-536907989 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 5c35ef36a81442b69cd93edc50ecb5bf Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-LiveMigrationTest-536907989 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 681cfb0e560145b4abef98dbd417f3e0 Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-LiveMigrationTest-536907989-project Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6a20c148-622e-4917-8183-cd467bf2a83b could not be found. Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6a20c148-622e-4917-8183-cd467bf2a83b'} Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a20c148-622e-4917-8183-cd467bf2a83b could not be found. Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a20c148-622e-4917-8183-cd467bf2a83b could not be found. Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:29.152350 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:29.157701 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:29.157701 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:29.157701 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:29.157701 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:29.157701 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a20c148-622e-4917-8183-cd467bf2a83b could not be found. Jun 18 22:09:29.157701 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:29.159889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] Returning 404 to user: Instance 6a20c148-622e-4917-8183-cd467bf2a83b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:29.160944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-652cb1da-efab-4479-81ee-bb6c938732c1 tempest-LiveMigrationTest-536907989 tempest-LiveMigrationTest-536907989-project] 10.222.0.30 "GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b" status: 404 len: 111 microversion: 2.1 time: 0.057626 Jun 18 22:09:29.162931 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1101/2183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:29 2022] GET /compute/v2.1/servers/6a20c148-622e-4917-8183-cd467bf2a83b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:29.167748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:29.168587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:29.173824 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e595d538-268c-4fc1-b12d-e8c9decb6c3a req-48ae85f7-40f4-4083-8ca8-a999b6e9bfec service nova] Creating event network-changed:43f6447f-9a81-4394-8c6e-2d915eecc788 for instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd on nch2-master-1 Jun 18 22:09:29.176184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.176865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.177884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.178477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.196258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e595d538-268c-4fc1-b12d-e8c9decb6c3a req-48ae85f7-40f4-4083-8ca8-a999b6e9bfec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078563 Jun 18 22:09:29.197251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1083/2184] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:29.212280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b538bb55-b8a7-422f-bd9e-8539d14e0211 req-2a9a4055-5d9d-4675-bbb0-12a28782a44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "d0e4b550-68d2-4471-a8ac-9a423214fa64"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-plugged", "status": "completed", "tag": "62d82a0f-55bf-4aaa-a72b-0128a6ac91ad"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:29.238628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b538bb55-b8a7-422f-bd9e-8539d14e0211 req-2a9a4055-5d9d-4675-bbb0-12a28782a44e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.239083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b538bb55-b8a7-422f-bd9e-8539d14e0211 req-2a9a4055-5d9d-4675-bbb0-12a28782a44e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.270100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b538bb55-b8a7-422f-bd9e-8539d14e0211 req-2a9a4055-5d9d-4675-bbb0-12a28782a44e service nova] Creating event network-vif-plugged:d0e4b550-68d2-4471-a8ac-9a423214fa64 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:29.271485 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b538bb55-b8a7-422f-bd9e-8539d14e0211 req-2a9a4055-5d9d-4675-bbb0-12a28782a44e service nova] Creating event network-vif-plugged:62d82a0f-55bf-4aaa-a72b-0128a6ac91ad for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:29.280614 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b538bb55-b8a7-422f-bd9e-8539d14e0211 req-2a9a4055-5d9d-4675-bbb0-12a28782a44e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076826 Jun 18 22:09:29.286779 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1084/2185] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:29.296459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:29.299031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:29.320445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.321542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.327857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.328907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.742447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:29.760953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:29.777598 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-03ecef61-0860-4b69-a748-c4698572e98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1507 microversion: 2.1 time: 0.489114 Jun 18 22:09:29.781670 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0ce3c57-f545-4409-a5ac-887c85e314a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.617475 Jun 18 22:09:29.782272 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1085/2186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:29 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:29.786608 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1102/2187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:29 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:29.799022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:29.800176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:29.822761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.823242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.824438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:29.824887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:29.996832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7749a527-bbea-4a0a-986a-b161055eab16 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "PUT /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1079 microversion: 2.1 time: 0.201012 Jun 18 22:09:30.008915 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1086/2188] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:09:29 2022] PUT /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1079 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:30.014034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:30.015633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:30.048803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.049539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.050519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.051133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.114709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15fd9c57-bddc-4da6-9491-729352900726 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19dc3160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:30.190822 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15fd9c57-bddc-4da6-9491-729352900726 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1425 microversion: 2.1 time: 0.080672 Jun 18 22:09:30.196704 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1087/2189] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:30 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1425 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:30.206629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:30.207274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:30.215031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.215820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.217066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.217676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.249524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:UPDATE=9,nova_cell1:DELETE=2,nova_cell1:SELECT=89 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:30.599179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:30.617075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cea3a3a8-72bf-461a-9096-538b6e455f4f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1505 microversion: 2.1 time: 0.606351 Jun 18 22:09:30.619722 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1103/2190] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:30 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:30.632944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:30.633871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:30.641070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.641699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.642646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.643244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.713023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:30.722570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:30.724079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:30.725291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7aa82029-5d52-4009-b207-12e21f605aaf tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.531383 Jun 18 22:09:30.726352 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1088/2191] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:30 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:30.803961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:30.805227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:30.811796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.812239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.813068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.813619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.869067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:30.878099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7a96db4a-9180-4f35-a747-ede76343564c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1505 microversion: 2.1 time: 0.248861 Jun 18 22:09:30.880679 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1104/2192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:30 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:30.895474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:30.897456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:30.904418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.904986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:30.906135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:30.906654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.041437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:09:31.042996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:09:31.043798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:09:31.044503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:09:31.045324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:09:31.094933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:31.106340 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f0e6156-0f00-464b-89d4-b49376fe9fb2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.306477 Jun 18 22:09:31.119697 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1089/2193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:30 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:31.120455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:31.138680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:31.149715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.150957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.152462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.153354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.200957 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc83bb6d-59f5-4b27-b6d1-65424348b9c5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "POST /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8/action" status: 202 len: 1111 microversion: 2.1 time: 0.309869 Jun 18 22:09:31.213818 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1105/2194] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:09:30 2022] POST /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8/action => generated 1111 bytes in 315 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 18 22:09:31.214046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-74babdf2-f5b0-439d-a7c2-b9d6e21154bb tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea1423d790>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:31.220097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:31.220673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:31.223941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:31.238995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.239488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.244686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.245214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.286179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-74babdf2-f5b0-439d-a7c2-b9d6e21154bb tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1434 microversion: 2.1 time: 0.085639 Jun 18 22:09:31.287403 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1090/2195] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:31 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1434 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:31.300193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b4384a5-a611-4346-a649-5ae581e18100 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19d1fb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:31.397949 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b4384a5-a611-4346-a649-5ae581e18100 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 200 len: 1434 microversion: 2.1 time: 0.102692 Jun 18 22:09:31.398837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1091/2196] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:31 2022] GET /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 1434 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:31.411476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:31.412103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:31.419066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.419531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.420324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.420769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.502082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:31.513350 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f069b2b0-17b1-4941-8993-bdd7620c6e06 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.297491 Jun 18 22:09:31.516412 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1106/2197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:31 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:31.684206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:31.704617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-810fd50b-62f3-428a-9ff3-65812941e6ed tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1467 microversion: 2.1 time: 0.293342 Jun 18 22:09:31.706101 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1092/2198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:31 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1467 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:31.729996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7ed77f4-d59d-46d6-8b28-92dadc0c5a3f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea19bd5160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:31.744117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:31.744746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:31.755797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.756319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:31.757076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:31.757697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.163089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:32.176796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:32.187166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:32.188433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c62b334-9694-4659-8955-737e941c1584 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1875 microversion: 2.32 time: 0.448466 Jun 18 22:09:32.189023 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1093/2199] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:31 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1875 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:09:32.194975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:32.195633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:32.218340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.218805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.219629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.220054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.413927 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7ed77f4-d59d-46d6-8b28-92dadc0c5a3f tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "DELETE /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35" status: 204 len: 0 microversion: 2.1 time: 0.688246 Jun 18 22:09:32.414492 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1107/2200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:31 2022] DELETE /compute/v2.1/images/abdbd293-adec-4ed8-86e3-e23dafc9da35 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:09:32.424740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ad3288c-8e1d-4290-9240-ab01d3bb4ec6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '.version_select at 0x7fea07a10310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:32.480403 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8ad3288c-8e1d-4290-9240-ab01d3bb4ec6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] HTTP exception thrown: Image not found. Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ad3288c-8e1d-4290-9240-ab01d3bb4ec6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Request method failure captured: Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 HTTP/1.1 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkypCB4vdSBuEcZURhpgOUh-H32lGMmAIaHbH8tEDBbxlmDypt4y9it63klELyO5k-O3DqUxe76emTLPI0LEI6hcsZ733TJYauOGYh4dduUebzO-sMPh_34G95m2YBn7nAAOOA5Yp29MzwLr_jTUKxZVyqKRAyi-rxhh1zG8ppuvJKA Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 0f681d806f354b8682bdae077a9ece40 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f681d806f354b8682bdae077a9ece40", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 0f681d806f354b8682bdae077a9ece40 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerTestJSON-738529669-project Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: dd075f9744d644e38be2333789563d12 Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerTestJSON-738529669-project Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd655fd40-24c9-4462-9728-5bb82395efd5'} Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d655fd40-24c9-4462-9728-5bb82395efd5 to delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d655fd40-24c9-4462-9728-5bb82395efd5 could not be found. Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.482216 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ad3288c-8e1d-4290-9240-ab01d3bb4ec6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8ad3288c-8e1d-4290-9240-ab01d3bb4ec6 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "DELETE /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5" status: 404 len: 62 microversion: 2.1 time: 0.064975 Jun 18 22:09:32.489182 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1108/2201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:32 2022] DELETE /compute/v2.1/images/d655fd40-24c9-4462-9728-5bb82395efd5 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:09:32.493822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:32.495422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:32.506502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.507813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.511510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.512268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.553370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:09:32.557882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:32.569269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9572941-376c-40d4-824a-8078f9a5f54f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.379105 Jun 18 22:09:32.569874 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1094/2202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:32 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:32.578935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:32.578935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:32.597049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:32.599301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.600500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.601804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.602515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.673568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a44ef4d3-23d5-49ee-bfeb-8a67b6e14968 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 204 len: 0 microversion: 2.1 time: 0.183446 Jun 18 22:09:32.678056 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1109/2203] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:09:32 2022] DELETE /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:09:32.689224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:32.691653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:32.701286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.702109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.703536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:32.704229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:32.981300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:33.015843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:33.025534 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1248481e-0f4d-4ea2-af64-8db02a429b70 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.454222 Jun 18 22:09:33.026545 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1095/2204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:32 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:33.028383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:33.036718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b42ef59-873e-4485-9803-2c00df584661 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1473 microversion: 2.1 time: 0.357151 Jun 18 22:09:33.048178 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1110/2205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:32 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:33.211847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:33.214429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:33.223710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:33.224583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:33.225673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:33.226372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:33.514118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:33.524427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:33.526717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:33.528077 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f594b6c-6480-438c-b49a-59f6eabbd007 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2827 microversion: 2.32 time: 0.324230 Jun 18 22:09:33.528713 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1096/2206] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:33 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2827 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:33.547477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:33.548576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:33.551563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:33.556417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:33.557103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:33.557900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:33.558335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:33.585622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:33.586248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:33.596464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:33.596917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:33.597813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:33.598146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:34.189154 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-289b8c06-9c3f-4070-8b62-3bc53db436c9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.645584 Jun 18 22:09:34.189769 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1111/2207] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:09:33 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e/os-interface => generated 1831 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:34.194513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:34.195055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:34.216290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:34.216744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:34.217740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:34.218726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:34.438150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:34.451494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-85ac6002-67cd-4ed9-a3ba-cbce75ee9195 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.869092 Jun 18 22:09:34.452861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1097/2208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:33 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:34.458876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:34.459778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:34.460646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:34.468785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:34.469289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:34.470108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:34.470424 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac1f1203-6bd1-4535-add5-c2cda9b5dff7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.279506 Jun 18 22:09:34.470573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:34.473590 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1112/2209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:34 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:34.663642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:34.672682 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f9669402-a3cb-41e1-a61e-1e2b1d3b1e73 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1473 microversion: 2.1 time: 0.218415 Jun 18 22:09:34.673702 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1098/2210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:34 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1473 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:34.882830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-de976d61-5f52-4d1a-a056-34a3e7243752 req-45c420e9-9f84-4eb6-bcc1-8a390f1bedfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "name": "network-vif-unplugged", "status": "completed", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:34.894061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-de976d61-5f52-4d1a-a056-34a3e7243752 req-45c420e9-9f84-4eb6-bcc1-8a390f1bedfc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:34.894801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-de976d61-5f52-4d1a-a056-34a3e7243752 req-45c420e9-9f84-4eb6-bcc1-8a390f1bedfc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.134110 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-de976d61-5f52-4d1a-a056-34a3e7243752 req-45c420e9-9f84-4eb6-bcc1-8a390f1bedfc service nova] Creating event network-vif-unplugged:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:09:35.138944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-de976d61-5f52-4d1a-a056-34a3e7243752 req-45c420e9-9f84-4eb6-bcc1-8a390f1bedfc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.260064 Jun 18 22:09:35.139944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1113/2211] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:09:35.468794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:35.469621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:35.478011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:35.478496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.479281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:35.480276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.491006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:35.491680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:35.498716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:35.499530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.500347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:35.501026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.694914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:35.703233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:35.706148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f61f7d9-dd3e-45f9-8b70-b59a9fefc3e9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.241440 Jun 18 22:09:35.706833 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1099/2212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:35 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:35.715959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:35.716990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:35.719205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81c8274f-2cf9-4deb-8aca-9182ee9ad998 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.232606 Jun 18 22:09:35.719801 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1114/2213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:35 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:35.727598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:35.728530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.729766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:35.730279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:35.929949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:35.941641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-328e34ad-b662-473b-b511-de9e7a624d84 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1473 microversion: 2.1 time: 0.233158 Jun 18 22:09:35.942721 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1100/2214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:35 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:36.730290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-886d7b4b-68b4-4206-874e-ee8c2a94fed8 req-8a029033-b501-422a-9a78-6d2ef0a0149e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a2cb3f-bb3a-4fec-a429-afb37d886bf8", "name": "network-vif-deleted", "tag": "1116b50c-9968-4f6a-a552-b19578922be8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:36.737349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:36.738612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:36.754242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-886d7b4b-68b4-4206-874e-ee8c2a94fed8 req-8a029033-b501-422a-9a78-6d2ef0a0149e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:36.757853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:36.758503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:36.759278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:36.759710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:36.763807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-886d7b4b-68b4-4206-874e-ee8c2a94fed8 req-8a029033-b501-422a-9a78-6d2ef0a0149e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:36.776452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-886d7b4b-68b4-4206-874e-ee8c2a94fed8 req-8a029033-b501-422a-9a78-6d2ef0a0149e service nova] Creating event network-vif-deleted:1116b50c-9968-4f6a-a552-b19578922be8 for instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 on nch1-master-1 Jun 18 22:09:36.789508 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-886d7b4b-68b4-4206-874e-ee8c2a94fed8 req-8a029033-b501-422a-9a78-6d2ef0a0149e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067378 Jun 18 22:09:36.790416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1101/2215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:36.796925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:36.798385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:36.806840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:36.807826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:36.808887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:36.809402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:37.014344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:37.027623 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-202615b2-34fd-4791-b19a-c0f0c75fb248 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.307767 Jun 18 22:09:37.036999 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1115/2216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:36 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:37.036999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:37.036999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:37.042619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:37.057267 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02f2c1ae-167b-4d3e-bbfa-2926bbeb0268 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.263242 Jun 18 22:09:37.058981 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1102/2217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:36 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:37.066982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:37.067862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:37.068475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:37.068984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:37.117381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:37.118111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:37.118746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lazy-loading 'fault' on Instance uuid a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:09:37.165750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e2acd34a-f5ec-4769-86ca-8471aec3a0f9 req-afeac08c-ae0b-4a08-9b2c-322c81083e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4543c2-b1ba-4e6c-8f6c-95c6621054fd", "name": "network-vif-plugged", "status": "completed", "tag": "43f6447f-9a81-4394-8c6e-2d915eecc788"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:37.178766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e2acd34a-f5ec-4769-86ca-8471aec3a0f9 req-afeac08c-ae0b-4a08-9b2c-322c81083e72 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:37.179488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e2acd34a-f5ec-4769-86ca-8471aec3a0f9 req-afeac08c-ae0b-4a08-9b2c-322c81083e72 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:37.194806 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e2acd34a-f5ec-4769-86ca-8471aec3a0f9 req-afeac08c-ae0b-4a08-9b2c-322c81083e72 service nova] Creating event network-vif-plugged:43f6447f-9a81-4394-8c6e-2d915eecc788 for instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd on nch2-master-1 Jun 18 22:09:37.207908 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e2acd34a-f5ec-4769-86ca-8471aec3a0f9 req-afeac08c-ae0b-4a08-9b2c-322c81083e72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050289 Jun 18 22:09:37.208771 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1103/2218] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:09:37.228584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd075f9744d644e38be2333789563d12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f681d806f354b8682bdae077a9ece40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:37.237279 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd46fef1-5aea-4234-847e-37f784f64515 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 200 len: 1307 microversion: 2.1 time: 0.206719 Jun 18 22:09:37.237945 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1116/2219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:37 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 1307 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:38.045495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:38.046262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:38.058378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:38.058833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:38.059661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:38.060103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:38.077859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:38.079319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:38.094286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:38.097601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:38.098703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:38.099155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:38.417753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:38.426997 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d77249ed-b17e-42f4-8a71-0238f519b361 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1314 microversion: 2.1 time: 0.386637 Jun 18 22:09:38.436226 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1104/2220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:38 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:38.448754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:38.449981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] [instance: a2a2cb3f-bb3a-4fec-a429-afb37d886bf8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:38.451195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:38.458116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:38.458823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:38.459855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:38.460528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:38.461572 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1923a9bb-45d0-47e1-8cd4-434db3da9898 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.388912 Jun 18 22:09:38.475770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1117/2221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:38 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:38.477406 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] HTTP exception thrown: Instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 could not be found. Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Request method failure captured: Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 HTTP/1.1 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkypCB4vdSBuEcZURhpgOUh-H32lGMmAIaHbH8tEDBbxlmDypt4y9it63klELyO5k-O3DqUxe76emTLPI0LEI6hcsZ733TJYauOGYh4dduUebzO-sMPh_34G95m2YBn7nAAOOA5Yp29MzwLr_jTUKxZVyqKRAyi-rxhh1zG8ppuvJKA Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 0f681d806f354b8682bdae077a9ece40 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f681d806f354b8682bdae077a9ece40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f681d806f354b8682bdae077a9ece40", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 0f681d806f354b8682bdae077a9ece40 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-738529669 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerTestJSON-738529669-project Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: dd075f9744d644e38be2333789563d12 Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerTestJSON-738529669-project Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 could not be found. Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a2a2cb3f-bb3a-4fec-a429-afb37d886bf8'} Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 could not be found. Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 could not be found. Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:38.479735 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 could not be found. Jun 18 22:09:38.484972 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:38.486451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] Returning 404 to user: Instance a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:38.487448 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-32c5d1e4-e618-44a5-934f-3607e7081fe4 tempest-ImagesOneServerTestJSON-738529669 tempest-ImagesOneServerTestJSON-738529669-project] 10.222.0.30 "GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8" status: 404 len: 111 microversion: 2.1 time: 0.044471 Jun 18 22:09:38.491580 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1105/2222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:38 2022] GET /compute/v2.1/servers/a2a2cb3f-bb3a-4fec-a429-afb37d886bf8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:39.186305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5c8f3af6-2c2b-484d-8b04-bc7fe0c4da39 req-e125fe6d-b61e-4df8-a740-fb7b3664a652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "tag": "76c427aa-55d9-476e-888c-c83eaf8976e0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:39.196833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5c8f3af6-2c2b-484d-8b04-bc7fe0c4da39 req-e125fe6d-b61e-4df8-a740-fb7b3664a652 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.197615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5c8f3af6-2c2b-484d-8b04-bc7fe0c4da39 req-e125fe6d-b61e-4df8-a740-fb7b3664a652 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.211716 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5c8f3af6-2c2b-484d-8b04-bc7fe0c4da39 req-e125fe6d-b61e-4df8-a740-fb7b3664a652 service nova] Creating event network-changed:76c427aa-55d9-476e-888c-c83eaf8976e0 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:09:39.219697 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5c8f3af6-2c2b-484d-8b04-bc7fe0c4da39 req-e125fe6d-b61e-4df8-a740-fb7b3664a652 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036816 Jun 18 22:09:39.220735 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1118/2223] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:39.447661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:39.448620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:39.467667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.468986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.470114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.471905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.522153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:39.522153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:39.522153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.522153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.522153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.522153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.834211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:39.845922 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-072bd89a-aa1e-4f9b-9b45-4283d11057de tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1500 microversion: 2.1 time: 0.402807 Jun 18 22:09:39.846588 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1106/2224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:39 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1500 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:39.863221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e4ef3bbf-8e6d-48f2-b7a7-52121522b7a1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:39.869821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4ef3bbf-8e6d-48f2-b7a7-52121522b7a1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.870677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4ef3bbf-8e6d-48f2-b7a7-52121522b7a1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.898278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4ef3bbf-8e6d-48f2-b7a7-52121522b7a1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Going to try to stop instance {{(pid=130902) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:09:39.942394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:39.962261 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e4ef3bbf-8e6d-48f2-b7a7-52121522b7a1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd/action" status: 202 len: 0 microversion: 2.1 time: 0.102877 Jun 18 22:09:39.968698 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1107/2225] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:09:39 2022] POST /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:39.977293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:39.978308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:39.989971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.990895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:39.991958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:39.992879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:40.052967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:40.061944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-02acdf06-a893-4ba7-8843-4ebd251bf092 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.587038 Jun 18 22:09:40.067740 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1119/2226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:39 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:40.252020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:40.265303 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-add5741b-bffc-49dd-973c-2c40c677d862 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.292925 Jun 18 22:09:40.265303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1108/2227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:39 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:41.043291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8534ec6-0594-443a-8747-576477b50c6e tempest-ListImageFiltersNegativeTestJSON-1733784033 tempest-ListImageFiltersNegativeTestJSON-1733784033-project] Calling method '.version_select at 0x7fea07a5d8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:41.067040 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e8534ec6-0594-443a-8747-576477b50c6e tempest-ListImageFiltersNegativeTestJSON-1733784033 tempest-ListImageFiltersNegativeTestJSON-1733784033-project] HTTP exception thrown: Image not found. Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8534ec6-0594-443a-8747-576477b50c6e tempest-ListImageFiltersNegativeTestJSON-1733784033 tempest-ListImageFiltersNegativeTestJSON-1733784033-project] Request method failure captured: Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/images/364b06fb-7230-44b9-bbb1-917a7ea6c8f3 HTTP/1.1 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk0kFWufjVRCZGFSPmq4GN8KuBlBpl79D_npCpHRyXvNflGRH_5--RoZQXnV3zDeQiilTlyD2ylnI1hoMYJi1pD1SwkU161eEJXTraDQV5W7qPCAjQw_hVUrpWZKsx03uZycf3zqfWMVfe4BsHRqnB-X1MzyVSi1tzO08Fcq11dvcwc Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: f0d6a4efa27946468a9a585f44337df0 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1733784033 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0d6a4efa27946468a9a585f44337df0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0d6a4efa27946468a9a585f44337df0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0d6a4efa27946468a9a585f44337df0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0d6a4efa27946468a9a585f44337df0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1733784033 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: f0d6a4efa27946468a9a585f44337df0 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1733784033 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ListImageFiltersNegativeTestJSON-1733784033-project Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 91f0c72b0f3b4ce6b8e67bbc8d2da5bd Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1733784033-project Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '364b06fb-7230-44b9-bbb1-917a7ea6c8f3'} Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 364b06fb-7230-44b9-bbb1-917a7ea6c8f3 Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:09:41.069556 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 364b06fb-7230-44b9-bbb1-917a7ea6c8f3 could not be found. Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8534ec6-0594-443a-8747-576477b50c6e tempest-ListImageFiltersNegativeTestJSON-1733784033 tempest-ListImageFiltersNegativeTestJSON-1733784033-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:41.074426 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e8534ec6-0594-443a-8747-576477b50c6e tempest-ListImageFiltersNegativeTestJSON-1733784033 tempest-ListImageFiltersNegativeTestJSON-1733784033-project] 10.222.0.30 "GET /compute/v2.1/images/364b06fb-7230-44b9-bbb1-917a7ea6c8f3" status: 404 len: 62 microversion: 2.1 time: 0.352475 Jun 18 22:09:41.079417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1120/2228] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:09:40 2022] GET /compute/v2.1/images/364b06fb-7230-44b9-bbb1-917a7ea6c8f3 => generated 62 bytes in 361 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:09:41.083260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:41.084552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:41.100718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:41.101354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:41.102427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:41.103189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:41.283582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:41.288219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:41.296816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:41.299446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:41.301101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:41.301738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:41.338463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:41.353885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1403de1-2477-4100-a33c-a76ade3a730a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.274585 Jun 18 22:09:41.356160 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1109/2229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:41 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:41.507085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:41.515862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b320504d-fbca-4212-96a0-41702993d76f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.237430 Jun 18 22:09:41.526028 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1121/2230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:41 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:42.374184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:42.375782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:42.385513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:42.388095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:42.391623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:42.392909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:42.535928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:42.538000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:42.554526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:42.555696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:42.567308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:42.568121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:42.874559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:42.889974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:42.905004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9e4d8a0-3d5e-4e89-8066-6d59815eb3bc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.535645 Jun 18 22:09:42.919428 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1110/2231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:42 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:42.920068 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8ba41e58-ac4a-40c0-aeb9-d87d10d543be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.390099 Jun 18 22:09:42.921582 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1122/2232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:42 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:43.565101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37e78b76-b86d-4a7a-b6b7-351878e078a4 tempest-NetworksTest-416704729 tempest-NetworksTest-416704729-project-admin] Calling method '.version_select at 0x7fea14526700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:43.725157 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37e78b76-b86d-4a7a-b6b7-351878e078a4 tempest-NetworksTest-416704729 tempest-NetworksTest-416704729-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 8068 microversion: 2.1 time: 0.440604 Jun 18 22:09:43.725793 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1111/2233] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:09:43 2022] GET /compute/v2.1/os-networks => generated 8068 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:43.734806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb71ba49-18cc-4efd-9afc-2a7fc616775e tempest-NetworksTest-416704729 tempest-NetworksTest-416704729-project-admin] Calling method '.version_select at 0x7fea07a5d550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:43.849750 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb71ba49-18cc-4efd-9afc-2a7fc616775e tempest-NetworksTest-416704729 tempest-NetworksTest-416704729-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/4576993c-4367-41ca-bae0-2febb9d30834" status: 200 len: 652 microversion: 2.1 time: 0.117973 Jun 18 22:09:43.862510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3abf13b-c500-4216-959e-ebefcd3d67de tempest-NetworksTest-416704729 tempest-NetworksTest-416704729-project-admin] Calling method '.version_select at 0x7fea14526820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:43.863364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1123/2234] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:09:43 2022] GET /compute/v2.1/os-networks/4576993c-4367-41ca-bae0-2febb9d30834 => generated 652 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:43.925007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:43.926439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:43.934741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:43.935441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:43.937643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:43.940905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:44.076702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3abf13b-c500-4216-959e-ebefcd3d67de tempest-NetworksTest-416704729 tempest-NetworksTest-416704729-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 8068 microversion: 2.1 time: 0.217442 Jun 18 22:09:44.078908 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1112/2235] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:09:43 2022] GET /compute/v2.1/os-networks => generated 8068 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:44.091178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:44.093552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:44.103257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:44.104674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:44.105797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:44.106441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:44.233696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:44.255170 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08d15e63-7ee0-44d3-8cac-d6debda587bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.332898 Jun 18 22:09:44.258174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1124/2236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:43 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:44.339952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:44.349301 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c6846db-6f70-40b6-8c32-a6d011265898 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.268264 Jun 18 22:09:44.350898 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1113/2237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:44 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:45.275358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:45.276490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:45.289639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:45.291501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:45.294446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:45.296899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:45.332734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:45.367486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:45.368126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:45.382795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:45.383476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:45.384443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:45.385072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:45.697469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:45.708579 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ecd13716-0dd6-4cc4-ae5a-0e9ebcdf73b9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.437084 Jun 18 22:09:45.719872 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1125/2238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:45 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:45.720146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:45.729695 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-82deed8b-9d4e-4fa5-a983-2753195343f2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.365837 Jun 18 22:09:45.739959 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1114/2239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:45 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:46.043657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-102465935", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:46.094443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:09:46.727422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:46.728046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:46.745437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:46.745994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:46.748275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:46.749852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:46.993254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:09:46.993757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:09:46.994171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:09:46.994595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:09:46.995849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:09:47.023175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:47.025538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:47.029384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:47.030102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:47.064944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:09:47.072430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for user 0e8a394c0a284416ac893321bd860e51 and project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:09:47.102835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:09:47.105444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:09:47.109315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:47.118566 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5492e589-d846-4709-a117-39ce6b1b8ec1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.395297 Jun 18 22:09:47.129625 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1115/2240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:46 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:47.134444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:47.135154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:47.153364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:47.153741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:47.163804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:47.164465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:47.211779 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a63e0338-f334-41f1-bda3-3f08e1fd840b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496890 Jun 18 22:09:47.212966 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1126/2241] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:09:47.225520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15ad83a2-c886-4177-8b88-4587cc283d76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:47.226411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15ad83a2-c886-4177-8b88-4587cc283d76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:47.382147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15ad83a2-c886-4177-8b88-4587cc283d76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:47.390995 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15ad83a2-c886-4177-8b88-4587cc283d76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1212 microversion: 2.1 time: 0.171745 Jun 18 22:09:47.395098 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1127/2242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:47 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1212 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:47.587416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:47.600928 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-811c5976-560f-49ba-b55e-96c47b4112eb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.475092 Jun 18 22:09:47.601666 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1116/2243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:47 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:48.143981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:48.144609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:48.167724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.168132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.169504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.170118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.413056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:48.413688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:48.414626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:48.425207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-baaa467c-eff1-4c08-a4d7-ef62fd935b52 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.288919 Jun 18 22:09:48.426620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.427078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.428085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.428531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.432146 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1128/2244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:48 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:48.454806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce126d46-5cbf-4f21-a555-25f49af6b2ae"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:48.456768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:48.483260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.491187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.492374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.492823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.539870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:48.557099 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ccccc720-061d-42ad-a4ad-ce12e396f07f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1264 microversion: 2.1 time: 0.146179 Jun 18 22:09:48.558849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1117/2245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:48 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:48.618964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:48.619668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:48.641936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.647028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.648200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:48.657893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:48.914246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:48.923469 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a87733c9-078d-4190-8519-1f0dc95b8985 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.309361 Jun 18 22:09:48.924057 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1118/2246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:48 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:48.930385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35f66a1e-89de-45ac-be54-8b36b6c4ae1e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "POST /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481641 Jun 18 22:09:48.931419 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1129/2247] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:09:48 2022] POST /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:09:49.097653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-191488353", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": "none"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:49.168158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:09:49.169053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:09:49.169767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:09:49.171208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:09:49.172466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:09:49.185088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.186545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.187631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.188275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.214890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Getting quotas for project d1ac36afdc84465caad8632e46fe3a96. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:09:49.222316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Getting quotas for user 64a676b449be43d9bc7fecb76178af16 and project d1ac36afdc84465caad8632e46fe3a96. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:09:49.243394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:09:49.247007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:09:49.330309 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a87fcff0-175a-4c97-b331-fad8ca722497 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.399465 Jun 18 22:09:49.333736 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1119/2248] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:09:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:09:49.357622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e2745a58-fc0c-460e-8621-c03c2bdb5ef0 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:49.359784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2745a58-fc0c-460e-8621-c03c2bdb5ef0 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:49.449941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:49.450674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:49.462269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.468478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.469594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.470152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.486540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2745a58-fc0c-460e-8621-c03c2bdb5ef0 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.494900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2745a58-fc0c-460e-8621-c03c2bdb5ef0 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.496395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2745a58-fc0c-460e-8621-c03c2bdb5ef0 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.517418 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e2745a58-fc0c-460e-8621-c03c2bdb5ef0 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "PUT /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1358 microversion: 2.75 time: 0.177757 Jun 18 22:09:49.529276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1130/2249] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Jun 18 22:09:49 2022] PUT /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:49.542264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-abc7c6b7-4fb1-4a81-8f85-27adba442173 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:49.543174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-abc7c6b7-4fb1-4a81-8f85-27adba442173 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:49.666927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-abc7c6b7-4fb1-4a81-8f85-27adba442173 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.680857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-abc7c6b7-4fb1-4a81-8f85-27adba442173 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.685684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-abc7c6b7-4fb1-4a81-8f85-27adba442173 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.700010 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-abc7c6b7-4fb1-4a81-8f85-27adba442173 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1358 microversion: 2.75 time: 0.163805 Jun 18 22:09:49.714552 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1131/2250] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:49 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:49.721053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:49.721948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:49.731321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.732162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.733185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.734022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.776926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.787475 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1e54a4e-1459-4b6a-9c4a-a01e9fc64b2a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.343264 Jun 18 22:09:49.789159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1120/2251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:49 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:49.839203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:49.848159 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f9616f8-88cc-4665-9f67-bb153a57e6c5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1270 microversion: 2.1 time: 0.131774 Jun 18 22:09:49.852549 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1132/2252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:49 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:49.950178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:49.950812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:49.967586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.968047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:49.968870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:49.975406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:50.164304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:50.174885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da3da164-c918-46a8-b093-048073324511 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.238761 Jun 18 22:09:50.175877 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1121/2253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:49 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:50.722662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:50.723287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:50.735442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:50.738246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:50.743518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:50.744228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:50.808913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:50.810123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:50.830848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:50.831603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:50.832927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:50.834503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:51.080299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:51.103859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:51.112367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:51.115053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:51.122123 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-77f13513-809a-49a2-b5b3-ada8692d1bef tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.318363 Jun 18 22:09:51.122953 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1122/2254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:50 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:51.129429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:51.130228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:51.134629 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c81b3daa-fd2f-41f4-8dd7-99dc64e799a3 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1418 microversion: 2.75 time: 0.416293 Jun 18 22:09:51.135298 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1133/2255] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:50 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1418 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:51.138316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:51.138949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:51.139960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:51.141977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:51.198142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:51.199938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:51.212134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:51.212840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:51.214211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:51.215062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:51.370228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:51.380804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-91b2909b-bf86-4a72-857b-ecbecdeede8c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.256381 Jun 18 22:09:51.381987 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1123/2256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:51 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:51.418865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:51.426998 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-daf3c86a-3b47-4211-9560-f9847294bec0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.238531 Jun 18 22:09:51.427577 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1134/2257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:51 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:52.141705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:52.144120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:52.153868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.154633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.155566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.156143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.158997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:52.160162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:52.171856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.172299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.173113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.173544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.334299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:52.353912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:52.371584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:52.377700 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-697ebd54-5c13-404b-83a7-20ca8f2d4817 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1416 microversion: 2.75 time: 0.222110 Jun 18 22:09:52.378320 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1135/2258] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:52 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1416 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:52.397326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d0e7196b-d9b8-4570-ac21-ee32ce251824 req-56cf62dc-4577-4dad-be63-a523c4d375f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e989fc58-3640-4eca-893e-43e4582d5efa", "tag": "995acddb-4f18-4c41-a76f-e684f04860ee"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:52.428567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d0e7196b-d9b8-4570-ac21-ee32ce251824 req-56cf62dc-4577-4dad-be63-a523c4d375f9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.429070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d0e7196b-d9b8-4570-ac21-ee32ce251824 req-56cf62dc-4577-4dad-be63-a523c4d375f9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.457588 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d0e7196b-d9b8-4570-ac21-ee32ce251824 req-56cf62dc-4577-4dad-be63-a523c4d375f9 service nova] Creating event network-changed:995acddb-4f18-4c41-a76f-e684f04860ee for instance e989fc58-3640-4eca-893e-43e4582d5efa on nch1-master-1 Jun 18 22:09:52.463140 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d0e7196b-d9b8-4570-ac21-ee32ce251824 req-56cf62dc-4577-4dad-be63-a523c4d375f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080045 Jun 18 22:09:52.467520 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1136/2259] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:52.478305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:52.479025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:52.502619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.503090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.504139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.504708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.522266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:52.538478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2a1b0c3-8451-4887-b4a8-e5686708b98e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.402081 Jun 18 22:09:52.540102 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1124/2260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:52 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:52.629995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3809f4c0-b0ea-4c0a-b22d-668a9f20762b tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea142aeca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1222459763", "description": "tempest-description-1094612516"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:52.734741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:52.743606 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9acde57-2bce-42d9-b5c8-2fef65ac1bd3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.274034 Jun 18 22:09:52.744815 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1137/2261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:52 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:52.749981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:52.750783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:52.757127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.757801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.758745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:52.759494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:52.908703 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3809f4c0-b0ea-4c0a-b22d-668a9f20762b tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.368317 Jun 18 22:09:52.909920 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1125/2262] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:52.964814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:52.973192 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2782a91-11f1-4fe5-84dd-4f5a2b6d382f tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.227067 Jun 18 22:09:52.982731 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1138/2263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:52 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:52.982731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22fad0ae-0e5f-4f70-848e-812555ad3e09 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea07a5d5e0>, body: {"security_group_rule": {"parent_group_id": "3d1b3d25-7943-4e08-b705-e82df5064afb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:53.045138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "95ef2e89-8570-4631-9452-b0866f4d820a"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:53.046300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.053307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.053846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.054648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.055265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.190365 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] HTTP exception thrown: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. Jun 18 22:09:53.213803 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22fad0ae-0e5f-4f70-848e-812555ad3e09 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.238477 Jun 18 22:09:53.214838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1139/2264] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:09:52 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Request method failure captured: Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments/ce126d46-5cbf-4f21-a555-25f49af6b2ae HTTP/1.1 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 74 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirky_k1iPNuopn0sddlxT9s3tNLAmakrWAvIL6BA08jJsqzl9OF8rQKkTmT8v_UW376BnmWdgYks9tAQCA_lY0ZLyJ9zue9v0kPjo1q5VP91UbIIanplw9LOrmOATHCoFSAOZgahJq1l4KtFezsGi-gbfQrm8Tjpijm_Cq4rjx6tTSNg Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: fed1a319a984482eabb1873973e84b83 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesAdminNegativeTest-192901963 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fed1a319a984482eabb1873973e84b83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1a319a984482eabb1873973e84b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1a319a984482eabb1873973e84b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fed1a319a984482eabb1873973e84b83", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesAdminNegativeTest-192901963 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: fed1a319a984482eabb1873973e84b83 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-192901963 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesAdminNegativeTest-192901963-project-admin Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: df66b9f0141a45a58b9a312c4c8a50f6 Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesAdminNegativeTest-192901963-project-admin Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: {"volumeAttachment": {"volumeId": "95ef2e89-8570-4631-9452-b0866f4d820a"}} Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: exception: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4', 'id': 'ce126d46-5cbf-4f21-a555-25f49af6b2ae', 'body': {'volumeAttachment': {'volumeId': '95ef2e89-8570-4631-9452-b0866f4d820a'}}} Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. (HTTP 404) (Request-ID: req-05c6368b-1665-480b-973e-22fbbcc35260) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:09:53.221906 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. Jun 18 22:09:53.225503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:53.230528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Returning 400 to user: Volume 95ef2e89-8570-4631-9452-b0866f4d820a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:53.231262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9262821-4546-4953-b496-a96f849003f7 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea07a1aaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1128314769", "description": "tempest-description-1737884736"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:53.231393 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3dcb9e05-2a75-4f73-a212-edd4812d79eb tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments/ce126d46-5cbf-4f21-a555-25f49af6b2ae" status: 400 len: 107 microversion: 2.1 time: 0.320355 Jun 18 22:09:53.232000 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1126/2265] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Jun 18 22:09:52 2022] PUT /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments/ce126d46-5cbf-4f21-a555-25f49af6b2ae => generated 107 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:09:53.309303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:53.309821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.317775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.318219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.319197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.319633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.404802 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9262821-4546-4953-b496-a96f849003f7 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.180275 Jun 18 22:09:53.405615 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1140/2266] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:53 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:53.418311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lazy-loading 'services' on Instance uuid 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:09:53.427861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:53.430435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.438524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.439100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.440096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.440617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.492565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:53.507137 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-71a6d792-d2ca-4e07-a5ef-0c6e9203bb3f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments/ce126d46-5cbf-4f21-a555-25f49af6b2ae" status: 202 len: 0 microversion: 2.1 time: 0.202197 Jun 18 22:09:53.509408 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1127/2267] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:09:53 2022] DELETE /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments/ce126d46-5cbf-4f21-a555-25f49af6b2ae => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:53.512707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:53.515582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61cd871d-c90f-4d71-b704-267986ff4081 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea14911160>, body: {"security_group_rule": {"parent_group_id": "c1d80528-585c-44eb-89d6-ecae096f1808", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:53.522595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:53.524922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:53.528461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:53.532808 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2fe13e72-c541-4657-ba65-bdf2b41e6628 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1437 microversion: 2.75 time: 0.125837 Jun 18 22:09:53.533538 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1141/2268] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:53 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1437 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:53.538852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:53.539952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.548012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.548719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.551487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.552233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.586164 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-05bf372c-fc4e-4fcc-9a9c-5c57559dfcf0 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051341 Jun 18 22:09:53.587193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1142/2269] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:09:53 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:53.597551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:53.599280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.606709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.607762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.608880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.609577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.745729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:09:53.748035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:09:53.749274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:09:53.750125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:09:53.750818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:09:53.771781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61cd871d-c90f-4d71-b704-267986ff4081 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.260995 Jun 18 22:09:53.772399 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1128/2270] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:09:53 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:53.777877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:53.781601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.796832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.797562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.799248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.799877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.861894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:53.869666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.870350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.872117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:53.873147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:53.977385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:53.991160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:53.998412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.005679 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e2dccddb-f394-4c16-92cf-26458051f6f7 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "POST /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088/action" status: 202 len: 1494 microversion: 2.75 time: 0.417112 Jun 18 22:09:54.018416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1143/2271] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:09:53 2022] POST /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088/action => generated 1494 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 18 22:09:54.038818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:54.039709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:54.048027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.048900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.050182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.050817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.095426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.108673 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad0af7ae-0854-443b-a54f-04d28f89eab1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.334754 Jun 18 22:09:54.113949 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1129/2272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:53 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:54.125665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a15e97c-4024-4fee-adba-e77502b9566b tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea19d4b700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-236040868", "description": "tempest-description-758312656"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:54.354397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.358336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:54.373215 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9f3805d-f712-4d25-9830-2ef8029a02a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.353554 Jun 18 22:09:54.374203 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1144/2273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:54 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:54.380441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:54.381216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:54.389208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.389927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.391048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.391900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.433585 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a15e97c-4024-4fee-adba-e77502b9566b tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.312277 Jun 18 22:09:54.434848 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1130/2274] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:54 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:54.440564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:54.442125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:54.454402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.455232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.456466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.457216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.602688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.613234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.614736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.615856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:54.624761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5f7cf7d-c7a3-4134-ae8e-56338d0fb437 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.248821 Jun 18 22:09:54.625262 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fef7100c-9e20-4c85-bbcd-6940a4905392 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.189002 Jun 18 22:09:54.626192 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1145/2275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:54 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:54.631339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bd99c26-8b74-4217-863f-bc985aa9bd9a tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea07a5de50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1351939373", "description": "tempest-description-53410292"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:54.635964 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1131/2276] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:54 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:54.641402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:54.642618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:54.650151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.651001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.651821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:54.652267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:54.687842 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0a7b6add-dfa7-4d19-a0bf-a1764372ca4a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Jun 18 22:09:54.688442 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1132/2277] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:09:54 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:54.793585 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bd99c26-8b74-4217-863f-bc985aa9bd9a tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.165920 Jun 18 22:09:54.794605 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1146/2278] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:54 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:54.806989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4cd5b38c-b037-4092-ad07-4b86dbfba53c tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea149028b0>, body: {"security_group_rule": {"parent_group_id": "09cb2561-d2c4-4c06-a46e-6c08120b4d2c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a4144694-59ae-407f-8908-d453a0e531d9"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:55.130792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:55.131541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:55.140982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.141528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.142688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.143131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.211502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4cd5b38c-b037-4092-ad07-4b86dbfba53c tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.409535 Jun 18 22:09:55.219878 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1133/2279] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:09:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:55.226082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccb8da54-3445-47bd-8c8b-1db09fef2594 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea142ae4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1943122887", "description": "tempest-description-1096953"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:55.388843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:55.401549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f02b5ee-b79e-49b7-a46a-1d6faaed7101 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.275128 Jun 18 22:09:55.402535 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1147/2280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:55 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:55.417432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:55.418446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:55.426406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.427067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.428607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.429183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.487864 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ccb8da54-3445-47bd-8c8b-1db09fef2594 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.265919 Jun 18 22:09:55.488697 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1134/2281] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:55 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:55.500221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f3d588d-3ae1-40c0-a2fb-381b406b128b tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea144f3ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-109829747", "description": "tempest-description-922172376"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:55.657217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:55.669365 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e16fc5ff-fabf-4b0d-8cdb-8b807dbbdeef tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.265324 Jun 18 22:09:55.670327 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1148/2282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:55 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:55.675901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:55.677233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:55.687450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.688476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.689971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.690836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.759803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f3d588d-3ae1-40c0-a2fb-381b406b128b tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.263582 Jun 18 22:09:55.760443 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1135/2283] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:55 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:09:55.779149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:55.781079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:55.806707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.808315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.809386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.814469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.934974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:55.951259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:55.953707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:55.960751 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec53394f-5a88-4dde-a5aa-1f509bdde58f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.199154 Jun 18 22:09:55.974231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1136/2284] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:55 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:55.974838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:55.981357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:55.982405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:55.983995 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d095fbb-ca2e-4be6-af9c-bf4b54a43bbc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.312141 Jun 18 22:09:55.984685 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1149/2285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:55 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:55.990019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.990621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e252fe5f-d5f4-46da-b8eb-98bbf6981fe0 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea07a5dd30>, body: {"security_group_rule": {"parent_group_id": "50d4cc58-831d-42fc-80a4-a16820ec240b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:55.991126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:55.992847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:55.993813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:56.057648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f19de51c-b567-45e2-b8b1-ef95580b971b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082108 Jun 18 22:09:56.058664 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1137/2286] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:09:55 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:09:56.246054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2056601113", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "31ac6f3e-51b9-4607-9ecf-0c908a61f330"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:56.315766 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e252fe5f-d5f4-46da-b8eb-98bbf6981fe0 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.329658 Jun 18 22:09:56.316696 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1150/2287] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:09:55 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:56.329700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d2c6b68-5794-4b33-8d70-037d34c2f074 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea07a7e790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:56.348616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] validate_networks() for [('31ac6f3e-51b9-4607-9ecf-0c908a61f330', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:09:56.750311 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d2c6b68-5794-4b33-8d70-037d34c2f074 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a" status: 202 len: 0 microversion: 2.1 time: 0.425872 Jun 18 22:09:56.751202 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1151/2288] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:09:56 2022] DELETE /compute/v2.1/os-security-groups/4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:56.756064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:56.757074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:56.764786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:56.765355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:56.766185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:56.766659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:56.932400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:09:56.934230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:09:56.934869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:09:56.936001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:09:56.936604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:09:56.949897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:56.950510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:56.951788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:56.952418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:56.962433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:56.972504 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5cfb6693-f592-416c-9dd1-57fd04311919 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.220009 Jun 18 22:09:56.973380 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1152/2289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:56 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:56.982790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Getting quotas for project 4643e24233bd4af1a0c020e4d9a474fb. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:09:56.988436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:56.989274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:56.989876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Getting quotas for user cf9fa8d3d2bc4f9fa12fab743b7090ad and project 4643e24233bd4af1a0c020e4d9a474fb. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:09:56.997439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:56.997965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:56.999923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:56.999923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:57.009404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:09:57.011993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:09:57.025648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:57.044229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:57.075492 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-78a34ed0-5a20-4130-83f7-24a0f97a8c9d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834451 Jun 18 22:09:57.077869 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1138/2290] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:09:57.086933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d13376c7-9659-4a78-bf66-9025a0fcfd39 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea14911820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:57.215261 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d13376c7-9659-4a78-bf66-9025a0fcfd39 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/50d4cc58-831d-42fc-80a4-a16820ec240b" status: 200 len: 245 microversion: 2.1 time: 0.136016 Jun 18 22:09:57.219531 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1139/2291] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:09:57 2022] GET /compute/v2.1/os-security-groups/50d4cc58-831d-42fc-80a4-a16820ec240b => generated 245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:57.224941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:57.225574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:57.235113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:57.236171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:57.236523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:57.236992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:57.270629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:57.284576 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6ad7030-daf1-4fd5-8808-44c6d4bdffa9 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.300318 Jun 18 22:09:57.285491 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1153/2292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:56 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:57.293970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:57.294597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:57.307017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:57.307705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:57.308642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:57.309283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:57.360931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:57.373107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:57.375657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:57.384128 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e131500-a11b-4fb7-bc61-c07bb1dacf83 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.163334 Jun 18 22:09:57.384745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1140/2293] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:57 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:57.402106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88b4707b-6ac7-4a74-8059-4db10a4e745d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:57.402933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88b4707b-6ac7-4a74-8059-4db10a4e745d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:57.514929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88b4707b-6ac7-4a74-8059-4db10a4e745d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:57.524391 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88b4707b-6ac7-4a74-8059-4db10a4e745d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1218 microversion: 2.1 time: 0.126191 Jun 18 22:09:57.525420 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1141/2294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:57 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:57.531619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-395132c5-e3cf-4f66-b336-a8c8191757a4 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea14526ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2008559220", "description": "tempest-description-1440720268"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:57.553830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:57.563594 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ea64bfb-31b5-4817-acc5-d5c127291689 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.276787 Jun 18 22:09:57.565152 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1154/2295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:57 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:57.710351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-395132c5-e3cf-4f66-b336-a8c8191757a4 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.182709 Jun 18 22:09:57.711269 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1142/2296] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:09:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:57.724791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5bf7f8a-f87b-48cb-be10-b7392cb35503 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea19dbc820>, body: {"security_group_rule": {"parent_group_id": "4e7d00ee-c996-43a5-9999-8c8d262209ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:57.941244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5bf7f8a-f87b-48cb-be10-b7392cb35503 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.220354 Jun 18 22:09:57.942518 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1155/2297] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:09:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:57.957083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf4231f4-1361-461e-b80a-2e258935d3b1 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Action: 'create', calling method: .version_select at 0x7fea14c1d0d0>, body: {"security_group_rule": {"parent_group_id": "4e7d00ee-c996-43a5-9999-8c8d262209ce", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:57.992868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:57.993565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:58.001062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.001592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.002403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.002845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.205387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.217453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c030a64-b9bc-458a-9c86-76ad61d8299c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1516 microversion: 2.1 time: 0.231249 Jun 18 22:09:58.218288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1156/2298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:57 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:58.254488 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf4231f4-1361-461e-b80a-2e258935d3b1 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.301811 Jun 18 22:09:58.255099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1143/2299] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:09:57 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:58.268787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fb06df37-592a-4a36-b8d9-a290b583a02d tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19dbc670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.304341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.305443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:58.314658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.315147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.316355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.316809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.329701 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fb06df37-592a-4a36-b8d9-a290b583a02d tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/4e7d00ee-c996-43a5-9999-8c8d262209ce" status: 200 len: 665 microversion: 2.1 time: 0.065015 Jun 18 22:09:58.330429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1157/2300] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:09:58 2022] GET /compute/v2.1/os-security-groups/4e7d00ee-c996-43a5-9999-8c8d262209ce => generated 665 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:58.342318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6fe1679e-0e2a-4bd6-9e6f-948ead6a360e tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19dfc8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.544916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.553641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9bb5aa21-8f1a-4342-90b1-d5252ac0904a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.255113 Jun 18 22:09:58.554561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1144/2301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:58 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:58.559011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.559645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:58.566666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.567130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.567913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.568391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.596821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6fe1679e-0e2a-4bd6-9e6f-948ead6a360e tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/b9eb26b7-aa2b-47b7-bf1e-6b23133517a8" status: 202 len: 0 microversion: 2.1 time: 0.258423 Jun 18 22:09:58.602893 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1158/2302] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Jun 18 22:09:58 2022] DELETE /compute/v2.1/os-security-group-rules/b9eb26b7-aa2b-47b7-bf1e-6b23133517a8 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:58.608603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.609684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:58.620254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.620717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.621941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.621941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.659060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.669507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.672458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.678504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7780949d-8776-4568-a557-4bce406b681f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.123139 Jun 18 22:09:58.679421 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1145/2303] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:58 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:58.685006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.685939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:58.695030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.695236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.695723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.696531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:58.697069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:58.705005 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f83100df-ff02-438f-9657-108d8c133705 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1270 microversion: 2.1 time: 0.100739 Jun 18 22:09:58.706007 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1159/2304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:58 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:58.711194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c5a3dad-dfe7-4fa3-8391-1301fdc4bc60 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19d885e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:58.911198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:58.922007 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d890d434-1cdd-4ae2-afbe-7d9fc78fd103 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.240957 Jun 18 22:09:58.932616 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1146/2305] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:58 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:59.033105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c5a3dad-dfe7-4fa3-8391-1301fdc4bc60 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4e7d00ee-c996-43a5-9999-8c8d262209ce" status: 202 len: 0 microversion: 2.1 time: 0.325831 Jun 18 22:09:59.037086 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1160/2306] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:09:58 2022] DELETE /compute/v2.1/os-security-groups/4e7d00ee-c996-43a5-9999-8c8d262209ce => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:59.044396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19dc3430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.083268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:09:59.083894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Neutron security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:09:59.084585 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] HTTP exception thrown: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.084585 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Request method failure captured: Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a HTTP/1.1 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk0w0it1nzSLkV5-87Zw2iqzZT5NAVhIsAFwZQzC1Kt53ujiKwrVnfLHc5q3-0i78kUvAdMoZSU_28-MSqJvGrWTNHi3U2VAGUzJBuDk5mQvf4Ck-UbIbTdi4pVELC3yiBYXFBlPf_94pZU3oq-NQm3mMKOwW0b3ZnxNOejEaHM-wVw Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1e0874e149554f3188d708fcc3ae7702 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-4205937 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1e0874e149554f3188d708fcc3ae7702"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1e0874e149554f3188d708fcc3ae7702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1e0874e149554f3188d708fcc3ae7702"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1e0874e149554f3188d708fcc3ae7702", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupRulesTestJSON-4205937 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1e0874e149554f3188d708fcc3ae7702 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-4205937 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupRulesTestJSON-4205937-project Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 57d545cdb9dc49279608a50f22d85c16 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupRulesTestJSON-4205937-project Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a'} Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:09:59.087189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] Jun 18 22:09:59.090561 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:09:59.094384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Returning 404 to user: Security group 4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a does not exist Jun 18 22:09:59.094384 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-0c9ee7be-7718-434d-87d5-3cb2e55ee51c'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:09:59.095578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d03eaf49-e959-48e6-98bc-d2ef2015f412 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a" status: 404 len: 194 microversion: 2.1 time: 0.056532 Jun 18 22:09:59.096928 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1147/2307] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:09:59 2022] DELETE /compute/v2.1/os-security-groups/4e24beb2-dbb2-4fdb-ae7d-074d55d0c19a => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:09:59.108647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9dabe0f-59dd-4e81-acf5-d89526597332 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19cc5700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.154981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8342b8f2-af55-4f21-9617-24301d0b424c req-2b74dd99-1e0d-4388-8314-f37f7cd3fe20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e989fc58-3640-4eca-893e-43e4582d5efa", "name": "network-vif-plugged", "status": "completed", "tag": "995acddb-4f18-4c41-a76f-e684f04860ee"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:09:59.177077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8342b8f2-af55-4f21-9617-24301d0b424c req-2b74dd99-1e0d-4388-8314-f37f7cd3fe20 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.177536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8342b8f2-af55-4f21-9617-24301d0b424c req-2b74dd99-1e0d-4388-8314-f37f7cd3fe20 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.189762 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8342b8f2-af55-4f21-9617-24301d0b424c req-2b74dd99-1e0d-4388-8314-f37f7cd3fe20 service nova] Creating event network-vif-plugged:995acddb-4f18-4c41-a76f-e684f04860ee for instance e989fc58-3640-4eca-893e-43e4582d5efa on nch1-master-1 Jun 18 22:09:59.195831 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8342b8f2-af55-4f21-9617-24301d0b424c req-2b74dd99-1e0d-4388-8314-f37f7cd3fe20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050667 Jun 18 22:09:59.196665 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1148/2308] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:09:59.236154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.236878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:59.244178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.244638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.245459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.245903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.385655 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9dabe0f-59dd-4e81-acf5-d89526597332 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/50d4cc58-831d-42fc-80a4-a16820ec240b" status: 202 len: 0 microversion: 2.1 time: 0.283930 Jun 18 22:09:59.386546 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1161/2309] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:09:59 2022] DELETE /compute/v2.1/os-security-groups/50d4cc58-831d-42fc-80a4-a16820ec240b => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:09:59.395345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e7477fb-abab-42c5-bbdd-99e53512f041 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19d57160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.452678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:59.466574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d241296-eb86-42b2-8db0-1b477fb42dee tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.234804 Jun 18 22:09:59.468049 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1149/2310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:59 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:09:59.572165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.573201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:59.581252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.582054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.582826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.583256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.673489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:09:59.728089 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e7477fb-abab-42c5-bbdd-99e53512f041 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a4144694-59ae-407f-8908-d453a0e531d9" status: 202 len: 0 microversion: 2.1 time: 0.336770 Jun 18 22:09:59.729778 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1162/2311] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:09:59 2022] DELETE /compute/v2.1/os-security-groups/a4144694-59ae-407f-8908-d453a0e531d9 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:09:59.736453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.737220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:59.771385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.772171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.773200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.775644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:59.777905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.790925 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2e90551b-e24c-4c9e-883c-9588960c70e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.222785 Jun 18 22:09:59.791587 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1150/2312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:59 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:09:59.805978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:09:59.806697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:09:59.814510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.816298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.816726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:09:59.817320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:09:59.859062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:59.871213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:59.873431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:09:59.881312 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58a335e8-b8e9-4e79-bf9d-b3a19aafec04 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.149982 Jun 18 22:09:59.881931 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1163/2313] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:09:59 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:09:59.887990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08581792-fcf4-450a-b446-6caa866ee71c tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea19dbc310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:00.043148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:00.051415 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6dbaefb-a833-4126-97fe-1b3cb385c26a tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.249773 Jun 18 22:10:00.061132 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1151/2314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:09:59 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:00.066718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:00.067621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:00.074109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:00.075018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:00.076072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:00.076226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:00.221334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08581792-fcf4-450a-b446-6caa866ee71c tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/09cb2561-d2c4-4c06-a46e-6c08120b4d2c" status: 202 len: 0 microversion: 2.1 time: 0.336861 Jun 18 22:10:00.222058 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1164/2315] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:09:59 2022] DELETE /compute/v2.1/os-security-groups/09cb2561-d2c4-4c06-a46e-6c08120b4d2c => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:10:00.232269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35a62556-5d38-4315-ad5f-e2e1197d3eec tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea07a5dc10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:00.292486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:00.300943 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58612a1f-7bb3-441d-9168-6ec7df8a0ef6 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.238161 Jun 18 22:10:00.301734 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1152/2316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:00 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:00.458360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35a62556-5d38-4315-ad5f-e2e1197d3eec tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c1d80528-585c-44eb-89d6-ecae096f1808" status: 202 len: 0 microversion: 2.1 time: 0.231130 Jun 18 22:10:00.459304 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1165/2317] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:10:00 2022] DELETE /compute/v2.1/os-security-groups/c1d80528-585c-44eb-89d6-ecae096f1808 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:10:00.467436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0a2e1d15-afeb-488a-9a90-da77c37c76d9 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] Calling method '.version_select at 0x7fea144f30d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:00.484604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:00.485262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:00.495061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:00.495554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:00.496312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:00.496960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.020117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.028491 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0fb66a34-b686-48ed-84f9-fe71ba5fcc46 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.547887 Jun 18 22:10:01.029094 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1166/2318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:00 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:01.034047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:01.034657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:01.040968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.041435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.042247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.042693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.145169 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0a2e1d15-afeb-488a-9a90-da77c37c76d9 tempest-SecurityGroupRulesTestJSON-4205937 tempest-SecurityGroupRulesTestJSON-4205937-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3d1b3d25-7943-4e08-b705-e82df5064afb" status: 202 len: 0 microversion: 2.1 time: 0.681514 Jun 18 22:10:01.146062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1153/2319] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:10:00 2022] DELETE /compute/v2.1/os-security-groups/3d1b3d25-7943-4e08-b705-e82df5064afb => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:10:01.151269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:01.152594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:01.161420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.162055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.163650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.164267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.230981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.239008 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-501ae609-8c31-4a50-87ce-a3a32dcafb76 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.208723 Jun 18 22:10:01.239595 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1167/2320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:01 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:01.264204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:01.265348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:01.270124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.274132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.274590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.275540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.276161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.284347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.288433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.294874 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bd0e0be-29d0-4dcf-86e2-5246c70fe746 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.147675 Jun 18 22:10:01.310122 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1154/2321] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:01 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:01.318713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:01.319516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:01.328634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.329223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.330147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:01.330647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:01.528115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.539113 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c2131880-ecf6-49bf-94bd-f436d3f34935 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.297865 Jun 18 22:10:01.548864 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1168/2322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:01 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:01.556569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:01.567683 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1157a57-6bcd-4cac-a8d7-c2549c899ad5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.253644 Jun 18 22:10:01.568551 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1155/2323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:01 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:02.047517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:02.048530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:02.055922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.056401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.057680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.058501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.235634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.244581 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a13d79b1-5a6c-41eb-afe4-069d827612bf tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.201816 Jun 18 22:10:02.246003 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1169/2324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:02 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:02.259369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:02.260024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:02.268964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.268964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.269903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.270364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.317850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:02.318657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:02.326261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.326728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.327629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.328120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.422091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.433002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.435527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.442276 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-87e2748f-dab9-4d39-b815-baa163ec24e1 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.129966 Jun 18 22:10:02.443569 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1170/2325] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:02 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:02.472080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.478398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:02.485133 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b7e54f53-f4a1-46a5-b84c-aca347da8573 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1312 microversion: 2.1 time: 0.229919 Jun 18 22:10:02.485846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1156/2326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:02 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:02.553928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4329217b-a1c8-4bcc-958a-7693933a55f2 req-f793521f-6cce-498d-8d14-fb4bdd25e604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6214ed2f-cfbb-4ccc-b6f7-0711af77391f", "tag": "71f5a1a3-23d0-4cbc-8d17-bd7955ebe277"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:02.565057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4329217b-a1c8-4bcc-958a-7693933a55f2 req-f793521f-6cce-498d-8d14-fb4bdd25e604 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.565815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4329217b-a1c8-4bcc-958a-7693933a55f2 req-f793521f-6cce-498d-8d14-fb4bdd25e604 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.571255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:02.573566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:02.583035 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4329217b-a1c8-4bcc-958a-7693933a55f2 req-f793521f-6cce-498d-8d14-fb4bdd25e604 service nova] Creating event network-changed:71f5a1a3-23d0-4cbc-8d17-bd7955ebe277 for instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f on nch1-master-1 Jun 18 22:10:02.584783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.585473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.588815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.589339 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4329217b-a1c8-4bcc-958a-7693933a55f2 req-f793521f-6cce-498d-8d14-fb4bdd25e604 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039412 Jun 18 22:10:02.590370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.590537 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1171/2327] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:02.601589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:02.602333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:02.621494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.622715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.624277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:02.624916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:02.897172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.905855 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8811a2af-10b2-4ef6-aa34-daf33c563a47 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.346738 Jun 18 22:10:02.908090 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1157/2328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:02 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:02.925517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:02.946647 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-159872ad-7ac7-43e2-a9af-ee5d4dc775be tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.354761 Jun 18 22:10:02.952848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1172/2329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:02 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:03.212255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-97031806-172b-4c6d-86a4-3392a866c060 req-f2c5144c-5273-49f5-8a4e-51cc19ba3475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2e22e-50e0-4ce6-a216-f49f927fa6d8", "name": "network-vif-unplugged", "status": "completed", "tag": "8cc0d016-5899-4de2-b140-bc2656bcb49c"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:03.227057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-97031806-172b-4c6d-86a4-3392a866c060 req-f2c5144c-5273-49f5-8a4e-51cc19ba3475 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.227526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-97031806-172b-4c6d-86a4-3392a866c060 req-f2c5144c-5273-49f5-8a4e-51cc19ba3475 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.244189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-97031806-172b-4c6d-86a4-3392a866c060 req-f2c5144c-5273-49f5-8a4e-51cc19ba3475 service nova] Creating event network-vif-unplugged:8cc0d016-5899-4de2-b140-bc2656bcb49c for instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 on nch1-master-1 Jun 18 22:10:03.252855 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-97031806-172b-4c6d-86a4-3392a866c060 req-f2c5144c-5273-49f5-8a4e-51cc19ba3475 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049747 Jun 18 22:10:03.253916 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1158/2330] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:03.263771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:03.265936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:03.274073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.274831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.275859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.276450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.280222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:03.470046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:03.471816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:03.473827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:03.481078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.481855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.482818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.482933 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-44d4ec25-68ed-48a6-b372-9300ce384410 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.223858 Jun 18 22:10:03.483506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.483622 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1173/2331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:03 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:03.502448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:03.503381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:03.511474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.511938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.513738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.514283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.565445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:03.576442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:03.578070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:03.583705 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1659ab1-3ae5-4e41-8961-01fdda4aed7f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.123486 Jun 18 22:10:03.584281 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1159/2332] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:03 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:03.674822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:03.683746 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4a8316a1-e01f-4787-9056-ba9e9d3f5bf1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1462 microversion: 2.1 time: 0.185807 Jun 18 22:10:03.684606 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1174/2333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:03 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1462 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:03.822217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:03.822888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:03.832072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.832757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.833661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.834322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.923774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:03.924845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:03.939093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.941427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:03.942518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:03.943856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.248193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.265362 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77634e7a-83fc-47b2-acbd-bbcdef6a91b2 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.345724 Jun 18 22:10:04.273217 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1175/2334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:03 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:04.300383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:04.301073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:04.318288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.318780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.319583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.320033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.330189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ef15399-d81a-4548-902b-1c7705ccf7ff tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1613 microversion: 2.1 time: 0.633307 Jun 18 22:10:04.330786 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1160/2335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:03 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1613 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:04.420275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:04.420925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:04.428569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.429393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.430483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.431262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.522060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.534442 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37bd5590-734d-4d9d-9d06-a551baa2e6a2 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.259977 Jun 18 22:10:04.544569 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1176/2336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:04 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:04.544569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:04.544569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:04.547869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.548336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.549114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7fa98fb81589488fa53a6f07a208b7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9654b224af4e6d9705c4a622c32a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.549722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.549722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.550097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] flavor_id is None. Assuming migration. {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 18 22:10:04.550674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:10:04.750147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.759587 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dbbb8c8b-45f8-4471-af90-f925a0f57cb9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.223356 Jun 18 22:10:04.770877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1177/2337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:04 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:04.778332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:04.779425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:04.787305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.788109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.789440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:04.790243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:04.879817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.896808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.900361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:04.909146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c4a6ca5-70e6-4787-8bfd-b5b42e541f1d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.135260 Jun 18 22:10:04.910226 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1178/2338] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:04 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:05.123382 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7086b50a-83c9-4352-9914-28e1ae439fb4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa/action" status: 202 len: 0 microversion: 2.1 time: 0.706951 Jun 18 22:10:05.124138 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1161/2339] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:10:04 2022] POST /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:10:05.138869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:05.139551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:05.152628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.153126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.154015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.160405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.285695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:05.286754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:05.294900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.296336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.297439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.298229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.353072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:05.380386 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4530c34f-dd3a-49c0-ad3c-2e9644ec3084 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1471 microversion: 2.1 time: 0.251423 Jun 18 22:10:05.380938 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1179/2340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:05 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:05.489004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:05.498572 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd397841-cf65-4a4d-ab62-d1e087893f41 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.219083 Jun 18 22:10:05.499201 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1162/2341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:05 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:05.552570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:05.553330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:05.564141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.564584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.565428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.565874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.761311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:05.778904 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12825ae0-949d-491f-8be3-05a78665298b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.230559 Jun 18 22:10:05.789244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1180/2342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:05 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:05.789650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:05.789650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:05.798944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.800903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.801859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.802308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.814235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9290433f-23ab-4595-8377-6eac07b86eef req-840c4f37-2c3c-455c-8720-5886dd595ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2e22e-50e0-4ce6-a216-f49f927fa6d8", "name": "network-vif-plugged", "status": "completed", "tag": "8cc0d016-5899-4de2-b140-bc2656bcb49c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:05.828201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9290433f-23ab-4595-8377-6eac07b86eef req-840c4f37-2c3c-455c-8720-5886dd595ec1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.828939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9290433f-23ab-4595-8377-6eac07b86eef req-840c4f37-2c3c-455c-8720-5886dd595ec1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.855586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9290433f-23ab-4595-8377-6eac07b86eef req-840c4f37-2c3c-455c-8720-5886dd595ec1 service nova] Creating event network-vif-plugged:8cc0d016-5899-4de2-b140-bc2656bcb49c for instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 on nch1-master-1 Jun 18 22:10:05.862840 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9290433f-23ab-4595-8377-6eac07b86eef req-840c4f37-2c3c-455c-8720-5886dd595ec1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053140 Jun 18 22:10:05.865923 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1181/2343] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:10:05.934307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:05.936257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:05.970805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.974476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:05.978502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:05.989706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.096304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:06.112952 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de3efcbd-4a09-40ac-bd1f-3c35eeb45270 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.336966 Jun 18 22:10:06.114835 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1163/2344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:05 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:06.198923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:06.212459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:06.214182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:06.223070 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8b70ecf6-9020-4729-b435-cfd062e11a1c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.295773 Jun 18 22:10:06.224185 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1182/2345] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:05 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:06.400816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:06.401702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:06.409482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:06.410260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.412035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:06.412657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.521063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:06.521868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:06.534054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:06.534685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.535848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:06.536554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.675321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:06.687365 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58441994-2175-438e-a521-87256583a555 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1471 microversion: 2.1 time: 0.292715 Jun 18 22:10:06.688723 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1164/2346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:06 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1471 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:06.768923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:06.779583 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22ed3d7f-d09e-4db5-b508-d80da39097cb tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.266021 Jun 18 22:10:06.780385 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1183/2347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:06 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:06.796855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:06.797527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:06.806206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:06.806962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.807991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:06.808679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:06.971551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:07.011694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:07.021073 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f204e350-5b8b-4726-8732-18e3a7533766 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.228577 Jun 18 22:10:07.031882 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1165/2348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:06 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:07.139565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:07.140706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:07.148526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.149092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.150050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.150587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.243888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:07.244840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:07.252851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.254063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.255134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.255774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.355637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:07.364996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:07.366788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:07.369607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:07.373640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-985b59ce-14f4-4dcb-9f67-df1f2fe34f3f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.134187 Jun 18 22:10:07.385906 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1166/2349] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:07 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:07.394890 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c450a25-4d4d-4696-9b75-8081903e250c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1522 microversion: 2.1 time: 0.259548 Jun 18 22:10:07.395666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1184/2350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:07 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:07.708319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:07.709554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:07.721636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=14 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:07.729322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.730110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.734299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.734502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.797743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:07.799173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:07.815935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.817322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:07.821293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:07.830119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.128442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.139293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.144379 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d485feb-7722-462b-996c-f2c28df48684 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1471 microversion: 2.1 time: 0.442302 Jun 18 22:10:08.155534 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1167/2351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:07 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:08.160843 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-caaa2b4d-fc40-4faa-b811-43683aca734d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.367701 Jun 18 22:10:08.161288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:08.161785 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1185/2352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:07 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:08.161929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:08.168591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.169173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.173084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.173084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.383671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.393304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f722af05-67c3-4b43-b55d-0168e7a67269 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.236398 Jun 18 22:10:08.394781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:08.395629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:08.403386 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1168/2353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:08 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:08.409538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.414514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.415143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:08.416125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:08.417781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.418405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.423553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.424468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.425379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.425866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.536068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.549592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.551369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.557998 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b787191f-d717-4514-9380-e3e604ed9d68 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.168597 Jun 18 22:10:08.570570 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1186/2354] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:08 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:08.601531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.611226 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83a9a90a-59f2-4639-ba09-88d3a09d1363 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1507 microversion: 2.1 time: 0.201994 Jun 18 22:10:08.612214 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1169/2355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:08 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:08.635447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:08.636100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:08.645410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.646589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.647921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.648549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.807615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:08.818241 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-589d65b3-e0a9-4d22-ab1e-3faf00ab63c1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 200 len: 1507 microversion: 2.1 time: 0.193593 Jun 18 22:10:08.818843 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1187/2356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:08 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:08.835049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:08.835566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:08.843527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.843903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.844674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:08.845135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:08.870439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:08.923235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:08.954894 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fb4f7d7a-5c9c-405f-bcd1-3f289371a722 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 204 len: 0 microversion: 2.1 time: 0.123409 Jun 18 22:10:08.955815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1170/2357] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:08 2022] DELETE /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:09.082020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-677139421", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "673307c5-760f-4780-9688-b6119455b2a6"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:09.135319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] validate_networks() for [('673307c5-760f-4780-9688-b6119455b2a6', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:10:09.163439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:09.164451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:09.172412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.173229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.174374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.175138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.399110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:09.409660 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c5613d3-6637-4f36-bb07-527c6e5eb5b4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.250388 Jun 18 22:10:09.410417 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1171/2358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:09 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:09.419933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:09.419933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:09.426623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.427081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.427928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.428376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.665648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:09.680940 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e83ad943-b1d1-4ced-8680-3ec0571af5ee tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.268824 Jun 18 22:10:09.682739 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1172/2359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:09 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:09.688660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:09.689114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:09.689604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:09.690438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:09.690870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:09.695675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:09.696339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:09.702805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.703263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.704077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.704516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.704720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.705222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.706009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.706445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.726310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Getting quotas for project e25c9a06b279434b8c8f262a3c0a968b. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:09.733551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Getting quotas for user 86d98b6f30884d13a94ea2d4cabff826 and project e25c9a06b279434b8c8f262a3c0a968b. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:09.765355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:10:09.768049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:10:09.797879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:09.822331 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-19e61636-455a-4943-8cff-e0b1aa5a2275 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744224 Jun 18 22:10:09.824960 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1188/2360] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:10:09.831336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:09.832197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:09.840873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.841699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.842696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:09.843415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:09.885630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:09.899760 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5301377c-54bc-4cb8-ac3b-37b42f72204b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1510 microversion: 2.1 time: 0.215602 Jun 18 22:10:09.908040 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1173/2361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:09 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:09.917266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1a911f0-a8c0-4e5a-8d4f-c0b625b3c2f2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:09.920265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1a911f0-a8c0-4e5a-8d4f-c0b625b3c2f2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:09.972137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:09.982270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:09.988101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:10.002489 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-863e7eb4-e05d-492e-bd44-56c4b4eb4f0e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.176163 Jun 18 22:10:10.004286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1a911f0-a8c0-4e5a-8d4f-c0b625b3c2f2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:10.012456 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1a911f0-a8c0-4e5a-8d4f-c0b625b3c2f2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1217 microversion: 2.1 time: 0.103278 Jun 18 22:10:10.013672 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1174/2362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:09 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:10.017181 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1189/2363] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:09 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:10.242689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ef22d922-a556-4616-b40c-635ddbff7a36 req-e30da36a-d0b9-4eaa-b73f-48a90f7609ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6214ed2f-cfbb-4ccc-b6f7-0711af77391f", "name": "network-vif-plugged", "status": "completed", "tag": "71f5a1a3-23d0-4cbc-8d17-bd7955ebe277"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:10.257448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ef22d922-a556-4616-b40c-635ddbff7a36 req-e30da36a-d0b9-4eaa-b73f-48a90f7609ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.258178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ef22d922-a556-4616-b40c-635ddbff7a36 req-e30da36a-d0b9-4eaa-b73f-48a90f7609ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.290808 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ef22d922-a556-4616-b40c-635ddbff7a36 req-e30da36a-d0b9-4eaa-b73f-48a90f7609ed service nova] Creating event network-vif-plugged:71f5a1a3-23d0-4cbc-8d17-bd7955ebe277 for instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f on nch1-master-1 Jun 18 22:10:10.305471 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ef22d922-a556-4616-b40c-635ddbff7a36 req-e30da36a-d0b9-4eaa-b73f-48a90f7609ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064362 Jun 18 22:10:10.307872 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1175/2364] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:10.428524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:10.429310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:10.439972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.442525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.443709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.444589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.702182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:10.703739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:10.719495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.720430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.721925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.722609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.799200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:10.809956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dfbec02f-10e4-4c5d-96f1-167a7d8556da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.385309 Jun 18 22:10:10.810910 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1190/2365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:10 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:10.925773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:10.926658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:10.935428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.936149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.937290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:10.938228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:10.948466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:11.089995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.102039 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7fd75e03-c1a5-47bf-a248-23ccf3d03fe6 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.406609 Jun 18 22:10:11.103115 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1176/2366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:10 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:11.108331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:11.109114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:11.116146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.116697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.117706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.118534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.251174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.262078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.263614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.269957 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15780280-d9b3-4d45-8d43-f8530c507fcb tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.165605 Jun 18 22:10:11.282366 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1177/2367] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:11 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:11.289484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:11.290144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:11.300359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.301126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.304040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.304876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.319572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.334633 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4233424a-7e1e-4c64-bcf4-0e8f227b76e5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1487 microversion: 2.1 time: 0.412703 Jun 18 22:10:11.338454 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1191/2368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:10 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1487 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:11.356694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:11.357549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:11.367836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.368664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.369806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.370472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.416787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:11.437131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.448664 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef4a4345-9444-4f77-bdd9-ed8a80a21dbc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1275 microversion: 2.1 time: 0.164013 Jun 18 22:10:11.460650 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1178/2369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:11 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:11.576745 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-312f226b-0c1b-4b85-9cae-737e45034ec5 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 204 len: 0 microversion: 2.1 time: 0.217238 Jun 18 22:10:11.578514 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1192/2370] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:11 2022] DELETE /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:10:11.589721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:11.591209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:11.591837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9b1e2d14-8cd4-4025-bc34-856d3417997d req-76e400b6-254f-4b66-947e-eea2063e10fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2e22e-50e0-4ce6-a216-f49f927fa6d8", "name": "network-vif-deleted", "tag": "8cc0d016-5899-4de2-b140-bc2656bcb49c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:11.600173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.600729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.601699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.602335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.602441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9b1e2d14-8cd4-4025-bc34-856d3417997d req-76e400b6-254f-4b66-947e-eea2063e10fc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.602871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9b1e2d14-8cd4-4025-bc34-856d3417997d req-76e400b6-254f-4b66-947e-eea2063e10fc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.617784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9b1e2d14-8cd4-4025-bc34-856d3417997d req-76e400b6-254f-4b66-947e-eea2063e10fc service nova] Creating event network-vif-deleted:8cc0d016-5899-4de2-b140-bc2656bcb49c for instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 on nch1-master-1 Jun 18 22:10:11.623851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9b1e2d14-8cd4-4025-bc34-856d3417997d req-76e400b6-254f-4b66-947e-eea2063e10fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036955 Jun 18 22:10:11.624608 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1193/2371] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:11.773768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:11.792815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c93e114-b7ff-447a-9f80-413a6d80bdaa tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1493 microversion: 2.1 time: 0.209243 Jun 18 22:10:11.797125 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1179/2372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:11 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1493 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:11.830101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:11.831118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:11.838325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.839078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:11.839975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:11.840529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.005373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:12.016297 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f280d5f4-52cc-4648-ae2b-e2ba92f1b263 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.192162 Jun 18 22:10:12.017146 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1194/2373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:11 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:12.120277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:12.120914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:12.127849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:12.130922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.131552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.132343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.132777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.290748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:12.293795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:12.308245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.308882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.311146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.311794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.324169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:12.336013 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7976b82c-0bcf-47cf-b992-aac43241ce4f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1318 microversion: 2.1 time: 0.220542 Jun 18 22:10:12.337907 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1180/2374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:12 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:12.393098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:12.408424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:12.411195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:12.434473 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3dabfe57-92f5-45a3-ae79-11369f00126a tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.145496 Jun 18 22:10:12.436291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1195/2375] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:12 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:12.468087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:12.468634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:12.485162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.485619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.486411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.486851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.597500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:12.607948 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0ae890e-1133-4a6d-bbde-1b6a7be93d9e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1275 microversion: 2.1 time: 0.143627 Jun 18 22:10:12.608812 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1181/2376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:12 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:12.814395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:12.816040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:12.823147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.824087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:12.825508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:12.826382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.045411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:13.047340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:13.060289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.061083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.063420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.064037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.242279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.252391 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3bd02d2-cb73-446d-8ec2-9197bcb77bb0 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1493 microversion: 2.1 time: 0.446033 Jun 18 22:10:13.252981 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1196/2377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:12 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1493 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:13.347083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.353757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:13.356414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:13.364019 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-09754d4e-be87-4a71-8d94-6675ea17f833 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.332975 Jun 18 22:10:13.369154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.370327 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1182/2378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:13 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:13.371115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.372071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.372649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.456218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:13.457150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:13.463930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.464674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.465668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.466247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.588105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.599815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.601976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.610098 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc8a9825-9296-44ff-afae-6cf71d8f7809 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.157465 Jun 18 22:10:13.610724 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1183/2379] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:13 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:13.629479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.631484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:13.631684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:13.637810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da68b75d-7432-45fe-b24d-79e89fb5e86f tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1508 microversion: 2.1 time: 0.287987 Jun 18 22:10:13.638422 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1197/2380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:13 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:13.639688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.640358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.641291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.641832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:13.875215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:13.911247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4e59eb6e-544c-4d89-a034-235c4858943f req-3b15e22d-1d0a-4e43-86a4-e9f53d756d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4543c2-b1ba-4e6c-8f6c-95c6621054fd", "name": "network-vif-deleted", "tag": "43f6447f-9a81-4394-8c6e-2d915eecc788"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:13.963865 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aff7ad7f-61d2-4eb7-8721-e0506d3593e5 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1275 microversion: 2.1 time: 0.336825 Jun 18 22:10:13.969560 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1184/2381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:13 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1275 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:13.981839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4e59eb6e-544c-4d89-a034-235c4858943f req-3b15e22d-1d0a-4e43-86a4-e9f53d756d37 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:13.987779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4e59eb6e-544c-4d89-a034-235c4858943f req-3b15e22d-1d0a-4e43-86a4-e9f53d756d37 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.067316 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4e59eb6e-544c-4d89-a034-235c4858943f req-3b15e22d-1d0a-4e43-86a4-e9f53d756d37 service nova] Creating event network-vif-deleted:43f6447f-9a81-4394-8c6e-2d915eecc788 for instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd on nch2-master-1 Jun 18 22:10:14.091878 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4e59eb6e-544c-4d89-a034-235c4858943f req-3b15e22d-1d0a-4e43-86a4-e9f53d756d37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188333 Jun 18 22:10:14.101699 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1198/2382] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:14.275613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:14.277884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:14.298778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.305797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.309757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.310385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.369465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.370897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.371507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'fault' on Instance uuid 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:14.388905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:14.391975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:14.412153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.415142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.417399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.419383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.493019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:14.509972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b6eb254a-3942-4d58-9714-a7876efdadbb tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 200 len: 1304 microversion: 2.1 time: 0.244312 Jun 18 22:10:14.522628 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1185/2383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:14 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 1304 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:14.633019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:14.633681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:14.645242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.645720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.646561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:14.646982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:14.740700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:14.752674 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4ded35f6-4df9-4e2e-b90a-04574ab7aebd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.368732 Jun 18 22:10:14.767158 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1199/2384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:14 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:14.788026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:14.797580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:14.799773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:14.805380 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-190cab82-fbb7-42dc-ac1b-d14c6282479e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.177399 Jun 18 22:10:14.807158 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1186/2385] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:14 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:14.987957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:14.988583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:15.001391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.001873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.002691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.003084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.166395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:15.177764 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2aae8c41-bbf2-49d0-a7a2-1594d8e774e2 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.194779 Jun 18 22:10:15.178661 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1200/2386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:14 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:15.306757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7b8f9ff8-db9b-412d-a6bb-442c07357ef4"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:15.308078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:15.315822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.316363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.319177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.320021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.384514 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] HTTP exception thrown: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Request method failure captured: Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f/os-volume_attachments/e00de7f4-e7b5-4688-8269-eb3956f6a97f HTTP/1.1 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 74 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirky_k1iPNuopn0sddlxT9s3tNLAmakrWAvIL6BA08jJsqzl9OF8rQKkTmT8v_UW376BnmWdgYks9tAQCA_lY0ZLyJ9zue9v0kPjo1q5VP91UbIIanplw9LOrmOATHCoFSAOZgahJq1l4KtFezsGi-gbfQrm8Tjpijm_Cq4rjx6tTSNg Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: fed1a319a984482eabb1873973e84b83 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesAdminNegativeTest-192901963 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fed1a319a984482eabb1873973e84b83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1a319a984482eabb1873973e84b83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fed1a319a984482eabb1873973e84b83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fed1a319a984482eabb1873973e84b83", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesAdminNegativeTest-192901963 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: fed1a319a984482eabb1873973e84b83 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-192901963 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesAdminNegativeTest-192901963-project-admin Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: df66b9f0141a45a58b9a312c4c8a50f6 Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesAdminNegativeTest-192901963-project-admin Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: {"volumeAttachment": {"volumeId": "7b8f9ff8-db9b-412d-a6bb-442c07357ef4"}} Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: exception: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '6214ed2f-cfbb-4ccc-b6f7-0711af77391f', 'id': 'e00de7f4-e7b5-4688-8269-eb3956f6a97f', 'body': {'volumeAttachment': {'volumeId': '7b8f9ff8-db9b-412d-a6bb-442c07357ef4'}}} Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. (HTTP 404) (Request-ID: req-f7f51e54-c085-4d5f-a829-1a06999b94fe) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:10:15.386751 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] Returning 404 to user: Volume e00de7f4-e7b5-4688-8269-eb3956f6a97f could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-00d03d70-2045-4829-b3e4-483436c8d788 tempest-VolumesAdminNegativeTest-192901963 tempest-VolumesAdminNegativeTest-192901963-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f/os-volume_attachments/e00de7f4-e7b5-4688-8269-eb3956f6a97f" status: 404 len: 109 microversion: 2.1 time: 0.085866 Jun 18 22:10:15.396498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1187/2387] 10.222.0.30 () {60 vars in 1432 bytes} [Sat Jun 18 22:10:15 2022] PUT /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f/os-volume_attachments/e00de7f4-e7b5-4688-8269-eb3956f6a97f => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:10:15.536325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:15.536325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:15.541419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.541905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.543134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.543585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.561948 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd HTTP/1.1 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6c4543c2-b1ba-4e6c-8f6c-95c6621054fd'} Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:15.563616 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-48abdcb4-4ae8-498b-b02c-761859740741 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 404 len: 111 microversion: 2.1 time: 0.041089 Jun 18 22:10:15.567049 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1201/2388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:15 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:15.710225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1307616156", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "3f441f27-3ba5-45d6-b95b-68817e9863ca"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:15.772372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:15.784781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:15.795883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] validate_networks() for [('3f441f27-3ba5-45d6-b95b-68817e9863ca', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:10:15.797101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.797586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:15.799281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:15.799734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:16.505794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:16.516111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb61429c-1986-4c89-a598-f2a80051185a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.748981 Jun 18 22:10:16.516703 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1202/2389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:15 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:16.525554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:16.528188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:16.548382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:16.550142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:16.553496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:16.554443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:16.734405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:16.744055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:16.748272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:16.763810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-efed76a2-a2bb-407b-99d5-d83da9de091e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.241736 Jun 18 22:10:16.765792 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1203/2390] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:16 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:16.780410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:16.781520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:16.792195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:16.795078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:16.796234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:16.798026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:16.925848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:16.926955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:16.927654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:16.928258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:16.928836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:16.955447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:16.957943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:16.959065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:16.966705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.011993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:17.027312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Getting quotas for user 8ede0902f6cf47fc8bbcec812fd9615b and project b9a85ed67a4b4908b724c49a9754d312. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:17.061883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:10:17.064822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:10:17.077625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:17.093185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ecf32b75-8a32-461a-a7fd-fc01b4e3e32c tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.319149 Jun 18 22:10:17.103773 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1204/2391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:16 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:17.117090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0578d90e-66c5-40b4-bad1-3595f6e298d4 req-899c3da5-5952-4841-9b4f-66ba0e5b0ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6213fe12-0911-477e-8fb7-26b27d05be02", "tag": "8df3d1be-0d9a-4024-8949-86cd73dddd1b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:17.137881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0578d90e-66c5-40b4-bad1-3595f6e298d4 req-899c3da5-5952-4841-9b4f-66ba0e5b0ebe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.138622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0578d90e-66c5-40b4-bad1-3595f6e298d4 req-899c3da5-5952-4841-9b4f-66ba0e5b0ebe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.151297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a7b9b39-a7c1-4768-9553-8dd51d0d9d41 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444897 Jun 18 22:10:17.158890 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1188/2392] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:10:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:10:17.164492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.165493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:17.172122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.175799 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0578d90e-66c5-40b4-bad1-3595f6e298d4 req-899c3da5-5952-4841-9b4f-66ba0e5b0ebe service nova] Creating event network-changed:8df3d1be-0d9a-4024-8949-86cd73dddd1b for instance 6213fe12-0911-477e-8fb7-26b27d05be02 on nch2-master-1 Jun 18 22:10:17.185874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.187177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.187423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.194069 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0578d90e-66c5-40b4-bad1-3595f6e298d4 req-899c3da5-5952-4841-9b4f-66ba0e5b0ebe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088380 Jun 18 22:10:17.195098 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1205/2393] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:17.212529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06f4d448-7b7b-45e3-9fe2-8cebf59b2504 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.213558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-06f4d448-7b7b-45e3-9fe2-8cebf59b2504 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:17.241267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:17.246951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:17.316008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06f4d448-7b7b-45e3-9fe2-8cebf59b2504 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:17.323769 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06f4d448-7b7b-45e3-9fe2-8cebf59b2504 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1215 microversion: 2.1 time: 0.127624 Jun 18 22:10:17.328253 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1206/2394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:17 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:17.378380 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e4ffb7a0-5c4b-4bc9-ac05-60c7b74f00c8 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 204 len: 0 microversion: 2.1 time: 0.213805 Jun 18 22:10:17.383670 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1189/2395] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:17 2022] DELETE /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:17.391009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.391753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:17.401164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.401690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.402780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.404310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.623420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:17.633481 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4562d4d1-52d2-4974-acae-93c3e31b68a5 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1514 microversion: 2.1 time: 0.248630 Jun 18 22:10:17.638241 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1207/2396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:17 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:17.643801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.644448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:17.651360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.651978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.652801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.653467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.677603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Calling method '.version_select at 0x7fea14a49160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.734675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:10:17.737651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Neutron security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:10:17.738320 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] HTTP exception thrown: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.738320 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Request method failure captured: Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-security-groups/3b95520b-328c-4c45-8a72-7fd82d0a4565 HTTP/1.1 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk1JBWcujr-6ib2OgzsFWwGpauvdQbQ0wLfQoVEXvn2OH_SZN86qAB8scxmohSC3fzhL7gzXteTyOg8g8kSbqIpOLE9obZKIfynu7-o05a87hH7hMkKtjMzbr2Bp1CWVtPYvX4MnMi5R7k0NRmiUL6HIZgydhLXsTn_YgVy62BPTl44 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd97846dc159425d83b5b7fe99db3549", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 9da453849f944743a866ca88f988d67b Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3b95520b-328c-4c45-8a72-7fd82d0a4565'} Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:10:17.744408 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Returning 404 to user: Security group 3b95520b-328c-4c45-8a72-7fd82d0a4565 does not exist Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-dce79907-04df-43fd-b846-fc7d7a674152'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:17.750522 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95c376e5-d424-4250-949f-50a3b67e30e1 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/3b95520b-328c-4c45-8a72-7fd82d0a4565" status: 404 len: 194 microversion: 2.1 time: 0.300036 Jun 18 22:10:17.754906 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1190/2397] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:10:17 2022] DELETE /compute/v2.1/os-security-groups/3b95520b-328c-4c45-8a72-7fd82d0a4565 => generated 194 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:17.760538 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7429b406-5302-44aa-8910-23ef710527cf tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004852 Jun 18 22:10:17.761465 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1191/2398] 10.222.0.30 () {58 vars in 1163 bytes} [Sat Jun 18 22:10:17 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 22:10:17.779480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-490791d7-ffa3-4216-8271-d6f4a6c6ca2d tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Calling method '.version_select at 0x7fea142fbaf0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.885062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:17.900175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1320501-cdad-444e-adc6-f50bc3252e1a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.260436 Jun 18 22:10:17.901434 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1208/2399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:17 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:17.920065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:17.920843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:17.929510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.930411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:17.931885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:17.932624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.020276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:18.024846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:18.039047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:18.041647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:18.049260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0842838a-9d61-4dc7-acff-fa54ebf7559f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.134929 Jun 18 22:10:18.050479 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1209/2400] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:17 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:18.077327 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-490791d7-ffa3-4216-8271-d6f4a6c6ca2d tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.306602 Jun 18 22:10:18.078010 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1192/2401] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:10:17 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:18.090750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-298bac24-d520-451d-a5f5-434555d8e2ff tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Calling method '.version_select at 0x7fea1493f9d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:18.114482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:18.115184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:18.125624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.130616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.130616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.130616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.326526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-298bac24-d520-451d-a5f5-434555d8e2ff tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:10:18.327614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-298bac24-d520-451d-a5f5-434555d8e2ff tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 18 22:10:18.327614 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-298bac24-d520-451d-a5f5-434555d8e2ff tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Request method failure captured: Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-security-groups/48587da6-1f0b-422c-84a3-a7a5f2e6340c HTTP/1.1 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk1JBWcujr-6ib2OgzsFWwGpauvdQbQ0wLfQoVEXvn2OH_SZN86qAB8scxmohSC3fzhL7gzXteTyOg8g8kSbqIpOLE9obZKIfynu7-o05a87hH7hMkKtjMzbr2Bp1CWVtPYvX4MnMi5R7k0NRmiUL6HIZgydhLXsTn_YgVy62BPTl44 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd97846dc159425d83b5b7fe99db3549", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 9da453849f944743a866ca88f988d67b Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: exception: Insufficient rights for removing default security group. Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '48587da6-1f0b-422c-84a3-a7a5f2e6340c'} Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:10:18.330106 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-298bac24-d520-451d-a5f5-434555d8e2ff tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-5cec6eb6-4243-47f6-bb82-9954a6c5fead'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-298bac24-d520-451d-a5f5-434555d8e2ff tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/48587da6-1f0b-422c-84a3-a7a5f2e6340c" status: 400 len: 182 microversion: 2.1 time: 0.246225 Jun 18 22:10:18.334258 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1210/2402] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:10:18 2022] DELETE /compute/v2.1/os-security-groups/48587da6-1f0b-422c-84a3-a7a5f2e6340c => generated 182 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:10:18.337880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:18.347811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:18.349794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:18.349954 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-00fdbcbd-7e61-45ba-b998-94e52e988bbe tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.239369 Jun 18 22:10:18.351006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1193/2403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:18 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:18.360158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Calling method '.version_select at 0x7fea142fb160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:18.360339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.360638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.361560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.362144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.394936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:10:18.395682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Neutron security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:10:18.396317 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] HTTP exception thrown: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.396317 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Request method failure captured: Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-security-groups/5a8ac87d-0eb3-4fbf-806f-fffde0473c98 HTTP/1.1 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk1JBWcujr-6ib2OgzsFWwGpauvdQbQ0wLfQoVEXvn2OH_SZN86qAB8scxmohSC3fzhL7gzXteTyOg8g8kSbqIpOLE9obZKIfynu7-o05a87hH7hMkKtjMzbr2Bp1CWVtPYvX4MnMi5R7k0NRmiUL6HIZgydhLXsTn_YgVy62BPTl44 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd97846dc159425d83b5b7fe99db3549", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 9da453849f944743a866ca88f988d67b Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '5a8ac87d-0eb3-4fbf-806f-fffde0473c98'} Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:10:18.399283 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Returning 404 to user: Security group 5a8ac87d-0eb3-4fbf-806f-fffde0473c98 does not exist Jun 18 22:10:18.403934 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-700117c1-1368-4b8c-91f2-61efd7ca30b7'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:18.407319 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aabea217-1cb5-4367-96ed-b4539b587701 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/5a8ac87d-0eb3-4fbf-806f-fffde0473c98" status: 404 len: 194 microversion: 2.1 time: 0.054002 Jun 18 22:10:18.412388 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1194/2404] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:10:18 2022] GET /compute/v2.1/os-security-groups/5a8ac87d-0eb3-4fbf-806f-fffde0473c98 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:18.432773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Action: 'update', calling method: .version_select at 0x7fea144bde50>, body: {"security_group": {"name": "tempest-sg-2003341400", "description": "tempest-description-271925501"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:18.504196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:10:18.505117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Neutron security group 098144fd-2bff-4b8d-a70e-6a00282b5241 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:10:18.505640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:18.511541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] HTTP exception thrown: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.511541 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Request method failure captured: Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/os-security-groups/098144fd-2bff-4b8d-a70e-6a00282b5241 HTTP/1.1 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 101 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk1JBWcujr-6ib2OgzsFWwGpauvdQbQ0wLfQoVEXvn2OH_SZN86qAB8scxmohSC3fzhL7gzXteTyOg8g8kSbqIpOLE9obZKIfynu7-o05a87hH7hMkKtjMzbr2Bp1CWVtPYvX4MnMi5R7k0NRmiUL6HIZgydhLXsTn_YgVy62BPTl44 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd97846dc159425d83b5b7fe99db3549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd97846dc159425d83b5b7fe99db3549", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: fd97846dc159425d83b5b7fe99db3549 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991 Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 9da453849f944743a866ca88f988d67b Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1795119991-project Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: {"security_group": {"name": "tempest-sg-2003341400", "description": "tempest-description-271925501"}} Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '098144fd-2bff-4b8d-a70e-6a00282b5241', 'body': {'security_group': {'name': 'tempest-sg-2003341400', 'description': 'tempest-description-271925501'}}} Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:10:18.515358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] Returning 404 to user: Security group 098144fd-2bff-4b8d-a70e-6a00282b5241 does not exist Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-4ed49f62-b59d-47bd-8e14-9983b29700d2'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-435f53ba-df67-4e4f-9672-561e242f9066 tempest-SecurityGroupsNegativeTestJSON-1795119991 tempest-SecurityGroupsNegativeTestJSON-1795119991-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/098144fd-2bff-4b8d-a70e-6a00282b5241" status: 404 len: 194 microversion: 2.1 time: 0.091511 Jun 18 22:10:18.524554 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1195/2405] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Jun 18 22:10:18 2022] PUT /compute/v2.1/os-security-groups/098144fd-2bff-4b8d-a70e-6a00282b5241 => generated 194 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:18.526821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab790ad1-9579-42a3-bd6c-870f95b24d97 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1219 microversion: 2.1 time: 0.178861 Jun 18 22:10:18.533583 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1211/2406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:18 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1219 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:18.652201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:18.654305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:18.668573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.669391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.672148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.672945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.930474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:18.934329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:18.956114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.957577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:18.960830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:18.961511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:19.033846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:19.049905 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f7abde5-82ec-4839-97aa-e756928948de tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1514 microversion: 2.1 time: 0.396387 Jun 18 22:10:19.052615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1196/2407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:18 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1514 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:19.087521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:19.091388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:19.115881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:19.119370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:19.120726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:19.121405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:19.296616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:19.312046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:19.315202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:19.334988 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-77450ad6-0a15-433d-b743-71f06f7fa446 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.264812 Jun 18 22:10:19.335638 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1197/2408] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:19 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:19.368300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:19.368930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:19.381785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:19.382163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:19.383032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:19.385715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:19.716011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:19.808730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:19.832244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-800bb731-67ed-436e-b1b0-6e32af9998c2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.915336 Jun 18 22:10:19.832847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1212/2409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:18 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:19.840397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:19.841302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:19.861237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:19.861866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:19.862724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:19.863859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.077397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:20.093787 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c26979e0-9900-47d1-a3e6-8664eb4f23ae tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1273 microversion: 2.1 time: 0.259306 Jun 18 22:10:20.102707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1213/2410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:19 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:20.108570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-46d53f55-6549-42f1-a391-2b2276d93583 req-b7181f68-3a47-4a32-a657-477eb2300575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6214ed2f-cfbb-4ccc-b6f7-0711af77391f", "name": "network-vif-deleted", "tag": "71f5a1a3-23d0-4cbc-8d17-bd7955ebe277"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:20.132709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46d53f55-6549-42f1-a391-2b2276d93583 req-b7181f68-3a47-4a32-a657-477eb2300575 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.148325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46d53f55-6549-42f1-a391-2b2276d93583 req-b7181f68-3a47-4a32-a657-477eb2300575 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.151446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:20.169115 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24230ac1-132c-4723-ac42-550542b37d77 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.804951 Jun 18 22:10:20.174274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1198/2411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:19 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:20.186825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:20.192320 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-46d53f55-6549-42f1-a391-2b2276d93583 req-b7181f68-3a47-4a32-a657-477eb2300575 service nova] Creating event network-vif-deleted:71f5a1a3-23d0-4cbc-8d17-bd7955ebe277 for instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f on nch1-master-1 Jun 18 22:10:20.193391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:20.218084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.218888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.220843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.221558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.230895 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-46d53f55-6549-42f1-a391-2b2276d93583 req-b7181f68-3a47-4a32-a657-477eb2300575 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122890 Jun 18 22:10:20.233073 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1214/2412] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:20.380914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:20.382392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:20.392618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:20.410070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.410685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.412624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.413334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.423747 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17b63097-1b96-4b90-9d78-3ac8b5784d51 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 200 len: 1303 microversion: 2.1 time: 0.246634 Jun 18 22:10:20.424943 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1199/2413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:20 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 1303 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:20.573240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:20.584481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:20.586439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:20.594253 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f81e708-1d5f-4ab0-bf93-7f74c9bbc7a5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.238514 Jun 18 22:10:20.607729 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1215/2414] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:20 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:20.852202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:20.852845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:20.860895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.861441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:20.862473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:20.863083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.114828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:21.115580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:21.124830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.125532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.126483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.126915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.393620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:21.402362 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c98cdebf-5bf1-4119-b0ed-8d6610356619 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1273 microversion: 2.1 time: 0.294394 Jun 18 22:10:21.403658 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1216/2415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:21 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:21.409697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:21.410756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:21.417497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.418069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.419014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.419658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.596083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:21.604815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b806813-5faa-4889-97ca-ac439a51510b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.757409 Jun 18 22:10:21.606033 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1200/2416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:20 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:21.610842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:21.611688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 6214ed2f-cfbb-4ccc-b6f7-0711af77391f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:21.619073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.619592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.621337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.621819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.637698 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] HTTP exception thrown: Instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f could not be found. Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Request method failure captured: Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f HTTP/1.1 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkytNTPQogU6-oHG9-byI8nG2pFRhtVKig3ct8YJ0C7MLBtLkPIJv0mKxe22XiwQ7YmXz9uaWO74yp1taHbhpxst4QFn04ejwvPuvEERYLrh4xUOnV11AFwrlTagfkN6DnNM0-AdAjF5T8c3ey9WWiMMUgf2cwwi-oeQc-iRujSVGQ8 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4643e24233bd4af1a0c020e4d9a474fb Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesAdminNegativeTest-711931070 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4643e24233bd4af1a0c020e4d9a474fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4643e24233bd4af1a0c020e4d9a474fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4643e24233bd4af1a0c020e4d9a474fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4643e24233bd4af1a0c020e4d9a474fb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesAdminNegativeTest-711931070 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4643e24233bd4af1a0c020e4d9a474fb Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-711931070 Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesAdminNegativeTest-711931070-project Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: cf9fa8d3d2bc4f9fa12fab743b7090ad Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesAdminNegativeTest-711931070-project Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f could not be found. Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '6214ed2f-cfbb-4ccc-b6f7-0711af77391f'} Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f could not be found. Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f could not be found. Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:21.639433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f could not be found. Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Returning 404 to user: Instance 6214ed2f-cfbb-4ccc-b6f7-0711af77391f could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-901b9e93-403b-4899-9249-6f803cf74d98 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f" status: 404 len: 111 microversion: 2.1 time: 0.033748 Jun 18 22:10:21.643943 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1201/2417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:21 2022] GET /compute/v2.1/servers/6214ed2f-cfbb-4ccc-b6f7-0711af77391f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:21.652001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:21.654667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:21.660715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.661328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.662029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:21.662446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:21.775927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:21.788947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:21.792312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:21.796052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:21.803526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-07b3e387-669e-4e89-b51d-60ed422412be tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.160541 Jun 18 22:10:21.804208 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1202/2418] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:21 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:21.805511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-42b040c7-e21d-4374-a3b0-db80cfd96590 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.399580 Jun 18 22:10:21.815842 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1217/2419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:21 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:22.423260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:22.424015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:22.432800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:22.433809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:22.435538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:22.436204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:22.631370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:22.632605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:22.641398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:22.641856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:22.642617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:22.643387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:22.966063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:22.976310 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7de8f9e-2635-4a29-8828-4335c0efa03a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.559996 Jun 18 22:10:22.977120 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1203/2420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:22 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:22.982367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:22.982885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:22.989903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:22.990486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:22.991450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:22.992027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.023219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:23.061405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:23.073082 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83b12442-5d9a-4084-a74c-d30c23db3c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.453387 Jun 18 22:10:23.074113 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1218/2421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:22 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:23.080176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:23.080935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:23.087720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.088577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.089906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.090587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.134406 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08c2d791-8493-4bbe-8716-2c5b9f7a74af tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 204 len: 0 microversion: 2.1 time: 0.155951 Jun 18 22:10:23.135349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1204/2422] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:22 2022] DELETE /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:23.143163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:23.144442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:23.152429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.152961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.153771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.154203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.313541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:23.324340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:23.326233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:23.332607 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f22cb5ad-94e8-46d5-9785-04a97fe1dd09 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.195149 Jun 18 22:10:23.333245 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1205/2423] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:23 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:23.338473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:23.339539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:23.347346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.347940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.349370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.349812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.393117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:23.412152 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ffed0797-2f12-4c7c-b814-b6e75c4a6e3d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.336121 Jun 18 22:10:23.414872 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1219/2424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:23 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:23.630177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:23.638711 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-31ab876d-d13f-4574-9f61-077828fb6ccd tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1683 microversion: 2.1 time: 0.304006 Jun 18 22:10:23.642102 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1206/2425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:23 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1683 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:23.850350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9baa68fb-5f0b-4ed5-ae81-5fb9e7f84f82 req-f3e67791-7fc3-4230-8e9c-368c7f8d26f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41187fb-e6bd-4e95-8982-d907f342e9ee", "tag": "5edb878d-9fb6-4cd0-b0bd-a9f5adf28bd9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:23.865925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9baa68fb-5f0b-4ed5-ae81-5fb9e7f84f82 req-f3e67791-7fc3-4230-8e9c-368c7f8d26f4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:23.887084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9baa68fb-5f0b-4ed5-ae81-5fb9e7f84f82 req-f3e67791-7fc3-4230-8e9c-368c7f8d26f4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:23.904811 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9baa68fb-5f0b-4ed5-ae81-5fb9e7f84f82 req-f3e67791-7fc3-4230-8e9c-368c7f8d26f4 service nova] Creating event network-changed:5edb878d-9fb6-4cd0-b0bd-a9f5adf28bd9 for instance a41187fb-e6bd-4e95-8982-d907f342e9ee on nch1-master-1 Jun 18 22:10:23.911379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9baa68fb-5f0b-4ed5-ae81-5fb9e7f84f82 req-f3e67791-7fc3-4230-8e9c-368c7f8d26f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069633 Jun 18 22:10:23.912664 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1220/2426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:23.994888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:23.995551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:24.004030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.004795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.005870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.006730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.094842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:24.095590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:24.118511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.119018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.120118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.120643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.272121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:24.282063 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92aecd35-286a-456b-91d9-a953a29f89cf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.291841 Jun 18 22:10:24.285495 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1207/2427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:23 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:24.351782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:24.357496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:24.358133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:24.364226 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93c265da-c29d-4109-a27f-c63513ee0bdb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.276500 Jun 18 22:10:24.365381 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1221/2428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:24 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:24.378440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.379374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.380307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.380913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.441602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:24.442479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:24.451591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.452502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.453393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.453840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.471623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:24.477076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:24.492208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:24.494644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:24.503341 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e4f477d9-da06-420c-8209-d89a0c5c5215 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1446 microversion: 2.75 time: 0.152494 Jun 18 22:10:24.504856 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1208/2429] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:24 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:24.510826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c2422f94-5317-411a-bda5-3ab3ca4064a9 req-d84c36e8-14ef-4286-9b4b-e2be7e15814d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6213fe12-0911-477e-8fb7-26b27d05be02", "name": "network-vif-plugged", "status": "completed", "tag": "8df3d1be-0d9a-4024-8949-86cd73dddd1b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:24.524046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c2422f94-5317-411a-bda5-3ab3ca4064a9 req-d84c36e8-14ef-4286-9b4b-e2be7e15814d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.524761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c2422f94-5317-411a-bda5-3ab3ca4064a9 req-d84c36e8-14ef-4286-9b4b-e2be7e15814d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.539146 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c2422f94-5317-411a-bda5-3ab3ca4064a9 req-d84c36e8-14ef-4286-9b4b-e2be7e15814d service nova] Creating event network-vif-plugged:8df3d1be-0d9a-4024-8949-86cd73dddd1b for instance 6213fe12-0911-477e-8fb7-26b27d05be02 on nch2-master-1 Jun 18 22:10:24.545297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c2422f94-5317-411a-bda5-3ab3ca4064a9 req-d84c36e8-14ef-4286-9b4b-e2be7e15814d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038925 Jun 18 22:10:24.546174 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1209/2430] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:24.657051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:24.657805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:24.681304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.682105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:24.683136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:24.684276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:25.210117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:25.220755 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d8db3d4-c5ac-4171-9276-e2e43b2d42aa tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.784582 Jun 18 22:10:25.233212 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1222/2431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:24 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:25.407866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:25.413798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:25.414550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:25.421642 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d25b8cde-f4ee-400b-b406-5ce8b4bf76be tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1683 microversion: 2.1 time: 0.768362 Jun 18 22:10:25.422397 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1210/2432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:24 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1683 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:25.429357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:25.430722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:25.454020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:25.455978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:25.458510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:25.461315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:25.510147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:25.511725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:25.514796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:25.515360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.027497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.035609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e82aa64-e435-435a-8927-f98d9ee66b5d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.612052 Jun 18 22:10:26.042234 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1211/2433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:25 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:26.050234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:26.051553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:26.072798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.091768 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-086d36fa-01c8-4a8d-b4af-b132a9302f2c tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.793059 Jun 18 22:10:26.093310 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1223/2434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:25 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:26.108359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.110960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.114679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.117195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.241371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:26.242199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:26.263239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.263701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.264685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.265338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.360474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.381226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.385201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.392428 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a3b600d-5156-45f8-ae52-8b2f51eb93b5 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1452 microversion: 2.75 time: 0.348585 Jun 18 22:10:26.394834 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1212/2435] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:26 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1452 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:26.441912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:26.443669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:26.461166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.472134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.477742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.478969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.676262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.724564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ebe676b-2d19-4f77-884b-a443fac5349e tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1615 microversion: 2.1 time: 0.282252 Jun 18 22:10:26.729008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:26.748815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1213/2436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:26 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1615 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:26.750546 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cf1c1fe-22da-44c6-9172-cc116f340885 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.514503 Jun 18 22:10:26.755161 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1224/2437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:26 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:26.758123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-17628edd-b70f-4bc3-8ce0-8fae60c64cb3 req-2024ef29-ceb9-4b13-8884-191395015db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4", "name": "network-vif-deleted", "tag": "26600d51-5817-4750-bb7c-c78f6322072b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:26.764032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:26.781515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-17628edd-b70f-4bc3-8ce0-8fae60c64cb3 req-2024ef29-ceb9-4b13-8884-191395015db9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:26.781956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-17628edd-b70f-4bc3-8ce0-8fae60c64cb3 req-2024ef29-ceb9-4b13-8884-191395015db9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:26.816431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-17628edd-b70f-4bc3-8ce0-8fae60c64cb3 req-2024ef29-ceb9-4b13-8884-191395015db9 service nova] Creating event network-vif-deleted:26600d51-5817-4750-bb7c-c78f6322072b for instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 on nch1-master-1 Jun 18 22:10:26.823337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-17628edd-b70f-4bc3-8ce0-8fae60c64cb3 req-2024ef29-ceb9-4b13-8884-191395015db9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070801 Jun 18 22:10:26.827755 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1214/2438] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:27.061021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:27.062062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:27.072313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.072978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.074261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.075517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.105716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:27.106908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:27.111979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:27.113347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:27.140438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.145850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.148069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.148754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.328459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:27.429774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:27.433342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:27.440074 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91c197dd-91d8-49a5-b1dc-90060835fe40 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.383901 Jun 18 22:10:27.441336 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1225/2439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:27 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:27.446843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:27.447556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:27.454185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0a01d3f-6451-4b5e-845f-b7d0358b6e4e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.349108 Jun 18 22:10:27.457083 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1215/2440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:27 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:27.461209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.461834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.462904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.463783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.560218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:27.576562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:27.587581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:27.596473 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ea1c08b-7b55-4a89-8f20-894f5080ca9f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1452 microversion: 2.75 time: 0.153492 Jun 18 22:10:27.597291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1226/2441] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:27 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:27.756357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:27.756950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:27.764585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.765142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.766203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.773179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:27.775113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:27.779131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.787099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.790798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.791627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.792071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.850771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:27.851337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:27.851969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lazy-loading 'fault' on Instance uuid 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:27.923415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:27.936972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9a082cf-cc3e-46f0-99b5-1b8fba61701d tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1331 microversion: 2.1 time: 0.183761 Jun 18 22:10:27.938572 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1216/2442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:27 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1331 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:28.014816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:28.027769 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f933a9ab-aadc-4464-a121-1e19ecdf8af3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1317 microversion: 2.1 time: 0.259469 Jun 18 22:10:28.037550 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1227/2443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:27 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:28.459457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:28.460531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:28.470268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.471247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.472253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.472883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.473004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:28.473691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:28.478085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:28.483146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.483728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.484968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.485735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.720049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:28.723151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:28.724335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:28.733563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3af7f4bd-2d3e-4c32-a99e-1fa161688d16 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.278767 Jun 18 22:10:28.734211 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1217/2444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:28 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:28.734337 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de247c50-3732-4b9c-bf99-2a609f0d071a tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.266185 Jun 18 22:10:28.735070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1228/2445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:28 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:28.741321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:28.741996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:28.749097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.749843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.750730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.751222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.833447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:28.844164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:28.846204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:28.851972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-942160d3-64bf-4234-a325-5682e8e9f72d tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1437 microversion: 2.75 time: 0.115925 Jun 18 22:10:28.852591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1218/2446] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:28 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:28.955601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:28.956223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:28.964444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.965194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:28.965971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:28.966408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.002681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.003583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.004183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lazy-loading 'fault' on Instance uuid 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:29.077784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf9fa8d3d2bc4f9fa12fab743b7090ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4643e24233bd4af1a0c020e4d9a474fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:29.092755 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21fb0ca0-8da2-4056-8dd1-ed3431a34177 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 200 len: 1331 microversion: 2.1 time: 0.141252 Jun 18 22:10:29.103488 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1219/2447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:28 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:29.112292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:29.117214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.120791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:29.123173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.127070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.127639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.128576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.129235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.132444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.132941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.135667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.136113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.238473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:29.239091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:29.239687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:29.240203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:29.240833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:29.287472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:29.299048 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f5724ea-00d6-41c5-a6f5-b7d6e17f5897 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1506 microversion: 2.1 time: 0.194224 Jun 18 22:10:29.311267 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1220/2448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:29 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:29.311567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.318106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:29.319179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.320441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.321421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.322275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.322760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.327606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.327820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.329659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.330221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.506208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:29.540115 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7582cdad-45ac-4368-80f8-b9e43c8e4d6e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088/action" status: 202 len: 1940 microversion: 2.75 time: 0.672122 Jun 18 22:10:29.541294 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1229/2449] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:10:28 2022] POST /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088/action => generated 1940 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 18 22:10:29.571941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:29.572609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.592409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:29.600902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.601128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.602066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.602631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.616985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d1e2e5e-af17-470e-a930-cf6b6f8d379d tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1506 microversion: 2.1 time: 0.303589 Jun 18 22:10:29.618295 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1221/2450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:29 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:29.640017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:29.643111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.659351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.659615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.660505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.661009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.819972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:29.847752 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90a59b77-16cd-4f31-bae9-b09ecf46eeff tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.289041 Jun 18 22:10:29.850026 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1230/2451] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:29 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:29.862144 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-baadecd4-3b5e-4d2b-9521-3ba197e60fe7 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "PUT /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1078 microversion: 2.1 time: 0.221622 Jun 18 22:10:29.862144 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1222/2452] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:10:29 2022] PUT /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1078 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:29.868363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:29.869287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.875744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:29.876372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:29.878001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.878455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.879396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.879996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.894349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.894908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:29.896717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:29.898153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.263707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:30.267072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:30.280130 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a49d2bda-dc1f-453d-b3ea-5db9dbd8b811 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.418153 Jun 18 22:10:30.280993 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1223/2453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:29 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:30.282026 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8e546dc1-3de7-429c-a19e-6e64aa8eb02d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.412976 Jun 18 22:10:30.289899 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1231/2454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:29 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:30.289899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:30.293219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] [instance: 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:30.295036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:30.298123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:30.301384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.301951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.302869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.303710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.311227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.313409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.314530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.315263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.328804 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] HTTP exception thrown: Instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 could not be found. Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Request method failure captured: Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 HTTP/1.1 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkytNTPQogU6-oHG9-byI8nG2pFRhtVKig3ct8YJ0C7MLBtLkPIJv0mKxe22XiwQ7YmXz9uaWO74yp1taHbhpxst4QFn04ejwvPuvEERYLrh4xUOnV11AFwrlTagfkN6DnNM0-AdAjF5T8c3ey9WWiMMUgf2cwwi-oeQc-iRujSVGQ8 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4643e24233bd4af1a0c020e4d9a474fb Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesAdminNegativeTest-711931070 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4643e24233bd4af1a0c020e4d9a474fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4643e24233bd4af1a0c020e4d9a474fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4643e24233bd4af1a0c020e4d9a474fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4643e24233bd4af1a0c020e4d9a474fb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesAdminNegativeTest-711931070 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4643e24233bd4af1a0c020e4d9a474fb Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-711931070 Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesAdminNegativeTest-711931070-project Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cf9fa8d3d2bc4f9fa12fab743b7090ad Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesAdminNegativeTest-711931070-project Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 could not be found. Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4'} Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 could not be found. Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 could not be found. Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:30.330983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 could not be found. Jun 18 22:10:30.334948 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:30.336965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Returning 404 to user: Instance 19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:30.338028 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81993555-8efa-41af-b83b-6c72421bfdd3 tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4" status: 404 len: 111 microversion: 2.1 time: 0.054127 Jun 18 22:10:30.338741 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1232/2455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:30 2022] GET /compute/v2.1/servers/19ba0cfb-fdf4-44cd-8bc9-ffa849e9aed4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:30.348586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-97a9e79b-3285-4bf4-adf7-67acf06f125b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] Calling method '.version_select at 0x7fea14550d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:30.378867 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-97a9e79b-3285-4bf4-adf7-67acf06f125b tempest-VolumesAdminNegativeTest-711931070 tempest-VolumesAdminNegativeTest-711931070-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522621009" status: 202 len: 0 microversion: 2.1 time: 0.034672 Jun 18 22:10:30.380104 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1233/2456] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522621009 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:10:30.605991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:30.626463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee109787-411f-4913-acac-1253b7fcc834 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1504 microversion: 2.1 time: 0.341995 Jun 18 22:10:30.637201 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1224/2457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:30 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:30.646369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:30.646997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:30.658606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.659346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.660906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.661556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.872426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:30.874000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:30.883282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.883862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.884761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:30.885322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:30.956071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:31.136229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:31.155565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-79cfcf12-4b94-45a8-959b-3c10bd685fba tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.289524 Jun 18 22:10:31.156161 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1225/2458] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:30 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:31.287337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:31.298402 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b5bc615-3b13-4cc6-a695-6d8bf4f6cc19 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1504 microversion: 2.1 time: 0.656919 Jun 18 22:10:31.298742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:31.299365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:31.299734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1234/2459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:30 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1504 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:31.305938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:31.307156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:31.307313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.307936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.309524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.310379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.316363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.317215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.318187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.319071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.761415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:31.773601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35b8b623-cf51-4eac-b6ef-d6490144fd66 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.479127 Jun 18 22:10:31.783677 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1226/2460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:31 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:31.783677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:31.783677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:31.789158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.789761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.790581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.791024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.800683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:31.811217 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66524be4-3fe8-4f8a-a16e-51a0dc701a12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.510172 Jun 18 22:10:31.812975 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1235/2461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:31 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:31.908335 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-98c3c620-1761-4add-84c6-eaac8371025a tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "PUT /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1080 microversion: 2.1 time: 0.132370 Jun 18 22:10:31.917717 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1227/2462] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:10:31 2022] PUT /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1080 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:31.923753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:31.924542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:31.931550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.932162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:31.933127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:31.933855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.176180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:32.176802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:32.184547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.185005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.185839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.186282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.319508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:32.337936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-395b9aaf-3ef6-4797-a483-ae43f3fabd99 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.165797 Jun 18 22:10:32.357073 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1228/2463] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:32 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:10:32.382052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:32.395927 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be325403-f7ff-420f-a540-7733b3a3810f tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1506 microversion: 2.1 time: 0.475996 Jun 18 22:10:32.397377 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1236/2464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:31 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:32.412659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:32.413546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:32.420173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.420619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.421682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.422266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.649138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:32.659246 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0eb31cff-774b-43a9-8b82-fd83d1946739 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1506 microversion: 2.1 time: 0.250401 Jun 18 22:10:32.661154 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1229/2465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:32 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:32.678190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:32.679533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:32.687723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.688452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.690046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.690496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.725537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:32.792826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:32.793329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:32.804089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.805593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.806678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.807133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.829002 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd1868ff-9dd9-4e44-8d92-b03be6d360f1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 204 len: 0 microversion: 2.1 time: 0.153857 Jun 18 22:10:32.831460 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1237/2466] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:32 2022] DELETE /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:32.845452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:32.846791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:32.854857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.855605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:32.856397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:32.856837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.166914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:33.168580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:33.178103 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d912ce45-87e7-46b5-bd0b-4e875491d153 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.345120 Jun 18 22:10:33.178694 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1238/2467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:32 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:33.189708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:33.189708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:33.190917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.191405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.192345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.192780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.193604 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93cfb5ca-abf9-4af6-b02f-29e758b7f514 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.406067 Jun 18 22:10:33.203756 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1230/2468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:32 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:33.223146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:33.272284 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.api [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Instance is already in deleting state, ignoring this request Jun 18 22:10:33.273521 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10d5078c-e7d3-4ddf-95da-8085f3580bdc tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 204 len: 0 microversion: 2.1 time: 0.093913 Jun 18 22:10:33.274639 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1239/2469] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:33 2022] DELETE /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:33.286773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:33.287449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:33.296832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.297390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.299202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.300004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.357857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:33.359032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:33.365726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.366471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.367448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.368075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.538239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:33.550122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:33.598701 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0dd7b28b-41c1-43c8-90f8-2ecf3d7dc70b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.244516 Jun 18 22:10:33.604418 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1240/2470] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:33 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:33.701166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:33.713116 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93efd0e5-5b88-4d8a-a6c1-fb992f14425e tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1512 microversion: 2.1 time: 0.434021 Jun 18 22:10:33.714520 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1231/2471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:33 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1512 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:33.851879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-53e4daa5-7d10-497a-8a3e-e7dbbf2c1881 req-004ad29f-eccd-4fdf-b2e2-bc7fd9fff77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41187fb-e6bd-4e95-8982-d907f342e9ee", "name": "network-vif-plugged", "status": "completed", "tag": "5edb878d-9fb6-4cd0-b0bd-a9f5adf28bd9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:33.872007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-53e4daa5-7d10-497a-8a3e-e7dbbf2c1881 req-004ad29f-eccd-4fdf-b2e2-bc7fd9fff77e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:33.872557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-53e4daa5-7d10-497a-8a3e-e7dbbf2c1881 req-004ad29f-eccd-4fdf-b2e2-bc7fd9fff77e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:33.888434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-53e4daa5-7d10-497a-8a3e-e7dbbf2c1881 req-004ad29f-eccd-4fdf-b2e2-bc7fd9fff77e service nova] Creating event network-vif-plugged:5edb878d-9fb6-4cd0-b0bd-a9f5adf28bd9 for instance a41187fb-e6bd-4e95-8982-d907f342e9ee on nch1-master-1 Jun 18 22:10:33.907375 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-53e4daa5-7d10-497a-8a3e-e7dbbf2c1881 req-004ad29f-eccd-4fdf-b2e2-bc7fd9fff77e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060731 Jun 18 22:10:33.912316 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1241/2472] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:34.197407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:34.198564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:34.212180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:34.213418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:34.230025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.230487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.231278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.235395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.236110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.238977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.242239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.245150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.704800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:34.715454 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ce07ba1-cfd5-4861-8911-9044c7b7ad54 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.505521 Jun 18 22:10:34.725921 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1242/2473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:34 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:34.731373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:34.731750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:34.738150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.738594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.739376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.739808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.810882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:34.819434 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ae966b97-3393-47c2-92b9-46d560955a57 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.627518 Jun 18 22:10:34.834749 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1232/2474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:34 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:34.840172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:34.841468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:34.852586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.853058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.853839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:34.854277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:34.873595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:34.907783 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11c14d17-1098-4112-a174-4741e1f4f5ef tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.180364 Jun 18 22:10:34.909283 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1243/2475] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:34 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:35.176105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d98b6f30884d13a94ea2d4cabff826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25c9a06b279434b8c8f262a3c0a968b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:35.199353 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f67766e-38fc-4128-a77f-70521b4ad0a9 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 200 len: 1512 microversion: 2.1 time: 0.362835 Jun 18 22:10:35.200395 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1233/2476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:34 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:35.397641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-24409e88-2ccd-4756-990e-2cf1938925ce req-dea499e2-a00b-4f62-b461-01cba1e1b9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6213fe12-0911-477e-8fb7-26b27d05be02", "name": "network-vif-deleted", "tag": "8df3d1be-0d9a-4024-8949-86cd73dddd1b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:35.419889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-24409e88-2ccd-4756-990e-2cf1938925ce req-dea499e2-a00b-4f62-b461-01cba1e1b9a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:35.422021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-24409e88-2ccd-4756-990e-2cf1938925ce req-dea499e2-a00b-4f62-b461-01cba1e1b9a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:35.449457 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-24409e88-2ccd-4756-990e-2cf1938925ce req-dea499e2-a00b-4f62-b461-01cba1e1b9a0 service nova] Creating event network-vif-deleted:8df3d1be-0d9a-4024-8949-86cd73dddd1b for instance 6213fe12-0911-477e-8fb7-26b27d05be02 on nch2-master-1 Jun 18 22:10:35.470622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-24409e88-2ccd-4756-990e-2cf1938925ce req-dea499e2-a00b-4f62-b461-01cba1e1b9a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064826 Jun 18 22:10:35.472301 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1244/2477] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:35.736220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:35.737278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:35.747434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:35.749001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:35.750414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:35.751041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:35.837503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:35.838230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:35.862102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:35.862794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:35.863788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:35.864507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.179453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:36.219261 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06de1cbe-1b6f-4907-82ad-e401fd030639 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1315 microversion: 2.1 time: 0.487793 Jun 18 22:10:36.220348 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1234/2478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:35 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:36.234180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:36.237823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:36.240339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:36.242874 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d11537b6-8944-4801-bd67-8ef8a04519d4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1476 microversion: 2.1 time: 0.409607 Jun 18 22:10:36.254917 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1245/2479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:35 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:36.254917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:36.254917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 6213fe12-0911-477e-8fb7-26b27d05be02] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:36.255979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.256446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.257300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.257748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.273693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.277192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.280040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.280531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.308583 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] HTTP exception thrown: Instance 6213fe12-0911-477e-8fb7-26b27d05be02 could not be found. Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Request method failure captured: Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 HTTP/1.1 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyg-mA--lhJuEdeQDe50tzrQP_J5Dmo5LYH6z7kt3jQLYSLd6iH2kIEcQZFNA1PIxnWbRpzpNmmV3eHtTHV6KscImtKUg_bPKBoHkd7mylxokXTurMBiuIz4LjmR2hbpkqs4nrxwkhr5Nq3jGWqEZDNNVYfr8T03Y3q2DpNJvJxREY Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e25c9a06b279434b8c8f262a3c0a968b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 86d98b6f30884d13a94ea2d4cabff826 Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6213fe12-0911-477e-8fb7-26b27d05be02 could not be found. Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6213fe12-0911-477e-8fb7-26b27d05be02'} Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6213fe12-0911-477e-8fb7-26b27d05be02 could not be found. Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6213fe12-0911-477e-8fb7-26b27d05be02 could not be found. Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.329836 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6213fe12-0911-477e-8fb7-26b27d05be02 could not be found. Jun 18 22:10:36.333370 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.336858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Returning 404 to user: Instance 6213fe12-0911-477e-8fb7-26b27d05be02 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:36.346483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee7c2543-3535-4d6c-b2f5-06d4941f5dc1 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02" status: 404 len: 111 microversion: 2.1 time: 0.099120 Jun 18 22:10:36.355865 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1246/2480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:36 2022] GET /compute/v2.1/servers/6213fe12-0911-477e-8fb7-26b27d05be02 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:36.371800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:36.375530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:36.388036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.393936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.397604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.402547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.441385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] HTTP exception thrown: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Request method failure captured: Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 HTTP/1.1 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyg-mA--lhJuEdeQDe50tzrQP_J5Dmo5LYH6z7kt3jQLYSLd6iH2kIEcQZFNA1PIxnWbRpzpNmmV3eHtTHV6KscImtKUg_bPKBoHkd7mylxokXTurMBiuIz4LjmR2hbpkqs4nrxwkhr5Nq3jGWqEZDNNVYfr8T03Y3q2DpNJvJxREY Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e25c9a06b279434b8c8f262a3c0a968b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 86d98b6f30884d13a94ea2d4cabff826 Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f6f2e22e-50e0-4ce6-a216-f49f927fa6d8'} Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:36.444974 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.448442 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.454909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Returning 404 to user: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:36.457732 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c73f5789-bf16-4554-923a-eb4bc79bf5a3 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 404 len: 111 microversion: 2.1 time: 0.100572 Jun 18 22:10:36.468879 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1247/2481] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:36 2022] DELETE /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:36.479089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:36.484625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: f6f2e22e-50e0-4ce6-a216-f49f927fa6d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:36.508790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.509660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.512547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.513544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.553622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] HTTP exception thrown: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Request method failure captured: Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 HTTP/1.1 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyg-mA--lhJuEdeQDe50tzrQP_J5Dmo5LYH6z7kt3jQLYSLd6iH2kIEcQZFNA1PIxnWbRpzpNmmV3eHtTHV6KscImtKUg_bPKBoHkd7mylxokXTurMBiuIz4LjmR2hbpkqs4nrxwkhr5Nq3jGWqEZDNNVYfr8T03Y3q2DpNJvJxREY Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e25c9a06b279434b8c8f262a3c0a968b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 86d98b6f30884d13a94ea2d4cabff826 Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f6f2e22e-50e0-4ce6-a216-f49f927fa6d8'} Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.555199 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. Jun 18 22:10:36.559405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.560907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Returning 404 to user: Instance f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:36.561980 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5be1c746-ffc4-4c81-a669-7981d4d94199 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8" status: 404 len: 111 microversion: 2.1 time: 0.091475 Jun 18 22:10:36.562651 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1248/2482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:36 2022] GET /compute/v2.1/servers/f6f2e22e-50e0-4ce6-a216-f49f927fa6d8 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:36.572595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:36.573152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:36.590533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.597429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.599095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.599095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.636131 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] HTTP exception thrown: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Request method failure captured: Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 HTTP/1.1 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyg-mA--lhJuEdeQDe50tzrQP_J5Dmo5LYH6z7kt3jQLYSLd6iH2kIEcQZFNA1PIxnWbRpzpNmmV3eHtTHV6KscImtKUg_bPKBoHkd7mylxokXTurMBiuIz4LjmR2hbpkqs4nrxwkhr5Nq3jGWqEZDNNVYfr8T03Y3q2DpNJvJxREY Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e25c9a06b279434b8c8f262a3c0a968b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 86d98b6f30884d13a94ea2d4cabff826 Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '711f5bc4-2480-4399-a4f3-77068704a9b8'} Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:36.648346 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Returning 404 to user: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d35e4f1-7607-4150-9638-db912ac166ed tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "DELETE /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 404 len: 111 microversion: 2.1 time: 0.081944 Jun 18 22:10:36.651765 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1249/2483] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:36 2022] DELETE /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:36.652509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:36.672467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:36.677599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] [instance: 711f5bc4-2480-4399-a4f3-77068704a9b8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:36.693755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.694562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.695728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:36.699095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:36.707490 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7e4d5883-aabe-4b91-b7d0-87b66e48170a tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.485921 Jun 18 22:10:36.713390 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1235/2484] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:36 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:36.734381 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] HTTP exception thrown: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Request method failure captured: Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 HTTP/1.1 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyg-mA--lhJuEdeQDe50tzrQP_J5Dmo5LYH6z7kt3jQLYSLd6iH2kIEcQZFNA1PIxnWbRpzpNmmV3eHtTHV6KscImtKUg_bPKBoHkd7mylxokXTurMBiuIz4LjmR2hbpkqs4nrxwkhr5Nq3jGWqEZDNNVYfr8T03Y3q2DpNJvJxREY Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e25c9a06b279434b8c8f262a3c0a968b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e25c9a06b279434b8c8f262a3c0a968b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e25c9a06b279434b8c8f262a3c0a968b Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-513394937 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 86d98b6f30884d13a94ea2d4cabff826 Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiskConfigTestJSON-513394937-project Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '711f5bc4-2480-4399-a4f3-77068704a9b8'} Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:36.735991 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:36.740150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] Returning 404 to user: Instance 711f5bc4-2480-4399-a4f3-77068704a9b8 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:36.741860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ccd1bfc7-d5ab-4884-a3b2-a2f6dc10cd98 tempest-ServerDiskConfigTestJSON-513394937 tempest-ServerDiskConfigTestJSON-513394937-project] 10.222.0.30 "GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8" status: 404 len: 111 microversion: 2.1 time: 0.081434 Jun 18 22:10:36.742945 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1250/2485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:36 2022] GET /compute/v2.1/servers/711f5bc4-2480-4399-a4f3-77068704a9b8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:37.238704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:37.239965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:37.262512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:37.263859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:37.270046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:37.270747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:37.272076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:37.272834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:37.273330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:37.273965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:37.275085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:37.277392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:37.979551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:38.000460 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f5d9d3ab-bf2a-4e83-bad2-0eebb1e44569 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1501 microversion: 2.1 time: 0.767440 Jun 18 22:10:38.018367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1236/2486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:37 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1501 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:38.062747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:38.073639 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-986f2cb2-0072-4cc2-8e98-037c2107908f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1475 microversion: 2.1 time: 0.815473 Jun 18 22:10:38.086235 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1251/2487] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:37 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1475 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:38.098597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:38.102036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:38.112561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.113734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:38.114849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.115525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:38.158790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b647e7c-f96e-4aaa-b659-5ebf334fa228 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Action: 'create', calling method: .version_select at 0x7fea1438cb80>, body: {"keypair": {"name": "tempest-keypair-1156525520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+EzRuJvk98Qv6+JKm65tHKJb/ekheqUbHFlOn1oEdMkz2x9kXF7bKICGaB1QuJOYjBWgcczGOkqPox8Hji+42OmzLBHdu8lgqO6Q4Wo7P/evGZtbQCclJ8YBh/iVfVoA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:38.232328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2b647e7c-f96e-4aaa-b659-5ebf334fa228 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Getting quotas for project 965efce4648a472eb15b6d1c0f8c6615. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:38.269066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2b647e7c-f96e-4aaa-b659-5ebf334fa228 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Getting quotas for user 48b167cdb1054ef5bfadd851be67e8aa and project 965efce4648a472eb15b6d1c0f8c6615. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:38.270248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:38.330774 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b647e7c-f96e-4aaa-b659-5ebf334fa228 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.310313 Jun 18 22:10:38.332392 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1237/2488] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:10:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:38.340317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:38.341275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:38.343614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-194331d6-cc8f-4579-a04b-4c3b67e5b77b tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.254975 Jun 18 22:10:38.344489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1252/2489] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:38 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:38.352188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.353619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:38.355133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.355782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:38.377455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8814ead3-9959-4b67-b1b0-071284cecfaf req-7767a35a-a57d-4adf-a371-2e544343d45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e989fc58-3640-4eca-893e-43e4582d5efa", "name": "network-vif-unplugged", "status": "completed", "tag": "995acddb-4f18-4c41-a76f-e684f04860ee"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:38.396052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'flavor' on Instance uuid a41187fb-e6bd-4e95-8982-d907f342e9ee {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:38.400868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8814ead3-9959-4b67-b1b0-071284cecfaf req-7767a35a-a57d-4adf-a371-2e544343d45f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.411468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8814ead3-9959-4b67-b1b0-071284cecfaf req-7767a35a-a57d-4adf-a371-2e544343d45f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:38.454017 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8814ead3-9959-4b67-b1b0-071284cecfaf req-7767a35a-a57d-4adf-a371-2e544343d45f service nova] Creating event network-vif-unplugged:995acddb-4f18-4c41-a76f-e684f04860ee for instance e989fc58-3640-4eca-893e-43e4582d5efa on nch2-master-1 Jun 18 22:10:38.490017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-8814ead3-9959-4b67-b1b0-071284cecfaf req-7767a35a-a57d-4adf-a371-2e544343d45f service nova] Instance e989fc58-3640-4eca-893e-43e4582d5efa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:10:38.512620 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8814ead3-9959-4b67-b1b0-071284cecfaf req-7767a35a-a57d-4adf-a371-2e544343d45f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139773 Jun 18 22:10:38.513803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1253/2490] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:38.534973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f5bf44d8-a793-486b-802d-798eb676206b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "POST /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee/action" status: 202 len: 0 microversion: 2.1 time: 0.200240 Jun 18 22:10:38.536225 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1238/2491] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:10:38 2022] POST /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:10:38.544849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:38.545935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:38.576507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.577812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:38.578858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:38.579546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:39.081433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:39.095728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31fdc53c-8b32-48c7-bb2e-bfba0ed5aa01 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1509 microversion: 2.1 time: 0.554848 Jun 18 22:10:39.096358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:39.097337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:39.097446 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1254/2492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:38 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1509 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:39.117237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:39.117805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:39.118693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:39.119202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:39.364465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:39.365326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:39.378749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:39.386399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:39.399746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:39.402259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:39.656731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:39.665016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:39.672613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:39.678070 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc6710b2-f269-40b0-82f4-495636b46a3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1475 microversion: 2.1 time: 0.589590 Jun 18 22:10:39.682862 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1239/2493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:39 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1475 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:39.709942 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1edc63ac-067e-4e10-9b4d-48f3538f8431 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.348728 Jun 18 22:10:39.711616 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1255/2494] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:39 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:40.114680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:40.115352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:40.136168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.136705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.138095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.138733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.369233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:40.382748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:40.393295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Searching by: {'deleted': False, 'project_id': 'a0f349f2feda450cbe24f0a17b186798'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:10:40.405758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.406789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.407856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.408491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.529535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:10:40.615570 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b3520ad0-fb60-4d3c-a88d-cc1bc839d2c8 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.252263 Jun 18 22:10:40.617623 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1256/2495] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:10:40 2022] GET /compute/v2.1/servers => generated 340 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:10:40.624591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c5ad2ed1-b25e-4cfc-8f43-c21831538a90 req-ce3df2b6-b36e-4686-8d81-6f57f9787c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e989fc58-3640-4eca-893e-43e4582d5efa", "tag": "995acddb-4f18-4c41-a76f-e684f04860ee"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:40.634778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c5ad2ed1-b25e-4cfc-8f43-c21831538a90 req-ce3df2b6-b36e-4686-8d81-6f57f9787c65 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.635180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c5ad2ed1-b25e-4cfc-8f43-c21831538a90 req-ce3df2b6-b36e-4686-8d81-6f57f9787c65 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.656859 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c5ad2ed1-b25e-4cfc-8f43-c21831538a90 req-ce3df2b6-b36e-4686-8d81-6f57f9787c65 service nova] Creating event network-changed:995acddb-4f18-4c41-a76f-e684f04860ee for instance e989fc58-3640-4eca-893e-43e4582d5efa on nch2-master-1 Jun 18 22:10:40.664375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-c5ad2ed1-b25e-4cfc-8f43-c21831538a90 req-ce3df2b6-b36e-4686-8d81-6f57f9787c65 service nova] Instance e989fc58-3640-4eca-893e-43e4582d5efa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:10:40.679166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c5ad2ed1-b25e-4cfc-8f43-c21831538a90 req-ce3df2b6-b36e-4686-8d81-6f57f9787c65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058923 Jun 18 22:10:40.679989 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1257/2496] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:40.686686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:40.690882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:40.691496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Searching by: {'deleted': False, 'project_id': 'a0f349f2feda450cbe24f0a17b186798'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:10:40.698920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.700859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.701962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.702521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.764846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:10:40.845292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:40.859376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:40.859832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:40.985018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:41.004805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-282468a2-c965-4da1-ba3b-012c9f3c05bc tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1492 microversion: 2.1 time: 0.895377 Jun 18 22:10:41.005819 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1240/2497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:40 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1492 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:41.012561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:41.013419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:41.021917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:41.022601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:41.030395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:41.031711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:41.811969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c169392-ab5a-4210-8bac-834113cf6f9a tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.130659 Jun 18 22:10:41.812748 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1258/2498] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:10:40 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:41.822746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:41.824035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:41.834031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:41.836627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:41.837718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:41.838221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:41.977202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:41.991512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5769ee5b-592a-47dc-8baf-bfbfa790fe92 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1473 microversion: 2.1 time: 0.983862 Jun 18 22:10:41.993307 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1241/2499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:41 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1473 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:42.000731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:42.004187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:42.018882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.019912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.020791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.021351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.064324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:42.198327 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f09f956b-72cf-4cce-b8a0-61cde2f2f897 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 204 len: 0 microversion: 2.1 time: 0.202726 Jun 18 22:10:42.199247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1242/2500] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:41 2022] DELETE /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:42.205897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:42.209599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f14a4744-0bce-4254-9cc1-8f0b6f73914d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:42.225318 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f14a4744-0bce-4254-9cc1-8f0b6f73914d tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024055 Jun 18 22:10:42.226365 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1243/2501] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:10:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:42.233730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:42.236037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:42.254384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.256479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.257701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.259640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.269247 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d960d784-f2a5-4393-9389-15c468773f54 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.454570 Jun 18 22:10:42.281104 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1259/2502] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:41 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:42.578220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:42.579027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:42.587372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.588059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.589562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.590603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.609948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:42.632377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:10:42.740182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:42.758848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3bc80d89-4a89-4476-ad8e-6832d69ea0ee tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1498 microversion: 2.1 time: 0.530573 Jun 18 22:10:42.769841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1244/2503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:42 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1498 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:42.774000 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-081945a2-42ad-4665-9a7d-23fe45132c97 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "DELETE /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 204 len: 0 microversion: 2.1 time: 0.201102 Jun 18 22:10:42.775449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1260/2504] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:42 2022] DELETE /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:42.782800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:42.785412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:42.786303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:42.788618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:42.791297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:42.799923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.801656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.802966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.804513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.815086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.815616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:42.816686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:42.818677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:43.569100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:43.583850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:43.595569 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-500ec9ff-6421-4615-bce9-cc2e68f01b60 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1714 microversion: 2.1 time: 0.815848 Jun 18 22:10:43.599853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:43.601389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:43.602630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-147ca567-f0c0-45db-a1a9-ef3b7b060029 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2945 microversion: 2.32 time: 0.840655 Jun 18 22:10:43.609275 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1261/2505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:42 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1714 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:43.616248 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1245/2506] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:42 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2945 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:43.631056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:43.631964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:43.633415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:43.634105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:43.648786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:43.649747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:43.650734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:43.651352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:43.665444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:43.666336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:43.677325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:43.679623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:43.840254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:43.893657 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab897e0e-5725-4c51-b2fc-1a8bd4e76e07 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.276214 Jun 18 22:10:43.895255 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1246/2507] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:43 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:43.913768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:43.914635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:43.922168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:43.922955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:43.924118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:43.925524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:44.176917 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b84dc268-89a2-45aa-bd72-3d3a8cab2996 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.268015 Jun 18 22:10:44.177818 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1247/2508] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:10:43 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e/os-interface => generated 1831 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:44.182970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:44.184071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:44.199168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:44.211043 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34e1f37c-d900-4830-a0cb-ce8e95678b01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1470 microversion: 2.1 time: 0.596802 Jun 18 22:10:44.212467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:44.214902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:44.217710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:44.218160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:44.219017 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1262/2509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:43 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:44.239034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:44.239773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:44.248653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:44.249649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:44.250621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:44.251385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:44.357446 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0408df6f-1402-4bc4-9537-25a16fb0ef3f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa/action" status: 204 len: 0 microversion: 2.1 time: 0.123407 Jun 18 22:10:44.358949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1263/2510] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:10:44 2022] POST /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa/action => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:10:44.371336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:44.373230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:44.383556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:44.384010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:44.384800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:44.387130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:45.456155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:45.468765 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-386a35fa-70b5-4445-8085-75b0be39e46e tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1498 microversion: 2.1 time: 1.289615 Jun 18 22:10:45.469438 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1248/2511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:44 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1498 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:45.484532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:45.485643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:45.495440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:45.515869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:45.516091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:45.517435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:45.518049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:45.539348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:45.550735 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d39a672f-a18d-47af-b266-af918a2eee42 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1470 microversion: 2.1 time: 1.185059 Jun 18 22:10:45.567753 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1264/2512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:44 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1470 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:45.573693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-2057319428", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "275c8bff-983f-446d-8356-f1b6b830b4a6"}], "security_groups": [{"name": "tempest-securitygroup--942488708"}], "key_name": "tempest-keypair-1156525520", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1a2187ea-feca-4aa9-ba15-d0a896e78836", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:45.893080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] validate_networks() for [('275c8bff-983f-446d-8356-f1b6b830b4a6', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:10:46.013071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:46.027397 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b066ce10-3fbd-4b27-a67b-0ce4a362b6d6 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1714 microversion: 2.1 time: 0.554070 Jun 18 22:10:46.047485 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1249/2513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:45 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1714 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:46.055819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:46.057121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:46.072230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.073287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:46.075316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.076487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:46.367165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:46.433065 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-967def1a-d38f-4e57-bbc4-021794da3f8e tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.384020 Jun 18 22:10:46.433699 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1250/2514] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:46 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:46.438650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-bc53adde-7c86-4ab1-a184-2e1a00b156f8 req-238cb77b-e59a-4f55-8b10-92d80003781a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e989fc58-3640-4eca-893e-43e4582d5efa", "name": "network-vif-plugged", "status": "completed", "tag": "995acddb-4f18-4c41-a76f-e684f04860ee"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:46.447341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-bc53adde-7c86-4ab1-a184-2e1a00b156f8 req-238cb77b-e59a-4f55-8b10-92d80003781a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.448028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-bc53adde-7c86-4ab1-a184-2e1a00b156f8 req-238cb77b-e59a-4f55-8b10-92d80003781a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:46.461768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-bc53adde-7c86-4ab1-a184-2e1a00b156f8 req-238cb77b-e59a-4f55-8b10-92d80003781a service nova] Creating event network-vif-plugged:995acddb-4f18-4c41-a76f-e684f04860ee for instance e989fc58-3640-4eca-893e-43e4582d5efa on nch2-master-1 Jun 18 22:10:46.472803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-bc53adde-7c86-4ab1-a184-2e1a00b156f8 req-238cb77b-e59a-4f55-8b10-92d80003781a service nova] Instance e989fc58-3640-4eca-893e-43e4582d5efa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:10:46.490196 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-bc53adde-7c86-4ab1-a184-2e1a00b156f8 req-238cb77b-e59a-4f55-8b10-92d80003781a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054643 Jun 18 22:10:46.491379 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1251/2515] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:46.502711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:46.504249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:46.512076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.513014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:46.514177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.514808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:46.866741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:46.877463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c5c0ef63-911d-4be3-9d01-a1c265d2c105 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1498 microversion: 2.1 time: 0.382881 Jun 18 22:10:46.878325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1252/2516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:46 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1498 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:46.884753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:46.885889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:46.893694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.894691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:46.895527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:46.896315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.151325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Getting quotas for project 965efce4648a472eb15b6d1c0f8c6615. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:47.165063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:47.168572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Getting quotas for user 48b167cdb1054ef5bfadd851be67e8aa and project 965efce4648a472eb15b6d1c0f8c6615. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:47.177695 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff9c5d11-c83e-4920-9ace-46b01b34246e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1470 microversion: 2.1 time: 0.297455 Jun 18 22:10:47.178099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1253/2517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:46 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:47.188885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:47.189493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:47.193694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:47.194357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:47.195020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:47.195713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:47.196311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:47.197161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.197621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.198408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.198843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.207095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.207916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.208873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.209891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.229150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Getting quotas for project 965efce4648a472eb15b6d1c0f8c6615. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:47.235690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Getting quotas for user 48b167cdb1054ef5bfadd851be67e8aa and project 965efce4648a472eb15b6d1c0f8c6615. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:47.320445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:10:47.322870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a2187ea-feca-4aa9-ba15-d0a896e78836',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:10:47.445022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:47.459973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a557cfb-10b2-4a74-93d0-c3ebfd585e02 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1714 microversion: 2.1 time: 0.280586 Jun 18 22:10:47.471353 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1254/2518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:47 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1714 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:47.478289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:47.480214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:47.491926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.492255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.493114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.493717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.587019 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fb89cd67-63ad-4e70-a94d-0c4c20914cf8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.017956 Jun 18 22:10:47.588288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1265/2519] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:10:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:10:47.598648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:47.598799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b63b958a-a9c0-4ad6-93f1-f6bae73cb5c2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:47.599314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b63b958a-a9c0-4ad6-93f1-f6bae73cb5c2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:47.609592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:47.682656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b63b958a-a9c0-4ad6-93f1-f6bae73cb5c2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:47.692227 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b63b958a-a9c0-4ad6-93f1-f6bae73cb5c2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1122 microversion: 2.1 time: 0.097644 Jun 18 22:10:47.694348 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1266/2520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:47 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1122 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:47.699581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-769e1ea9-ff88-4ade-9032-e8099e16e706 req-ad34cdd3-4634-432d-9dd5-c833f416329d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41187fb-e6bd-4e95-8982-d907f342e9ee", "name": "network-vif-deleted", "tag": "5edb878d-9fb6-4cd0-b0bd-a9f5adf28bd9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:47.712135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-769e1ea9-ff88-4ade-9032-e8099e16e706 req-ad34cdd3-4634-432d-9dd5-c833f416329d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.712853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-769e1ea9-ff88-4ade-9032-e8099e16e706 req-ad34cdd3-4634-432d-9dd5-c833f416329d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.714796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a9a7a01-53e4-433c-a6e5-a200509860a4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.239426 Jun 18 22:10:47.717524 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1255/2521] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:47 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:47.729339 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-769e1ea9-ff88-4ade-9032-e8099e16e706 req-ad34cdd3-4634-432d-9dd5-c833f416329d service nova] Creating event network-vif-deleted:5edb878d-9fb6-4cd0-b0bd-a9f5adf28bd9 for instance a41187fb-e6bd-4e95-8982-d907f342e9ee on nch1-master-1 Jun 18 22:10:47.757300 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-769e1ea9-ff88-4ade-9032-e8099e16e706 req-ad34cdd3-4634-432d-9dd5-c833f416329d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060826 Jun 18 22:10:47.758038 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1267/2522] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:47.898367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:47.900205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:47.911916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.912790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:47.917702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:47.918395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.010543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.011910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.013083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lazy-loading 'fault' on Instance uuid a41187fb-e6bd-4e95-8982-d907f342e9ee {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:48.158399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ede0902f6cf47fc8bbcec812fd9615b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a85ed67a4b4908b724c49a9754d312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:48.172130 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b9581c57-ff4d-4948-af28-1dd9a62e02b1 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 200 len: 1305 microversion: 2.1 time: 0.279601 Jun 18 22:10:48.177377 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1256/2523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:47 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:48.197735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:48.199424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:48.216334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.217678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.220136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.221205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.479647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:48.480766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:48.483646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:48.498032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.498796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.499703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.501731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.703108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:48.717652 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4dea6782-1e2c-480e-b20f-6a011ed0eb81 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1647 microversion: 2.1 time: 0.242709 Jun 18 22:10:48.718574 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1257/2524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:48 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1647 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:48.732303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:48.732926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:48.752994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.753483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.754375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.754812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.802410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:48.816315 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b7488999-d358-4cd5-96e0-526b6cb9ee06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1470 microversion: 2.1 time: 0.621163 Jun 18 22:10:48.819216 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1268/2525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:48 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:48.828654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:48.829318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:48.843995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.844792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.845804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:48.846391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:48.933372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:48.945237 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-12a77923-e1f7-45fd-82f7-6a47d597cbd2 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1164 microversion: 2.1 time: 0.216658 Jun 18 22:10:48.947058 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1258/2526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:48 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1164 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:49.000032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:49.043933 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-30dd3f06-390d-499a-bd5e-de25f164ac50 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.222100 Jun 18 22:10:49.046089 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1269/2527] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:48 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:49.199471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.201708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.217893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.218656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.220831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.222502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.249399 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee HTTP/1.1 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a41187fb-e6bd-4e95-8982-d907f342e9ee'} Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.252281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.256493 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.257134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.258907 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a1c23d3-5508-47cc-8e3c-6e453fb7eacf tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 404 len: 111 microversion: 2.1 time: 0.065747 Jun 18 22:10:49.271733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1259/2528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.272512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.273238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.287242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.289938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.291909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.294786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.332423 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee HTTP/1.1 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'a41187fb-e6bd-4e95-8982-d907f342e9ee'} Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.340510 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.345020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.346141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.349301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8636b80e-7cd9-49aa-a093-9e9ba7332e00 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 404 len: 111 microversion: 2.1 time: 0.079763 Jun 18 22:10:49.350191 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1270/2529] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:49 2022] DELETE /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:10:49.359341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.360303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: a41187fb-e6bd-4e95-8982-d907f342e9ee] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.371419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.371879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.375272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.375934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.420353 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee HTTP/1.1 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a41187fb-e6bd-4e95-8982-d907f342e9ee'} Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.429007 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. Jun 18 22:10:49.433203 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.434445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance a41187fb-e6bd-4e95-8982-d907f342e9ee could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.435465 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c37ef203-73b9-4a6d-afd7-09b101744716 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee" status: 404 len: 111 microversion: 2.1 time: 0.080971 Jun 18 22:10:49.438946 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1260/2530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/a41187fb-e6bd-4e95-8982-d907f342e9ee => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.446657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.447734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.458844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.467900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.469318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.469904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.494529 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd HTTP/1.1 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6c4543c2-b1ba-4e6c-8f6c-95c6621054fd'} Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.496446 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.499942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.501578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.502605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2aae669c-0075-4fc8-820c-6a0fabfac0c8 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 404 len: 111 microversion: 2.1 time: 0.060001 Jun 18 22:10:49.503648 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1271/2531] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:49 2022] DELETE /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.512921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.514282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.524710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.525638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.526819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.529316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.550491 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd HTTP/1.1 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '6c4543c2-b1ba-4e6c-8f6c-95c6621054fd'} Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.553244 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. Jun 18 22:10:49.556959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.560153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 6c4543c2-b1ba-4e6c-8f6c-95c6621054fd could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.561927 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73619557-6759-4798-a7b9-5d62569d33df tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd" status: 404 len: 111 microversion: 2.1 time: 0.053483 Jun 18 22:10:49.563173 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1261/2532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/6c4543c2-b1ba-4e6c-8f6c-95c6621054fd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.573842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.574750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.587465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.588269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.589450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.590141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.622790 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 HTTP/1.1 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2a462d18-117e-4b5d-965c-4f16125395e8'} Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.624831 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.628973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.631373 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0d371745-44ea-436e-8355-474f19be6323 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 404 len: 111 microversion: 2.1 time: 0.062463 Jun 18 22:10:49.635483 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1272/2533] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:49 2022] DELETE /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:10:49.646185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.647237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2a462d18-117e-4b5d-965c-4f16125395e8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.655204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.656580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.657923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.658621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.680164 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 HTTP/1.1 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2a462d18-117e-4b5d-965c-4f16125395e8'} Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.682464 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. Jun 18 22:10:49.686181 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.688831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2a462d18-117e-4b5d-965c-4f16125395e8 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.690037 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-af3ac07a-07ac-47fb-8552-f2fc90973945 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8" status: 404 len: 111 microversion: 2.1 time: 0.053243 Jun 18 22:10:49.691194 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1262/2534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/2a462d18-117e-4b5d-965c-4f16125395e8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.700526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.701674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.715479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.716083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.717100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.717858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.735379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.736558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.749765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.750860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.752727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.754427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.755490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a HTTP/1.1 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8265e105-3c88-4fa3-a004-6b7932b7c60a'} Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.759460 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.763396 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.766237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.768511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-38527d05-5205-40ee-8305-dec51a8e7170 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 404 len: 111 microversion: 2.1 time: 0.073270 Jun 18 22:10:49.780352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1273/2535] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:49 2022] DELETE /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.802411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.803341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 8265e105-3c88-4fa3-a004-6b7932b7c60a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.818361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.819201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.823095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.823791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.863881 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.866136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.866714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.868390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lazy-loading 'fault' on Instance uuid 317af96c-4307-42c7-bc40-fb9e18ad31bf {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a HTTP/1.1 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8265e105-3c88-4fa3-a004-6b7932b7c60a'} Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:49.870663 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 8265e105-3c88-4fa3-a004-6b7932b7c60a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:49.881244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a11cf8f5-4775-4cae-b2de-4f0146aa72a9 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a" status: 404 len: 111 microversion: 2.1 time: 0.087673 Jun 18 22:10:49.893814 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1274/2536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/8265e105-3c88-4fa3-a004-6b7932b7c60a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:49.899659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-944b9f1b-83c3-48c9-9c06-6866f9c7cf9b req-431a4330-2776-4bab-924b-0a076cf6da92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317af96c-4307-42c7-bc40-fb9e18ad31bf", "name": "network-vif-deleted", "tag": "99632f5c-c3a7-4cf2-8ff7-920ee86c9f73"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:49.913289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-944b9f1b-83c3-48c9-9c06-6866f9c7cf9b req-431a4330-2776-4bab-924b-0a076cf6da92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.916670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-944b9f1b-83c3-48c9-9c06-6866f9c7cf9b req-431a4330-2776-4bab-924b-0a076cf6da92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.940689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3022aec60f643b2a66492ad8f8d7e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f349f2feda450cbe24f0a17b186798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:49.940979 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-944b9f1b-83c3-48c9-9c06-6866f9c7cf9b req-431a4330-2776-4bab-924b-0a076cf6da92 service nova] Creating event network-vif-deleted:99632f5c-c3a7-4cf2-8ff7-920ee86c9f73 for instance 317af96c-4307-42c7-bc40-fb9e18ad31bf on nch1-master-1 Jun 18 22:10:49.951376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-170894c6-cf86-4bd3-9da5-ed1dd33e618c tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 200 len: 1368 microversion: 2.1 time: 0.220008 Jun 18 22:10:49.952302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1263/2537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:49.960330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.960956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.967627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-944b9f1b-83c3-48c9-9c06-6866f9c7cf9b req-431a4330-2776-4bab-924b-0a076cf6da92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072034 Jun 18 22:10:49.968912 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1275/2538] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:49.972907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.973914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.974856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:49.975437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:49.982609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:49.983564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:49.998010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.001390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.004039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.004716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.032198 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 HTTP/1.1 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '9473bc11-bdc3-40ed-8e36-8bcb7c78a317'} Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:50.038958 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:50.042496 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5bf3313-1846-4555-a2bc-48463469d345 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317" status: 404 len: 111 microversion: 2.1 time: 0.068626 Jun 18 22:10:50.044832 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1276/2539] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:49 2022] DELETE /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:50.050945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:50.051567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:50.065465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.065925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.067764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.068954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.263005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:50.280412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf21081b-d625-4b36-a802-2c5332a2b602 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1238 microversion: 2.1 time: 0.234091 Jun 18 22:10:50.287555 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1277/2540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:50 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1238 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:50.294328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:50.295406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 9473bc11-bdc3-40ed-8e36-8bcb7c78a317] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:50.309894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.309894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.309894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.309894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.329665 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 HTTP/1.1 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '9473bc11-bdc3-40ed-8e36-8bcb7c78a317'} Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:50.331496 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. Jun 18 22:10:50.335204 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:50.337672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 9473bc11-bdc3-40ed-8e36-8bcb7c78a317 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:50.338897 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fcf9902-9144-41ab-a1ee-5f213429293b tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317" status: 404 len: 111 microversion: 2.1 time: 0.049854 Jun 18 22:10:50.340529 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1278/2541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:50 2022] GET /compute/v2.1/servers/9473bc11-bdc3-40ed-8e36-8bcb7c78a317 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:50.346206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:50.347381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:50.355643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.357125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.358453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.359713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.392355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:50.407703 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f5d86b3-f3a8-4b23-bdaa-c85475f7dfb6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1462 microversion: 2.1 time: 0.447958 Jun 18 22:10:50.408371 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1264/2542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:49 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1462 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:50.424695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:50.425587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:50.440479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.442195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.443196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.443812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.519049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:50.570026 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4a16a82-9823-4dd9-b5f8-a88488da2e7f tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.226902 Jun 18 22:10:50.572587 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1279/2543] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:50 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:50.712650 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-63555e28-1daa-447d-9dc4-046d5011d0f4 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1613 microversion: 2.1 time: 0.291966 Jun 18 22:10:50.714463 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1265/2544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:50 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1613 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:50.740129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8950cc53-a3bd-44f1-860e-9306b0382d5e tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '.version_select at 0x7fea14278f70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:50.747063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8950cc53-a3bd-44f1-860e-9306b0382d5e tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.748182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8950cc53-a3bd-44f1-860e-9306b0382d5e tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.764408 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8950cc53-a3bd-44f1-860e-9306b0382d5e tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.029799 Jun 18 22:10:50.766481 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1280/2545] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:10:50 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:50.971780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:50.972730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] [instance: 317af96c-4307-42c7-bc40-fb9e18ad31bf] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:50.983644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.984095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:50.988850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:50.989571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:51.042069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2019122315", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:51.072679 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] HTTP exception thrown: Instance 317af96c-4307-42c7-bc40-fb9e18ad31bf could not be found. Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Request method failure captured: Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf HTTP/1.1 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkzfa_vc017sc6TJN-eZEd3YgN_5OzYOXjp7gxLVDR6dRrscwazF66sjPi0CnDPlcRNu_zZRPkFyDj90uEwh-rJNqu9SSuvO21xSrUedB2AIoiKwD2pGapSw-OwvYHkd53FwqhGFTeP0TaMZZlsUx2t5ZlDg--xonU8Yko-_hNo1en0 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a0f349f2feda450cbe24f0a17b186798 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestManualDisk-1801600646 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a0f349f2feda450cbe24f0a17b186798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a0f349f2feda450cbe24f0a17b186798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a0f349f2feda450cbe24f0a17b186798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a0f349f2feda450cbe24f0a17b186798", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestManualDisk-1801600646 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a0f349f2feda450cbe24f0a17b186798 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestManualDisk-1801600646 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestManualDisk-1801600646-project Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a3022aec60f643b2a66492ad8f8d7e96 Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestManualDisk-1801600646-project Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 317af96c-4307-42c7-bc40-fb9e18ad31bf could not be found. Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '317af96c-4307-42c7-bc40-fb9e18ad31bf'} Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317af96c-4307-42c7-bc40-fb9e18ad31bf could not be found. Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317af96c-4307-42c7-bc40-fb9e18ad31bf could not be found. Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:51.081059 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317af96c-4307-42c7-bc40-fb9e18ad31bf could not be found. Jun 18 22:10:51.085487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:51.090253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Returning 404 to user: Instance 317af96c-4307-42c7-bc40-fb9e18ad31bf could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:51.091431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3bcc0448-dd88-4cf3-a4ee-5e2067291314 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf" status: 404 len: 111 microversion: 2.1 time: 0.124853 Jun 18 22:10:51.101162 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1266/2546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:50 2022] GET /compute/v2.1/servers/317af96c-4307-42c7-bc40-fb9e18ad31bf => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:51.120452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d4f60dd-646a-40d0-b9a8-75360ba68477 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] Calling method '.version_select at 0x7fea19bccf70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:51.151471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:10:51.173804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d4f60dd-646a-40d0-b9a8-75360ba68477 tempest-ServersTestManualDisk-1801600646 tempest-ServersTestManualDisk-1801600646-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964832939" status: 202 len: 0 microversion: 2.1 time: 0.070013 Jun 18 22:10:51.174588 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1267/2547] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964832939 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:10:51.302739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:51.303369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:51.313822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:51.318998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:51.322649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:51.327044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:51.968423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:51.969542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:51.970217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:51.970806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:51.971435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:51.992757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:51.993528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:51.994776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:51.997249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.011716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:52.023757 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce7fb2a6-e24a-44fb-8c5a-1c6b1ce500c3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1305 microversion: 2.1 time: 0.724618 Jun 18 22:10:52.024928 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1268/2548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:51 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1305 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:10:52.038691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:52.039611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:52.044627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:52.047889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.048708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.049762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.050672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.051637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for user 0e8a394c0a284416ac893321bd860e51 and project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:52.065934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:10:52.068776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:10:52.165834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a0baa50b-955e-496b-8245-a12e8fa58248 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140987 Jun 18 22:10:52.172416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1281/2549] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:10:52.178347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:52.179019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:52.181972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:52.188077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.188932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.189945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.190607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.208031 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 HTTP/1.1 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3'} Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:52.209947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.214667 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.216905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:52.218076 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37724260-c1d1-4081-8578-7c4f1ee377db tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 404 len: 111 microversion: 2.1 time: 0.044114 Jun 18 22:10:52.222517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1282/2550] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:52 2022] DELETE /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:52.227805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d914fe8e-f826-4ab2-9d4d-8803934b5e84 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:52.228679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d914fe8e-f826-4ab2-9d4d-8803934b5e84 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:52.238143 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f32f685-ce93-4f0d-b78a-3c94de175d7d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.211754 Jun 18 22:10:52.252695 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1269/2551] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:52 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:52.260188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:52.261214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:52.268047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.268764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.269758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.270348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.292186 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 HTTP/1.1 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3'} Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.294461 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. Jun 18 22:10:52.298748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.300018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:52.301107 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-998f7a29-9e04-4097-9e5b-4a273297f333 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3" status: 404 len: 111 microversion: 2.1 time: 0.046294 Jun 18 22:10:52.302372 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1270/2552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:52 2022] GET /compute/v2.1/servers/2eeaef7c-f76e-4fde-8a82-ebc2f988d1e3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:52.310530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:52.311237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:52.324915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.325794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.326651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.327134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.349063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d914fe8e-f826-4ab2-9d4d-8803934b5e84 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:52.357684 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d914fe8e-f826-4ab2-9d4d-8803934b5e84 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1213 microversion: 2.1 time: 0.133236 Jun 18 22:10:52.358480 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.358858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1283/2553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:52 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 HTTP/1.1 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '980110ca-e679-4848-9c62-97f89f2949e9'} Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:52.360942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.364349 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.366603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:52.368145 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bd17a93-539a-41be-bac2-86f86aa07355 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "DELETE /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 404 len: 111 microversion: 2.1 time: 0.061932 Jun 18 22:10:52.369522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1271/2554] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:10:52 2022] DELETE /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:10:52.378457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:52.379412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] [instance: 980110ca-e679-4848-9c62-97f89f2949e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:52.387126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.387989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.389117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:52.389946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:52.397319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:52.412790 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] HTTP exception thrown: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Request method failure captured: Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 HTTP/1.1 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkwkp0Kj-QV3r19arBW8a0jzaqQTw7cugHHiUuayUe8qKlwwEor5zKDm-9J5JiRzsh7fH8xsA3N-57CGGCijATSYHJqAfrr59yUONxlVCjNbcPPzAvdSOXgUIlsVyswEGO0TGUhKeGNjTmvOxhYa9xuA9wNb3Q-nqRm0Saa0g_Vv7xg Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b9a85ed67a4b4908b724c49a9754d312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b9a85ed67a4b4908b724c49a9754d312", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b9a85ed67a4b4908b724c49a9754d312 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-1102121297 Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8ede0902f6cf47fc8bbcec812fd9615b Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-1102121297-project Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '980110ca-e679-4848-9c62-97f89f2949e9'} Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:10:52.414759 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. Jun 18 22:10:52.418644 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:10:52.420581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] Returning 404 to user: Instance 980110ca-e679-4848-9c62-97f89f2949e9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:10:52.421997 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de6cd53e-6d51-40d9-9b50-252ecfa38ed3 tempest-DeleteServersTestJSON-1102121297 tempest-DeleteServersTestJSON-1102121297-project] 10.222.0.30 "GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9" status: 404 len: 111 microversion: 2.1 time: 0.048254 Jun 18 22:10:52.422852 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1284/2555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:52 2022] GET /compute/v2.1/servers/980110ca-e679-4848-9c62-97f89f2949e9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:10:53.048076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:53.049605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:53.059049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.060044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.061111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.061937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.261869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:53.263652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:53.277895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.280631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.282123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.286346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.731962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:53.761915 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ccf12820-a3ba-4221-8493-f3f040d7404d tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.504235 Jun 18 22:10:53.776657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1285/2556] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:53 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:53.785873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:53.787093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:53.795120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.795800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.796826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.797425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.865434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:53.878990 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18e2b52b-9af2-4e3d-9f89-afbf8e250687 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.840227 Jun 18 22:10:53.882364 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1272/2557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:53 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:53.889283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-68f8fdb3-f011-4ade-b76b-9c273f47b175 req-7355db6c-1fcf-49af-8a22-ac0420fe8858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd948550-44ae-411d-b1d1-b562dd92d9ce", "tag": "cf37ed15-38ad-441a-baa4-8156ecae1064"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:53.899294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-68f8fdb3-f011-4ade-b76b-9c273f47b175 req-7355db6c-1fcf-49af-8a22-ac0420fe8858 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:53.900007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-68f8fdb3-f011-4ade-b76b-9c273f47b175 req-7355db6c-1fcf-49af-8a22-ac0420fe8858 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:53.911265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-68f8fdb3-f011-4ade-b76b-9c273f47b175 req-7355db6c-1fcf-49af-8a22-ac0420fe8858 service nova] Creating event network-changed:cf37ed15-38ad-441a-baa4-8156ecae1064 for instance fd948550-44ae-411d-b1d1-b562dd92d9ce on nch2-master-1 Jun 18 22:10:53.916848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-68f8fdb3-f011-4ade-b76b-9c273f47b175 req-7355db6c-1fcf-49af-8a22-ac0420fe8858 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032900 Jun 18 22:10:53.918323 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1273/2558] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:53.923716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:53.924001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90615e8d-36ed-42e5-a5e6-e820a53518ff tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07a18f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:53.948092 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1ad478b-d831-42ba-872e-54a78b89bd83 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1271 microversion: 2.1 time: 0.168917 Jun 18 22:10:53.949448 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1286/2559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:53 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:53.995725 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90615e8d-36ed-42e5-a5e6-e820a53518ff tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/e8217fc6-9161-4117-8def-5286a7d89d26" status: 200 len: 661 microversion: 2.1 time: 0.075465 Jun 18 22:10:53.996429 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1274/2560] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:53 2022] GET /compute/v2.1/images/e8217fc6-9161-4117-8def-5286a7d89d26 => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:54.007751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-793b8092-2240-45d6-9566-3704ac466637 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea141fe9d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:54.072465 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-793b8092-2240-45d6-9566-3704ac466637 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/e8217fc6-9161-4117-8def-5286a7d89d26" status: 200 len: 661 microversion: 2.1 time: 0.068403 Jun 18 22:10:54.073150 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1287/2561] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:54 2022] GET /compute/v2.1/images/e8217fc6-9161-4117-8def-5286a7d89d26 => generated 661 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:54.782065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:54.782954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:54.791638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:54.792449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:54.793481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:54.794165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:54.903040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:54.905389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:54.933188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:54.947759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:54.948562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:54.951268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:54.951722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:54.978541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c53d438-ce96-4618-b206-2e0534090149 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.200436 Jun 18 22:10:54.980171 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1275/2562] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:54 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:54.996995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:54.998002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:55.012648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:55.013510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:55.014582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:55.015175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:55.131851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:55.141974 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0824279f-bdf9-4edd-99b8-0daa3a3c1496 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1271 microversion: 2.1 time: 0.160241 Jun 18 22:10:55.142574 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1276/2563] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:54 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:55.319526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:55.332488 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3878991a-17fb-4cfa-903d-24abfca0574b tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.436282 Jun 18 22:10:55.343978 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1288/2564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:54 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:55.587564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c0f58ad0-e416-48f1-8dd4-9cc39f240968 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1423b0d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:55.648516 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c0f58ad0-e416-48f1-8dd4-9cc39f240968 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/16ecb526-da8c-4b1e-ae24-0fc968c60798" status: 200 len: 662 microversion: 2.1 time: 0.064755 Jun 18 22:10:55.650188 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1277/2565] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:55 2022] GET /compute/v2.1/images/16ecb526-da8c-4b1e-ae24-0fc968c60798 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:55.663120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2fc5c9d-da33-43bc-852d-7a6110200f5e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14c378b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:55.716351 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2fc5c9d-da33-43bc-852d-7a6110200f5e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/16ecb526-da8c-4b1e-ae24-0fc968c60798" status: 200 len: 662 microversion: 2.1 time: 0.057766 Jun 18 22:10:55.717784 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1289/2566] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:55 2022] GET /compute/v2.1/images/16ecb526-da8c-4b1e-ae24-0fc968c60798 => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:10:56.004849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:56.006399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:56.023160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:56.023852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:56.024762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:56.025333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:56.159745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:56.160941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:56.163127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:56.183897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:56.184638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:56.185521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:56.186122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:56.658974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:56.663204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:10:56.691549 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-256a4f86-cd25-4cf2-9d20-3599b8004b5c tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.692024 Jun 18 22:10:56.692892 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1278/2567] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:55 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:56.699270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:56.700620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:56.708393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:56.709119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:56.710047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:56.710626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:56.883931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:56.916102 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a0999bd-bb75-45bf-ae51-455dcfa0321f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.760975 Jun 18 22:10:56.926128 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1290/2568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:56 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:57.052282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:57.066003 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5300b253-c161-41c0-9bf4-57a60e76e1a8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.371684 Jun 18 22:10:57.067392 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1279/2569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:56 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:57.260857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9b634ad5-f6b6-41df-a5b9-c804c950bf79 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea140c73a0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:57.314076 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9b634ad5-f6b6-41df-a5b9-c804c950bf79 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/fc2db7bb-9458-4317-9c6c-5cd1d29a4f98" status: 200 len: 662 microversion: 2.1 time: 0.059209 Jun 18 22:10:57.314989 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1291/2570] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:57 2022] GET /compute/v2.1/images/fc2db7bb-9458-4317-9c6c-5cd1d29a4f98 => generated 662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:57.330485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-20cfe830-f81b-410f-9d12-92c5a294b7f2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea079a0ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:57.403299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-20cfe830-f81b-410f-9d12-92c5a294b7f2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/fc2db7bb-9458-4317-9c6c-5cd1d29a4f98" status: 200 len: 662 microversion: 2.1 time: 0.078478 Jun 18 22:10:57.404083 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1280/2571] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:10:57 2022] GET /compute/v2.1/images/fc2db7bb-9458-4317-9c6c-5cd1d29a4f98 => generated 662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:10:57.605693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1134195794", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:57.671383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:10:57.712429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:57.713234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:57.729485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:57.730527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:57.733781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:57.734461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:57.914724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:57.956555 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-03da54d8-09a9-4316-91ab-9cab34977357 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.248240 Jun 18 22:10:57.969930 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1281/2572] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:57 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:57.969930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:57.969930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:57.979734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:57.980182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:57.981191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:57.981774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.184861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:58.186730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:58.187561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:58.188231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:58.188682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:58.203170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.203821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.205290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.205503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.248529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:58.270180 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9db1bb6-7cc1-4419-97b3-f4c4303bc4bb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.307519 Jun 18 22:10:58.271118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1282/2573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:57 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:58.274749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Getting quotas for project e29bd993bde443a7ae41414b603e05d5. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:58.285007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Getting quotas for user c121277893cc4640a85bc96dcef6aef7 and project e29bd993bde443a7ae41414b603e05d5. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:58.289525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:58.290518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:58.316659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.317083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.318723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.319172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.327973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:10:58.331223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:10:58.422398 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5762f53d-815b-4f30-abee-bc6a08ee8122 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820956 Jun 18 22:10:58.424522 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1292/2574] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:10:58.492862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1131239113", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:10:58.593080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] validate_networks() for None {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:10:58.789451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:58.810255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f649f058-b8d2-4e49-9efb-ab0afd22f7a6 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.534375 Jun 18 22:10:58.810822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1283/2575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:58 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:58.981448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:10:58.981931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:10:58.982264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:58.982413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:10:58.982769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:10:58.983093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:58.983229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:10:58.990478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.991219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.992410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.993056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.994933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.995403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:58.996220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:58.996664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:59.020341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Getting quotas for project e29bd993bde443a7ae41414b603e05d5. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:10:59.026258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Getting quotas for user c121277893cc4640a85bc96dcef6aef7 and project e29bd993bde443a7ae41414b603e05d5. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:10:59.042776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:10:59.045661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:10:59.112018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:10:59.112785 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-223dd2ab-2c3b-4932-a825-4a44568dd5d2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624925 Jun 18 22:10:59.118717 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1293/2576] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:10:59.124926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e9a7cd1d-87ba-447e-b71c-1a9e32995700 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:59.125791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e9a7cd1d-87ba-447e-b71c-1a9e32995700 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:59.134813 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-535e38c2-17da-477b-b302-373b1b1b73e8 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.157792 Jun 18 22:10:59.136012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1284/2577] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:10:58 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:10:59.209342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e9a7cd1d-87ba-447e-b71c-1a9e32995700 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:59.218973 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e9a7cd1d-87ba-447e-b71c-1a9e32995700 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1218 microversion: 2.1 time: 0.098722 Jun 18 22:10:59.219563 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1294/2578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:59 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:59.287465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:59.288926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:59.294509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:59.294880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:59.295663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:59.296138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:59.464944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:10:59.475891 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e53a78f3-40fb-44c4-8a7b-6ef719419f01 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.191828 Jun 18 22:10:59.477637 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1285/2579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:59 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:10:59.827938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:10:59.828557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:10:59.841071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:59.841539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:10:59.842326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:10:59.844688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.158554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:00.165210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:00.178568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.183828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.184872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.187823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.220440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:00.230639 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b8b2b158-ca42-4b58-b18d-423c7218b130 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.406615 Jun 18 22:11:00.236916 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1295/2580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:10:59 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:00.241948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:00.248672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:00.263476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.264084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.265608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.267256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.608471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:11:00.619823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:00.632708 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8beae032-870a-49ee-a946-be7c9cf90767 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1270 microversion: 2.1 time: 0.394465 Jun 18 22:11:00.633421 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1296/2581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:00 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1270 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:00.637919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b5d8e042-7a61-4b35-abb7-c0e5bb54bfcc req-6e61d223-dd48-45dc-a0b8-75682bea5611 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92830c8-3210-4136-9abf-efdf84adfd89", "tag": "b4a9b468-9c40-4049-8455-b484be445a4d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:00.658835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b5d8e042-7a61-4b35-abb7-c0e5bb54bfcc req-6e61d223-dd48-45dc-a0b8-75682bea5611 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.661322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b5d8e042-7a61-4b35-abb7-c0e5bb54bfcc req-6e61d223-dd48-45dc-a0b8-75682bea5611 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.663075 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc338b66-7222-4df4-acfc-073bac247bee tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1927 microversion: 2.75 time: 0.508415 Jun 18 22:11:00.676961 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1286/2582] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:00 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1927 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:11:00.682134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:00.683149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:00.689014 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b5d8e042-7a61-4b35-abb7-c0e5bb54bfcc req-6e61d223-dd48-45dc-a0b8-75682bea5611 service nova] Creating event network-changed:b4a9b468-9c40-4049-8455-b484be445a4d for instance c92830c8-3210-4136-9abf-efdf84adfd89 on nch1-master-1 Jun 18 22:11:00.693060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.693733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.694714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:00.695333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:00.707084 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b5d8e042-7a61-4b35-abb7-c0e5bb54bfcc req-6e61d223-dd48-45dc-a0b8-75682bea5611 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072361 Jun 18 22:11:00.710514 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1297/2583] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:01.247774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:01.249499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:01.263882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:01.274201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:01.275242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:01.282453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:01.282936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:01.295104 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a399d559-416c-4b9c-8fbb-8d02c4d4ba1c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.616846 Jun 18 22:11:01.306726 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1287/2584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:00 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:01.650907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:01.652284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:01.659487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:01.660356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:01.661202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:01.661662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:01.682652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:01.693873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0d2644e5-ed09-4ff9-8e2c-19af16e1d92d tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.450253 Jun 18 22:11:01.694852 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1298/2585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:01 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:01.703080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:01.707091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:01.723223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:01.724889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:01.725941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:01.726556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:01.823003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:01.836512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-945f46c5-46f0-461c-868b-2666a8be50a0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1276 microversion: 2.1 time: 0.190195 Jun 18 22:11:01.837144 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1288/2586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:01 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:01.900109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:11:01.944049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-920d10f1-c69a-4dd1-8110-00814b3102ea tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1933 microversion: 2.75 time: 0.247983 Jun 18 22:11:01.944931 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1299/2587] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:01 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1933 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:11:02.312666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:02.313937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:02.330169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:02.332556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:02.336276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:02.338067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:02.712832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:02.716473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:02.741487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:02.743312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:02.746999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:02.748248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:03.155794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:03.165617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9660ee79-488a-4cea-ba54-e3e1e801f025 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.855635 Jun 18 22:11:03.168870 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1289/2588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:02 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:03.173911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-58e3afa4-7d53-425c-b03d-10e50a7ee867 req-d0de6626-4dcf-486b-9a1c-6bbba86f7c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd948550-44ae-411d-b1d1-b562dd92d9ce", "name": "network-vif-plugged", "status": "completed", "tag": "cf37ed15-38ad-441a-baa4-8156ecae1064"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:03.199384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-58e3afa4-7d53-425c-b03d-10e50a7ee867 req-d0de6626-4dcf-486b-9a1c-6bbba86f7c87 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:03.199928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-58e3afa4-7d53-425c-b03d-10e50a7ee867 req-d0de6626-4dcf-486b-9a1c-6bbba86f7c87 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:03.229755 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-58e3afa4-7d53-425c-b03d-10e50a7ee867 req-d0de6626-4dcf-486b-9a1c-6bbba86f7c87 service nova] Creating event network-vif-plugged:cf37ed15-38ad-441a-baa4-8156ecae1064 for instance fd948550-44ae-411d-b1d1-b562dd92d9ce on nch2-master-1 Jun 18 22:11:03.255902 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-58e3afa4-7d53-425c-b03d-10e50a7ee867 req-d0de6626-4dcf-486b-9a1c-6bbba86f7c87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084403 Jun 18 22:11:03.257067 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1290/2589] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:03.263431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:03.264407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:03.282650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:03.288717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:03.289201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:03.293398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:03.296031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:03.474069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:03.482570 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b76c331-9e39-4c02-9afc-066fa0c96d7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1276 microversion: 2.1 time: 0.223675 Jun 18 22:11:03.483818 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1291/2590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:03 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:03.496017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:03.496926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:03.507633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:03.509669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:03.510369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:03.511365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:03.513351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:03.530074 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-129e00ad-b2a9-41a9-88d6-572bb128a9e8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.822716 Jun 18 22:11:03.535107 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1300/2591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:02 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:03.703105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:11:03.744164 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-29ce0f30-29f4-4452-9f32-63044ea35c28 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1933 microversion: 2.75 time: 0.257176 Jun 18 22:11:03.745176 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1292/2592] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:03 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1933 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:11:04.188247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:04.189592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:04.206998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:04.210243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:04.211307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:04.213504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:04.501603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:04.502239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:04.526245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:04.527875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:04.531523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:04.532167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:04.707760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:04.737833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10b4bf63-97ba-4320-8a8e-60907a05c32a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.553972 Jun 18 22:11:04.767285 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1301/2593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:04 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:04.772674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:04.773523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:04.785537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:04.786434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:04.788765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:04.790761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:04.969900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:04.996721 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-224c65f5-b25d-4a11-aa78-212e24418bd7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 0.500349 Jun 18 22:11:05.000588 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1293/2594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:04 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:05.013983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:05.015235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:05.026734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.027686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.028724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.029497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.062609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:05.085517 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fc94c65-11da-464b-b185-4b092d254de3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1293 microversion: 2.1 time: 0.315236 Jun 18 22:11:05.087381 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1302/2595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:04 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1293 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:05.282110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] Lazy-loading 'services' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:11:05.332380 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-947c063a-0694-4794-a686-2cbeaeb568b4 tempest-ServersAdmin275Test-738405593 tempest-ServersAdmin275Test-738405593-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1918 microversion: 2.75 time: 0.330332 Jun 18 22:11:05.337754 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1294/2596] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:05 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1918 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:11:05.368310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:05.368931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:05.377026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.377872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.378814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.379535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.412239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:11:05.530462 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-284cf6cf-1ad5-4aa5-a227-098962bdb26e tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 204 len: 0 microversion: 2.75 time: 0.165763 Jun 18 22:11:05.543414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:05.544147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:05.547240 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1303/2597] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:11:05 2022] DELETE /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:11:05.553366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.553846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.554662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.555104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.580421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:05.670304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:05.682037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:05.683560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:05.699043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f3cde32-a0ca-457f-99b2-cb16f798652f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1443 microversion: 2.75 time: 0.161363 Jun 18 22:11:05.710130 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1295/2598] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:05 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1443 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:11:05.757109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:05.758436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:05.772392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.772858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:05.773887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:05.774253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.015766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:06.017761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:06.033775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.034235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.035032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.035479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.047582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:06.055939 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4eec55ea-b4f0-4e95-8dd3-6686bcc06b12 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.303830 Jun 18 22:11:06.056727 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1304/2599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:05 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:06.103054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:06.103690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:06.114031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.114503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.118008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.118485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.125244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:06.230418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:06.240805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6134fca5-f5fa-4b67-8e12-720ac5590432 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 0.228822 Jun 18 22:11:06.251013 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1296/2600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:06 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:06.376255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:06.399738 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5115100-cd70-4398-a3c7-52a168c3b068 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1484 microversion: 2.1 time: 0.300663 Jun 18 22:11:06.400278 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1305/2601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:06 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1484 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:06.417170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:06.417860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:06.432357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.434953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.436901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.440767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.492348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-602644388", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "374ea46b-0f5e-4cc2-a1fb-7c7adee27706"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:06.570841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] validate_networks() for [('374ea46b-0f5e-4cc2-a1fb-7c7adee27706', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:11:06.589645 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f10dd7c3-7d96-4165-a2d7-041fd5ff7ea4 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176819 Jun 18 22:11:06.597016 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1306/2602] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:11:06 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:11:06.721634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:06.722525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:06.732277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.735781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.736910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:06.737919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:06.899489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:06.917334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:06.919733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:06.928799 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51a906d1-b63f-4480-b9c8-c7e77ab6c9b6 tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1443 microversion: 2.75 time: 0.209026 Jun 18 22:11:06.931270 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1307/2603] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:06 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1443 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:11:07.074274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:07.075835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:07.082542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:07.082744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:07.084359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:07.085010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:07.910833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:07.926761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22472d77-3a67-4be2-9add-42a415574c81 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.857102 Jun 18 22:11:07.927390 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1308/2604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:07 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:07.955078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:07.961164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:07.990215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:07.993553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:07.999305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.001457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.139978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:11:08.141795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:11:08.142495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:11:08.144020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:11:08.145491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:11:08.160794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.161973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.164546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.167083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.251650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Getting quotas for project be82e54d6aa74bb09a543b6b225b9676. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:11:08.276205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Getting quotas for user fef0c44eb8be4d1fbf6caeedacf7ac21 and project be82e54d6aa74bb09a543b6b225b9676. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:11:08.331501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:11:08.334682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:11:08.448011 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.194983 Jun 18 22:11:08.449498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1297/2605] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:11:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:11:08.467244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:08.468181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:08.479791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.481057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.482051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.482647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.584584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.585599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.586388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lazy-loading 'fault' on Instance uuid 0bbe9127-1e3a-4167-abf8-5faeeef90088 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:11:08.822077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:08.840971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:08.843648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '64a676b449be43d9bc7fecb76178af16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac36afdc84465caad8632e46fe3a96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:08.866907 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-efacc0da-e3c7-480d-859d-aca6ca259a9c tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 200 len: 1448 microversion: 2.75 time: 0.415518 Jun 18 22:11:08.883477 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1298/2606] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:08 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 1448 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:11:08.898258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0b5f7aea-ba81-4d17-98b2-a21b3f9a1823 req-9831a764-0ab3-45c1-bc42-4bd256721d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92830c8-3210-4136-9abf-efdf84adfd89", "name": "network-vif-plugged", "status": "completed", "tag": "b4a9b468-9c40-4049-8455-b484be445a4d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:08.921370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0b5f7aea-ba81-4d17-98b2-a21b3f9a1823 req-9831a764-0ab3-45c1-bc42-4bd256721d4a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:08.936736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0b5f7aea-ba81-4d17-98b2-a21b3f9a1823 req-9831a764-0ab3-45c1-bc42-4bd256721d4a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:08.970528 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0b5f7aea-ba81-4d17-98b2-a21b3f9a1823 req-9831a764-0ab3-45c1-bc42-4bd256721d4a service nova] Creating event network-vif-plugged:b4a9b468-9c40-4049-8455-b484be445a4d for instance c92830c8-3210-4136-9abf-efdf84adfd89 on nch1-master-1 Jun 18 22:11:08.986455 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0b5f7aea-ba81-4d17-98b2-a21b3f9a1823 req-9831a764-0ab3-45c1-bc42-4bd256721d4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105030 Jun 18 22:11:08.989444 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1299/2607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:09.005012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16bb222a-e839-45dc-832c-69ca76f33a53 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:09.009574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:09.013605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16bb222a-e839-45dc-832c-69ca76f33a53 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:09.097943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:09.106940 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-57a0da85-c408-45c7-9340-ea826317d365 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 1.163029 Jun 18 22:11:09.127355 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1309/2608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:07 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:09.144491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:09.149984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:09.173706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:09.176959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:09.182459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:09.185845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:09.238538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=36 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:09.417233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16bb222a-e839-45dc-832c-69ca76f33a53 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:09.427747 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16bb222a-e839-45dc-832c-69ca76f33a53 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1216 microversion: 2.1 time: 0.430704 Jun 18 22:11:09.442040 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1300/2609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:08 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1216 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:09.451726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e4873c53-599f-4b4f-8e4a-8888784586f3 req-156f1daf-31c6-40a4-bc73-375947edf4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:09.490550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e4873c53-599f-4b4f-8e4a-8888784586f3 req-156f1daf-31c6-40a4-bc73-375947edf4cc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:09.493130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e4873c53-599f-4b4f-8e4a-8888784586f3 req-156f1daf-31c6-40a4-bc73-375947edf4cc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:09.548352 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e4873c53-599f-4b4f-8e4a-8888784586f3 req-156f1daf-31c6-40a4-bc73-375947edf4cc service nova] Creating event network-changed:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:11:09.562967 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e4873c53-599f-4b4f-8e4a-8888784586f3 req-156f1daf-31c6-40a4-bc73-375947edf4cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119157 Jun 18 22:11:09.563615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1301/2610] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:09.895329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:09.897230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] [instance: 0bbe9127-1e3a-4167-abf8-5faeeef90088] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:09.922807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:09.926159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:09.935356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:09.936411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:09.981477 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] HTTP exception thrown: Instance 0bbe9127-1e3a-4167-abf8-5faeeef90088 could not be found. Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Request method failure captured: Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 HTTP/1.1 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk0rng9pmhiRbKvktiEAs5f8Vg7tSfaLB95XVFEGbnnclVz9spemGScBF8AmuSKClQCf14PNVh8vbdSNvKzABOqiV1oRUzRNzoksrlHMye7FtF7eEdXkHWmTDGAU-HbsXUZA0wpYr-tDjRuEbpQBagarhjEgmpff3auvsziQbqf6IWQ Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.75 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d1ac36afdc84465caad8632e46fe3a96 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAdmin275Test-238493886 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d1ac36afdc84465caad8632e46fe3a96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d1ac36afdc84465caad8632e46fe3a96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d1ac36afdc84465caad8632e46fe3a96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d1ac36afdc84465caad8632e46fe3a96", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAdmin275Test-238493886 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d1ac36afdc84465caad8632e46fe3a96 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAdmin275Test-238493886 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAdmin275Test-238493886-project Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 64a676b449be43d9bc7fecb76178af16 Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAdmin275Test-238493886-project Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 0bbe9127-1e3a-4167-abf8-5faeeef90088 could not be found. Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '0bbe9127-1e3a-4167-abf8-5faeeef90088'} Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bbe9127-1e3a-4167-abf8-5faeeef90088 could not be found. Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bbe9127-1e3a-4167-abf8-5faeeef90088 could not be found. Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:11:09.985421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bbe9127-1e3a-4167-abf8-5faeeef90088 could not be found. Jun 18 22:11:09.990764 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:09.999517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] Returning 404 to user: Instance 0bbe9127-1e3a-4167-abf8-5faeeef90088 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:11:10.001242 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c4c35096-57f2-42aa-82ca-8835df044d6f tempest-ServersAdmin275Test-238493886 tempest-ServersAdmin275Test-238493886-project] 10.222.0.30 "GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088" status: 404 len: 111 microversion: 2.75 time: 0.110670 Jun 18 22:11:10.005259 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1302/2611] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:11:09 2022] GET /compute/v2.1/servers/0bbe9127-1e3a-4167-abf8-5faeeef90088 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:11:10.069961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:10.082139 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-42c201a9-50b5-4c0c-a925-0d410341d75b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.957058 Jun 18 22:11:10.085841 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1310/2612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:09 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:10.135495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:10.136277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:10.147082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:10.149376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:10.156829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:10.158228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:10.455924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:10.457582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:10.471384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:10.472191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:10.474219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:10.474847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:10.921383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:10.942075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1eb7b371-4bc6-45ff-a1ea-a406b1c3c151 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1268 microversion: 2.1 time: 0.491786 Jun 18 22:11:10.946370 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1311/2613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:10 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1268 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:11.106785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:11.108296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:11.125502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:11.127063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:11.132188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:11.132671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:11.185553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:11.199800 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eec743c2-6bc9-4ce9-bb1a-f37f1e20b418 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 1.065043 Jun 18 22:11:11.202040 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1303/2614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:10 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:11.683020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0fd178ff-cf41-4517-92f5-097397d79008 req-93723841-4bc9-4c9e-8e0b-ae7098e10170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64809918-45ff-4e75-9136-72b4a53b4046", "tag": "02edfb5d-e4f7-4f79-bd38-14abde92e757"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:11.693385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0fd178ff-cf41-4517-92f5-097397d79008 req-93723841-4bc9-4c9e-8e0b-ae7098e10170 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:11.693845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0fd178ff-cf41-4517-92f5-097397d79008 req-93723841-4bc9-4c9e-8e0b-ae7098e10170 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:11.725509 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0fd178ff-cf41-4517-92f5-097397d79008 req-93723841-4bc9-4c9e-8e0b-ae7098e10170 service nova] Creating event network-changed:02edfb5d-e4f7-4f79-bd38-14abde92e757 for instance 64809918-45ff-4e75-9136-72b4a53b4046 on nch1-master-1 Jun 18 22:11:11.731097 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0fd178ff-cf41-4517-92f5-097397d79008 req-93723841-4bc9-4c9e-8e0b-ae7098e10170 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061199 Jun 18 22:11:11.732404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1304/2615] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:11.964360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:11.965181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:11.986343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:11.987041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:11.987994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:11.989485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:12.046263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:12.054498 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10bef17a-a11a-4bbd-960d-ebaaafbcb5e2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1313 microversion: 2.1 time: 0.955499 Jun 18 22:11:12.064429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1312/2616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:11 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:12.174838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:12.183091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:12.183718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:12.193193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:12.193662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:12.198623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47a934f1-a819-490c-be41-5a8df0a70deb tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1274 microversion: 2.1 time: 0.238398 Jun 18 22:11:12.200077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1305/2617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:11 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:12.204059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:12.205804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:12.221244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:12.224290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:12.250782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:12.251236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:12.255074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:12.255519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:12.894818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:12.904219 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ce6a243-fa36-41c0-b291-80e04b3a31f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 0.690142 Jun 18 22:11:12.913996 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1306/2618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:12 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:12.914199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cba6111a-11e5-4677-a08a-d9514d38e64a req-075abc11-aa64-45e0-b951-41a53d733bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd948550-44ae-411d-b1d1-b562dd92d9ce", "tag": "cf37ed15-38ad-441a-baa4-8156ecae1064"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:12.924131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cba6111a-11e5-4677-a08a-d9514d38e64a req-075abc11-aa64-45e0-b951-41a53d733bb8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:12.924931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cba6111a-11e5-4677-a08a-d9514d38e64a req-075abc11-aa64-45e0-b951-41a53d733bb8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:12.951636 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cba6111a-11e5-4677-a08a-d9514d38e64a req-075abc11-aa64-45e0-b951-41a53d733bb8 service nova] Creating event network-changed:cf37ed15-38ad-441a-baa4-8156ecae1064 for instance fd948550-44ae-411d-b1d1-b562dd92d9ce on nch2-master-1 Jun 18 22:11:12.959041 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cba6111a-11e5-4677-a08a-d9514d38e64a req-075abc11-aa64-45e0-b951-41a53d733bb8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048263 Jun 18 22:11:12.960769 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1307/2619] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:13.073685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:13.075862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:13.076840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:13.092094 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ed9f440-1fe1-46fb-ae74-d92ca77542a1 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1484 microversion: 2.1 time: 0.910780 Jun 18 22:11:13.094000 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1313/2620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:12 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1484 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:13.094660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.095973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.098402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.099316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.218141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:13.219893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:13.229353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.232197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.234060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.234514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.400928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:13.420207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3ecb553-4c51-4bf6-94f2-d3b7cca583f4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1274 microversion: 2.1 time: 0.207384 Jun 18 22:11:13.421382 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1314/2621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:13 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:13.826294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:13.836661 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ffc0402c-7728-4880-bed9-e9e1d0d916cd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1463 microversion: 2.1 time: 0.767830 Jun 18 22:11:13.849899 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1308/2622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:13 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1463 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:13.855851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:13.857246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:13.866958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.867680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.868646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.869284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.923833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:13.924748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:13.934603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.935066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:13.935876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:13.941971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:14.113409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:14.123491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Old instance type m1.heat2, new instance type m1.heat {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:11:14.166584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:11:14.167029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:11:14.173789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:11:14.176012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:11:14.176405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:11:14.338557 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f88592b-f1e6-445e-80b1-997e1b20990f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89/action" status: 202 len: 0 microversion: 2.1 time: 0.486849 Jun 18 22:11:14.342451 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1315/2623] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:11:13 2022] POST /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:11:14.349460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:14.367989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:14.383882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:14.386787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:14.387936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:14.389234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:14.456752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:14.469391 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d3c42bc-008a-4606-b105-8629a73299dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 0.548650 Jun 18 22:11:14.470737 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1309/2624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:13 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:14.476288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:14.477441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:14.485023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:14.485961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:14.487244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:14.487964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:15.062544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:15.073299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee3efb4b-988a-418e-898e-cb0a158e0d72 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.600706 Jun 18 22:11:15.074415 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1310/2625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:14 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:15.199600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:15.221018 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1b248f9-2a33-48fc-8f6d-c94ae7363e10 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1472 microversion: 2.1 time: 0.875026 Jun 18 22:11:15.222630 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1316/2626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:14 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1472 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:15.489355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:15.490217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:15.510926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:15.511147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:15.513322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:15.516665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:16.091421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:16.092832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:16.108817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:16.109695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:16.110661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:16.111396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:16.612987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:16.629529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc6b3f38-5c76-4113-949a-49bf717ef86e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 1.146821 Jun 18 22:11:16.631068 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1311/2627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:15 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:16.645527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:16.647933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:16.669004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:16.669953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:16.675488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:16.677686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:17.713181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:17.735279 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c687cf63-39c5-41c0-b699-7493ca5c2ef4 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 1.647869 Jun 18 22:11:17.752019 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1317/2628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:16 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:17.759595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:17.768949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:17.771413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:17.779724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:17.781007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:17.782396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:17.783042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:17.784780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aac7aed1-550a-4a6b-a4a0-8e4a5e6f8c58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1472 microversion: 2.1 time: 1.149648 Jun 18 22:11:17.788491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1312/2629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:16 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1472 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:18.074258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fea05fc3-96be-4220-8c42-52db911ba640 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.079123 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.079123 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.081962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea05fc3-96be-4220-8c42-52db911ba640 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.082618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea05fc3-96be-4220-8c42-52db911ba640 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.084164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea05fc3-96be-4220-8c42-52db911ba640 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.084850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fea05fc3-96be-4220-8c42-52db911ba640 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.122625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fea05fc3-96be-4220-8c42-52db911ba640 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.240279 Jun 18 22:11:18.124447 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1313/2630] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:11:17 2022] GET /compute/v2.1/os-services => generated 947 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:11:18.135820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8556daea-e19c-4ef5-95f7-896630cbac91 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.138110 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.138110 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.139712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8556daea-e19c-4ef5-95f7-896630cbac91 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.140630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8556daea-e19c-4ef5-95f7-896630cbac91 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.141906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8556daea-e19c-4ef5-95f7-896630cbac91 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.142575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8556daea-e19c-4ef5-95f7-896630cbac91 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.187833 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8556daea-e19c-4ef5-95f7-896630cbac91 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.056088 Jun 18 22:11:18.198253 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1314/2631] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:11:18.204730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f0d3b3e-23af-4225-8f8f-a4318082672d tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.206146 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.206146 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.209378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f0d3b3e-23af-4225-8f8f-a4318082672d tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.210438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f0d3b3e-23af-4225-8f8f-a4318082672d tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.211607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f0d3b3e-23af-4225-8f8f-a4318082672d tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.212282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f0d3b3e-23af-4225-8f8f-a4318082672d tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.257658 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f0d3b3e-23af-4225-8f8f-a4318082672d tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.057476 Jun 18 22:11:18.261846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1315/2632] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/os-services => generated 947 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:18.284760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd21263a-20ec-4211-8dd5-d67decf341f0 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.286150 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.286150 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.293844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd21263a-20ec-4211-8dd5-d67decf341f0 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.294639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd21263a-20ec-4211-8dd5-d67decf341f0 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.296242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd21263a-20ec-4211-8dd5-d67decf341f0 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.297439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd21263a-20ec-4211-8dd5-d67decf341f0 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.397631 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd21263a-20ec-4211-8dd5-d67decf341f0 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.119641 Jun 18 22:11:18.405305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1316/2633] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:11:18.413001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75ccf9cb-e808-4b88-8b00-9ac089382797 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.414622 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.414622 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.417307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ccf9cb-e808-4b88-8b00-9ac089382797 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.417955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ccf9cb-e808-4b88-8b00-9ac089382797 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.419127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ccf9cb-e808-4b88-8b00-9ac089382797 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.420449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ccf9cb-e808-4b88-8b00-9ac089382797 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.462526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75ccf9cb-e808-4b88-8b00-9ac089382797 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.055598 Jun 18 22:11:18.463472 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1317/2634] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/os-services => generated 947 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:18.476511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e4b8e62-b5aa-46ac-9a95-d0645ae93253 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.478174 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.478174 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.479654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e4b8e62-b5aa-46ac-9a95-d0645ae93253 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.480283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e4b8e62-b5aa-46ac-9a95-d0645ae93253 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.481781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e4b8e62-b5aa-46ac-9a95-d0645ae93253 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.482435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e4b8e62-b5aa-46ac-9a95-d0645ae93253 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.525371 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e4b8e62-b5aa-46ac-9a95-d0645ae93253 tempest-ServicesAdminNegativeTestJSON-384049421 tempest-ServicesAdminNegativeTestJSON-384049421-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.053401 Jun 18 22:11:18.526324 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1318/2635] 10.222.0.30 () {58 vars in 1197 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:11:18.603051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:18.615604 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f083f2e9-731e-4d83-a159-ac60f952d75f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 0.860235 Jun 18 22:11:18.618742 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1318/2636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:17 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:18.694622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de71f3ff-5a58-46c2-b5bc-56dda5cf7088 tempest-ServicesAdminNegativeTestJSON-5987218 tempest-ServicesAdminNegativeTestJSON-5987218-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.696205 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:11:18.696205 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:11:18.697961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de71f3ff-5a58-46c2-b5bc-56dda5cf7088 tempest-ServicesAdminNegativeTestJSON-5987218 tempest-ServicesAdminNegativeTestJSON-5987218-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '841d1a7d74af4d6c9a55ef0a8dcc5033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7a17dc15d45b4b333bade888c180d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de71f3ff-5a58-46c2-b5bc-56dda5cf7088 tempest-ServicesAdminNegativeTestJSON-5987218 tempest-ServicesAdminNegativeTestJSON-5987218-project] Request method failure captured: Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2EktLVZ1NX-rakvmn4KGgN_g7treKn47vgbSBVtQwuorSCm_LtZiRObkI7MbWZmb74OBdMM3xhLEk_kO3yiAbf64-SDn77--GMFk-QF7dOcuCSsfm-C2DZdRzFiRKc2aNoOVW10AAJ3hq0kKQnIrMQdWCua6LT5nYPk7RvlPWuKvo Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a6f7a17dc15d45b4b333bade888c180d Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-5987218 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a6f7a17dc15d45b4b333bade888c180d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a6f7a17dc15d45b4b333bade888c180d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a6f7a17dc15d45b4b333bade888c180d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a6f7a17dc15d45b4b333bade888c180d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-5987218 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a6f7a17dc15d45b4b333bade888c180d Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-5987218 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServicesAdminNegativeTestJSON-5987218-project Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 841d1a7d74af4d6c9a55ef0a8dcc5033 Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-5987218-project Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise self.value Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 18 22:11:18.700177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 18 22:11:18.705263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:11:18.707304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de71f3ff-5a58-46c2-b5bc-56dda5cf7088 tempest-ServicesAdminNegativeTestJSON-5987218 tempest-ServicesAdminNegativeTestJSON-5987218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:11:18.708463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de71f3ff-5a58-46c2-b5bc-56dda5cf7088 tempest-ServicesAdminNegativeTestJSON-5987218 tempest-ServicesAdminNegativeTestJSON-5987218-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.174118 Jun 18 22:11:18.720117 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1319/2637] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/os-services => generated 112 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:11:18.753416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.754894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:18.772245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:18.777914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.778403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.781510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.782175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.806271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:18.806874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:18.835643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.837999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:18.844409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:18.847397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:19.422412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:19.482271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:19.500100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1959e96e-2720-429e-a3ab-0b59a1e03530 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.751699 Jun 18 22:11:19.504666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1319/2638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:19.526347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-80c7062b-8410-44f5-8936-9809fc16d0cc req-abdb73cc-3222-4310-a945-5edefbe2ee52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "name": "network-vif-plugged", "status": "completed", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:19.551873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-80c7062b-8410-44f5-8936-9809fc16d0cc req-abdb73cc-3222-4310-a945-5edefbe2ee52 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:19.554318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-80c7062b-8410-44f5-8936-9809fc16d0cc req-abdb73cc-3222-4310-a945-5edefbe2ee52 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:19.585551 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-80c7062b-8410-44f5-8936-9809fc16d0cc req-abdb73cc-3222-4310-a945-5edefbe2ee52 service nova] Creating event network-vif-plugged:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:11:19.596833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-80c7062b-8410-44f5-8936-9809fc16d0cc req-abdb73cc-3222-4310-a945-5edefbe2ee52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090402 Jun 18 22:11:19.601711 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1320/2639] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:19.636296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:19.637001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:19.651441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:19.651900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:19.652685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:19.653152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:19.691999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:20.746533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:20.759183 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-daa7d949-2f0d-4637-8d6c-6e8f22af2216 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 1.126979 Jun 18 22:11:20.759782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1321/2640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:19 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:20.777671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-eb81e7a1-de1d-466a-8a15-2fb568035696 req-14ccba5c-6898-4bc3-b501-c89f21f1a9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c441f9-184f-43d7-99cc-07755ebfa97b", "tag": "646c2773-d178-4e72-9bdf-313447acda8a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:20.802668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-eb81e7a1-de1d-466a-8a15-2fb568035696 req-14ccba5c-6898-4bc3-b501-c89f21f1a9c4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:20.805287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-eb81e7a1-de1d-466a-8a15-2fb568035696 req-14ccba5c-6898-4bc3-b501-c89f21f1a9c4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:20.822031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:20.829179 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-eb81e7a1-de1d-466a-8a15-2fb568035696 req-14ccba5c-6898-4bc3-b501-c89f21f1a9c4 service nova] Creating event network-changed:646c2773-d178-4e72-9bdf-313447acda8a for instance d6c441f9-184f-43d7-99cc-07755ebfa97b on nch2-master-1 Jun 18 22:11:20.831763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f933076b-c065-4689-a809-95513db9b1f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1472 microversion: 2.1 time: 2.031590 Jun 18 22:11:20.834147 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1320/2641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:18 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1472 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:20.841371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-eb81e7a1-de1d-466a-8a15-2fb568035696 req-14ccba5c-6898-4bc3-b501-c89f21f1a9c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079205 Jun 18 22:11:20.842261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1322/2642] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:20.846968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:20.847771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:20.860333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:20.862205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:20.864307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:20.864967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:21.651796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:21.657842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:21.666156 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1232e635-b0b7-4cec-b13a-7be6ddf652db tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.822768 Jun 18 22:11:21.667013 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1321/2643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:20 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:21.783648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:21.784373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:21.852741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:21.853434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:21.866073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:21.866535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:21.872797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:21.873282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:21.873813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:21.877144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:21.879962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:21.881294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:22.636576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:22.668384 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3f40b535-e6cd-433d-b57d-88454f2baffb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 0.895331 Jun 18 22:11:22.669747 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1323/2644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:21 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:22.680141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-15ae0b85-6efe-4d28-9af6-7d571856e91c req-162faa5f-3968-47ce-adec-72a5b9462167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64809918-45ff-4e75-9136-72b4a53b4046", "name": "network-vif-plugged", "status": "completed", "tag": "02edfb5d-e4f7-4f79-bd38-14abde92e757"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:22.705157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-15ae0b85-6efe-4d28-9af6-7d571856e91c req-162faa5f-3968-47ce-adec-72a5b9462167 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:22.705611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-15ae0b85-6efe-4d28-9af6-7d571856e91c req-162faa5f-3968-47ce-adec-72a5b9462167 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:22.776761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-15ae0b85-6efe-4d28-9af6-7d571856e91c req-162faa5f-3968-47ce-adec-72a5b9462167 service nova] Creating event network-vif-plugged:02edfb5d-e4f7-4f79-bd38-14abde92e757 for instance 64809918-45ff-4e75-9136-72b4a53b4046 on nch1-master-1 Jun 18 22:11:22.795197 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-15ae0b85-6efe-4d28-9af6-7d571856e91c req-162faa5f-3968-47ce-adec-72a5b9462167 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124156 Jun 18 22:11:22.797702 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1324/2645] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:22.806852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:22.818164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:22.837510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:22.841738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:22.842962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:22.846072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:22.913581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:22.928842 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1af043bd-d4d6-483d-9c97-98d94be47f05 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 1.081425 Jun 18 22:11:22.937771 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1322/2646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:21 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:23.460999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:23.473453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9725de7d-4a9b-4422-bfc6-49a36e5161f2 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.674222 Jun 18 22:11:23.474055 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1325/2647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:22 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:23.686586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:23.687404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:23.697374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:23.706141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:23.706661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:23.709930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:23.710409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:23.954057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:23.955475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:23.963625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:23.964075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:23.964888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:23.965348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:24.784744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:24.796749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:24.801323 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-114cb077-57f7-459d-baad-5026d7fa82c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.852940 Jun 18 22:11:24.801937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1326/2648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:23 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:24.809355 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e1e8c8b-3b60-49d1-b9fe-7bbe8c9b06c2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1318 microversion: 2.1 time: 1.127876 Jun 18 22:11:24.818845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:24.819481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:24.828170 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1323/2649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:23 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1318 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:24.830790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:24.831436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:24.834807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:24.835428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:25.255926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-668595710", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:25.305190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:25.314573 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e50c90e0-7f9c-4c42-819f-d94fb7b0698d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.511591 Jun 18 22:11:25.318739 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1327/2650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:24 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:25.391216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] validate_networks() for [('5f383b05-8595-491c-b273-dd69bbad8619', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:11:25.818513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:25.819369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:25.826059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:25.826779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:25.827867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:25.828300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.196813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:11:26.198072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:11:26.198821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:11:26.199603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:11:26.200102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:11:26.203556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:26.210434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.211220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.212226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.212670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.217521 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1040e57-2947-4645-97df-eef605e2389d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.402613 Jun 18 22:11:26.219672 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1328/2651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:25 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:26.233238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:26.235853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:26.240264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:11:26.247286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for user 65fa96c0dcf948d185e7d5fdcf280fa4 and project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:11:26.249426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.251214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.252712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.253271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.262691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:11:26.265390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:11:26.326233 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dad3bb5c-1d19-4132-a562-361009a8ad8d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.429396 Jun 18 22:11:26.329492 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1324/2652] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:11:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:11:26.338938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:26.344150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:26.358437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.359030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.360730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.364506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.647286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:26.660543 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ce20320-2e77-4e32-8361-f23364c8cf63 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.329433 Jun 18 22:11:26.664270 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1325/2653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:26 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:26.676579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ddee5c61-1a6c-468d-9805-ccaa4bde3035 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:26.695061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ddee5c61-1a6c-468d-9805-ccaa4bde3035 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:26.769192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:26.778656 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5af65cc-eb26-4898-b78a-05d5dbb29979 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1468 microversion: 2.1 time: 0.556469 Jun 18 22:11:26.782142 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1329/2654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:26 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1468 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:26.798790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:26.804238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:26.825681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.829835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.833938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:26.836785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:26.911979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ddee5c61-1a6c-468d-9805-ccaa4bde3035 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:26.928116 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ddee5c61-1a6c-468d-9805-ccaa4bde3035 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1221 microversion: 2.1 time: 0.262374 Jun 18 22:11:26.928731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1326/2655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:26 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:27.198907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1974491084", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:27.301646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] validate_networks() for [('5f383b05-8595-491c-b273-dd69bbad8619', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:11:27.504251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:27.525393 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ada8c608-0437-4fba-9bb1-f2e7deeb4a48 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1468 microversion: 2.1 time: 0.727580 Jun 18 22:11:27.526234 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1330/2656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:26 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1468 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:27.558247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:27.563646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:27.581798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:27.584605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:27.585542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:27.587389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:28.244270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:28.256099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-874cce82-e253-4009-8009-05e5668b04ae tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.712096 Jun 18 22:11:28.261594 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1331/2657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:27 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:28.276963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1106725757"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:28.296184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:28.333976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:28.335953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:28.337827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:28.342100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:28.888251 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65d84b6c-ec67-422f-8130-60c11b9b0fc5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "POST /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469/action" status: 202 len: 0 microversion: 2.1 time: 0.621143 Jun 18 22:11:28.889636 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1332/2658] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:11:28 2022] POST /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:11:28.897194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:28.899425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:28.915981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:28.916826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:28.922938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:28.923799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:29.384766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:11:29.385394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:11:29.385888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:11:29.386262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:11:29.387274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:11:29.408622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:29.409109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:29.410238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:29.410681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:29.461492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:11:29.474504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for user 65fa96c0dcf948d185e7d5fdcf280fa4 and project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:11:29.501948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:29.518819 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f144241-f536-463a-957d-34601daea0bd tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.627422 Jun 18 22:11:29.521571 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1333/2659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:28 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:29.527492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:11:29.538858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:11:29.539788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6e06350-9f38-44e6-8d88-878bd8178cac tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea143780d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:29.658560 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-62ab2515-5d2d-4854-ab3b-d252eba942a0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.465011 Jun 18 22:11:29.659229 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6e06350-9f38-44e6-8d88-878bd8178cac tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.135232 Jun 18 22:11:29.660120 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1334/2660] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:29 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:29.660894 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1327/2661] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:11:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:11:29.672017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a339391-d20d-4bd0-8305-a14ec87565cc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:29.672654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a339391-d20d-4bd0-8305-a14ec87565cc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:29.678115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:29.687326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:29.711519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:29.714891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:29.715877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:29.716492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:30.074267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a339391-d20d-4bd0-8305-a14ec87565cc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:30.134511 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a339391-d20d-4bd0-8305-a14ec87565cc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1222 microversion: 2.1 time: 0.442337 Jun 18 22:11:30.141765 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1328/2662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:29 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1222 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:30.243686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:30.265399 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4231ee9d-a707-4d63-8bbd-2c327cdf4f64 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.604044 Jun 18 22:11:30.266011 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1335/2663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:29 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:30.543475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:30.544185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:30.545466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-770c62df-db61-4361-9a86-f2c823b8d9c2 req-62250055-6ace-47e8-9061-06157373e56f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c441f9-184f-43d7-99cc-07755ebfa97b", "name": "network-vif-plugged", "status": "completed", "tag": "646c2773-d178-4e72-9bdf-313447acda8a"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:30.569147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:30.571264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:30.578502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:30.579610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-770c62df-db61-4361-9a86-f2c823b8d9c2 req-62250055-6ace-47e8-9061-06157373e56f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:30.580341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-770c62df-db61-4361-9a86-f2c823b8d9c2 req-62250055-6ace-47e8-9061-06157373e56f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:30.581179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:30.633973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-770c62df-db61-4361-9a86-f2c823b8d9c2 req-62250055-6ace-47e8-9061-06157373e56f service nova] Creating event network-vif-plugged:646c2773-d178-4e72-9bdf-313447acda8a for instance d6c441f9-184f-43d7-99cc-07755ebfa97b on nch2-master-1 Jun 18 22:11:30.661866 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-770c62df-db61-4361-9a86-f2c823b8d9c2 req-62250055-6ace-47e8-9061-06157373e56f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121834 Jun 18 22:11:30.663504 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1329/2664] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:30.681684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73cbe24d-13a4-4e6c-946d-734e527bc3af tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14193790>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:30.780557 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73cbe24d-13a4-4e6c-946d-734e527bc3af tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.106412 Jun 18 22:11:30.781457 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1330/2665] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:30 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:31.158817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:31.159921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:31.176371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:31.177658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:31.180817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:31.184153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:31.397560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:31.406998 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b4da6bd-cd67-4c3e-a251-dc53f802177a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1274 microversion: 2.1 time: 0.252604 Jun 18 22:11:31.415671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:31.425256 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1331/2666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:31 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:31.429062 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-00560ec0-d962-420e-a304-9e64180e049c tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1316 microversion: 2.1 time: 0.894360 Jun 18 22:11:31.435766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1336/2667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:30 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:31.449020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:31.450085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:31.459988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:31.460690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:31.461658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:31.462252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:31.797137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e27a3a64-bdf6-4d2b-b843-93004cbeeb7a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078d3ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:31.818876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:31.831357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f5fe89c-69a4-4998-bf95-6728dafa9f79 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.403660 Jun 18 22:11:31.833453 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1332/2668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:31 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:31.860524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e27a3a64-bdf6-4d2b-b843-93004cbeeb7a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.069589 Jun 18 22:11:31.861598 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1337/2669] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:31 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:32.442457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:32.443487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:32.454871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:32.456609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:32.475209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:32.476064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:32.481671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:32.486070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:32.494432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:32.497265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:32.498460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:32.506106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:32.805924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:32.846383 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64ac8d63-1c6e-4232-8cb8-fab1413e0062 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1280 microversion: 2.1 time: 0.405077 Jun 18 22:11:32.850946 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1333/2670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:32 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1280 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:32.864904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:32.882023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:32.906520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:32.907494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:32.910944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:32.912346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.366023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:33.379764 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e0393975-236f-4b5a-a895-d177718da019 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1504 microversion: 2.1 time: 0.931553 Jun 18 22:11:33.407777 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1338/2671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:32 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1504 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:33.433886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36c9c730-b821-46d7-affb-dfc5173a81d8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078bf280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:33.558806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36c9c730-b821-46d7-affb-dfc5173a81d8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.143087 Jun 18 22:11:33.564324 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1339/2672] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:33 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:33.592688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:33.593358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:33.604988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:33.607834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.609599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:33.610854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.703363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:33.713574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3064084d-5dd3-4c24-acfa-d53ad6a39202 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.860376 Jun 18 22:11:33.732189 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1334/2673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:32 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:33.738400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:33.741631 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0db5ca46-8b45-4549-9c35-3bdfb8d876ae tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b/os-instance-actions/req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4" status: 200 len: 313 microversion: 2.1 time: 0.176032 Jun 18 22:11:33.751849 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1340/2674] 10.222.0.30 () {58 vars in 1418 bytes} [Sat Jun 18 22:11:33 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b/os-instance-actions/req-1c3d06e8-39c0-4d1f-bbdf-bde9d4f147c4 => generated 313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:33.765446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:33.770360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:33.794580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:33.795037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.795882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:33.796324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.870572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:33.872197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:33.892464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:33.893508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.895643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:33.902582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:33.931738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:34.047802 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc2d4614-d617-4633-b225-2cc64abe426e tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "POST /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b/action" status: 202 len: 0 microversion: 2.1 time: 0.286311 Jun 18 22:11:34.074895 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1335/2675] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:11:33 2022] POST /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:11:34.101249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:34.125755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:34.151948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:34.157778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:34.159131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:34.159618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:34.888666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:34.904473 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-53f5f887-a241-4ebb-9e0a-cb82a2d94770 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 1.040577 Jun 18 22:11:34.906611 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1341/2676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:33 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:34.920056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f8c74f5-1265-411b-9067-82745499822b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14088160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:34.943927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:34.973368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f4c2910-fa5f-480e-a172-d994f31b178d tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1506 microversion: 2.1 time: 0.889513 Jun 18 22:11:34.983871 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1336/2677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:34 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1506 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:34.993094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:34.994309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:35.015328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:35.016525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:35.018960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:35.020021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:35.072082 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f8c74f5-1265-411b-9067-82745499822b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.164066 Jun 18 22:11:35.072557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1342/2678] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:34 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:35.558043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:35.574770 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a058849e-98f3-4973-a611-0e7d324be320 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.593634 Jun 18 22:11:35.575842 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1337/2679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:34 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:35.846253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4d2d1c1e-f472-48f4-ba96-86513a4aba5c req-0fe8b6bd-746b-43ba-ae1b-14d7aec60973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c421b265-a2ca-42cf-8eed-603f694967a1", "tag": "c6489495-ef26-4bfc-9180-23df81823434"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:35.884863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4d2d1c1e-f472-48f4-ba96-86513a4aba5c req-0fe8b6bd-746b-43ba-ae1b-14d7aec60973 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:35.885383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4d2d1c1e-f472-48f4-ba96-86513a4aba5c req-0fe8b6bd-746b-43ba-ae1b-14d7aec60973 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:35.911635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4d2d1c1e-f472-48f4-ba96-86513a4aba5c req-0fe8b6bd-746b-43ba-ae1b-14d7aec60973 service nova] Creating event network-changed:c6489495-ef26-4bfc-9180-23df81823434 for instance c421b265-a2ca-42cf-8eed-603f694967a1 on nch2-master-1 Jun 18 22:11:35.925961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:35.926884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:35.943793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4d2d1c1e-f472-48f4-ba96-86513a4aba5c req-0fe8b6bd-746b-43ba-ae1b-14d7aec60973 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102787 Jun 18 22:11:35.945985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:35.946415 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1343/2680] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:11:35.947214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:35.948298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:35.951481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:35.993725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:35.994858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:36.007810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:36.022077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:36.023439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:36.027453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:36.470294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:36.491035 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02d89b26-e9e5-4975-856b-21c035f83fc4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.566695 Jun 18 22:11:36.493336 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1338/2681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:35 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:36.500769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a91891d4-4469-4a81-81cc-ce67a9310d54 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07a39c10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:36.586028 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a91891d4-4469-4a81-81cc-ce67a9310d54 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.091298 Jun 18 22:11:36.590716 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1339/2682] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:36 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:36.604396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:36.605227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:36.624100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:36.624798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:36.626088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:36.631287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:36.631931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:36.637340 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-399b406a-2753-4c1a-9ef6-b59e6a2a4a78 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1506 microversion: 2.1 time: 0.647026 Jun 18 22:11:36.641819 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1344/2683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:35 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1506 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:37.055603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:37.073934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8cf04b8c-3a5f-4478-800e-85d20df4b2f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.481991 Jun 18 22:11:37.086128 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1340/2684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:36 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:37.512251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:37.514118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:37.533540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:37.535269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:37.537694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:37.538610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:37.634556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fecdbaac-85ba-42b3-83ee-45a82b7bacd9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea079bb1f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:37.743203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fecdbaac-85ba-42b3-83ee-45a82b7bacd9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.142524 Jun 18 22:11:37.745639 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1341/2685] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:37 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:37.759670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:37.760250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:37.806832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:37.809677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:37.812482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:37.815214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:37.965802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:37.974398 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-147099a7-7313-42f4-9ae9-0434562a5b0c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.469623 Jun 18 22:11:37.979740 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1345/2686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:37 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:38.095261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:38.097251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:38.110788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:38.111360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:38.112297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:38.116549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:38.329386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:38.350307 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f03c5130-f941-4f2d-b340-74c7a14e27fe tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1506 microversion: 2.1 time: 0.600071 Jun 18 22:11:38.355323 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1342/2687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:37 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:38.601422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:38.612507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bcd47dd7-2b74-4bbb-aaea-50a8099748ad tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.522297 Jun 18 22:11:38.613113 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1346/2688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:38 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:38.757019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f798060-b610-4cf6-bd30-68aa0394135d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea079560d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:38.929431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4f798060-b610-4cf6-bd30-68aa0394135d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.176827 Jun 18 22:11:38.935194 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1343/2689] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:38 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:38.992683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:38.993340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:39.003965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.008697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:39.010067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.010249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:39.345602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-107aa672-339d-4457-9abe-965e8767e9d5 req-0549aa9a-35e2-4fc9-bf39-2d6187118acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "name": "network-vif-plugged", "status": "completed", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:39.386130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-107aa672-339d-4457-9abe-965e8767e9d5 req-0549aa9a-35e2-4fc9-bf39-2d6187118acc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.386588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-107aa672-339d-4457-9abe-965e8767e9d5 req-0549aa9a-35e2-4fc9-bf39-2d6187118acc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:39.435238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=18 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:39.465804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-107aa672-339d-4457-9abe-965e8767e9d5 req-0549aa9a-35e2-4fc9-bf39-2d6187118acc service nova] Creating event network-vif-plugged:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:11:39.499124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-107aa672-339d-4457-9abe-965e8767e9d5 req-0549aa9a-35e2-4fc9-bf39-2d6187118acc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155809 Jun 18 22:11:39.499789 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1344/2690] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:39.536268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:39.541496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:39.568568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.569134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:39.569854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.570271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:39.701252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:39.729397 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-17cabb5d-6b4d-4369-a589-1fb979550d26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.740861 Jun 18 22:11:39.750348 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1347/2691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:38 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:39.771108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:39.772691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:39.796803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.799982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:39.801872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:39.803902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.085401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:40.394779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:40.410103 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a1624a6-d979-4136-ad1d-484494adfbf5 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1504 microversion: 2.1 time: 0.887847 Jun 18 22:11:40.411683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1345/2692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:39 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1504 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:40.563816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:40.584767 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4cc23e56-52c6-461b-b5cc-f0aab2cc45bf tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.833099 Jun 18 22:11:40.602260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1348/2693] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:39 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:40.620228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-434b08f8-21c4-4808-ba6e-a6e4fd6b5baa tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07920a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:40.709520 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-434b08f8-21c4-4808-ba6e-a6e4fd6b5baa tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.103324 Jun 18 22:11:40.722672 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1349/2694] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:40 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:40.733685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '.version_select at 0x7fea0796c160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:40.734325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:40.748842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.749653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.750687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.751427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.811028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a9ec0ff1-c9c2-47e5-a253-4ebce8672005 req-e5f36202-3d84-4425-9f21-03b07b42c8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74506814-2e86-4ead-b8f8-f5713285226f", "tag": "a680c731-229e-4690-a78d-4c886894a41d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:40.813961 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e4c05e6f-ad39-47af-b7a1-26c294aaec0a tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.089046 Jun 18 22:11:40.814792 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1350/2695] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Jun 18 22:11:40 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b/os-instance-actions => generated 611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:40.821266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:40.822172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:40.837245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.838079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a9ec0ff1-c9c2-47e5-a253-4ebce8672005 req-e5f36202-3d84-4425-9f21-03b07b42c8b9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.838289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.838543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a9ec0ff1-c9c2-47e5-a253-4ebce8672005 req-e5f36202-3d84-4425-9f21-03b07b42c8b9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.839522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.840366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.881733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:40.887411 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a9ec0ff1-c9c2-47e5-a253-4ebce8672005 req-e5f36202-3d84-4425-9f21-03b07b42c8b9 service nova] Creating event network-changed:a680c731-229e-4690-a78d-4c886894a41d for instance 74506814-2e86-4ead-b8f8-f5713285226f on nch1-master-1 Jun 18 22:11:40.907488 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a9ec0ff1-c9c2-47e5-a253-4ebce8672005 req-e5f36202-3d84-4425-9f21-03b07b42c8b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490720 Jun 18 22:11:40.912680 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1346/2696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:40.936176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:40.937080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:40.965886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.972815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:40.976604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:40.982449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:41.125693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:11:41.327824 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4436b426-ffe7-491d-91e2-a1d49bfb8ed0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 204 len: 0 microversion: 2.1 time: 0.410844 Jun 18 22:11:41.328489 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1347/2697] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:11:40 2022] DELETE /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:11:41.347196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:41.348025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:41.367831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:41.370933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:41.373871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:41.374358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:42.181789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:42.191860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b6966aef-696c-4cb5-8191-c37fb1f679a0 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1510 microversion: 2.1 time: 0.853731 Jun 18 22:11:42.198113 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1348/2698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:41 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1510 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:42.202179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:42.205726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:42.209989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:42.215719 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4a126e4e-32da-4b3b-9c50-c83b35bd84c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 1.398442 Jun 18 22:11:42.218009 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1351/2699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:40 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:42.228241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7366a30-3db0-49b7-b87d-688741dc042d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078e6700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:42.229112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:42.229793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:42.230681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:42.234104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:42.359728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7366a30-3db0-49b7-b87d-688741dc042d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.140295 Jun 18 22:11:42.362272 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1352/2700] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:42 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:42.520473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:42.535146 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d945adc8-e562-4900-97b4-1a01feaf0c36 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.329673 Jun 18 22:11:42.535834 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1349/2701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:42 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:43.211540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:43.212733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:43.235675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:43.236232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:43.236377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:43.253761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:43.255803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:43.256273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:43.259464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:43.260111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:43.265589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:43.267248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:43.608641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:43.622026 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b31d5e27-a87d-4c95-8ff2-ef957bce1ae7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.390402 Jun 18 22:11:43.624788 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1350/2702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:43 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:43.636584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be51139d-6703-4761-91da-f6191e0e5e26 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea079d8940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:43.765852 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be51139d-6703-4761-91da-f6191e0e5e26 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.139676 Jun 18 22:11:43.767190 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1351/2703] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:43 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:43.793472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:43.796960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:43.798568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:43.817441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d9d5cb2-4da2-428a-a52e-93bfd1ceee01 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1510 microversion: 2.1 time: 0.609357 Jun 18 22:11:43.824292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:43.827461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:43.828581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:43.829383 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1353/2704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:43 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:43.830224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.255594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-09ab727d-3b1c-4a9d-992d-554018a49e0b req-1cc0937c-832e-4ac2-be02-ca61b0cd87ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c441f9-184f-43d7-99cc-07755ebfa97b", "name": "network-vif-deleted", "tag": "646c2773-d178-4e72-9bdf-313447acda8a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:44.282447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-09ab727d-3b1c-4a9d-992d-554018a49e0b req-1cc0937c-832e-4ac2-be02-ca61b0cd87ba service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:44.282900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-09ab727d-3b1c-4a9d-992d-554018a49e0b req-1cc0937c-832e-4ac2-be02-ca61b0cd87ba service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.351870 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-09ab727d-3b1c-4a9d-992d-554018a49e0b req-1cc0937c-832e-4ac2-be02-ca61b0cd87ba service nova] Creating event network-vif-deleted:646c2773-d178-4e72-9bdf-313447acda8a for instance d6c441f9-184f-43d7-99cc-07755ebfa97b on nch2-master-1 Jun 18 22:11:44.368659 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-09ab727d-3b1c-4a9d-992d-554018a49e0b req-1cc0937c-832e-4ac2-be02-ca61b0cd87ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135334 Jun 18 22:11:44.372264 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1354/2705] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:44.391973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:44.404249 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb917fb7-83ad-49aa-b3fa-e7466ad1b015 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.633301 Jun 18 22:11:44.410125 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1352/2706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:43 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:44.645005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:44.649378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:44.666442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:44.667196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.669475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:44.670530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.780332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ecdaa5f-f56b-4cda-93af-58e04eacb541 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0794b280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:44.861622 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ecdaa5f-f56b-4cda-93af-58e04eacb541 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.085548 Jun 18 22:11:44.862285 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1353/2707] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:44 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:44.868438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:44.869224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:44.884428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:44.885572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.889586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:44.890794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.953128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:44.980866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd304c5f-b988-45d1-90ce-897ac8378f95 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.341895 Jun 18 22:11:44.994459 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1355/2708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:44 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:44.995806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:44.997662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:44.998305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lazy-loading 'fault' on Instance uuid d6c441f9-184f-43d7-99cc-07755ebfa97b {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:11:45.102997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef0c44eb8be4d1fbf6caeedacf7ac21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be82e54d6aa74bb09a543b6b225b9676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:45.117171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e75fcd45-7d1d-4ebc-9ab5-53251d963c15 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 200 len: 1306 microversion: 2.1 time: 0.250626 Jun 18 22:11:45.118002 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1354/2709] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:44 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:45.439452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:45.442723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:45.476353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:45.480283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:45.487437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:45.490458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:45.782489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-31ffa74e-d009-4abb-aa20-dc9f9e7af75c req-fce407cc-6e8d-4c16-861c-2baad830a9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c421b265-a2ca-42cf-8eed-603f694967a1", "name": "network-vif-plugged", "status": "completed", "tag": "c6489495-ef26-4bfc-9180-23df81823434"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:45.841337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-31ffa74e-d009-4abb-aa20-dc9f9e7af75c req-fce407cc-6e8d-4c16-861c-2baad830a9fd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:45.841858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-31ffa74e-d009-4abb-aa20-dc9f9e7af75c req-fce407cc-6e8d-4c16-861c-2baad830a9fd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:45.935541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:45.948151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c15d49a4-a02e-453a-a371-f2d9ff25f213 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.523973 Jun 18 22:11:45.950495 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1356/2710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:45 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:45.956710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-703fed81-3a65-47c7-8089-31658702810d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078bfdc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:45.971556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-31ffa74e-d009-4abb-aa20-dc9f9e7af75c req-fce407cc-6e8d-4c16-861c-2baad830a9fd service nova] Creating event network-vif-plugged:c6489495-ef26-4bfc-9180-23df81823434 for instance c421b265-a2ca-42cf-8eed-603f694967a1 on nch2-master-1 Jun 18 22:11:46.001312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-31ffa74e-d009-4abb-aa20-dc9f9e7af75c req-fce407cc-6e8d-4c16-861c-2baad830a9fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223242 Jun 18 22:11:46.008474 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1355/2711] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:46.055072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:46.059779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:46.087457 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-703fed81-3a65-47c7-8089-31658702810d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.134807 Jun 18 22:11:46.088487 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1357/2712] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:45 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:46.097205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:46.098131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:46.099317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:46.102918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:46.136268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:46.137173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] [instance: d6c441f9-184f-43d7-99cc-07755ebfa97b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:46.163098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:46.168388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:46.172729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:46.177929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:46.235873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] HTTP exception thrown: Instance d6c441f9-184f-43d7-99cc-07755ebfa97b could not be found. Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Request method failure captured: Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b HTTP/1.1 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk15kMIPshMUeD-XaTfeylH21RS6PXPKVqUfETc3XZ1xr4ryNtg00iiT6urM--cVOhh6TPZpruWScfi7_g6dD2stxdI4A6OT2J-3dyK2qIYQ4zELMjz7iFWdMo_rTc-lmuUzq7E_3XRIzdUZ2WBDbbiNqchCSjtZKHvs-p-N4mmOd9o Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: be82e54d6aa74bb09a543b6b225b9676 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-InstanceActionsTestJSON-1414421849 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/be82e54d6aa74bb09a543b6b225b9676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/be82e54d6aa74bb09a543b6b225b9676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/be82e54d6aa74bb09a543b6b225b9676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_be82e54d6aa74bb09a543b6b225b9676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-InstanceActionsTestJSON-1414421849 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: be82e54d6aa74bb09a543b6b225b9676 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1414421849 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-InstanceActionsTestJSON-1414421849-project Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: fef0c44eb8be4d1fbf6caeedacf7ac21 Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-InstanceActionsTestJSON-1414421849-project Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d6c441f9-184f-43d7-99cc-07755ebfa97b could not be found. Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd6c441f9-184f-43d7-99cc-07755ebfa97b'} Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c441f9-184f-43d7-99cc-07755ebfa97b could not be found. Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c441f9-184f-43d7-99cc-07755ebfa97b could not be found. Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:11:46.239127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c441f9-184f-43d7-99cc-07755ebfa97b could not be found. Jun 18 22:11:46.244599 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:11:46.246664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] Returning 404 to user: Instance d6c441f9-184f-43d7-99cc-07755ebfa97b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:11:46.247682 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-647f08f8-82d3-4770-9c0d-7ebbdd93ed33 tempest-InstanceActionsTestJSON-1414421849 tempest-InstanceActionsTestJSON-1414421849-project] 10.222.0.30 "GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b" status: 404 len: 111 microversion: 2.1 time: 0.116525 Jun 18 22:11:46.253578 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1358/2713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:46 2022] GET /compute/v2.1/servers/d6c441f9-184f-43d7-99cc-07755ebfa97b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:11:46.971907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:46.972700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:46.987567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:46.998388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:47.001443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:47.001983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:47.074601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:47.120279 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dcdd0c2b-0dd5-457b-8ce0-b4f950474920 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 1.109981 Jun 18 22:11:47.122279 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1356/2714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:46 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:47.143176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d6a3407-3413-4b8b-8ad4-b9dc6ab4eb1a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea079d81f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:47.242813 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d6a3407-3413-4b8b-8ad4-b9dc6ab4eb1a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.117994 Jun 18 22:11:47.243732 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1357/2715] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:47 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:47.976106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:47.992917 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ded50cbb-e604-424d-ac63-e13a147c0d3e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 1.026769 Jun 18 22:11:47.998860 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1359/2716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:46 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:48.147037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:48.148343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:48.185664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:48.186889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:48.187756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:48.190943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:48.257565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e89ac65b-0885-4a09-98b4-e551e68f92a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078bfc10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:48.399218 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e89ac65b-0885-4a09-98b4-e551e68f92a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.146928 Jun 18 22:11:48.400837 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1360/2717] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:48 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:48.921978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:48.931832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ecc4389-5a4b-4170-9ec2-300bedb55af1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.789318 Jun 18 22:11:48.934539 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1358/2718] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:48 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:49.019605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:49.021435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:49.046549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=68 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:49.056647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:49.059010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:49.060078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:49.060704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:49.419848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c0af35a-7b80-4fa5-9b58-c86eb9537eca tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07929f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:49.542827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c0af35a-7b80-4fa5-9b58-c86eb9537eca tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.132190 Jun 18 22:11:49.544040 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1359/2719] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:49 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:49.586672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:49.602266 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-07c9c303-edb9-4225-aa06-1ad992a1a123 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.589791 Jun 18 22:11:49.605369 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1361/2720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:49 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:49.963171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:49.964037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:49.987267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:49.992276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:49.997182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:49.998424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:50.490787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:50.502047 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c88250cd-0fb5-4de6-a57c-02be87796c76 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.547949 Jun 18 22:11:50.508836 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1360/2721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:49 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:50.564584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a49e206c-bfc2-4584-bcf2-587138451776 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14377a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:50.621370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:50.622141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:50.626651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:50.707280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:50.709572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.058s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:50.714947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:50.719177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:50.734324 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a49e206c-bfc2-4584-bcf2-587138451776 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.178536 Jun 18 22:11:50.736694 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1362/2722] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:50 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:51.334071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:51.359376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8077cd9e-4e0f-4a8a-bb1a-be8942c6fa7c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 0.741579 Jun 18 22:11:51.385485 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1361/2723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:50 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:51.527568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:51.528407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:51.537856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:51.541310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:51.542459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:51.553578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:51.752028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-083d166e-5d7f-41c9-91f8-64b2cf77c208 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07958af0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:51.825942 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-083d166e-5d7f-41c9-91f8-64b2cf77c208 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.081494 Jun 18 22:11:51.827206 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1362/2724] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:51 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:52.318099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:52.335691 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c3ac5be-2608-420d-9dfa-a43e91b28d18 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.812199 Jun 18 22:11:52.336369 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1363/2725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:51 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:52.377746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:52.379581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:52.401237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:52.404889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:52.408335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:52.414896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:52.839821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f28f5f8-1907-48e2-a8f8-f79dbea496e5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1404e430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:52.944895 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f28f5f8-1907-48e2-a8f8-f79dbea496e5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.109273 Jun 18 22:11:52.946137 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1364/2726] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:52 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:53.360330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:53.362435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:53.371623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:53.372329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:53.376252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:53.379749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:53.862823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:53.872589 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e53f4f77-a112-44ab-8950-1564c92b5897 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1477 microversion: 2.1 time: 1.499083 Jun 18 22:11:53.879084 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1363/2727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:52 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1477 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:53.959983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c48f575-5743-44ce-b71b-d01a2abc1e68 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0792d280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:54.036170 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c48f575-5743-44ce-b71b-d01a2abc1e68 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.081304 Jun 18 22:11:54.037570 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1364/2728] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:53 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:11:54.461403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c4c693a0-b098-45d0-9dee-4a7a931a775d req-c84a3afe-e87b-4906-89de-7c964f943c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92830c8-3210-4136-9abf-efdf84adfd89", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a9b468-9c40-4049-8455-b484be445a4d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:54.506878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c4c693a0-b098-45d0-9dee-4a7a931a775d req-c84a3afe-e87b-4906-89de-7c964f943c77 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:54.513067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c4c693a0-b098-45d0-9dee-4a7a931a775d req-c84a3afe-e87b-4906-89de-7c964f943c77 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:54.563542 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c4c693a0-b098-45d0-9dee-4a7a931a775d req-c84a3afe-e87b-4906-89de-7c964f943c77 service nova] Creating event network-vif-unplugged:b4a9b468-9c40-4049-8455-b484be445a4d for instance c92830c8-3210-4136-9abf-efdf84adfd89 on nch2-master-1 Jun 18 22:11:54.584155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-c4c693a0-b098-45d0-9dee-4a7a931a775d req-c84a3afe-e87b-4906-89de-7c964f943c77 service nova] Instance c92830c8-3210-4136-9abf-efdf84adfd89 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:11:54.609515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:54.624069 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c4c693a0-b098-45d0-9dee-4a7a931a775d req-c84a3afe-e87b-4906-89de-7c964f943c77 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174589 Jun 18 22:11:54.628580 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1365/2729] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:54.628953 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-599ae38f-f72c-4e9b-889f-d337ec70194a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 1.276021 Jun 18 22:11:54.642203 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1365/2730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:53 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:54.904150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:54.905201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:54.936818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:54.938465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:54.943420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:54.944503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:55.050394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2500cd62-bad8-4d6f-97ba-fb9408615961 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0796c8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:55.190004 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2500cd62-bad8-4d6f-97ba-fb9408615961 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.141929 Jun 18 22:11:55.191578 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1366/2731] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:55 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:55.508868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:55.536145 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bd08030-d3fc-41e3-b6ce-c72454c1be51 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1476 microversion: 2.1 time: 0.643098 Jun 18 22:11:55.539475 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1366/2732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:54 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1476 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:55.659350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:55.659878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:55.676988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:55.688133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:55.689252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:55.689723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:56.205692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1243e688-46f1-4f4d-b760-76304ad41c19 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea079bb0d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:56.296922 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1243e688-46f1-4f4d-b760-76304ad41c19 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.095121 Jun 18 22:11:56.298046 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1367/2733] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:56 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:56.338080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:56.344433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:56.353484 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d3b2ec9c-09a2-4983-9a3a-61c241aba269 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 0.698660 Jun 18 22:11:56.354935 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1367/2734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:55 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:56.558929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:56.559820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:56.574500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:56.576457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:56.579777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:56.582805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:57.472028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4455fb02-d243-458f-9a4c-2bfb14e29cfc req-3f057ea9-cbce-4865-a85a-8b97c1011f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74506814-2e86-4ead-b8f8-f5713285226f", "name": "network-vif-plugged", "status": "completed", "tag": "a680c731-229e-4690-a78d-4c886894a41d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:57.508399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4455fb02-d243-458f-9a4c-2bfb14e29cfc req-3f057ea9-cbce-4865-a85a-8b97c1011f29 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:57.509610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4455fb02-d243-458f-9a4c-2bfb14e29cfc req-3f057ea9-cbce-4865-a85a-8b97c1011f29 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:57.525842 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4455fb02-d243-458f-9a4c-2bfb14e29cfc req-3f057ea9-cbce-4865-a85a-8b97c1011f29 service nova] Creating event network-vif-plugged:a680c731-229e-4690-a78d-4c886894a41d for instance 74506814-2e86-4ead-b8f8-f5713285226f on nch1-master-1 Jun 18 22:11:57.539531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4455fb02-d243-458f-9a4c-2bfb14e29cfc req-3f057ea9-cbce-4865-a85a-8b97c1011f29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.845815 Jun 18 22:11:57.547536 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1368/2735] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:11:57.563384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7a7fef88-6951-41dc-8aac-4b0bc7466f31 req-46491e55-340f-449a-9f2b-2c015a957839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92830c8-3210-4136-9abf-efdf84adfd89", "tag": "b4a9b468-9c40-4049-8455-b484be445a4d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:11:57.580658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7a7fef88-6951-41dc-8aac-4b0bc7466f31 req-46491e55-340f-449a-9f2b-2c015a957839 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:57.581929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7a7fef88-6951-41dc-8aac-4b0bc7466f31 req-46491e55-340f-449a-9f2b-2c015a957839 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:57.646303 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7a7fef88-6951-41dc-8aac-4b0bc7466f31 req-46491e55-340f-449a-9f2b-2c015a957839 service nova] Creating event network-changed:b4a9b468-9c40-4049-8455-b484be445a4d for instance c92830c8-3210-4136-9abf-efdf84adfd89 on nch2-master-1 Jun 18 22:11:57.671768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-7a7fef88-6951-41dc-8aac-4b0bc7466f31 req-46491e55-340f-449a-9f2b-2c015a957839 service nova] Instance c92830c8-3210-4136-9abf-efdf84adfd89 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:11:57.706676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7a7fef88-6951-41dc-8aac-4b0bc7466f31 req-46491e55-340f-449a-9f2b-2c015a957839 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155246 Jun 18 22:11:57.714476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1369/2736] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:11:57.731856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fb32805d-087f-4931-a905-baf8593a371d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14377a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:57.842151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fb32805d-087f-4931-a905-baf8593a371d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.125517 Jun 18 22:11:57.843059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1370/2737] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:57 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:57.858695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:57.862216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:57.882316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:57.886040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:57.887228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:57.888143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:58.350612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:58.388424 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38700294-8b24-43aa-b264-17936aa680b1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1476 microversion: 2.1 time: 1.835134 Jun 18 22:11:58.390199 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1368/2738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:56 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1476 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:58.856172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97c4bd25-84cf-43e8-a72a-ebecaf0ec9e4 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0792d280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:58.941988 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97c4bd25-84cf-43e8-a72a-ebecaf0ec9e4 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.090130 Jun 18 22:11:58.943544 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1369/2739] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:58 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:59.408005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:11:59.409537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:11:59.423006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:59.423468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:59.424268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:11:59.435931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:11:59.484492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:11:59.721652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:11:59.737412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65d5e0dd-e3e0-4585-a85f-3bfc85d8379f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1322 microversion: 2.1 time: 1.891662 Jun 18 22:11:59.753484 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1371/2740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:57 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1322 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:11:59.966319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-012e58b7-36bd-4d62-96de-b2ea36aeca55 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078fae50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:00.082097 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-012e58b7-36bd-4d62-96de-b2ea36aeca55 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.124659 Jun 18 22:12:00.084861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1372/2741] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:11:59 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:00.103768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:00.129384 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-12011119-8000-4bce-a55e-cb210ea939ba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1474 microversion: 2.1 time: 0.719860 Jun 18 22:12:00.136558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1370/2742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:11:59 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1474 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:00.765406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:00.766147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:00.786695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:00.787706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:00.790399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:00.794919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:01.097847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-714234b0-1512-4038-9a4f-bdafe3688ba2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0794b040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:01.212453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:01.224796 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-838dab51-a487-416d-aff4-73f0ddd82018 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1516 microversion: 2.1 time: 0.467508 Jun 18 22:12:01.229627 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1373/2743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:00 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1516 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:01.242281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:01.243883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:01.267405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:01.268260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:01.269397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:01.270300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:02.051221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:02.061275 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1003253-dec7-4d49-b835-a5919a56c467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1471 microversion: 2.1 time: 0.827788 Jun 18 22:12:02.088712 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1374/2744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:01 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1471 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:02.113581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:02.119875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:02.138509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:02.150977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:02.151981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:02.165200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:02.305545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lazy-loading 'flavor' on Instance uuid 74506814-2e86-4ead-b8f8-f5713285226f {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:12:02.773439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f58ed42-b8dc-4387-b8ef-1ee1ab3d940b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action" status: 200 len: 32 microversion: 2.1 time: 0.683336 Jun 18 22:12:02.779177 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1375/2745] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:02 2022] POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action => generated 32 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:12:02.811803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:02.819709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:02.842587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:02.843614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:02.844686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:02.850846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:03.186104 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ac057ad-7a1f-4273-a458-cf9a7dbbacfa tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89/action" status: 204 len: 0 microversion: 2.1 time: 0.397012 Jun 18 22:12:03.212730 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1376/2746] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:02 2022] POST /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89/action => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:12:03.225868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:03.226904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:03.254077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:03.256870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:03.257963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:03.261576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:04.029779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:04.072512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-913c5501-72e3-43b3-9a49-99239e8ab647 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.847543 Jun 18 22:12:04.077990 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1377/2747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:03 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:04.101024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:04.102033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:04.127666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:04.128327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:04.129068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:04.129649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:05.026912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:05.043256 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22bc66f9-21b8-43af-bda3-c0c8e5a790ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1471 microversion: 2.1 time: 0.963261 Jun 18 22:12:05.048266 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1378/2748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:04 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1471 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:05.062347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85887161-57e0-4dfd-96b1-2857dcef4d42 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Action: 'create', calling method: .version_select at 0x7fea078e6430>, body: {"keypair": {"name": "tempest-keypair-1213769530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMLBP8dx53eIR4urQ5yMB1oXlvmzJblGVeEjp+raQXOcTJF6/xyXBtrzodbXCfuIHLJqFsTXMYbpfay1qHiMx/Svs8iTmEPjUyw3TTBa+/fV7ZGJQkgO8ePbuzntjAp1Q=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:05.133746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-85887161-57e0-4dfd-96b1-2857dcef4d42 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Getting quotas for project b8ddaa6fbcdf4368a8e9be0d07596178. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:05.174947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-85887161-57e0-4dfd-96b1-2857dcef4d42 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Getting quotas for user a8eb1a760d644f97bf3aae882e905b85 and project b8ddaa6fbcdf4368a8e9be0d07596178. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:05.270352 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85887161-57e0-4dfd-96b1-2857dcef4d42 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.220183 Jun 18 22:12:05.276891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1379/2749] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:12:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:12:05.280761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:05.280958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:05.312069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:05.312735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:05.328181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:05.328856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:06.668251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:06.683528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b063190a-f16d-4192-a9dc-3a523067354e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 1.406039 Jun 18 22:12:06.689547 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1380/2750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:05 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:06.724871 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-714234b0-1512-4038-9a4f-bdafe3688ba2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 5.631119 Jun 18 22:12:06.727152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:06.732210 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1371/2751] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:01 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 5639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:06.736620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:06.771438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:06.771902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:06.784959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:06.785546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:07.607633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:07.619354 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4b4c03e-9278-4d93-95d2-4f7e5e760850 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1471 microversion: 2.1 time: 0.924306 Jun 18 22:12:07.629066 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1381/2752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:06 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1471 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:07.712680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:07.714639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:07.732847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:07.733600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:07.735502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:07.737598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:07.741856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-083e667e-8916-4bc8-a35f-fd88f4e1c09a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0789baf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:07.830457 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-083e667e-8916-4bc8-a35f-fd88f4e1c09a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.092670 Jun 18 22:12:07.831598 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1382/2753] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:07 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:08.080059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:08.093717 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f0c4161e-759c-4254-9801-983f21d663d7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.387798 Jun 18 22:12:08.095381 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1372/2754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:07 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:08.645179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:08.646090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:08.672075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:08.674383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:08.677957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:08.687727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:08.847820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e9069c3-e916-4d8f-b4d4-14f840c765f7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0794ba60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:08.971577 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e9069c3-e916-4d8f-b4d4-14f840c765f7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.131383 Jun 18 22:12:08.972734 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1373/2755] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:08 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:09.119920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:09.120905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:09.135247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:09.136090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:09.137177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:09.139141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:09.474370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:09.491852 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bac53bd-e02c-4bd0-9882-343928e25349 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1463 microversion: 2.1 time: 0.851132 Jun 18 22:12:09.494944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1383/2756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:08 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1463 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:09.517437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:09.518295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:09.534704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:09.535548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:09.538185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:09.538933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:09.732835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:09.743765 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-595d5945-75c4-48bf-907b-10969109defc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.627346 Jun 18 22:12:09.747055 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1374/2757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:09 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:09.986913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfac0982-fa66-4fbc-8b92-659985719a3c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07a184c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:10.090456 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bfac0982-fa66-4fbc-8b92-659985719a3c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.107419 Jun 18 22:12:10.091208 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1375/2758] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:09 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:10.750934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:10.764834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:10.765933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:10.772452 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-339bfe70-16e9-4db8-bf35-c8defe040944 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1463 microversion: 2.1 time: 1.261029 Jun 18 22:12:10.786230 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1384/2759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:09 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1463 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:10.811248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-740c0e71-e8a8-41a7-9d47-516e6af4f760 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'create', calling method: .version_select at 0x7fea078bfc10>, body: {"keypair": {"name": "tempest-keypair-1915367950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo6OYHIHR6XlW8Cl/6fBvGzkiHsQvpm39RYHrHZvqk41FxlxQ4chVW57RmNkR367boK7HzvYcBJjBqWq6oF+JmjrA1KxSOCcCeWfYr7e11K477ce5KLzuTgPj9tSFLj8Q=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:10.813557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:10.813557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:10.834405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:10.840340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:10.927648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-740c0e71-e8a8-41a7-9d47-516e6af4f760 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for project ac774f9b327041a887378bd2725853c6. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:10.984134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-740c0e71-e8a8-41a7-9d47-516e6af4f760 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for user 0e8a394c0a284416ac893321bd860e51 and project ac774f9b327041a887378bd2725853c6. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:11.153295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-740c0e71-e8a8-41a7-9d47-516e6af4f760 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.341511 Jun 18 22:12:11.160443 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1385/2760] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:12:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:11.179185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-48a62d06-b37c-444b-ba41-6c4761e3d8c6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078faf70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:11.290120 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-48a62d06-b37c-444b-ba41-6c4761e3d8c6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1455 microversion: 2.1 time: 0.126999 Jun 18 22:12:11.304766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1386/2761] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:11 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1455 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:11.336370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:11.345382 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b454f2b-04ef-488a-ba68-2383a3ceefb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.584768 Jun 18 22:12:11.354917 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1376/2762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:10 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:12.129163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-973726f0-8b30-48c2-ae28-7d9f0887bf15 req-190f8e4b-cf0f-4b2e-9195-9f4645c3efd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92830c8-3210-4136-9abf-efdf84adfd89", "name": "network-vif-plugged", "status": "completed", "tag": "b4a9b468-9c40-4049-8455-b484be445a4d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:12.158697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-973726f0-8b30-48c2-ae28-7d9f0887bf15 req-190f8e4b-cf0f-4b2e-9195-9f4645c3efd4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:12.159432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-973726f0-8b30-48c2-ae28-7d9f0887bf15 req-190f8e4b-cf0f-4b2e-9195-9f4645c3efd4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:12.182220 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-973726f0-8b30-48c2-ae28-7d9f0887bf15 req-190f8e4b-cf0f-4b2e-9195-9f4645c3efd4 service nova] Creating event network-vif-plugged:b4a9b468-9c40-4049-8455-b484be445a4d for instance c92830c8-3210-4136-9abf-efdf84adfd89 on nch2-master-1 Jun 18 22:12:12.195172 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-973726f0-8b30-48c2-ae28-7d9f0887bf15 req-190f8e4b-cf0f-4b2e-9195-9f4645c3efd4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066711 Jun 18 22:12:12.211012 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1387/2763] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:12.304055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2cf1e68f-c1a7-429f-896f-0db1cfc26562 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0792cb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:12.357107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-35219667", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "af34a9ca-6473-4535-9496-a7d34a23c72f"}, {"port": "efa1b247-18d7-4cf8-beb3-93636b50c24f", "tag": "port-1"}, {"port": "56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507", "tag": "port-2"}, {"uuid": "16c90c86-7a04-478c-8239-dc374c7b2afe", "tag": "net-1"}, {"uuid": "16c90c86-7a04-478c-8239-dc374c7b2afe"}, {"uuid": "2262b390-a7da-4506-8113-f0e6161c46a6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2262b390-a7da-4506-8113-f0e6161c46a6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "df050525-1359-4e57-a0a7-5bfc9b675988", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "312a3580-badc-4fa9-b41c-122707532350", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--874648776"}], "key_name": "tempest-keypair-1213769530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:12.433708 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2cf1e68f-c1a7-429f-896f-0db1cfc26562 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1464 microversion: 2.1 time: 0.133817 Jun 18 22:12:12.444440 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1377/2764] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:12 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:12.452058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:12.460890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:12.505330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:12.506979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:12.509499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:12.515540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:13.045494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] validate_networks() for [('af34a9ca-6473-4535-9496-a7d34a23c72f', None, None, None, None, None), (None, None, 'efa1b247-18d7-4cf8-beb3-93636b50c24f', None, None, None), (None, None, '56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507', None, None, None), ('16c90c86-7a04-478c-8239-dc374c7b2afe', None, None, None, None, None), ('16c90c86-7a04-478c-8239-dc374c7b2afe', None, None, None, None, None), ('2262b390-a7da-4506-8113-f0e6161c46a6', '10.2.2.100', None, None, None, None), ('2262b390-a7da-4506-8113-f0e6161c46a6', '10.2.2.200', None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:12:13.203704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:13.215037 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3bf3eae-e788-4405-a80d-c553c577e641 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.769133 Jun 18 22:12:13.216918 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1378/2765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:12 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:13.222584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c2c550e-d6b2-4de0-aaf3-1239c0397dee tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0794bc10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:13.290758 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c2c550e-d6b2-4de0-aaf3-1239c0397dee tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 200 len: 1464 microversion: 2.1 time: 0.071416 Jun 18 22:12:13.291849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1379/2766] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:13 2022] GET /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:13.303952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:13.304869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:13.311955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:13.312694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:13.313703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:13.314316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:13.955398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:13.985711 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2fd7882d-ed1f-4d7e-9715-d7d39a27dc1d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1468 microversion: 2.1 time: 0.685287 Jun 18 22:12:13.987553 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1380/2767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:13 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1468 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:14.004555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1971474094"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:14.006009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:14.014840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:14.015548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:14.016681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:14.017310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:14.320951 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe647d04-9e71-43fb-b3f2-f4633a2e66a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "POST /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046/action" status: 202 len: 0 microversion: 2.1 time: 0.320615 Jun 18 22:12:14.321938 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1381/2768] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:13 2022] POST /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 18 22:12:14.331528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-372e1924-838d-44ee-b7f7-78dcc153c104 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '.version_select at 0x7fea0794b160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:14.334412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-372e1924-838d-44ee-b7f7-78dcc153c104 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:14.334874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-372e1924-838d-44ee-b7f7-78dcc153c104 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:14.359253 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-372e1924-838d-44ee-b7f7-78dcc153c104 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.035078 Jun 18 22:12:14.360467 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1382/2769] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:12:14 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:14.382349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:14.386952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:14.399060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:14.399806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:14.400799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:14.401433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:14.740009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:14.749501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-111c8bfc-d024-4fe2-b30f-51614892ccbb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.387517 Jun 18 22:12:14.750470 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1383/2770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:14 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:14.764685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dd52a75d-0bf6-4bdd-bfc4-55b4d41f4680 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea141939d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:14.812965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dd52a75d-0bf6-4bdd-bfc4-55b4d41f4680 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.052256 Jun 18 22:12:14.813594 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1384/2771] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:14 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:14.824339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d380fc0d-812c-45e3-8df2-cce3080f4e14 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:14.832554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d380fc0d-812c-45e3-8df2-cce3080f4e14 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012671 Jun 18 22:12:14.833753 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1385/2772] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:12:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:14.851441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-09c4a868-7de7-4fe2-923f-193c18584beb tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1396820017", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:14.853720 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:12:14.853720 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:12:14.874480 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-09c4a868-7de7-4fe2-923f-193c18584beb tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.033337 Jun 18 22:12:14.875546 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1386/2773] 10.222.0.30 () {60 vars in 1145 bytes} [Sat Jun 18 22:12:14 2022] POST /compute/v2.1/flavors => generated 499 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:14.886231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb3bd96d-0337-4916-96e2-e9c8a40828ae tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:14.895185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cb3bd96d-0337-4916-96e2-e9c8a40828ae tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012867 Jun 18 22:12:14.896115 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1387/2774] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Jun 18 22:12:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:12:15.090970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2022219825", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "26182349-2d05-45b8-a55e-4e986e371809"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:15.150658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:12:16.208869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:12:16.209801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:12:16.209801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:12:16.210182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:12:16.210616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:12:16.231560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:16.232006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:16.232920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:16.233388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:16.277619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:16.287686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for user 0e8a394c0a284416ac893321bd860e51 and project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:16.315966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:12:16.321399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:12:16.398148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1666d2e-8dd5-412b-96dd-b75f61353071 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.316574 Jun 18 22:12:16.401552 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1388/2775] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:12:16.419129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:16.420103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:16.437855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:16.439545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:16.441893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:16.443249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:16.969929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:16.981829 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fdbab5b4-7ddf-4d97-99b9-9d56dae8a3a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.576643 Jun 18 22:12:16.983362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1389/2776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:16 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:16.992532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75b85f3e-28c5-4d4d-bc01-34a97a301973 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19bfedc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:17.081360 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75b85f3e-28c5-4d4d-bc01-34a97a301973 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.096735 Jun 18 22:12:17.081938 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1390/2777] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:16 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:17.105089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d341495e-a134-4108-9088-9326da7e5708 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:17.106054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d341495e-a134-4108-9088-9326da7e5708 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:17.204850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d341495e-a134-4108-9088-9326da7e5708 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:17.212139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d341495e-a134-4108-9088-9326da7e5708 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1279 microversion: 2.1 time: 0.122664 Jun 18 22:12:17.226960 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1391/2778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:17 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1279 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:17.233234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f49d4b7d-71d6-4b5a-b1fa-aa999ee17b37 req-2d9b1d13-8331-4e37-b018-093348b50742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "name": "network-vif-unplugged", "status": "completed", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:17.252175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f49d4b7d-71d6-4b5a-b1fa-aa999ee17b37 req-2d9b1d13-8331-4e37-b018-093348b50742 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:17.252628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f49d4b7d-71d6-4b5a-b1fa-aa999ee17b37 req-2d9b1d13-8331-4e37-b018-093348b50742 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:17.279868 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f49d4b7d-71d6-4b5a-b1fa-aa999ee17b37 req-2d9b1d13-8331-4e37-b018-093348b50742 service nova] Creating event network-vif-unplugged:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:12:17.290621 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f49d4b7d-71d6-4b5a-b1fa-aa999ee17b37 req-2d9b1d13-8331-4e37-b018-093348b50742 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074461 Jun 18 22:12:17.300914 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1392/2779] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:18.032860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:18.033778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:18.050836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:18.053490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:18.060898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:18.065208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:18.658275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:18.673826 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e108f7b9-0f9a-4722-89fe-4370e5905752 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.673534 Jun 18 22:12:18.675497 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1393/2780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:17 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:18.686269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b628b73a-710c-4280-8690-7f7e30e9599e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0797bd30>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:18.775020 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b628b73a-710c-4280-8690-7f7e30e9599e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.098233 Jun 18 22:12:18.775682 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1394/2781] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:18 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:18.790532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:18.797326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:18.798139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Searching by: {'deleted': False, 'project_id': '965efce4648a472eb15b6d1c0f8c6615'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:12:18.817850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:18.821959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:18.823028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:18.823986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:18.889717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:12:18.976272 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-770c18e4-8b2b-43c8-89dc-881136a836de tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.197590 Jun 18 22:12:18.976898 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1395/2782] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:12:18 2022] GET /compute/v2.1/servers => generated 344 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:18.993429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:18.994133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:19.017006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:19.017534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:19.021465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:19.022311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:19.150100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:19.158307 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c66d14b-d281-4df9-8368-e3ab4f666d4d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1337 microversion: 2.1 time: 0.178477 Jun 18 22:12:19.161072 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1396/2783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:18 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1337 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:19.174644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:19.184005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:19.186538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Searching by: {'deleted': False, 'project_id': '965efce4648a472eb15b6d1c0f8c6615'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:12:19.198489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:19.204455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:19.205547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:19.206238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:19.414523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:12:19.415740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:12:19.416528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:12:19.417203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:12:19.417849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:12:19.420895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:19.458182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:19.458958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:19.459998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:19.460623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:19.497295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Getting quotas for project b8ddaa6fbcdf4368a8e9be0d07596178. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:19.510193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Getting quotas for user a8eb1a760d644f97bf3aae882e905b85 and project b8ddaa6fbcdf4368a8e9be0d07596178. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:19.938274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:12:19.943121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='df050525-1359-4e57-a0a7-5bfc9b675988',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cc6a43ba-fbd8-4625-a50e-5dfddf14fb0b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='312a3580-badc-4fa9-b41c-122707532350',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:12:20.027790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:12:20.252129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:20.266261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:20.266720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:20.782188 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b292b52c-60da-43e4-a715-972ee1961448 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.430609 Jun 18 22:12:20.790471 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1388/2784] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Jun 18 22:12:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 8440 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 18 22:12:20.797169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:20.798122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:20.806072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:20.806778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:20.807794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:20.808451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:21.799834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d47d3e4-eedd-40bd-902f-e1a49fe35bd8 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 2.636352 Jun 18 22:12:21.802046 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1397/2785] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:12:19 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:21.826699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb26fcfd-b4e8-4330-bdaf-6e836116a56d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19bcc160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:21.830820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:21.833752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:21.848330 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31505323-e9b7-4eee-b105-beeb5c989ecd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 1.056410 Jun 18 22:12:21.849061 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1389/2786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:20 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:21.868292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:21.870900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:21.894365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:21.897499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:21.898423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:21.899270 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb26fcfd-b4e8-4330-bdaf-6e836116a56d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.082026 Jun 18 22:12:21.901017 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1398/2787] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:21 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:21.901209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:21.906506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f3914717-8b30-4f27-9523-dfe83e0a0b89 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:21.907367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f3914717-8b30-4f27-9523-dfe83e0a0b89 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:21.935787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:22.145442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f3914717-8b30-4f27-9523-dfe83e0a0b89 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:22.153950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f3914717-8b30-4f27-9523-dfe83e0a0b89 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:22.155613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f3914717-8b30-4f27-9523-dfe83e0a0b89 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:22.163178 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f3914717-8b30-4f27-9523-dfe83e0a0b89 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1284 microversion: 2.42 time: 0.260525 Jun 18 22:12:22.165064 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1399/2788] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:21 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:22.411597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-341056921", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:22.460842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:22.475074 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-efd507ad-b272-448a-b935-3a50ae0a8306 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1379 microversion: 2.1 time: 0.624850 Jun 18 22:12:22.478924 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1390/2789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:21 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1379 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:22.484733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac02aa04-0dd4-445b-9cce-9cdaf51584d3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:22.503712 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac02aa04-0dd4-445b-9cce-9cdaf51584d3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023159 Jun 18 22:12:22.521940 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1391/2790] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:12:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:22.548521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] validate_networks() for [('c8d8d130-6cbb-4e46-8637-13f50b7c8bf8', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:12:22.840646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:22.842085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:22.864331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:22.864917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:22.869324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:22.870072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.051795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:12:23.249506 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5c904a72-2cae-4921-8701-fc592a5f0192 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 204 len: 0 microversion: 2.1 time: 0.410847 Jun 18 22:12:23.255727 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1392/2791] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:12:22 2022] DELETE /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:12:23.278828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:23.280448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:23.291087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.292174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.304841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.306182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.708228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:12:23.708694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:12:23.709171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:12:23.709792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:12:23.710432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:12:23.729425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.730393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.731393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.732108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.776543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:23.777778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Getting quotas for project c66aab4ab90e4ee1be5a36496447d1a2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:23.785953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Getting quotas for user 519822988db142fba7e027f3dd1109a7 and project c66aab4ab90e4ee1be5a36496447d1a2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:23.791461 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-423f2d4d-199c-4db7-96f9-715d2dff2b42 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.533680 Jun 18 22:12:23.801345 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1393/2792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:23 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:23.806176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1757277-88fe-452b-84a9-40e5081ff38c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078e5f70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:23.823304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:12:23.826647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:12:23.898922 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1757277-88fe-452b-84a9-40e5081ff38c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.105194 Jun 18 22:12:23.900461 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1394/2793] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:23 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:23.911280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:23.913272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:23.925408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.926079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.936292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.938172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.942177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-36037635-8d3d-4fc5-8a7a-9bdc7edafd43 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.763346 Jun 18 22:12:23.946830 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1400/2794] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:12:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:12:23.964160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:23.965451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:23.982034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.982807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:23.983900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:23.984568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.014844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:24.061759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:24.071694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:24.079933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:24.081809 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39da8fe4-c054-4aa9-ab5f-f0bc41457e69 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1574 microversion: 2.42 time: 0.174770 Jun 18 22:12:24.082693 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1395/2795] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:23 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:24.099205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4bb2fdf0-edd7-471a-bdce-a24818e3280f req-0330ecf0-70f0-47bf-b388-68bdb0fbcbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64809918-45ff-4e75-9136-72b4a53b4046", "name": "network-vif-plugged", "status": "completed", "tag": "02edfb5d-e4f7-4f79-bd38-14abde92e757"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:24.117418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4bb2fdf0-edd7-471a-bdce-a24818e3280f req-0330ecf0-70f0-47bf-b388-68bdb0fbcbed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:24.128291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4bb2fdf0-edd7-471a-bdce-a24818e3280f req-0330ecf0-70f0-47bf-b388-68bdb0fbcbed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.150500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4bb2fdf0-edd7-471a-bdce-a24818e3280f req-0330ecf0-70f0-47bf-b388-68bdb0fbcbed service nova] Creating event network-vif-plugged:02edfb5d-e4f7-4f79-bd38-14abde92e757 for instance 64809918-45ff-4e75-9136-72b4a53b4046 on nch1-master-1 Jun 18 22:12:24.158651 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4bb2fdf0-edd7-471a-bdce-a24818e3280f req-0330ecf0-70f0-47bf-b388-68bdb0fbcbed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074337 Jun 18 22:12:24.160054 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1396/2796] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:24.168372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:24.169282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:24.180836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:24.181568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.182989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:24.183748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.340190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:24.355526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-644d5aff-7103-4697-80a2-0e2c4b1f6dfb tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1609 microversion: 2.1 time: 0.402754 Jun 18 22:12:24.356297 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1401/2797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:23 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1609 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:24.371567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-848c465b-7a94-4e33-94de-9b708d93d405 req-e4c472fd-9841-4538-a8af-74fb642b856b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:24.396241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-848c465b-7a94-4e33-94de-9b708d93d405 req-e4c472fd-9841-4538-a8af-74fb642b856b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:24.397773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-848c465b-7a94-4e33-94de-9b708d93d405 req-e4c472fd-9841-4538-a8af-74fb642b856b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.437454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-848c465b-7a94-4e33-94de-9b708d93d405 req-e4c472fd-9841-4538-a8af-74fb642b856b service nova] Creating event network-changed:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:12:24.443512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-848c465b-7a94-4e33-94de-9b708d93d405 req-e4c472fd-9841-4538-a8af-74fb642b856b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085514 Jun 18 22:12:24.444328 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1402/2798] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:24.449931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95b8694c-5b5f-4072-aed7-136fafff5717 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:24.457871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95b8694c-5b5f-4072-aed7-136fafff5717 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:24.533109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:24.543225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ffb6afa-baad-4c98-b174-46aa7f6169e3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1379 microversion: 2.1 time: 0.381464 Jun 18 22:12:24.546687 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1397/2799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:24 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1379 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:24.610080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-95b8694c-5b5f-4072-aed7-136fafff5717 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:24.620605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95b8694c-5b5f-4072-aed7-136fafff5717 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1222 microversion: 2.1 time: 0.174787 Jun 18 22:12:24.625772 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1403/2800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:24 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:24.809650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:24.810297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:24.819121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:24.819588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.820397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:24.820839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:24.916011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-12dd41f1-9261-42da-a581-efb4e6df3402 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0796b040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:25.011260 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-12dd41f1-9261-42da-a581-efb4e6df3402 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.097205 Jun 18 22:12:25.013757 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1404/2801] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:24 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:25.102278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:25.102913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:25.116253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:25.117247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:25.119991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:25.121479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:25.424084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:25.430008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:25.439206 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-777bf063-4940-4ca5-aa00-8b161cec6ed1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 0.630755 Jun 18 22:12:25.439840 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1398/2802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:24 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:25.446965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:25.448904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:25.450463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-03dec432-994a-41be-a49c-cdc5937ac4f9 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1582 microversion: 2.42 time: 0.353188 Jun 18 22:12:25.451633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:25.452266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:25.464748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:25.465226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:25.465989 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1405/2803] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:25 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1582 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:25.466121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:25.466444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:25.564594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:25.565350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:25.578944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:25.579707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:25.580730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:25.581385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:25.994298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:26.008086 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e34f1d65-0625-4a09-bdf9-180d93cde1e9 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1609 microversion: 2.1 time: 0.565992 Jun 18 22:12:26.010248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1399/2804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:25 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1609 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:26.023881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:26.024848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:26.038222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:26.041100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:26.045013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:26.045770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:26.087984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:26.103002 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e2ea61f1-14b2-4f5c-9003-d78612a747be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1379 microversion: 2.1 time: 0.542470 Jun 18 22:12:26.103631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1406/2805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:25 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1379 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:12:26.126654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77c7bedd-59af-4157-81b1-57987734303a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1447c940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:26.160712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:26.174440 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3de43bea-617b-4774-996b-1b16fd599c69 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1274 microversion: 2.1 time: 0.162449 Jun 18 22:12:26.175799 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1400/2806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:26 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:26.224395 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-77c7bedd-59af-4157-81b1-57987734303a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.119029 Jun 18 22:12:26.227210 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1407/2807] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:26 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:26.460574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:26.462045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:26.478610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:26.495623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:26.532849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:26.533932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:26.535113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:26.536246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:26.552592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:26.553646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:26.554464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:26.573406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.149263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:27.182445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:27.185388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:27.189483 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7e45da9-ea6b-4fe4-8a56-671dfdc2b94f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1592 microversion: 2.42 time: 0.720550 Jun 18 22:12:27.195089 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1408/2808] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:26 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1592 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:27.216362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:27.217066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:27.272673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.278612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.280186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.285133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.552981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:27.569141 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b92aed5-5662-4492-9451-f1dd2a254c5e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1522 microversion: 2.1 time: 1.111025 Jun 18 22:12:27.582375 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1401/2809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:26 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1522 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:27.625577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-30c2aaf2-ca81-4e05-a0bd-2140e1b5221c req-2bca1f45-96cd-4996-8940-236409990f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd948550-44ae-411d-b1d1-b562dd92d9ce", "name": "network-vif-deleted", "tag": "cf37ed15-38ad-441a-baa4-8156ecae1064"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:27.671185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-30c2aaf2-ca81-4e05-a0bd-2140e1b5221c req-2bca1f45-96cd-4996-8940-236409990f59 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.671963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-30c2aaf2-ca81-4e05-a0bd-2140e1b5221c req-2bca1f45-96cd-4996-8940-236409990f59 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.702994 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-30c2aaf2-ca81-4e05-a0bd-2140e1b5221c req-2bca1f45-96cd-4996-8940-236409990f59 service nova] Creating event network-vif-deleted:cf37ed15-38ad-441a-baa4-8156ecae1064 for instance fd948550-44ae-411d-b1d1-b562dd92d9ce on nch2-master-1 Jun 18 22:12:27.718588 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-30c2aaf2-ca81-4e05-a0bd-2140e1b5221c req-2bca1f45-96cd-4996-8940-236409990f59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129676 Jun 18 22:12:27.720001 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1402/2810] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:27.731773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:27.733229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:27.748416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.753843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.759991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.760690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.820284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48b167cdb1054ef5bfadd851be67e8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965efce4648a472eb15b6d1c0f8c6615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:27.844658 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad788f16-15df-4e55-8461-6ca04906b9e3 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 200 len: 1253 microversion: 2.1 time: 0.642867 Jun 18 22:12:27.862071 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1409/2811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:27 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 1253 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:27.887684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:27.888375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:27.939337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.943979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:27.944863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:27.972930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:28.304819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:28.358570 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d46e1697-50d0-4d48-90ef-5e6e62e8463f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1280 microversion: 2.1 time: 0.487407 Jun 18 22:12:28.362116 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1410/2812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:27 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:28.402301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8de9fa36-0460-4702-a6a1-d022e7535c1b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14693670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:29.218006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:29.231144 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac3272a4-0d9b-43e5-8cc8-1b6ea59ce05c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1379 microversion: 2.1 time: 1.509620 Jun 18 22:12:29.232682 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1403/2813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:27 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1379 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:29.242633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:29.245886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:29.260227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:29.260891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:29.264611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:29.269454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:29.485963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:29.529247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:29.634109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:29.656705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:29.670799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:29.677369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41aba337-75c3-49a3-8491-ac4ff2269e1b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1592 microversion: 2.42 time: 0.441169 Jun 18 22:12:29.679617 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1404/2814] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:29 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1592 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:29.684476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:29.713139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:29.727493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:29.727964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:29.733700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:29.734215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:30.443075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:30.458493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c71e8f2-f60a-4efa-96dd-63260e6c08b7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1502 microversion: 2.1 time: 0.777740 Jun 18 22:12:30.459102 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1405/2815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:29 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1502 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:30.501381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:30.502165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] [instance: fd948550-44ae-411d-b1d1-b562dd92d9ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:30.524826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:30.525812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:30.528330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:30.528799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:30.612820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] HTTP exception thrown: Instance fd948550-44ae-411d-b1d1-b562dd92d9ce could not be found. Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Request method failure captured: Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce HTTP/1.1 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk1dT_ChFDZdmI9sbsSws2z02UrHjZ8XRVOZs9TWp2q4XXn0TWLmcNk3Q10kwUQyqxlncXpOhw2iiDHyaEJqAtYV8M2LLx4Lz6tgGdZd-FhZom1gTN3_PsoNWMf6BV8E-6B9EQr56eI8dyaRi_w0LvT3mdxoYZGl9Y2IgDCx-1sqei4 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 965efce4648a472eb15b6d1c0f8c6615 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestBootFromVolume-816570874 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/965efce4648a472eb15b6d1c0f8c6615"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/965efce4648a472eb15b6d1c0f8c6615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/965efce4648a472eb15b6d1c0f8c6615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_965efce4648a472eb15b6d1c0f8c6615", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestBootFromVolume-816570874 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 965efce4648a472eb15b6d1c0f8c6615 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestBootFromVolume-816570874 Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestBootFromVolume-816570874-project Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 48b167cdb1054ef5bfadd851be67e8aa Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestBootFromVolume-816570874-project Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance fd948550-44ae-411d-b1d1-b562dd92d9ce could not be found. Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'fd948550-44ae-411d-b1d1-b562dd92d9ce'} Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd948550-44ae-411d-b1d1-b562dd92d9ce could not be found. Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd948550-44ae-411d-b1d1-b562dd92d9ce could not be found. Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:12:30.628786 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd948550-44ae-411d-b1d1-b562dd92d9ce could not be found. Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Returning 404 to user: Instance fd948550-44ae-411d-b1d1-b562dd92d9ce could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55961a4b-fb58-43fd-b22b-1e2b9267fbc7 tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce" status: 404 len: 111 microversion: 2.1 time: 0.170418 Jun 18 22:12:30.632952 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1406/2816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:30 2022] GET /compute/v2.1/servers/fd948550-44ae-411d-b1d1-b562dd92d9ce => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:12:30.644505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:30.645164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:30.689582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:30.690586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:30.691464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:30.691914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:31.924005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:31.932772 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a461f69b-8fb2-4d93-bd10-55d6a43e34d7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 1.293781 Jun 18 22:12:31.938647 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1407/2817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:30 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:31.960343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:31.961653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:31.988801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:31.989280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:31.990090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:31.990536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:32.512775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:32.520605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:32.533272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88183ccb-0b5b-42e4-80bb-5dc16b68929e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1379 microversion: 2.1 time: 0.588281 Jun 18 22:12:32.535143 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1408/2818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:31 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1379 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:32.551413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:32.552060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:32.593835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:32.594489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:32.595348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:32.595799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:33.141395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:33.155733 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa63e73c-ffd0-4da2-a9cd-53b3c540672b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1516 microversion: 2.1 time: 0.617489 Jun 18 22:12:33.156609 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1409/2819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:32 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1516 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:33.171975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0cb8de3e-c176-4bdd-9b09-9eaab671146c tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] Calling method '.version_select at 0x7fea078e5b80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:33.221411 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0cb8de3e-c176-4bdd-9b09-9eaab671146c tempest-ServersTestBootFromVolume-816570874 tempest-ServersTestBootFromVolume-816570874-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156525520" status: 202 len: 0 microversion: 2.1 time: 0.061784 Jun 18 22:12:33.223027 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1410/2820] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1156525520 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:12:33.234204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:33.235097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:33.251889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:33.252602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:33.254715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:33.255309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:33.754544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:33.985790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:34.019897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:34.025704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:34.029921 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5a6798a-ac0d-420f-bb4b-3ac743b822f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1705 microversion: 2.42 time: 0.803961 Jun 18 22:12:34.031585 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1411/2821] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:33 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1705 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:34.044823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:34.045916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:34.063487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:34.064959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:34.066937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:34.069706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:34.571690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:34.588368 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-774209f4-1401-4c68-91d9-38f4859fc5a5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 0.554068 Jun 18 22:12:34.588990 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1412/2822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:34 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:34.615354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=20 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:34.623749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f8cf5944-0b13-4f24-91c4-ca13144b4bc3 req-0a3876fa-5923-4a71-8ab1-862d528dd6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:34.663620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f8cf5944-0b13-4f24-91c4-ca13144b4bc3 req-0a3876fa-5923-4a71-8ab1-862d528dd6e7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:34.667033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f8cf5944-0b13-4f24-91c4-ca13144b4bc3 req-0a3876fa-5923-4a71-8ab1-862d528dd6e7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:34.706219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f8cf5944-0b13-4f24-91c4-ca13144b4bc3 req-0a3876fa-5923-4a71-8ab1-862d528dd6e7 service nova] Creating event network-changed:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:12:34.725380 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f8cf5944-0b13-4f24-91c4-ca13144b4bc3 req-0a3876fa-5923-4a71-8ab1-862d528dd6e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121279 Jun 18 22:12:34.728212 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1413/2823] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:34.741397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ceb0646c-e0f2-4219-8137-61c3fa87ba09 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:34.742677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ceb0646c-e0f2-4219-8137-61c3fa87ba09 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:34.790433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ceb0646c-e0f2-4219-8137-61c3fa87ba09 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Instance 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40 could not be found. Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ceb0646c-e0f2-4219-8137-61c3fa87ba09 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/7bb7ec18-6bed-4026-85fe-2f8a8ba76d40/action HTTP/1.1 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 14 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: {"rescue": {}} Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40 could not be found. Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7bb7ec18-6bed-4026-85fe-2f8a8ba76d40', 'body': {'rescue': {}}} Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40 could not be found. Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40 could not be found. Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:34.815494 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40 could not be found. Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ceb0646c-e0f2-4219-8137-61c3fa87ba09 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 404 to user: Instance 7bb7ec18-6bed-4026-85fe-2f8a8ba76d40 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ceb0646c-e0f2-4219-8137-61c3fa87ba09 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/7bb7ec18-6bed-4026-85fe-2f8a8ba76d40/action" status: 404 len: 111 microversion: 2.1 time: 0.087733 Jun 18 22:12:34.820645 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1414/2824] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:34 2022] POST /compute/v2.1/servers/7bb7ec18-6bed-4026-85fe-2f8a8ba76d40/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:12:34.822587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-37d11a87-6d28-4c04-b0cc-4e3dd5658ef0 req-bfddace8-8b1b-4bd0-aa30-d3198550847f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "name": "network-vif-plugged", "status": "completed", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:34.875366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-37d11a87-6d28-4c04-b0cc-4e3dd5658ef0 req-bfddace8-8b1b-4bd0-aa30-d3198550847f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:34.891243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-37d11a87-6d28-4c04-b0cc-4e3dd5658ef0 req-bfddace8-8b1b-4bd0-aa30-d3198550847f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:34.945618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-37d11a87-6d28-4c04-b0cc-4e3dd5658ef0 req-bfddace8-8b1b-4bd0-aa30-d3198550847f service nova] Creating event network-vif-plugged:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:12:34.955293 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-37d11a87-6d28-4c04-b0cc-4e3dd5658ef0 req-bfddace8-8b1b-4bd0-aa30-d3198550847f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134088 Jun 18 22:12:34.958640 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1415/2825] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:34.976683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:34.977838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:35.010977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:35.021050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:35.022822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:35.023532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:35.732093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:35.741487 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a31d8632-7928-457e-9a55-cfa12addf1cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1379 microversion: 2.1 time: 0.781099 Jun 18 22:12:35.746205 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1416/2826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:34 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1379 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:35.756857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:35.757671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:35.770168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:35.776098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:35.777441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:35.778104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:35.945943 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e53a3562-fe64-4404-917f-78052cdbe3ed tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action" status: 202 len: 0 microversion: 2.1 time: 0.197705 Jun 18 22:12:35.948478 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1417/2827] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:35 2022] POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:12:35.966367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:35.968355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:35.987207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:35.989916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:35.992049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:35.992519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:36.379595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:36.391815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:36.394126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:36.395390 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2f5018d-4213-4516-91cd-7b714f59e653 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1797 microversion: 2.42 time: 0.444195 Jun 18 22:12:36.407850 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1418/2828] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:35 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1797 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:36.413315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:36.413960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:36.443897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:36.444036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:36.445025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:36.445521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:36.758870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:36.772306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b395ee15-14ec-4a2c-9777-9450c2e4e22d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 0.363226 Jun 18 22:12:36.776621 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1419/2829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:36 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:36.790121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:36.796362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:36.818829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:36.823914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:36.825139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:36.825851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.222635 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8de9fa36-0460-4702-a6a1-d022e7535c1b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 8.858404 Jun 18 22:12:37.223934 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1411/2830] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:28 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 8861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:37.235604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:37.236512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:37.243633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.244174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.245205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.246033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.289150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:37.301369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c727eb5-7338-4a62-9d7f-cb03087249d0 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1501 microversion: 2.1 time: 0.521429 Jun 18 22:12:37.301983 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1420/2831] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:36 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1501 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:37.437175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a9344d0-93a3-4b5d-926f-2104fbcff61f tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Action: 'create', calling method: .version_select at 0x7fea078a7940>, body: {"keypair": {"name": "tempest-keypair-1405650717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrkzvzfeMvD1TOxMaTHew8BeYfE9Xc1Y5OUQV1aQZkz4IhqJxbP5TWSqvnAd6aKxqV2c4RTQFxAAEh9Kvf9cg7gwS7BL+EC5iX+ZWgDEuW4MNZ0FOL8hGuiPLdVwCXpRg=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:37.459522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6a9344d0-93a3-4b5d-926f-2104fbcff61f tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Getting quotas for project 07a129b1f88f4c4f97cc3a9f76ef47f1. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:37.466384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6a9344d0-93a3-4b5d-926f-2104fbcff61f tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Getting quotas for user 27c40405bf7547b4b1b896b142ea4156 and project 07a129b1f88f4c4f97cc3a9f76ef47f1. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:37.497382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a9344d0-93a3-4b5d-926f-2104fbcff61f tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194097 Jun 18 22:12:37.506030 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1421/2832] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:12:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:37.514993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:37.516976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:37.527434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:37.538973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7fcec2ab-6410-4205-b4de-1edbd705928b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1529 microversion: 2.1 time: 0.305016 Jun 18 22:12:37.540487 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1412/2833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:37 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1529 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:37.555363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.556618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.560356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.561177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.566343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:37.568378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:37.585740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.588223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.589262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.590591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.624912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lazy-loading 'flavor' on Instance uuid c421b265-a2ca-42cf-8eed-603f694967a1 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:12:37.654875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Cannot 'rescue' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state paused Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action HTTP/1.1 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 14 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: {"rescue": {}} Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'rescue' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state paused Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c421b265-a2ca-42cf-8eed-603f694967a1', 'body': {'rescue': {}}} Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c421b265-a2ca-42cf-8eed-603f694967a1 in vm_state paused. Cannot rescue while the instance is in this state. Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state paused Jun 18 22:12:37.657020 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state paused Jun 18 22:12:37.663488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:12:37.665595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 409 to user: Cannot 'rescue' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state paused {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:12:37.666857 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3eff5696-f2c0-47ab-98ca-331de4ae4c94 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action" status: 409 len: 144 microversion: 2.1 time: 0.158319 Jun 18 22:12:37.668130 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1422/2834] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:37 2022] POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action => generated 144 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:12:37.673321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:37.674348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:37.682436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.683936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:37.685406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:37.686160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:38.528893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:38.550558 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-518c9b38-ef62-4796-a828-4e01b3f2618b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1529 microversion: 2.1 time: 0.880807 Jun 18 22:12:38.570582 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1423/2835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:37 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1529 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:38.576324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:38.587520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:38.601622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:38.618596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:38.621069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:38.622028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:38.624144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:38.653256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:38.663974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:38.678028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:38.679567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5f50e10d-4b4f-41c3-ae9a-3ddf7721a914 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1797 microversion: 2.42 time: 1.124875 Jun 18 22:12:38.681109 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1413/2836] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:37 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1797 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:38.689691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:38.690541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:38.704280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:38.707534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:38.708468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:38.709021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:38.808606 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e8eff42b-ca73-493c-9e50-3221de8595c7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action" status: 202 len: 0 microversion: 2.1 time: 0.235917 Jun 18 22:12:38.813490 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1424/2837] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:38 2022] POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:12:38.841481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-340698ab-7f36-4de4-8ce0-ab86b8fe128e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078a3790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:38.934923 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-340698ab-7f36-4de4-8ce0-ab86b8fe128e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.116812 Jun 18 22:12:38.940291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1425/2838] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:38 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:38.948598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee6b5fb1-966a-4e6c-8d0c-026a65c7ad42 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:38.949571 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:12:38.949571 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:12:38.968901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:38.982231 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43a955cb-a273-49db-823c-6bbd68d7d766 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 0.299480 Jun 18 22:12:38.983570 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1414/2839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:38 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:38.995119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:38.996281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:39.010784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.011369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.017315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.017892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.040455 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee6b5fb1-966a-4e6c-8d0c-026a65c7ad42 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/26182349-2d05-45b8-a55e-4e986e371809" status: 202 len: 0 microversion: 2.1 time: 0.103854 Jun 18 22:12:39.043986 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1426/2840] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:12:38 2022] DELETE /compute/v2.1/flavors/26182349-2d05-45b8-a55e-4e986e371809 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:12:39.053290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d0cf858-16aa-46f2-8b7e-12e50944a846 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:39.199378 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d0cf858-16aa-46f2-8b7e-12e50944a846 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.153503 Jun 18 22:12:39.207395 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1427/2841] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:12:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:39.230871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:39.234238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:39.257366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.257928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.258823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.259360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.340831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:39.360984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Old instance type tempest-test_resize_flavor_-1396820017, new instance type m1.heat {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:12:39.371674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:12:39.372235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:12:39.373536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:12:39.381867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:12:39.382459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:12:39.510546 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1249d78a-f0f3-4e7b-9dd6-88d9115634cc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a/action" status: 202 len: 0 microversion: 2.1 time: 0.291877 Jun 18 22:12:39.514950 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1428/2842] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:39 2022] POST /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:12:39.523310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:39.524962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:39.533428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.534059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.535233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.535874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.573333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:39.725784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:39.734867 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-10150e24-cf69-46d1-9968-077c42e1f6b6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1508 microversion: 2.1 time: 0.749940 Jun 18 22:12:39.742683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1415/2843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:38 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:39.748510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:39.757473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:39.771057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.771828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:39.774017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:39.777895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:40.177301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:40.210524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0259df4-5c9b-4acd-9afc-84f712842218 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1538 microversion: 2.1 time: 0.688528 Jun 18 22:12:40.213293 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1429/2844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:39 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1538 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:40.219806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8e79bd18-01de-416f-93a3-1f564df9c0e8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078fd940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:40.307758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8e79bd18-01de-416f-93a3-1f564df9c0e8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.091800 Jun 18 22:12:40.310514 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1430/2845] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:40 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:40.320142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:40.320969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:40.334860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:40.335507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:40.336315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:40.337627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:40.378053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:40.387656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:40.398171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:40.404039 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d348f399-60bf-4cc7-b944-ec898fa30368 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1831 microversion: 2.42 time: 0.659650 Jun 18 22:12:40.410368 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1416/2846] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:39 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1831 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:40.712219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:40.723614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11aeffc7-743e-495e-92ad-b7d463c2dcec tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 0.411003 Jun 18 22:12:40.727734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1431/2847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:40 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:40.760424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:40.761389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:40.771575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:40.788481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:40.794796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:40.795307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:41.103299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-751765174", "imageRef": "1801620e-0e7f-4446-bcd0-ad06e86e0ffb", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7f9a7f9f-b3c6-4da1-a994-9de327b9ce5e"}], "security_groups": [{"name": "tempest-securitygroup--481786989"}], "key_name": "tempest-keypair-1405650717", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:41.290150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:41.298751 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17bfa222-184a-4d56-8af7-29ae35ce9ccb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1516 microversion: 2.1 time: 0.542962 Jun 18 22:12:41.303608 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1417/2848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:40 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1516 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:41.314471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:41.317141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:41.333432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:41.337136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:41.338466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:41.341785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:41.533476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] validate_networks() for [('7f9a7f9f-b3c6-4da1-a994-9de327b9ce5e', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:12:41.901061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:41.911024 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7359e734-71c0-4403-a5f0-2a00ad02d8b5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1538 microversion: 2.1 time: 0.605512 Jun 18 22:12:41.926459 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1418/2849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:41 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1538 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:41.926459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ac6c412a-f2af-43db-b86f-724482046ce0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea143d8040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:42.061231 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ac6c412a-f2af-43db-b86f-724482046ce0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.143146 Jun 18 22:12:42.062158 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1419/2850] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:41 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:42.074835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7967799c-72f6-4c04-b56f-9bf792309d8d req-1c6ef40f-d5a5-4a6d-8dc3-ad92cb6001de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "e82aea74-0ff1-4853-b959-c6713a07c673"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:42.100318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7967799c-72f6-4c04-b56f-9bf792309d8d req-1c6ef40f-d5a5-4a6d-8dc3-ad92cb6001de service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:42.101181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7967799c-72f6-4c04-b56f-9bf792309d8d req-1c6ef40f-d5a5-4a6d-8dc3-ad92cb6001de service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:42.133595 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7967799c-72f6-4c04-b56f-9bf792309d8d req-1c6ef40f-d5a5-4a6d-8dc3-ad92cb6001de service nova] Creating event network-changed:e82aea74-0ff1-4853-b959-c6713a07c673 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:42.144015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7967799c-72f6-4c04-b56f-9bf792309d8d req-1c6ef40f-d5a5-4a6d-8dc3-ad92cb6001de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077531 Jun 18 22:12:42.151594 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1420/2851] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:42.157589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:42.166065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:42.176950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:42.180267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:42.182548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:42.183857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:43.340476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:43.361946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:43.363614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:43.364884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee27c2ce-f15c-48cf-8d24-68f14fc2188c tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1831 microversion: 2.42 time: 1.211949 Jun 18 22:12:43.378440 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1421/2852] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:42 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1831 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:43.383641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e8a07ab1-30e2-436f-bf61-ee22bb2cd641 req-80532f2e-24fe-4444-a8ff-77b24d28ddf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "name": "network-vif-plugged", "status": "completed", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:43.422090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e8a07ab1-30e2-436f-bf61-ee22bb2cd641 req-80532f2e-24fe-4444-a8ff-77b24d28ddf8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:43.422539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e8a07ab1-30e2-436f-bf61-ee22bb2cd641 req-80532f2e-24fe-4444-a8ff-77b24d28ddf8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:43.445647 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e8a07ab1-30e2-436f-bf61-ee22bb2cd641 req-80532f2e-24fe-4444-a8ff-77b24d28ddf8 service nova] Creating event network-vif-plugged:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:12:43.470617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e8a07ab1-30e2-436f-bf61-ee22bb2cd641 req-80532f2e-24fe-4444-a8ff-77b24d28ddf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090788 Jun 18 22:12:43.471259 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1422/2853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:43.487010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:43.495781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:43.521099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:43.523298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:43.527766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:43.529842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:43.694011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:12:43.694744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:12:43.695187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:12:43.695831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:12:43.696466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:12:43.737065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:43.741071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:43.743796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:43.749217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:43.800739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Getting quotas for project 07a129b1f88f4c4f97cc3a9f76ef47f1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:12:43.806849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Getting quotas for user 27c40405bf7547b4b1b896b142ea4156 and project 07a129b1f88f4c4f97cc3a9f76ef47f1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:12:43.848250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:12:43.856064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1801620e-0e7f-4446-bcd0-ad06e86e0ffb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:12:44.008252 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f829926c-758a-447d-91de-29255be1a6c8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.909557 Jun 18 22:12:44.015387 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1432/2854] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:12:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:12:44.020903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:44.021800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:44.049737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.050779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.051731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.052999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.158631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:44.170714 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d08a46cb-37d4-4df5-8527-d1835ad75128 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 0.694472 Jun 18 22:12:44.180188 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1423/2855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:43 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:44.182656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-579ebece-ec23-45f6-bc5b-b10b43258df3 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea144eaa60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:44.296567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-579ebece-ec23-45f6-bc5b-b10b43258df3 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.122001 Jun 18 22:12:44.297201 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1424/2856] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:44 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:44.320468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:44.321765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:44.361912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.372643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.375467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.380137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.456635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lazy-loading 'flavor' on Instance uuid c421b265-a2ca-42cf-8eed-603f694967a1 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:12:44.498944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:44.513547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:44.528901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2455f62f-6b0e-426a-afd2-edf02019bcbc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.511815 Jun 18 22:12:44.529952 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1433/2857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:44 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:44.538603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0743058-9efa-4e13-8247-3376ebe80eaf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:44.541667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0743058-9efa-4e13-8247-3376ebe80eaf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:44.619020 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3aa736a-7ff4-4182-91ba-e9bf789ccbfc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action" status: 200 len: 32 microversion: 2.1 time: 0.314804 Jun 18 22:12:44.624452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1425/2858] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:44 2022] POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:12:44.631245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:44.632079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:44.640558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.640955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.642051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.642638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.860048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b0743058-9efa-4e13-8247-3376ebe80eaf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:44.877830 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0743058-9efa-4e13-8247-3376ebe80eaf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1245 microversion: 2.1 time: 0.344889 Jun 18 22:12:44.878462 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1434/2859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:44 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1245 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:44.895486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0c88120b-233b-4990-809e-0242a283d940 req-e9764a3a-c863-4521-be93-dd6b6f205f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "efa1b247-18d7-4cf8-beb3-93636b50c24f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:44.922306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0c88120b-233b-4990-809e-0242a283d940 req-e9764a3a-c863-4521-be93-dd6b6f205f7e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.922768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0c88120b-233b-4990-809e-0242a283d940 req-e9764a3a-c863-4521-be93-dd6b6f205f7e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.946753 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0c88120b-233b-4990-809e-0242a283d940 req-e9764a3a-c863-4521-be93-dd6b6f205f7e service nova] Creating event network-changed:efa1b247-18d7-4cf8-beb3-93636b50c24f for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:44.953182 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0c88120b-233b-4990-809e-0242a283d940 req-e9764a3a-c863-4521-be93-dd6b6f205f7e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069675 Jun 18 22:12:44.953182 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1435/2860] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:44.960123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:44.960123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:44.967404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.968000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:44.968915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:44.969577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:45.197962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:45.216385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:45.221341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:45.227115 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-baf28067-681e-4237-b9fe-c8f1ef80d5c7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1852 microversion: 2.42 time: 0.600873 Jun 18 22:12:45.230785 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1426/2861] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:44 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1852 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:45.242945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:45.253022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:45.264879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:45.265944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:45.268380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:45.270176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:45.462177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:45.475272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-71c6ff3b-20a5-4771-a21c-7f8790834a5b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.521295 Jun 18 22:12:45.479197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1436/2862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:44 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:45.501368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-253bed29-1577-46ad-8487-7f5cc1f6a15e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078bf160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:45.612539 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-253bed29-1577-46ad-8487-7f5cc1f6a15e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1455 microversion: 2.1 time: 0.130666 Jun 18 22:12:45.613714 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1437/2863] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:45 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:45.618531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:45.624332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:45.647992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:45.648541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:45.649417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:45.654540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:45.907184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:45.926124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d91298d-72d1-4b08-b443-f6c9665d3f22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1322 microversion: 2.1 time: 0.694014 Jun 18 22:12:45.938779 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1427/2864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:45 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1322 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:45.982176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:45.982858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:46.004808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:46.010766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:46.020641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:46.021323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:46.248981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:46.257949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:46.268898 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91485572-e092-4f16-8ec6-54368965ca02 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.651871 Jun 18 22:12:46.271143 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1438/2865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:45 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:46.280431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:46.284720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:46.296015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-335c7317-9b62-4f6a-9bc3-b6c723e41727 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1315 microversion: 2.1 time: 0.329388 Jun 18 22:12:46.298615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1428/2866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:45 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:46.317316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:46.317886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:46.318948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:46.319497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:46.511731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:46.512668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:46.533615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:46.534546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:46.538179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:46.541448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:47.171662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:47.202487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:47.206716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:47.207837 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-052d0db6-0161-445b-a06e-484cb928a6e8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.934746 Jun 18 22:12:47.208252 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1439/2867] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:46 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:47.226022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa857db4-636c-4b0d-80c4-64a159984098 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078d3940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:47.507186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:47.532545 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f83206a8-b010-4999-972a-59d557ca38c9 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 1.026840 Jun 18 22:12:47.543683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1429/2868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:46 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:47.553583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:47.554885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:47.563252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:47.563997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:47.565259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:47.566380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.105438 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa857db4-636c-4b0d-80c4-64a159984098 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1464 microversion: 2.1 time: 0.883419 Jun 18 22:12:48.106800 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1440/2869] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:47 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1464 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:48.119395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-68cc2546-3fe6-4c29-a96b-0857a9de88d8 req-3d33973f-8c5f-4d5c-aa64-7dde63f2332a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:48.141049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-68cc2546-3fe6-4c29-a96b-0857a9de88d8 req-3d33973f-8c5f-4d5c-aa64-7dde63f2332a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.142096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-68cc2546-3fe6-4c29-a96b-0857a9de88d8 req-3d33973f-8c5f-4d5c-aa64-7dde63f2332a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.158669 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-68cc2546-3fe6-4c29-a96b-0857a9de88d8 req-3d33973f-8c5f-4d5c-aa64-7dde63f2332a service nova] Creating event network-changed:56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:48.165374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-68cc2546-3fe6-4c29-a96b-0857a9de88d8 req-3d33973f-8c5f-4d5c-aa64-7dde63f2332a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049351 Jun 18 22:12:48.166532 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1441/2870] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:48.172126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:48.173097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:48.180621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.181387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.182562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.183143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.210532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:48.222690 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d702fc76-052b-46eb-8a55-7682a8b665e3 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1516 microversion: 2.1 time: 0.673538 Jun 18 22:12:48.223297 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1430/2871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:47 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1516 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:48.259856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:48.261657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:48.278901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.279446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.281690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.282986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.444314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:48.458600 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e314dc61-2985-45d1-b964-c6d6a682442d tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1303 microversion: 2.1 time: 0.228220 Jun 18 22:12:48.461516 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1431/2872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:48 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1303 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:48.474444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a0ba043-860f-4420-856d-ad2404ec8166 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1423b160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:48.600564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a0ba043-860f-4420-856d-ad2404ec8166 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 200 len: 1464 microversion: 2.1 time: 0.137542 Jun 18 22:12:48.623684 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1432/2873] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:48 2022] GET /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:48.643559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:48.644204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:48.679831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.682479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.685415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.686042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.709632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:48.724860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95621851-4eca-4df4-bd60-a3f3569d2fd0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.556759 Jun 18 22:12:48.726257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1442/2874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:48 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:48.735696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:48.742581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:48.761350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.762240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.765547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:48.766255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:48.827076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lazy-loading 'flavor' on Instance uuid 40a9b61c-f4b3-4970-a1cf-0f99f076e072 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:12:49.011507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd876a18-b457-443c-b74c-de92113a6515 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action" status: 200 len: 32 microversion: 2.1 time: 0.282027 Jun 18 22:12:49.017628 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1443/2875] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:48 2022] POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:12:49.034069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:49.037215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:49.046307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.048141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.051500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.052411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.561826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:49.577400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:49.585739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:49.587234 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c6b0130-2497-49bb-a14f-8037e3d2eac5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.962444 Jun 18 22:12:49.589186 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1433/2876] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:48 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:49.602870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:49.604643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:49.605555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:49.627358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.630688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.635681 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-487d7fc0-8c6d-4f59-9573-fa09e38783d2 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.612440 Jun 18 22:12:49.636510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1444/2877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:49 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:49.646688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.646688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.672215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:49.672215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:49.683240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.683909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.687514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.689597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.750841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:12:49.960944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0640e090-79d7-499d-bb6b-1f8b28e250ed tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 204 len: 0 microversion: 2.32 time: 0.310151 Jun 18 22:12:49.965623 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1445/2878] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:12:49 2022] DELETE /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:12:49.973929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:49.975799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:49.985212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.986402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:49.987752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:49.989274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:50.546494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:50.555440 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ea2cb39-9350-4ba8-889f-283ce9dfb8e0 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1468 microversion: 2.1 time: 0.964036 Jun 18 22:12:50.563526 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1434/2879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:49 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1468 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:50.568888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:50.574386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:50.590802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:50.591319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:50.592125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:50.592574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:50.737806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:50.747138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3e9fbb37-e249-47e7-b32f-41c180c1101c tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.779208 Jun 18 22:12:50.757350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1446/2880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:49 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:50.762815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:50.763806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:50.770480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:50.771222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:50.772259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:50.772937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.093822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:51.102466 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe12f5f7-b0e6-4a53-b9f9-090450e2ae85 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.537325 Jun 18 22:12:51.114340 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1435/2881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:50 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:51.114340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:51.114340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:51.122938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.123398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.124211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.124659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.313817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:51.322855 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58601229-1429-4ced-a7f4-2be9bcaf8ac4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.563938 Jun 18 22:12:51.335368 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1447/2882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:50 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:51.341052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d046b600-a1d8-425a-92a2-6f83c43e6f01 req-c00bc915-e750-48d0-b28b-c73e598057a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "6f6f5ea1-9aec-43dd-9351-058a6528ebba"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:51.355738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d046b600-a1d8-425a-92a2-6f83c43e6f01 req-c00bc915-e750-48d0-b28b-c73e598057a2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.356393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d046b600-a1d8-425a-92a2-6f83c43e6f01 req-c00bc915-e750-48d0-b28b-c73e598057a2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.375438 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d046b600-a1d8-425a-92a2-6f83c43e6f01 req-c00bc915-e750-48d0-b28b-c73e598057a2 service nova] Creating event network-changed:6f6f5ea1-9aec-43dd-9351-058a6528ebba for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:51.381854 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d046b600-a1d8-425a-92a2-6f83c43e6f01 req-c00bc915-e750-48d0-b28b-c73e598057a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044842 Jun 18 22:12:51.383176 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1448/2883] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:51.388811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-209869280"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:51.390306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:51.400846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.401804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.403079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.403897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.410404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:51.562921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:51.591592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:51.597786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:51.600231 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57ba7b06-3e21-4829-8567-7d1843c0ee19 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2951 microversion: 2.32 time: 0.495698 Jun 18 22:12:51.603008 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1436/2884] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:51 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2951 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:51.618467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:51.619706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:51.640647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.641535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.642940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.644035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.858735 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-30044c8c-691a-4187-b669-0bcd403e03e6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "POST /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469/action" status: 202 len: 0 microversion: 2.1 time: 0.473861 Jun 18 22:12:51.861340 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1449/2885] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:12:51 2022] POST /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:12:51.868883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:51.870127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:51.882253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.884121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:51.885374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:51.886336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.066765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:52.077098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:52.078856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:52.080446 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e31c0a5-9277-4acb-9848-679ab605960b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.475925 Jun 18 22:12:52.093229 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1437/2886] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:51 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:52.099272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:52.100704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:52.111380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:52.114200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.114662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.117123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.117123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.316952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:52.329988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ebab119-b46a-426b-971a-452314ae214c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.467111 Jun 18 22:12:52.339810 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1450/2887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:51 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:52.345376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe6da083-ab8f-417f-bdd8-1125b82ec01a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea140bcaf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:52.420108 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fe6da083-ab8f-417f-bdd8-1125b82ec01a tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.088057 Jun 18 22:12:52.420968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1451/2888] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:52 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:52.432862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:52.439343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:52.447521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.452884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.454045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.454500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.686331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:52.705195 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f79e2fd-0500-478c-81aa-86ebccf09280 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.607981 Jun 18 22:12:52.707897 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1438/2889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:52 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:52.722840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6595d2fd-ac2f-4241-b376-a692026c33e1 req-dbfaf32b-6675-4fc6-8e8c-310a003b9c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e0fe1a-5120-4953-8610-19c8bb8dab59", "tag": "e067ed6e-b170-4963-97d6-d82c9599c977"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:52.745774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6595d2fd-ac2f-4241-b376-a692026c33e1 req-dbfaf32b-6675-4fc6-8e8c-310a003b9c89 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.746518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6595d2fd-ac2f-4241-b376-a692026c33e1 req-dbfaf32b-6675-4fc6-8e8c-310a003b9c89 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.766171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6595d2fd-ac2f-4241-b376-a692026c33e1 req-dbfaf32b-6675-4fc6-8e8c-310a003b9c89 service nova] Creating event network-changed:e067ed6e-b170-4963-97d6-d82c9599c977 for instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 on nch2-master-1 Jun 18 22:12:52.773537 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6595d2fd-ac2f-4241-b376-a692026c33e1 req-dbfaf32b-6675-4fc6-8e8c-310a003b9c89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060658 Jun 18 22:12:52.774751 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1439/2890] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:52.783040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:52.784116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:52.793154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.793854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.795042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.795635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.828085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:52.841386 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8b54f6a2-607b-4269-99e7-2a5c4fc924e3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.414751 Jun 18 22:12:52.842020 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1452/2891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:52 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:52.850993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:52.854768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:52.870136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.873457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:52.874524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:52.875126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:53.508834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:53.520040 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9aa466f7-6c55-4afd-9a3c-1a535dbd7283 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.743067 Jun 18 22:12:53.530607 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1440/2892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:52 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:53.536017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:53.536931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:53.544169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:53.544912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:53.545906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:53.546514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:53.593219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:53.609185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:53.615844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:53.617481 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6dd29d8e-7852-4c67-a3c7-9f8def1bab18 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2951 microversion: 2.32 time: 0.774446 Jun 18 22:12:53.618707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1453/2893] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:52 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2951 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:53.624207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-588a1f18-72ac-4f9e-9d4e-eddcb880c1a3 req-55868d23-475a-4d2a-97ee-4ee55493826d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64809918-45ff-4e75-9136-72b4a53b4046", "name": "network-vif-unplugged", "status": "completed", "tag": "02edfb5d-e4f7-4f79-bd38-14abde92e757"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:53.635194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-588a1f18-72ac-4f9e-9d4e-eddcb880c1a3 req-55868d23-475a-4d2a-97ee-4ee55493826d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:53.636195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-588a1f18-72ac-4f9e-9d4e-eddcb880c1a3 req-55868d23-475a-4d2a-97ee-4ee55493826d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:53.664545 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-588a1f18-72ac-4f9e-9d4e-eddcb880c1a3 req-55868d23-475a-4d2a-97ee-4ee55493826d service nova] Creating event network-vif-unplugged:02edfb5d-e4f7-4f79-bd38-14abde92e757 for instance 64809918-45ff-4e75-9136-72b4a53b4046 on nch1-master-1 Jun 18 22:12:53.677219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-588a1f18-72ac-4f9e-9d4e-eddcb880c1a3 req-55868d23-475a-4d2a-97ee-4ee55493826d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056693 Jun 18 22:12:53.682385 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1454/2894] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:53.692815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:53.696310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:53.708884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:53.712190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:53.715458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:53.716224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:53.797341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:54.031785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:54.052328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:54.054103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:54.060897 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46a7922f-1e53-422e-b72b-ffaaf8de00e1 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.528824 Jun 18 22:12:54.068158 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1441/2895] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:53 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:54.084964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960"}, {"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "f9640cbc-f56e-4a87-9083-cba5d2310a57"}, {"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "a3aec98b-5ee4-4848-9035-2ba72eaa628a"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:54.100660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:54.110736 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81163e03-b90c-4438-a4f4-3c0031a573de tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.426758 Jun 18 22:12:54.112312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.113199 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1455/2896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:53 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:54.123413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.133953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc280aca-12dc-4c8b-83d3-f9123fd44c0d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078a7a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:54.168630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] Creating event network-changed:6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:54.171524 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] Creating event network-changed:f9640cbc-f56e-4a87-9083-cba5d2310a57 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:54.172073 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] Creating event network-changed:a3aec98b-5ee4-4848-9035-2ba72eaa628a for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:12:54.190172 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-35a20552-c01c-4cd5-b1e3-dc22ac62d5b1 req-1cd5b27f-f5c2-46b8-bb35-143b1184a4ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.120464 Jun 18 22:12:54.190807 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1442/2897] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:54.194272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc280aca-12dc-4c8b-83d3-f9123fd44c0d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.068963 Jun 18 22:12:54.195149 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1456/2898] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:54 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:54.201408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:54.202031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:54.205643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:54.209359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.209857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.210696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.211318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.212673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:54.227663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.232750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.233932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.234556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.244358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:54.455797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:54.468317 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ebdcc72-17f1-48dd-bc56-5a138ab7fce3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.271286 Jun 18 22:12:54.469497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1457/2899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:54 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:54.538897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:54.539599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:54.554392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.555573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.559175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.559653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.601671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:54.611151 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55c2b09e-c1ae-44e1-a601-7e3ed2986972 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.416221 Jun 18 22:12:54.627339 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1443/2900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:54 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:54.639906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:54.640673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:54.657113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.657527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.658347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:54.658823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:54.870816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:55.065005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.079950 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bfa7c6bf-bc22-42a8-8e11-4793a1fe8bba tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.540267 Jun 18 22:12:55.081356 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1458/2901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:54 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:55.094200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:55.095204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:55.111130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.116744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.129215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.129808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.131553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.132145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.138144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.141476 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-441dd2a0-5236-4c51-9ef3-7389d9cab34e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2951 microversion: 2.32 time: 0.505790 Jun 18 22:12:55.157593 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1444/2902] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:54 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2951 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:12:55.171730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:55.173667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:55.194177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.195122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.196218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.196883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.445478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.465596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.471261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.473267 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7da68157-53a3-4e31-836d-6f0b1efe07f6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.390351 Jun 18 22:12:55.477985 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1459/2903] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:55 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:55.493892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12ba1f3c-356e-41e8-9b3d-6c23b250c4af tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078604c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:55.576984 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12ba1f3c-356e-41e8-9b3d-6c23b250c4af tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.097251 Jun 18 22:12:55.577994 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1460/2904] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:55 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:55.587577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:55.595701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:55.609958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.610670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.611735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.612615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.860877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:55.870811 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-77f7586f-3dd1-48c5-b9e0-cfc62c0eea7e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.711571 Jun 18 22:12:55.888733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1445/2905] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:55 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:55.894726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:55.906066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:55.921107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.930266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:55.931460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:55.933608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.116386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:56.132058 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c90bfb46-7a4f-45f7-b9c3-9814d37a8bf0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.552238 Jun 18 22:12:56.134489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1461/2906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:55 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:56.140933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:56.141605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:56.198611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:56.199108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.199940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:56.200422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.381477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:56.401811 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93f985c7-a372-40a7-8a0d-f2619ef5c3b7 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.511784 Jun 18 22:12:56.406410 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1446/2907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:55 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:56.431410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:56.432154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:56.455936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:56.458139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.459268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:56.467410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.620291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:56.631151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a26a293d-23da-4cfc-aec4-400a60608ddc tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.495335 Jun 18 22:12:56.642974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1462/2908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:56 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:56.650002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:56.651578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:56.661046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:56.661908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.662986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:56.664003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:56.902911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:56.920929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:56.922649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:56.924134 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6d40e90-6e0e-4124-ab19-32a462fd70d4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2951 microversion: 2.32 time: 0.512189 Jun 18 22:12:56.929474 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1447/2909] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:56 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2951 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:56.935119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb96e518-e08d-44f0-82fa-4ee3a2f9bf1b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea143e5160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:57.024482 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb96e518-e08d-44f0-82fa-4ee3a2f9bf1b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.093576 Jun 18 22:12:57.031921 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1448/2910] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:56 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:57.049493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:57.050423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:57.069905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:57.070380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:57.071218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:57.071720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.050798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:58.071257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:58.090182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:58.097009 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9463bf0b-d1ed-4395-a458-ba54d3742ede tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 1.451914 Jun 18 22:12:58.106513 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1463/2911] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:56 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:58.122419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:58.125921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:58.143630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:58.147051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:12:58.148678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.149182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.150064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.152833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.162340 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8630894-10d7-41ab-80c0-5be09f121b5d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 1.125867 Jun 18 22:12:58.165317 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1449/2912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:57 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:58.179922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:58.183798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:58.208126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.210693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.213384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.214071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.607346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:58.627761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6bce273f-5234-449e-ad40-27b627b0cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.517825 Jun 18 22:12:58.628887 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1464/2913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:58 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:58.639111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:58.653878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:58.673661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.674954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.676956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.678317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.742611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:58.765605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35bc2802-6eb0-4da4-aa39-a60476fb603d tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.596869 Jun 18 22:12:58.766739 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1450/2914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:58 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:58.782349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:58.785842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:58.798984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.800169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:58.801401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:58.802095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:59.182790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:59.195349 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-33d126b5-f2a8-4226-969c-712b851886d8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.564599 Jun 18 22:12:59.206030 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1465/2915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:58 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:59.211168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22477675-63bb-4a9f-baf8-cb4a42b77c09 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0784a4c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:59.263255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:59.283033 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22477675-63bb-4a9f-baf8-cb4a42b77c09 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.075617 Jun 18 22:12:59.286108 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1466/2916] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:12:59 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:12:59.287567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:59.289229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:59.290560 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8bd8574f-f763-4522-8ef3-796755251f32 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2951 microversion: 2.32 time: 0.520860 Jun 18 22:12:59.291128 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1451/2917] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:58 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2951 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:12:59.295778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-abda43c6-8498-4a3f-a4f9-f08b14da0afd req-48d0c010-ceaf-4a62-b182-5db366083586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "6a0a73d3-2b87-4e05-a042-2a9468fbabf2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:12:59.300041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:59.305645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:59.314110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-abda43c6-8498-4a3f-a4f9-f08b14da0afd req-48d0c010-ceaf-4a62-b182-5db366083586 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:59.315229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-abda43c6-8498-4a3f-a4f9-f08b14da0afd req-48d0c010-ceaf-4a62-b182-5db366083586 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:59.319877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:59.320338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:59.324432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:59.329307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:59.345139 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-abda43c6-8498-4a3f-a4f9-f08b14da0afd req-48d0c010-ceaf-4a62-b182-5db366083586 service nova] Creating event network-vif-unplugged:6a0a73d3-2b87-4e05-a042-2a9468fbabf2 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:12:59.355976 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-abda43c6-8498-4a3f-a4f9-f08b14da0afd req-48d0c010-ceaf-4a62-b182-5db366083586 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068516 Jun 18 22:12:59.356638 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1467/2918] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:12:59.369464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:12:59.371894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:12:59.387058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:59.387537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:59.390296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:12:59.392214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:12:59.989085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:12:59.997597 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22c4a420-838a-4d3b-98ab-a3990c8a628c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.639605 Jun 18 22:12:59.998247 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1468/2919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:12:59 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:00.006207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.013325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:00.014288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:00.017197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.022103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.023696 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75bb1f19-9d04-4456-8c77-6475cf3fe0d4 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.731626 Jun 18 22:13:00.024886 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1452/2920] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:12:59 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:00.029988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:00.030688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:00.036285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.037059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.037269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.037843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.038355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.038861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.039278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.039941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.353554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.360351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:00.377974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-44cfff37-ba62-4bb7-b751-6c6f850ab188 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.367474 Jun 18 22:13:00.380352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.389420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1469/2921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:00 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:00.389631 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f0bccc1-3123-44db-83ff-d1a9dbc3a8bd tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.363217 Jun 18 22:13:00.390468 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1453/2922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:00 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:00.396273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5d24a8d-7c8b-4ca5-842b-4a47e5bfd2f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1423b430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:00.405964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:00.422974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:00.453425 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5d24a8d-7c8b-4ca5-842b-4a47e5bfd2f8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.060504 Jun 18 22:13:00.454180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1454/2923] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:00 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:00.461732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.462188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.462973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.463496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.465286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:00.466197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:00.474620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.475415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.476276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:00.476815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:00.829458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.853932 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-373718f2-c025-44c4-aa3f-066d4a3d6b0c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.456447 Jun 18 22:13:00.855311 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1470/2924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:00 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:00.908309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.928408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.930322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:00.931668 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0af606e9-ba8c-4473-a9c4-87b5e8fe444f tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2930 microversion: 2.32 time: 0.476454 Jun 18 22:13:00.932320 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1455/2925] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:00 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2930 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:01.018421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:01.019372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:01.030367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.030971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.031870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.032565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.042670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:01.043856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:01.058009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.058569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.059437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.059981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.498486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:01.518933 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7718609a-faa2-4b0d-9dab-46ada26aaad6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.504226 Jun 18 22:13:01.526128 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1471/2926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:01 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:01.532588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:01.546295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:01.558739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:01.571288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.574155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.578573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.579158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.584851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:01.595882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:01.598847 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-495b11b1-853a-45e1-82c3-9b16a42bf901 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.560353 Jun 18 22:13:01.599444 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1456/2927] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:01 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:01.617318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:01.619870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:01.634526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.634749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:01.635447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:01.637915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.032791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:02.041238 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b81e31d7-c55c-4626-8e1c-d668625444dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.513377 Jun 18 22:13:02.045596 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1472/2928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:01 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:02.050910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "76c427aa-55d9-476e-888c-c83eaf8976e0"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "f8b3e4e4-8c18-4595-9154-6af81f221d72"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "a7f7354f-e621-46bf-8827-3e2bff0d2ff4"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "5d49787b-1805-487b-be9d-36fcc5e21b70"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:02.059792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:02.069185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a80c6a6b-30e7-4871-982f-f8c077e59ce2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.467086 Jun 18 22:13:02.072211 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1457/2929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:01 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:02.082687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-79316974-7eae-4b3b-9fcd-1ce0acfba3d7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea149983a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:02.089760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.091023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.112024 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Creating event network-vif-unplugged:76c427aa-55d9-476e-888c-c83eaf8976e0 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:02.113547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Creating event network-vif-unplugged:f8b3e4e4-8c18-4595-9154-6af81f221d72 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:02.115325 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Creating event network-vif-unplugged:a7f7354f-e621-46bf-8827-3e2bff0d2ff4 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:02.116224 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] Creating event network-vif-unplugged:5d49787b-1805-487b-be9d-36fcc5e21b70 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:02.126313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4e96ed5c-7423-484e-926a-3b463ce278c7 req-e1cc08d7-29a4-4bcf-80e4-0bf9badc1864 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.077945 Jun 18 22:13:02.127986 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1473/2930] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:02.137056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:02.138506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:02.149254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.150300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.151315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.151910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.184263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-79316974-7eae-4b3b-9fcd-1ce0acfba3d7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.105525 Jun 18 22:13:02.188875 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1458/2931] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:02 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:02.202512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:02.203229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:02.217594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.218406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.219280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.219791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.536235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:02.547216 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08c4a446-b137-49ab-b83f-d2c99461c6ca tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1543 microversion: 2.1 time: 0.417573 Jun 18 22:13:02.548667 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1474/2932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:02 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1543 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:02.559286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:02.560264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:02.571372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.572546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.573765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.574378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.575085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:02.610146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:02.615347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:02.616703 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7cdfa03d-ba32-4b26-942d-636705e743a9 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2909 microversion: 2.32 time: 0.426238 Jun 18 22:13:02.617328 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1459/2933] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:02 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2909 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:02.627332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:02.627964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:02.634951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.635672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:02.636654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:02.637127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.339264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:03.359978 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ebaec934-2d74-4bda-9a9a-9537d844bf87 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.809857 Jun 18 22:13:03.362896 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1475/2934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:02 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:03.371427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:03.374317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:03.392779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.393702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.395067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.396330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.433563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:03.450138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:03.453416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:03.454886 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-902225eb-9567-470a-afbe-d9b505a2a394 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.836598 Jun 18 22:13:03.471228 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1460/2935] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:02 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:03.479674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:03.480602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:03.492148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.493535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.494846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.495470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.768355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:03.777303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:03.781091 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f7c7c7af-823f-4bf2-87c1-eee7aca036f8 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.415245 Jun 18 22:13:03.782033 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1476/2936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:03 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:03.786855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3fc44a33-f819-4ad0-8e90-f50d6c97b903 req-101ea682-b51b-4e52-a51e-9ed409f1aaca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-deleted", "tag": "6a0a73d3-2b87-4e05-a042-2a9468fbabf2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:03.796887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d7ed394-8da4-432a-b8bd-6faf6ee667c0 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.323989 Jun 18 22:13:03.800357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3fc44a33-f819-4ad0-8e90-f50d6c97b903 req-101ea682-b51b-4e52-a51e-9ed409f1aaca service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.801421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3fc44a33-f819-4ad0-8e90-f50d6c97b903 req-101ea682-b51b-4e52-a51e-9ed409f1aaca service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.804127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1461/2937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:03 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:03.811389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7218ffbf-406a-4efa-be99-84e6705082df tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea143e5280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:03.819758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3fc44a33-f819-4ad0-8e90-f50d6c97b903 req-101ea682-b51b-4e52-a51e-9ed409f1aaca service nova] Creating event network-vif-deleted:6a0a73d3-2b87-4e05-a042-2a9468fbabf2 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:03.845175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3fc44a33-f819-4ad0-8e90-f50d6c97b903 req-101ea682-b51b-4e52-a51e-9ed409f1aaca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043184 Jun 18 22:13:03.848361 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1477/2938] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:03.861877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:03.862846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:03.880859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.881517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.883185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:03.883768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:03.888692 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7218ffbf-406a-4efa-be99-84e6705082df tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.083267 Jun 18 22:13:03.889679 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1462/2939] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:03 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:04.219174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:04.221884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:04.236497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.237852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:04.238956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.241590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:04.267335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:04.277744 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08bf9d94-83c5-4974-9e6c-2c7d2db79a7e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1542 microversion: 2.1 time: 0.427156 Jun 18 22:13:04.279197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1478/2940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:03 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1542 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:04.291651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9a7c894f-eb02-4abd-bab3-d04716b04c86 req-0d69a616-7d4e-4042-ac01-cf36ea2de5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "name": "network-vif-plugged", "status": "completed", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-unplugged", "status": "completed", "tag": "62d82a0f-55bf-4aaa-a72b-0128a6ac91ad"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:04.316157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9a7c894f-eb02-4abd-bab3-d04716b04c86 req-0d69a616-7d4e-4042-ac01-cf36ea2de5dc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.316597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9a7c894f-eb02-4abd-bab3-d04716b04c86 req-0d69a616-7d4e-4042-ac01-cf36ea2de5dc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:04.347033 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9a7c894f-eb02-4abd-bab3-d04716b04c86 req-0d69a616-7d4e-4042-ac01-cf36ea2de5dc service nova] Creating event network-vif-plugged:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:13:04.347635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9a7c894f-eb02-4abd-bab3-d04716b04c86 req-0d69a616-7d4e-4042-ac01-cf36ea2de5dc service nova] Creating event network-vif-unplugged:62d82a0f-55bf-4aaa-a72b-0128a6ac91ad for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:04.357981 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9a7c894f-eb02-4abd-bab3-d04716b04c86 req-0d69a616-7d4e-4042-ac01-cf36ea2de5dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.074051 Jun 18 22:13:04.359239 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1479/2941] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:04.446406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39b802c0-5c1f-4d2e-8a85-8ef8cabd0f0a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Action: 'create', calling method: .version_select at 0x7fea077ff820>, body: {"keypair": {"name": "tempest-keypair-409594677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgWDe1wiciW4uIwTsKCQ4M6t1mh1oqWDRI6YZzJBd/5gMGCDPJpdwf1LmBIo010JbEC5blKOWZU/5lc/FilBDkSvbxYo1b4Ued8NTS8G+pcZZf6TG9jc7UPfuQH7biBXg=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:04.485133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-39b802c0-5c1f-4d2e-8a85-8ef8cabd0f0a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Getting quotas for project f4f6c403962a44408ce491f377e5ab11. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:04.492962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-39b802c0-5c1f-4d2e-8a85-8ef8cabd0f0a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Getting quotas for user 2a7f3b25d8234bf881b76473dbfd8fc7 and project f4f6c403962a44408ce491f377e5ab11. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:04.503822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:04.512993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:04.530747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:04.530944 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39b802c0-5c1f-4d2e-8a85-8ef8cabd0f0a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.169954 Jun 18 22:13:04.531899 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1480/2942] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:13:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:04.540314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:04.542493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:04.544425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:04.549929 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-159fb6bd-1925-4dd6-8f6b-1dd04043d7c3 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2704 microversion: 2.32 time: 0.656262 Jun 18 22:13:04.553211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.558802 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1463/2943] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:03 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2704 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:04.559034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:04.564951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.567965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:04.577218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:04.577991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:04.602326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.604709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:04.607514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:04.608691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:05.126995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:05.128748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:05.141314 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66d3dad8-1008-4016-8e62-a7b032c28034 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.608015 Jun 18 22:13:05.152242 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1481/2944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:04 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:05.154205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:05.164479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:05.165147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:05.166253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:05.166473 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-66e10c4d-72e3-4f1c-9cba-df024e0521f8 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.609985 Jun 18 22:13:05.170441 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1464/2945] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:04 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:05.198489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:05.202619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:05.203770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:05.205497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:05.207330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:05.212570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:05.228064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:05.228495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:05.234885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:05.235662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.139463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:06.155102 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ab19c53-c12e-4c0b-b804-4fbcf9910f31 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.994415 Jun 18 22:13:06.157971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:06.169403 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1482/2946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:05 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:06.174799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f467a9a-c7bc-423d-a147-ac238a455f55 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078e55e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:06.178624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2fab97c-19c8-4153-a249-78ce06e5542f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.998208 Jun 18 22:13:06.203907 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1465/2947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:05 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:06.243413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:06.249306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:06.279314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.279944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.280783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.284048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.321824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4f467a9a-c7bc-423d-a147-ac238a455f55 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.147424 Jun 18 22:13:06.327194 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1483/2948] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:06 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:06.356354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:06.360358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:06.381520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.381975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.391228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.391689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.891846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:06.903680 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38f25644-5cd6-4021-b6d0-2292e8b1c6b6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1542 microversion: 2.1 time: 0.693235 Jun 18 22:13:06.907056 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1466/2949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:06 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1542 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:06.919366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-44a9759e-5394-4b39-b03a-8f065f8b7b33 req-127df6a2-5d28-441b-baf5-3adc93a7df88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-deleted", "tag": "5d49787b-1805-487b-be9d-36fcc5e21b70"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:06.942054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-44a9759e-5394-4b39-b03a-8f065f8b7b33 req-127df6a2-5d28-441b-baf5-3adc93a7df88 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.942821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-44a9759e-5394-4b39-b03a-8f065f8b7b33 req-127df6a2-5d28-441b-baf5-3adc93a7df88 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.943416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:06.958372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:06.966562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:06.968038 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-74eea56a-f7fb-4f7c-bb80-4191d938f97b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2658 microversion: 2.32 time: 0.636827 Jun 18 22:13:06.973456 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1484/2950] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:06 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2658 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:06.982023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:06.982826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:06.991244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.993564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.995869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:06.996596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:06.997498 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-44a9759e-5394-4b39-b03a-8f065f8b7b33 req-127df6a2-5d28-441b-baf5-3adc93a7df88 service nova] Creating event network-vif-deleted:5d49787b-1805-487b-be9d-36fcc5e21b70 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:07.012556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-44a9759e-5394-4b39-b03a-8f065f8b7b33 req-127df6a2-5d28-441b-baf5-3adc93a7df88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103848 Jun 18 22:13:07.013322 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1467/2951] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:07.018741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:07.019469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:07.057579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.058047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.058862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.059611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.346342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:07.359443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3698973a-b589-4c7a-be30-a22a3b7dfe8f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1502 microversion: 2.1 time: 0.383668 Jun 18 22:13:07.362477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1485/2952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:06 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1502 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:07.370469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-bfb83f9d-9722-400d-a98a-9b10c8a4a03d req-e6fb4f8c-829f-4ba6-b86f-2a649a6b60df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "name": "network-vif-unplugged", "status": "completed", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:07.394558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bfb83f9d-9722-400d-a98a-9b10c8a4a03d req-e6fb4f8c-829f-4ba6-b86f-2a649a6b60df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.395001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:07.397528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bfb83f9d-9722-400d-a98a-9b10c8a4a03d req-e6fb4f8c-829f-4ba6-b86f-2a649a6b60df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.405698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:07.407804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:07.409584 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dae12ca8-e2fa-4a30-aa66-015ead2204e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.395143 Jun 18 22:13:07.410341 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1468/2953] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:07 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:07.415418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:07.416375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:07.423139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.423841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.424862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.425495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.426579 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-bfb83f9d-9722-400d-a98a-9b10c8a4a03d req-e6fb4f8c-829f-4ba6-b86f-2a649a6b60df service nova] Creating event network-vif-unplugged:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:13:07.441321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-bfb83f9d-9722-400d-a98a-9b10c8a4a03d req-e6fb4f8c-829f-4ba6-b86f-2a649a6b60df service nova] Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:13:07.464322 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-bfb83f9d-9722-400d-a98a-9b10c8a4a03d req-e6fb4f8c-829f-4ba6-b86f-2a649a6b60df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097473 Jun 18 22:13:07.466919 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1486/2954] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:07.473264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:07.476361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:07.485975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.486673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.487999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.488601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.821945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:07.827192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:07.835497 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec0cbcc6-2c6e-41e9-91a1-4df91cdac92b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.366797 Jun 18 22:13:07.836783 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1487/2955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:07 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:07.838648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1782acb-87d3-40ec-acb4-e3f8ff0f6f8c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.427018 Jun 18 22:13:07.839714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1469/2956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:07 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:07.844989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:07.846625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:07.854802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.855645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.856792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.857584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.858024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-23230a54-1c2d-445a-825d-ec3e58831ee4 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078a7280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:07.889744 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Cannot 'attach_volume' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state rescued Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/os-volume_attachments HTTP/1.1 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 74 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: {"volumeAttachment": {"volumeId": "c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8"}} Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'attach_volume' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state rescued Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': 'c421b265-a2ca-42cf-8eed-603f694967a1', 'body': {'volumeAttachment': {'volumeId': 'c8b0b02a-22f1-4cb1-a2a5-c68dbe22a9d8'}}} Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c421b265-a2ca-42cf-8eed-603f694967a1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 18 22:13:07.891570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state rescued Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state rescued Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 409 to user: Cannot 'attach_volume' instance c421b265-a2ca-42cf-8eed-603f694967a1 while it is in vm_state rescued {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:07.896242 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-33ae0c3d-4035-42f3-89d9-a2f3f94879af tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052161 Jun 18 22:13:07.898183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1470/2957] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:13:07 2022] POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:13:07.903416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:07.903984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:07.911522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.912034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.912833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.913315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.959364 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-23230a54-1c2d-445a-825d-ec3e58831ee4 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.121110 Jun 18 22:13:07.960194 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1488/2958] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:07 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:07.973121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:07.977827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:07.996702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.997698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:07.998815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:07.999706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:08.010550 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d42879ac-42ad-4008-a283-37949690236d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action" status: 202 len: 0 microversion: 2.1 time: 0.108540 Jun 18 22:13:08.013258 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1471/2959] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:07 2022] POST /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:08.028213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:08.029388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:08.049169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:08.050891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:08.053151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:08.053761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:08.680811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:08.686116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:08.698998 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60394635-ebf7-48e4-9ef5-f80bf926e102 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1474 microversion: 2.1 time: 0.737694 Jun 18 22:13:08.701430 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1489/2960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:07 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1474 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:08.706568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:08.715288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:08.720411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:08.723285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:08.727630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f73bd833-d543-470c-b5ce-021d6295499c tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2544 microversion: 2.32 time: 0.707759 Jun 18 22:13:08.736691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:08.737647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:08.738673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:08.739722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:08.745578 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1472/2961] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:08 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2544 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:08.760878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:08.761559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:08.808565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:08.809264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:08.811613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:08.812443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:09.538126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:09.554194 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed44c976-1b57-4fad-9082-d5bf51723157 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1510 microversion: 2.1 time: 0.848306 Jun 18 22:13:09.555798 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1490/2962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:08 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1510 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:09.568515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:09.584884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:09.586272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:09.587968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:09.592106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:09.604950 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-395f9145-a104-4cc3-be4c-77ba72be584b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.858087 Jun 18 22:13:09.608468 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1473/2963] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:08 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:09.616050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:09.617540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:09.619804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:09.620919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:09.622527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:09.625184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:09.651434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:09.655078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:09.658355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:09.658817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.127485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:10.157618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95b30317-b0ed-419c-bbd9-5831ece064da tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.547405 Jun 18 22:13:10.173409 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1474/2964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:09 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:10.186328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc86da5a-25e7-4621-b63f-5543a3689512 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19cbfca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:10.284375 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc86da5a-25e7-4621-b63f-5543a3689512 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.109217 Jun 18 22:13:10.285163 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1475/2965] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:10 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:10.306014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-47538fed-7e8b-4837-b461-38982e7b104d req-cfc229c0-9ef7-4942-93c0-ae8e6a19a64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-deleted", "tag": "76c427aa-55d9-476e-888c-c83eaf8976e0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:10.314058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:10.318505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:10.321977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-47538fed-7e8b-4837-b461-38982e7b104d req-cfc229c0-9ef7-4942-93c0-ae8e6a19a64c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.329177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-47538fed-7e8b-4837-b461-38982e7b104d req-cfc229c0-9ef7-4942-93c0-ae8e6a19a64c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.330600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9992041-c4ae-4ccc-b9ed-28c3cdf1a04e tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.773500 Jun 18 22:13:10.335420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1491/2966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:09 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:10.345936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-47538fed-7e8b-4837-b461-38982e7b104d req-cfc229c0-9ef7-4942-93c0-ae8e6a19a64c service nova] Creating event network-vif-deleted:76c427aa-55d9-476e-888c-c83eaf8976e0 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:10.362025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ff2fef6d-3502-4747-9a96-c53d58e73c91 req-7ba84245-08bc-4b26-b12b-45d1ca4416a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e0fe1a-5120-4953-8610-19c8bb8dab59", "name": "network-vif-plugged", "status": "completed", "tag": "e067ed6e-b170-4963-97d6-d82c9599c977"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:10.367135 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-47538fed-7e8b-4837-b461-38982e7b104d req-cfc229c0-9ef7-4942-93c0-ae8e6a19a64c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080462 Jun 18 22:13:10.371760 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1476/2967] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:10.389539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:10.391726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:10.404022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.405616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.406318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff2fef6d-3502-4747-9a96-c53d58e73c91 req-7ba84245-08bc-4b26-b12b-45d1ca4416a5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.406770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff2fef6d-3502-4747-9a96-c53d58e73c91 req-7ba84245-08bc-4b26-b12b-45d1ca4416a5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.412846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.413580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.436618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ff2fef6d-3502-4747-9a96-c53d58e73c91 req-7ba84245-08bc-4b26-b12b-45d1ca4416a5 service nova] Creating event network-vif-plugged:e067ed6e-b170-4963-97d6-d82c9599c977 for instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 on nch2-master-1 Jun 18 22:13:10.457664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ff2fef6d-3502-4747-9a96-c53d58e73c91 req-7ba84245-08bc-4b26-b12b-45d1ca4416a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107780 Jun 18 22:13:10.460535 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1492/2968] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:10.475027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:10.476660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:10.493936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.495284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.496241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.499674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.883324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:10.891709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97bd6ed3-ae8a-463c-9d86-8f60beaaf94c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1471 microversion: 2.1 time: 0.513550 Jun 18 22:13:10.896732 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1477/2969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:10 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:10.903118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:10.904058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:10.916216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:10.928795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:10.934129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.934129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.934129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.934129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.938349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:10.939858 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6ad79321-dd74-402d-8c0f-c56d5e7fcac4 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 2212 microversion: 2.32 time: 0.477707 Jun 18 22:13:10.942156 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1493/2970] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:10 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 2212 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:10.955141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:10.955814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:10.967878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.968334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:10.969142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:10.969583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.459516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:11.468610 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-877de13e-be24-4598-9e3e-37105ad90caf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1510 microversion: 2.1 time: 0.570489 Jun 18 22:13:11.473474 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1478/2971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:10 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:11.480271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:11.486768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:11.496885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.497645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.498595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.499196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.556264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:11.559073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.560168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.561307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.561987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.574384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:11.576018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:11.590573 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-648d285b-ce3a-468d-99f6-6a38e00306ac tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.647297 Jun 18 22:13:11.593011 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1494/2972] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:10 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:11.596189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for project ac774f9b327041a887378bd2725853c6. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:11.602011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for user 0e8a394c0a284416ac893321bd860e51 and project ac774f9b327041a887378bd2725853c6. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:11.603482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:11.604100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:11.624680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.638483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.639451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.639903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.779123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:11.848035 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f452a4a8-9091-4003-bb8e-da4c101ef467 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a/action" status: 202 len: 0 microversion: 2.1 time: 0.372923 Jun 18 22:13:11.855674 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1479/2973] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:11 2022] POST /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:11.871257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6577f830-4d49-405f-b08c-7fa69839dd79 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14c1d5e0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:11.949797 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6577f830-4d49-405f-b08c-7fa69839dd79 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.092703 Jun 18 22:13:11.952250 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1480/2974] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:11 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:11.956684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:11.960930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a36d1d62-e256-4519-bea4-83088bc0dcb7"}], "security_groups": [{"name": "tempest-securitygroup--1812735032"}], "key_name": "tempest-keypair-409594677", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:11.971444 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f42d408f-f08d-4317-9dc2-e8559cc5c8bf tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1370 microversion: 2.1 time: 0.377120 Jun 18 22:13:11.975616 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1495/2975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:11 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:11.982642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:11.983776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:11.993180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.994212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:11.996346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:11.997478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:12.427198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] validate_networks() for [('a36d1d62-e256-4519-bea4-83088bc0dcb7', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:13:12.949998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:12.966167 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-043c0a77-fda9-4ddc-bd94-fe4422b41508 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.988779 Jun 18 22:13:12.966778 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1496/2976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:11 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:12.971577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:12.975943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:12.993439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:12.994362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:12.995313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:12.995895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.263840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:13.276094 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7184f692-8adf-441a-b439-7d7e340dc6c4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1470 microversion: 2.1 time: 0.306222 Jun 18 22:13:13.280649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1497/2977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:12 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:13.294996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:13.296067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:13.306356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.307845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.308800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.309547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.446437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b0598fbccf348148fda392a40bf0078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '637c113ab85b43cb815b1e6e2d868a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b7a6d481-af07-4a51-bf4d-5913641cc60e tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 200 len: 1605 microversion: 2.32 time: 0.193806 Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1498/2978] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:13 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 1605 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:13.501291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.505278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.506327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.506779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.871565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:13.882477 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-53b776bc-453c-4ccb-8286-df6f45469842 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1516 microversion: 2.1 time: 0.402582 Jun 18 22:13:13.883281 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1499/2979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:13 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1516 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:13.884201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:13:13.884708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:13:13.886891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:13:13.887565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:13:13.888165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:13:13.889385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:13.890672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:13.916045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.916709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.917742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.918956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.939419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.944769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Getting quotas for project f4f6c403962a44408ce491f377e5ab11. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:13.944998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.948740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:13.949348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:13.952818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Getting quotas for user 2a7f3b25d8234bf881b76473dbfd8fc7 and project f4f6c403962a44408ce491f377e5ab11. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:13.957484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:13.972709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:13:13.977779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:13:14.041501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f6cecba-87a0-4784-80e0-c6e65cc13c10 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.088055 Jun 18 22:13:14.048211 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1481/2980] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:13:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:13:14.054721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-08e29b04-c649-489d-ba36-0613c4321748 req-47eb0324-d16e-47b0-b193-bcdd047691a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-deleted", "tag": "f8b3e4e4-8c18-4595-9154-6af81f221d72"}, {"server_uuid": "d9abc8c2-cd3c-4214-95eb-dc962474d49e", "name": "network-vif-deleted", "tag": "62d82a0f-55bf-4aaa-a72b-0128a6ac91ad"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:14.066801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-08e29b04-c649-489d-ba36-0613c4321748 req-47eb0324-d16e-47b0-b193-bcdd047691a4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:14.067487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-08e29b04-c649-489d-ba36-0613c4321748 req-47eb0324-d16e-47b0-b193-bcdd047691a4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:14.081334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-08e29b04-c649-489d-ba36-0613c4321748 req-47eb0324-d16e-47b0-b193-bcdd047691a4 service nova] Creating event network-vif-deleted:f8b3e4e4-8c18-4595-9154-6af81f221d72 for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:14.082959 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-08e29b04-c649-489d-ba36-0613c4321748 req-47eb0324-d16e-47b0-b193-bcdd047691a4 service nova] Creating event network-vif-deleted:62d82a0f-55bf-4aaa-a72b-0128a6ac91ad for instance d9abc8c2-cd3c-4214-95eb-dc962474d49e on nch2-master-1 Jun 18 22:13:14.089807 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-08e29b04-c649-489d-ba36-0613c4321748 req-47eb0324-d16e-47b0-b193-bcdd047691a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039776 Jun 18 22:13:14.095229 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1482/2981] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:14.101566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e3706d1-6868-420e-94a3-9b1db872e6b3 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19cbf940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:14.160099 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e3706d1-6868-420e-94a3-9b1db872e6b3 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.063280 Jun 18 22:13:14.160994 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1483/2982] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:14 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:14.167418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:14.168405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:14.175917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:14.176688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:14.177815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:14.178612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:14.501507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:14.646548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:14.657396 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf0d4af5-a685-4f35-ba0b-b9690440ea0e tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1555 microversion: 2.1 time: 0.494997 Jun 18 22:13:14.658305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1484/2983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:14 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1555 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:14.675512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-38905630-2629-4203-906b-e2688b456532 req-9ebab4cf-49a2-4f8b-91ee-2c687bd25852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "name": "network-vif-plugged", "status": "completed", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:14.688516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38905630-2629-4203-906b-e2688b456532 req-9ebab4cf-49a2-4f8b-91ee-2c687bd25852 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:14.689102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38905630-2629-4203-906b-e2688b456532 req-9ebab4cf-49a2-4f8b-91ee-2c687bd25852 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:14.702360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:14.722506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:14.728934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-38905630-2629-4203-906b-e2688b456532 req-9ebab4cf-49a2-4f8b-91ee-2c687bd25852 service nova] Creating event network-vif-plugged:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:13:14.729169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:14.734324 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-808dd626-3163-4ff6-809b-3d2028e95f3d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.848852 Jun 18 22:13:14.736863 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1500/2984] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:13 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:14.746482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-38905630-2629-4203-906b-e2688b456532 req-9ebab4cf-49a2-4f8b-91ee-2c687bd25852 service nova] Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:13:14.750013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:14.751552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:14.753920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-38905630-2629-4203-906b-e2688b456532 req-9ebab4cf-49a2-4f8b-91ee-2c687bd25852 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089998 Jun 18 22:13:14.761724 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1485/2985] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:14.768498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e2c26471-bbfc-462e-8bfd-8c80d3ada8c3 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:14.769204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:14.769733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e2c26471-bbfc-462e-8bfd-8c80d3ada8c3 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:14.772869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:14.775761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:14.777741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:14.951464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e2c26471-bbfc-462e-8bfd-8c80d3ada8c3 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:14.960878 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e2c26471-bbfc-462e-8bfd-8c80d3ada8c3 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1225 microversion: 2.1 time: 0.197709 Jun 18 22:13:14.963425 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1486/2986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:14 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1225 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:14.976561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:14.980654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:15.019594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.023507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.024733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.027447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.178136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:15.195159 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc0cee31-976a-4259-b2b8-08f723fff17f tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.455549 Jun 18 22:13:15.207259 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1501/2987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:14 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:15.232550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:15.233354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:15.243014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.243462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.244250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.244740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.264083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:15.273414 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52ff7860-8e6e-458c-9676-55fb2e66b1e5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1470 microversion: 2.1 time: 0.307471 Jun 18 22:13:15.275134 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1487/2988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:14 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:15.276587 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] HTTP exception thrown: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Request method failure captured: Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e HTTP/1.1 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyyjbupwKWmxHOonbMW3xRmSCoDJkCsf9_eEpLGrf_PX6FH0Uo5qUJvt17Rpw1kNaBFaMaec77aBlE2fFZLVfvAq45iaNu0GNO4Es9yF2sPMmt52WBdZF5mhNs25SZVcLj9jhZsEHj268I2hdxKu1-LUjCEGuqppzQka3P_FVc9WeE Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.32 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 637c113ab85b43cb815b1e6e2d868a29 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_637c113ab85b43cb815b1e6e2d868a29", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 637c113ab85b43cb815b1e6e2d868a29 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TaggedBootDevicesTest-1883771144-project Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1b0598fbccf348148fda392a40bf0078 Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TaggedBootDevicesTest-1883771144-project Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd9abc8c2-cd3c-4214-95eb-dc962474d49e'} Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:15.278624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Returning 404 to user: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:15.283982 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62c5bf89-ef8a-4abe-b19f-d243c3507cf7 tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 404 len: 111 microversion: 2.32 time: 0.070298 Jun 18 22:13:15.284666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1502/2989] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:15 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:13:15.289788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2faeb1ca-5c4a-4db0-83fe-c92373b170ea tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea077ff3a0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:15.291192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:15.291908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:15.300137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.300947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.302368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.302999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.370891 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2faeb1ca-5c4a-4db0-83fe-c92373b170ea tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.085192 Jun 18 22:13:15.371488 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1503/2990] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:15 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:15.377384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34ef0c8c-cf13-4d06-9759-05554645cb3b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '.version_select at 0x7fea1404e040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:15.401547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34ef0c8c-cf13-4d06-9759-05554645cb3b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951429247" status: 204 len: 0 microversion: 2.32 time: 0.027931 Jun 18 22:13:15.402898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1504/2991] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951429247 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:13:15.437213 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3cf6999d-134f-4b6a-bc8a-31de2f6459a0 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160446 Jun 18 22:13:15.438639 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1488/2992] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:13:15 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:15.712023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d6ed943-0747-4f69-8612-f2431d368428 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'create', calling method: .version_select at 0x7fea0780de50>, body: {"keypair": {"name": "tempest-keypair-1030554409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPe9KJGMoXPSKhwrw00b48ajKSmf5H+DEKvCqMCLJivU5XZSZKsNAZ0cHhLJ4lyh3UTK9latGZno+7apFiR9QVp84NfqCRviUGR3Yx/vlncZX3EvCJ8eO9cYp2Q59JPa0A=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:15.734416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-5d6ed943-0747-4f69-8612-f2431d368428 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:15.740465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-5d6ed943-0747-4f69-8612-f2431d368428 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for user 65fa96c0dcf948d185e7d5fdcf280fa4 and project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:15.754303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:15.755309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:15.768608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.773237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.774387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.775066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:15.797786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5d6ed943-0747-4f69-8612-f2431d368428 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090225 Jun 18 22:13:15.798957 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1505/2993] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:13:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:15.981429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:15.982443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:15.997483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:15.999763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:16.002345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:16.003486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:16.197799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:16.217781 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fc17bdc3-9711-40ff-a625-ed2a11f2644a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1277 microversion: 2.1 time: 0.230588 Jun 18 22:13:16.217781 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1506/2994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:15 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:16.218347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:16.234133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:16.237905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:16.242277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:16.243132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:16.244007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:16.244578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:16.301024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:16.328640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:16.336131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:16.338084 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b2511cc1-1bad-4f09-8126-5abb539e0989 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.587710 Jun 18 22:13:16.339311 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1489/2995] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:15 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:13:16.346133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:16.347069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:16.355441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:16.356529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:16.358536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:16.359405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:16.959513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:16.976906 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc43c752-31d2-4144-af8a-2641f6fd5ce1 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.762242 Jun 18 22:13:16.989320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:17.003098 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9c85e53d-c60e-42b1-8f83-02fab19775da tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1470 microversion: 2.1 time: 0.662160 Jun 18 22:13:17.006782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1507/2996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:16 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:17.017970 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1490/2997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:16 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1470 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:17.019782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83a421cf-d1dd-4f2d-8271-c8620fe74362 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0780d670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:17.104141 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83a421cf-d1dd-4f2d-8271-c8620fe74362 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.094195 Jun 18 22:13:17.109880 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1508/2998] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:17 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:17.229560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:17.230518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:17.258406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:17.267809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:17.274633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:17.275298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:17.358860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:17.361279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:17.374564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:17.376504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:17.380233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:17.380955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:17.856894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:17.875551 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de3a713e-3ac3-4c45-abaf-bd2c8e3caeb6 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1283 microversion: 2.1 time: 0.651965 Jun 18 22:13:17.876269 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1491/2999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:17 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1283 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:17.881582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4ee2e384-9014-4d3d-912f-f2ca28b1e5bc req-c4186b1d-26ea-4182-853e-196e1c4f7796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "a3aec98b-5ee4-4848-9035-2ba72eaa628a"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:17.902037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4ee2e384-9014-4d3d-912f-f2ca28b1e5bc req-c4186b1d-26ea-4182-853e-196e1c4f7796 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:17.902783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4ee2e384-9014-4d3d-912f-f2ca28b1e5bc req-c4186b1d-26ea-4182-853e-196e1c4f7796 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:17.933082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4ee2e384-9014-4d3d-912f-f2ca28b1e5bc req-c4186b1d-26ea-4182-853e-196e1c4f7796 service nova] Creating event network-vif-plugged:a3aec98b-5ee4-4848-9035-2ba72eaa628a for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:17.947997 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4ee2e384-9014-4d3d-912f-f2ca28b1e5bc req-c4186b1d-26ea-4182-853e-196e1c4f7796 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070046 Jun 18 22:13:17.949333 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1492/3000] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:17.995471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:17.996593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:18.012643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:18.013516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:18.014612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:18.015305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:18.887730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:18.897454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-595cc461-2ed0-43c0-9c3e-ed5253bade02 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.906094 Jun 18 22:13:18.901852 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1493/3001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:17 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:18.916222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:18.917227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:18.930602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:18.944405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:18.946500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:18.947713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:18.948828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:18.950885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:18.951962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:18.956599 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75696955-1abc-440c-b8b7-b2dbd0e7ec2d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 1.602656 Jun 18 22:13:18.969718 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1509/3002] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:17 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:13:18.979524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd3c2919-0f1a-4542-b3ca-5570448bca9c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0780da60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:19.068433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd3c2919-0f1a-4542-b3ca-5570448bca9c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.097265 Jun 18 22:13:19.069382 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1510/3003] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:18 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:19.074592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:19.075470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:19.083370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:19.084093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:19.085086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:19.085686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:19.235201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:19.245181 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4cba763e-f76a-4d2b-9e10-b81bce0f53eb tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1283 microversion: 2.1 time: 0.174525 Jun 18 22:13:19.249843 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1511/3004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:19 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1283 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:19.442243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:19.454054 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c7e7f63-23a7-4024-ba8f-2f0da4682e7d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1536 microversion: 2.1 time: 0.545388 Jun 18 22:13:19.455287 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1494/3005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:18 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1536 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:19.922683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:19.923533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:19.937519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:19.939683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:19.940574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:19.948179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.011321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7af13cc3-8541-431e-a159-21ad3be459b1 req-02e6c62c-c8a3-4937-885c-884fcc6fdab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e0fe1a-5120-4953-8610-19c8bb8dab59", "tag": "e067ed6e-b170-4963-97d6-d82c9599c977"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:20.041759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7af13cc3-8541-431e-a159-21ad3be459b1 req-02e6c62c-c8a3-4937-885c-884fcc6fdab5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.042260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7af13cc3-8541-431e-a159-21ad3be459b1 req-02e6c62c-c8a3-4937-885c-884fcc6fdab5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.068913 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7af13cc3-8541-431e-a159-21ad3be459b1 req-02e6c62c-c8a3-4937-885c-884fcc6fdab5 service nova] Creating event network-changed:e067ed6e-b170-4963-97d6-d82c9599c977 for instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 on nch2-master-1 Jun 18 22:13:20.083691 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7af13cc3-8541-431e-a159-21ad3be459b1 req-02e6c62c-c8a3-4937-885c-884fcc6fdab5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193383 Jun 18 22:13:20.086054 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1512/3006] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:20.097243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:20.098211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:20.106032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.106783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.107813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.108458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.536391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:20.545242 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-07f72558-fbcd-4827-8692-e304c26a4440 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.629493 Jun 18 22:13:20.550118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1495/3007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:19 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:20.563136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d99deca0-e66c-423b-8d4e-c642bcdeb993 req-a18f5423-537c-41d8-9087-ea7775ec9a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "f9640cbc-f56e-4a87-9083-cba5d2310a57"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:20.578954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d99deca0-e66c-423b-8d4e-c642bcdeb993 req-a18f5423-537c-41d8-9087-ea7775ec9a98 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.581568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d99deca0-e66c-423b-8d4e-c642bcdeb993 req-a18f5423-537c-41d8-9087-ea7775ec9a98 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.605117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d99deca0-e66c-423b-8d4e-c642bcdeb993 req-a18f5423-537c-41d8-9087-ea7775ec9a98 service nova] Creating event network-vif-plugged:56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:20.609871 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d99deca0-e66c-423b-8d4e-c642bcdeb993 req-a18f5423-537c-41d8-9087-ea7775ec9a98 service nova] Creating event network-vif-plugged:f9640cbc-f56e-4a87-9083-cba5d2310a57 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:20.633201 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d99deca0-e66c-423b-8d4e-c642bcdeb993 req-a18f5423-537c-41d8-9087-ea7775ec9a98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081408 Jun 18 22:13:20.637309 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1496/3008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:20.652484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-119757ef-c547-4868-9d6f-7929104efdb7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19cbf700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:20.743478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:20.766772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:20.774828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:20.776086 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d8253ec9-e40b-468f-b44e-8040dd3f34e6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.688687 Jun 18 22:13:20.777465 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1513/3009] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:20 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:20.782317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:20.785898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:20.800729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.801476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.801721 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-119757ef-c547-4868-9d6f-7929104efdb7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.161935 Jun 18 22:13:20.802725 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1497/3010] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:20 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:20.803771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.810429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.824117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:20.825049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:20.845913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.847650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:20.850688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:20.851420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:21.539731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:21.566073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:21.577782 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f52972a1-b16f-4716-ae6a-1ee295a9b95c tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.798887 Jun 18 22:13:21.578502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc582e40-048e-4265-985f-0f7f41690506 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1536 microversion: 2.1 time: 0.774371 Jun 18 22:13:21.579252 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1498/3011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:20 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1536 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:21.590099 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1514/3012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:20 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:21.592096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:21.593821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:21.603969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:21.604683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:21.605676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:21.606591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:21.794249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:21.795881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:21.803560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:21.825803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:21.827059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:21.829114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:21.874185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:22.555682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:22.569519 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d68e2b1b-9723-4801-99b8-8be1fd1280ba tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.988023 Jun 18 22:13:22.575860 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1499/3013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:21 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:22.581308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c35cc3aa-1909-40d2-a5c4-3d71017a66a2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dcb940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:22.647229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c35cc3aa-1909-40d2-a5c4-3d71017a66a2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.069252 Jun 18 22:13:22.647829 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1500/3014] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:22 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:22.660762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:22.665854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:22.680141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:22.682050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:22.683155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:22.684008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:22.740130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:22.768700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:22.770806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:22.773346 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60122c0a-09c2-4257-b97d-116d44f17672 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.983446 Jun 18 22:13:22.775741 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1515/3015] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:21 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:22.781606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:22.782511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:22.790657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:22.791343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:22.792393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:22.793276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:23.271786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:23.280057 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ccfa32a8-cc2b-4552-ac71-daacd529cf1b tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.631059 Jun 18 22:13:23.284050 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1501/3016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:22 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:23.294597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9eceb003-d2c9-46d4-ada0-0bc8f9f18c84 req-aba97cc7-fbd2-4109-a608-bc2c44153b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "name": "network-vif-unplugged", "status": "completed", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:23.314961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9eceb003-d2c9-46d4-ada0-0bc8f9f18c84 req-aba97cc7-fbd2-4109-a608-bc2c44153b7d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:23.319098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9eceb003-d2c9-46d4-ada0-0bc8f9f18c84 req-aba97cc7-fbd2-4109-a608-bc2c44153b7d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:23.344525 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9eceb003-d2c9-46d4-ada0-0bc8f9f18c84 req-aba97cc7-fbd2-4109-a608-bc2c44153b7d service nova] Creating event network-vif-unplugged:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:13:23.353432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9eceb003-d2c9-46d4-ada0-0bc8f9f18c84 req-aba97cc7-fbd2-4109-a608-bc2c44153b7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067617 Jun 18 22:13:23.361617 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1502/3017] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:23.428438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:23.449596 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-736982f0-d5bc-4fc7-94e2-acd7c7dfdbfd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1529 microversion: 2.1 time: 0.669817 Jun 18 22:13:23.450782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1516/3018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:22 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1529 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:23.467353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:23.468077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:23.479543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:23.480287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:23.481912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:23.484445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:23.591614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:23.592237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:23.602421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:23.602950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:23.604887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:23.605599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:23.937002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=5 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:24.035037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:24.083866 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16f79b13-6fb4-4416-9c09-c21923823fe1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1529 microversion: 2.1 time: 0.614531 Jun 18 22:13:24.087245 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1503/3019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:23 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1529 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:24.113994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a26d799-c8a8-460e-a0b0-d2637f465e5f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dd7e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:24.137230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:24.167147 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f8396a7a-1539-40e4-9c30-ee71ed003bdc tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.579257 Jun 18 22:13:24.171169 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1517/3020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:23 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:24.180008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:24.181975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:24.189913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:24.204949 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a26d799-c8a8-460e-a0b0-d2637f465e5f tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.111372 Jun 18 22:13:24.205945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:24.207011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1504/3021] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:24 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:24.209483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:24.211774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:24.219821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df763c74-cfce-4261-a731-01d7d6ff49e3 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:24.226005 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:13:24.226005 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:13:24.245419 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-df763c74-cfce-4261-a731-01d7d6ff49e3 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] HTTP exception thrown: Flavor 26182349-2d05-45b8-a55e-4e986e371809 could not be found. Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df763c74-cfce-4261-a731-01d7d6ff49e3 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Request method failure captured: Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/flavors/26182349-2d05-45b8-a55e-4e986e371809 HTTP/1.1 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk0prHD6TQUyuUrnLjMbcfdejLmeBGXX0bqmBLpS2y3jEhTZPfpI1tgPwQV2rI_L_yOjpzHTpFCBG7KLXmSHh3ksOS0j-rXlaLmKbkLnUuaQXuQsfDv6NiztYvjOVZtcrMTxRX8_i5WE5oeFrUhnO3nSArg29d67HrPmBXKr-LOh6Ec Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: aa9654b224af4e6d9705c4a622c32a01 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MigrationsAdminTest-174349502 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aa9654b224af4e6d9705c4a622c32a01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9654b224af4e6d9705c4a622c32a01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aa9654b224af4e6d9705c4a622c32a01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aa9654b224af4e6d9705c4a622c32a01", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MigrationsAdminTest-174349502 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: aa9654b224af4e6d9705c4a622c32a01 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MigrationsAdminTest-174349502 Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MigrationsAdminTest-174349502-project-admin Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 7fa98fb81589488fa53a6f07a208b7fa Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MigrationsAdminTest-174349502-project-admin Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: exception: Flavor 26182349-2d05-45b8-a55e-4e986e371809 could not be found. Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '26182349-2d05-45b8-a55e-4e986e371809'} Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 26182349-2d05-45b8-a55e-4e986e371809 could not be found. Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 26182349-2d05-45b8-a55e-4e986e371809 could not be found. Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:24.275701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 26182349-2d05-45b8-a55e-4e986e371809 could not be found. Jun 18 22:13:24.279675 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:24.281920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df763c74-cfce-4261-a731-01d7d6ff49e3 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Returning 404 to user: Flavor 26182349-2d05-45b8-a55e-4e986e371809 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:24.283788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df763c74-cfce-4261-a731-01d7d6ff49e3 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/26182349-2d05-45b8-a55e-4e986e371809" status: 404 len: 109 microversion: 2.1 time: 0.074486 Jun 18 22:13:24.284901 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1505/3022] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:13:24 2022] DELETE /compute/v2.1/flavors/26182349-2d05-45b8-a55e-4e986e371809 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:24.303398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:24.304472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:24.318939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:24.323205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:24.332660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:24.333264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:24.727407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:24.761691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:24.771012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:24.789784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c87bb55-03b2-49fa-b94b-74c045d2a75f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.603249 Jun 18 22:13:24.804610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:24.816415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:24.819424 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1518/3023] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:24 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:24.832676 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7aaf66a7-25ae-400e-8545-00aa27d389de tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.529432 Jun 18 22:13:24.845706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1148359570", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f383b05-8595-491c-b273-dd69bbad8619"}], "security_groups": [{"name": "tempest-securitygroup--1744737306"}], "key_name": "tempest-keypair-1030554409", "user_data": "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:24.845987 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1506/3024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:24 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:24.855962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1298064934", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:24.956809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:25.018113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:13:25.290399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] validate_networks() for [('5f383b05-8595-491c-b273-dd69bbad8619', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:13:25.488957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:13:25.489481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:13:25.489967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:13:25.490480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:13:25.490900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:13:25.500653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.501128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:25.502110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.502557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:25.521858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:25.527538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Getting quotas for user 0e8a394c0a284416ac893321bd860e51 and project ac774f9b327041a887378bd2725853c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:25.560138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:13:25.562551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:13:25.638513 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d34e2bb0-93ad-4580-a85a-720a3ee9354b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790743 Jun 18 22:13:25.639745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1507/3025] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:13:25.679960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:25.684922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:25.695199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.696408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:25.697550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.698616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:25.735901 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] HTTP exception thrown: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Request method failure captured: Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e HTTP/1.1 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirkyyjbupwKWmxHOonbMW3xRmSCoDJkCsf9_eEpLGrf_PX6FH0Uo5qUJvt17Rpw1kNaBFaMaec77aBlE2fFZLVfvAq45iaNu0GNO4Es9yF2sPMmt52WBdZF5mhNs25SZVcLj9jhZsEHj268I2hdxKu1-LUjCEGuqppzQka3P_FVc9WeE Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.32 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 637c113ab85b43cb815b1e6e2d868a29 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_637c113ab85b43cb815b1e6e2d868a29", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 637c113ab85b43cb815b1e6e2d868a29 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TaggedBootDevicesTest-1883771144-project Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 1b0598fbccf348148fda392a40bf0078 Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TaggedBootDevicesTest-1883771144-project Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd9abc8c2-cd3c-4214-95eb-dc962474d49e'} Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:13:25.739090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Returning 404 to user: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-177e3219-ba8e-48e7-828a-6ff04a543d6b tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 404 len: 111 microversion: 2.32 time: 0.073438 Jun 18 22:13:25.743984 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1508/3026] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:13:25 2022] DELETE /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:13:25.754886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9e4aa878-5b31-4d9a-9a8b-b4ff51d7e742 req-34751f44-ffd8-4bec-8b8f-18ac444ca062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93252f6-2582-403c-973f-e17f4a9f03fd", "tag": "a9dd753b-6694-48fe-8e25-b5c2ba258d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:25.765873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:25.769253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9e4aa878-5b31-4d9a-9a8b-b4ff51d7e742 req-34751f44-ffd8-4bec-8b8f-18ac444ca062 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.769727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9e4aa878-5b31-4d9a-9a8b-b4ff51d7e742 req-34751f44-ffd8-4bec-8b8f-18ac444ca062 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:25.795258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9e4aa878-5b31-4d9a-9a8b-b4ff51d7e742 req-34751f44-ffd8-4bec-8b8f-18ac444ca062 service nova] Creating event network-changed:a9dd753b-6694-48fe-8e25-b5c2ba258d2f for instance d93252f6-2582-403c-973f-e17f4a9f03fd on nch2-master-1 Jun 18 22:13:25.810595 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9e4aa878-5b31-4d9a-9a8b-b4ff51d7e742 req-34751f44-ffd8-4bec-8b8f-18ac444ca062 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067000 Jun 18 22:13:25.815639 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1509/3027] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:25.828074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:25.828862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:25.841806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.842266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:25.850805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:25.851290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.161386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:26.176837 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d4fc1a2-794a-47b4-885e-d788a60fe9c2 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1522 microversion: 2.1 time: 0.359464 Jun 18 22:13:26.177818 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1510/3028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:25 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:26.184803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd6380e3-6312-4942-a2b0-30c88e63f8c1 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dd1ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:26.271263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cd6380e3-6312-4942-a2b0-30c88e63f8c1 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1454 microversion: 2.1 time: 0.090970 Jun 18 22:13:26.272549 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1511/3029] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:26 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:26.282920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "efa1b247-18d7-4cf8-beb3-93636b50c24f"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "6f6f5ea1-9aec-43dd-9351-058a6528ebba"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-plugged", "status": "completed", "tag": "e82aea74-0ff1-4853-b959-c6713a07c673"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:26.295407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.296307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.309659 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Creating event network-vif-plugged:efa1b247-18d7-4cf8-beb3-93636b50c24f for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:26.310960 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Creating event network-vif-plugged:6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:26.311445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:13:26.311968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:13:26.312427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:13:26.312844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:13:26.313006 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Creating event network-vif-plugged:6f6f5ea1-9aec-43dd-9351-058a6528ebba for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:26.313556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] Creating event network-vif-plugged:e82aea74-0ff1-4853-b959-c6713a07c673 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:26.314757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:13:26.321459 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-20d83441-5cc4-4345-a3ca-95c1954a0e71 req-59de8fcc-62cf-4008-87c4-696f825da02b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.042195 Jun 18 22:13:26.322565 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1512/3030] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:26.328995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:26.329208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.330166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:26.336066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.337050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.337459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.339275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.340224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.341566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.342302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.381466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:26.387500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Getting quotas for user 65fa96c0dcf948d185e7d5fdcf280fa4 and project a9a765e6391f4d36bd54b8119d4c84eb. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:26.402233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:13:26.405169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:13:26.475616 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b4f63b8-c3cd-4bca-b577-6b7babec35ad tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.654565 Jun 18 22:13:26.476713 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1519/3031] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:13:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:13:26.488730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:26.489309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:26.490320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] [instance: d9abc8c2-cd3c-4214-95eb-dc962474d49e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:26.497640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7cfe1055-1c8e-4ff1-bba3-51ee5e7340f3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1217 microversion: 2.1 time: 0.173444 Jun 18 22:13:26.515944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.516435 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1513/3032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:26 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:26.517184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.520270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.520982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.521762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:26.522396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:26.547467 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] HTTP exception thrown: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Request method failure captured: Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e HTTP/1.1 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirkyyjbupwKWmxHOonbMW3xRmSCoDJkCsf9_eEpLGrf_PX6FH0Uo5qUJvt17Rpw1kNaBFaMaec77aBlE2fFZLVfvAq45iaNu0GNO4Es9yF2sPMmt52WBdZF5mhNs25SZVcLj9jhZsEHj268I2hdxKu1-LUjCEGuqppzQka3P_FVc9WeE Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.32 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 637c113ab85b43cb815b1e6e2d868a29 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/637c113ab85b43cb815b1e6e2d868a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_637c113ab85b43cb815b1e6e2d868a29", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 637c113ab85b43cb815b1e6e2d868a29 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1883771144 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TaggedBootDevicesTest-1883771144-project Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1b0598fbccf348148fda392a40bf0078 Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TaggedBootDevicesTest-1883771144-project Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd9abc8c2-cd3c-4214-95eb-dc962474d49e'} Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:26.550008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. Jun 18 22:13:26.554036 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:26.557226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] Returning 404 to user: Instance d9abc8c2-cd3c-4214-95eb-dc962474d49e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:26.559301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6898ff7-a91c-4744-84f6-a25c994388dc tempest-TaggedBootDevicesTest-1883771144 tempest-TaggedBootDevicesTest-1883771144-project] 10.222.0.30 "GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e" status: 404 len: 111 microversion: 2.32 time: 0.080483 Jun 18 22:13:26.560108 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1520/3033] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:26 2022] GET /compute/v2.1/servers/d9abc8c2-cd3c-4214-95eb-dc962474d49e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:13:26.565405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.565737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.566693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.566940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.567076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:26.567972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:26.575675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.577231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.578480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:26.579143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:26.917964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:26.930616 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f8cba2c8-f372-4582-994f-c2b128ddd6fa tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.368704 Jun 18 22:13:26.940291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1521/3034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:26 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:26.946898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f741f904-4f9f-41fe-b81f-e6bbf6ee57b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:26.952207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f741f904-4f9f-41fe-b81f-e6bbf6ee57b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:27.055980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f741f904-4f9f-41fe-b81f-e6bbf6ee57b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.062847 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f741f904-4f9f-41fe-b81f-e6bbf6ee57b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1246 microversion: 2.1 time: 0.121180 Jun 18 22:13:27.063436 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1522/3035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:26 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:27.081089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.091391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.092994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.094441 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d6c79f2-d11f-46a8-bf69-9a76c27c467f tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1873 microversion: 2.42 time: 0.576854 Jun 18 22:13:27.105975 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1514/3036] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:26 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1873 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:27.193173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:27.194043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:27.200352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.200809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.202087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.202529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.285462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b5ff733-058e-4ace-9466-2e29597ad5fc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19cbf9d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:27.343743 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b5ff733-058e-4ace-9466-2e29597ad5fc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1463 microversion: 2.1 time: 0.062129 Jun 18 22:13:27.344707 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1515/3037] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:27 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1463 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:27.356204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7cc99e36-78d6-4725-8ec3-8452ecc78224 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14526e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:27.379266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.388503 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4a27f541-0576-4fbe-9a24-fffef31819ff tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1502 microversion: 2.1 time: 0.199162 Jun 18 22:13:27.389042 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1523/3038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:27 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:27.405375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a382636f-9f76-4734-a351-311361672c2a tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'create', calling method: .version_select at 0x7fea0784ab80>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2109141430", "description": "tempest-description-397714793"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:27.407487 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7cc99e36-78d6-4725-8ec3-8452ecc78224 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 200 len: 1463 microversion: 2.1 time: 0.055395 Jun 18 22:13:27.408063 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1516/3039] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:27 2022] GET /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 1463 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:27.419362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:27.420025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:27.426978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.427449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.428229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.428673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.696719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.705140 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-809a8deb-5fbd-4715-a840-f99bca437f18 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1481 microversion: 2.1 time: 0.289583 Jun 18 22:13:27.705797 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1517/3040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:27 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1481 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:27.710509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:27.711204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:27.717490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.717976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.718752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.719187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.835519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:27.844312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-28d8b644-ee0c-4a69-b94d-2c9ffc641826 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1265 microversion: 2.1 time: 0.137238 Jun 18 22:13:27.854966 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a382636f-9f76-4734-a351-311361672c2a tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.448699 Jun 18 22:13:27.855584 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1518/3041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:27 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:27.857855 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1524/3042] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:13:27 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:13:27.864716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2109141430"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:27.869809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:27.886344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.887475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.888703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.889334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.947808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:27.948717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:27.958402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.959125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:27.960369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:27.960960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:28.511927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:28.520722 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e9811afe-0b35-4ec8-9098-bb3f96b1d19d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.577812 Jun 18 22:13:28.521721 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1525/3043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:27 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:28.530640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.security_group_api [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Adding security group 399a58a2-82ca-4d54-9ea8-5460bfaab64e to port 745ab995-24dc-4566-b192-a1e4deba6d79 Jun 18 22:13:28.536140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:28.537055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:28.543621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:28.544070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:28.545064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:28.545672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:28.644799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:28.655978 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8771600d-058c-4b32-aef3-a5edce3cecdd tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1298 microversion: 2.1 time: 0.123619 Jun 18 22:13:28.662132 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1526/3044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:28 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:28.670163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:28.672333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:28.684656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:28.685431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:28.686205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:28.686791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.006098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:29.024247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:29.029056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:29.032093 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d39b5142-434f-4172-a339-13f7ba677f60 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2833 microversion: 2.42 time: 0.367874 Jun 18 22:13:29.043015 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1527/3045] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:13:28 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2833 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:29.057560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1d46a009-a12c-4bb9-9efa-c95783925ca1 req-57d945ba-5a2c-4b76-ad7a-34eac9349511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "name": "network-vif-plugged", "status": "completed", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:29.084646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1d46a009-a12c-4bb9-9efa-c95783925ca1 req-57d945ba-5a2c-4b76-ad7a-34eac9349511 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.085541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1d46a009-a12c-4bb9-9efa-c95783925ca1 req-57d945ba-5a2c-4b76-ad7a-34eac9349511 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.105297 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1d46a009-a12c-4bb9-9efa-c95783925ca1 req-57d945ba-5a2c-4b76-ad7a-34eac9349511 service nova] Creating event network-vif-plugged:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:13:29.125077 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1d46a009-a12c-4bb9-9efa-c95783925ca1 req-57d945ba-5a2c-4b76-ad7a-34eac9349511 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079645 Jun 18 22:13:29.126360 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1528/3046] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:29.132009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:29.133093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:29.146663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.147464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.153173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.153985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.396358 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d0e5be24-36f4-4bf4-b4e8-41eb88087e99 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action" status: 202 len: 0 microversion: 2.1 time: 1.536680 Jun 18 22:13:29.397509 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1519/3047] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:27 2022] POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action => generated 0 bytes in 1539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:29.402734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:29.403439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:29.436949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.438221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.441155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.443133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.497676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:29.509027 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab7e8e6e-1fcb-411b-815d-4b5a8ea54132 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1468 microversion: 2.1 time: 0.381008 Jun 18 22:13:29.524537 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1529/3048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:29 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1468 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:29.530841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:29.533974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:29.543721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.544554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.545710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.546842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.693620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:29.707890 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e5e83313-3207-451f-91f3-bf59c5f9845a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.308449 Jun 18 22:13:29.721673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1520/3049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:29 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:29.730446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-2109141430"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:29.731460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:29.739544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.740814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.741893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.742622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.752187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-19755845-4182-4723-85c2-60c514a30e6a tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.226090 Jun 18 22:13:29.753364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1530/3050] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:13:29 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce/os-interface => generated 1833 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:13:29.758190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ee1b8479-f69b-4baf-a626-4088c7b825e5 req-4ecb5281-8fe6-4077-a3cc-554612ea0406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:29.769852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ee1b8479-f69b-4baf-a626-4088c7b825e5 req-4ecb5281-8fe6-4077-a3cc-554612ea0406 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:29.771892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ee1b8479-f69b-4baf-a626-4088c7b825e5 req-4ecb5281-8fe6-4077-a3cc-554612ea0406 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:29.801196 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ee1b8479-f69b-4baf-a626-4088c7b825e5 req-4ecb5281-8fe6-4077-a3cc-554612ea0406 service nova] Creating event network-changed:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:13:29.809959 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ee1b8479-f69b-4baf-a626-4088c7b825e5 req-4ecb5281-8fe6-4077-a3cc-554612ea0406 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054346 Jun 18 22:13:29.811261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1531/3051] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:29.837276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2b0e43b5-159f-448b-9ab6-9714c4150242 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07811ca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:30.032488 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2b0e43b5-159f-448b-9ab6-9714c4150242 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-06-18T22%3A10%3A56Z" status: 200 len: 2329 microversion: 2.1 time: 0.219797 Jun 18 22:13:30.043276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1532/3052] 10.222.0.30 () {58 vars in 1198 bytes} [Sat Jun 18 22:13:29 2022] GET /compute/v2.1/images?changes-since=2022-06-18T22%3A10%3A56Z => generated 2329 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:30.048482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:30.049322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:30.061459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:30.061920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:30.063315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:30.063763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:30.206752 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.security_group_api [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Removing security group 399a58a2-82ca-4d54-9ea8-5460bfaab64e from port 745ab995-24dc-4566-b192-a1e4deba6d79 Jun 18 22:13:30.593786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:30.602321 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-92c3522c-47f5-4c88-8d6a-7aff78006fd7 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.557749 Jun 18 22:13:30.603070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1533/3053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:30 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:30.615580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:30.616218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:30.639407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:30.639779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:30.640581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:30.641269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:30.994741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:31.003205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3d34b29-3521-4c97-a27d-bc1c8b2cacd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1304 microversion: 2.1 time: 0.399121 Jun 18 22:13:31.003912 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1534/3054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:30 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1304 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:31.009332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2641dcd9-4989-4e9c-bad4-caf23eb8c507 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078a38b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:31.127648 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2641dcd9-4989-4e9c-bad4-caf23eb8c507 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-387753032" status: 200 len: 484 microversion: 2.1 time: 0.122304 Jun 18 22:13:31.134605 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1535/3055] 10.222.0.30 () {58 vars in 1228 bytes} [Sat Jun 18 22:13:31 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-387753032 => generated 484 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:31.148020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:31.148774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:31.156015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:31.156833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:31.158088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:31.160300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:31.964411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:31.977140 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-024f4357-ce4f-4e11-aa6f-7d03ebda16a8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.833683 Jun 18 22:13:31.978715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1536/3056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:31 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:31.986039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f19ea9e1-e9cc-46e8-94df-f95fe24e2e67 req-0d778f42-16f0-47d9-9858-bb59ebde3b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:32.002408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f19ea9e1-e9cc-46e8-94df-f95fe24e2e67 req-0d778f42-16f0-47d9-9858-bb59ebde3b3c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:32.003029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f19ea9e1-e9cc-46e8-94df-f95fe24e2e67 req-0d778f42-16f0-47d9-9858-bb59ebde3b3c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:32.004770 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47622757-7aab-4dee-a449-98f7561f2f27 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action" status: 202 len: 0 microversion: 2.1 time: 2.281399 Jun 18 22:13:32.005734 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1521/3057] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:29 2022] POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action => generated 0 bytes in 2283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:32.014903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8007e85c-6ac6-44e5-8ad3-75e4cc71a6e4 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dd1280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:32.029846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f19ea9e1-e9cc-46e8-94df-f95fe24e2e67 req-0d778f42-16f0-47d9-9858-bb59ebde3b3c service nova] Creating event network-changed:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch1-master-1 Jun 18 22:13:32.040517 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f19ea9e1-e9cc-46e8-94df-f95fe24e2e67 req-0d778f42-16f0-47d9-9858-bb59ebde3b3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057626 Jun 18 22:13:32.043952 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1537/3058] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:32.084288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:32.086790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:32.108144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:32.112063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:32.115605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:32.116093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:32.235912 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8007e85c-6ac6-44e5-8ad3-75e4cc71a6e4 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?server=417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 957 microversion: 2.1 time: 0.228648 Jun 18 22:13:32.237103 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1522/3059] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:13:32 2022] GET /compute/v2.1/images?server=417dc01e-91d1-4843-8c11-b0081ea68469 => generated 957 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:32.243491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-36d83bda-07a3-46b5-a8a9-8dc1bca97d28 req-817e555d-5c8f-495f-b609-b37433d0bffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "name": "network-vif-unplugged", "status": "completed", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:32.253933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-36d83bda-07a3-46b5-a8a9-8dc1bca97d28 req-817e555d-5c8f-495f-b609-b37433d0bffb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:32.254624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-36d83bda-07a3-46b5-a8a9-8dc1bca97d28 req-817e555d-5c8f-495f-b609-b37433d0bffb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:32.266118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-36d83bda-07a3-46b5-a8a9-8dc1bca97d28 req-817e555d-5c8f-495f-b609-b37433d0bffb service nova] Creating event network-vif-unplugged:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:13:32.272182 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-36d83bda-07a3-46b5-a8a9-8dc1bca97d28 req-817e555d-5c8f-495f-b609-b37433d0bffb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033584 Jun 18 22:13:32.273381 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1523/3060] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:32.278923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e61ea4c8-9119-4687-8bcb-69222c629d9b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'create', calling method: .version_select at 0x7fea1423d280>, body: {"pool": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:32.580172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:32.595072 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d095c6f6-bc55-46d8-849b-c777bfb0797e tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.549281 Jun 18 22:13:32.606414 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1538/3061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:32 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:32.611709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:32.613079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:32.620946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:32.628762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:32.630045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:32.630846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:33.019207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:33.028594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:33.039250 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32d32635-4565-4ff3-9723-847164772cd7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.428041 Jun 18 22:13:33.050933 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1539/3062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:32 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:33.053790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-46e2383e-8fba-4d40-bdd5-6ecea5298c79 req-b1958aed-b82c-4600-8eb1-f7344c118d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:33.070045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46e2383e-8fba-4d40-bdd5-6ecea5298c79 req-b1958aed-b82c-4600-8eb1-f7344c118d71 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:33.070798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46e2383e-8fba-4d40-bdd5-6ecea5298c79 req-b1958aed-b82c-4600-8eb1-f7344c118d71 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:33.087096 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-46e2383e-8fba-4d40-bdd5-6ecea5298c79 req-b1958aed-b82c-4600-8eb1-f7344c118d71 service nova] Creating event network-changed:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:13:33.093757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-46e2383e-8fba-4d40-bdd5-6ecea5298c79 req-b1958aed-b82c-4600-8eb1-f7344c118d71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049865 Jun 18 22:13:33.094861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1540/3063] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:33.100411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c90cb339-db3b-4710-8f11-2aa62fd8ed24 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0780d790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:33.164254 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c90cb339-db3b-4710-8f11-2aa62fd8ed24 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 485 microversion: 2.1 time: 0.068136 Jun 18 22:13:33.165190 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1541/3064] 10.222.0.30 () {58 vars in 1316 bytes} [Sat Jun 18 22:13:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046 => generated 485 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:33.175102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:33.177469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:33.187251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:33.188049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:33.189679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:33.191408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:33.439196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:33.453581 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4e8d3f7-6fab-4b7b-9050-385d80388c86 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.287188 Jun 18 22:13:33.454603 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1542/3065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:33 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:33.460666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3e0bbc9-e634-49dd-9679-ca20cca0c708 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea07811310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:33.528329 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3e0bbc9-e634-49dd-9679-ca20cca0c708 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 485 microversion: 2.1 time: 0.071596 Jun 18 22:13:33.529250 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1543/3066] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Jun 18 22:13:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046 => generated 485 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:33.551449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-514beb1f-b316-428a-9980-fc1125820965 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1404e280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:33.680127 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-514beb1f-b316-428a-9980-fc1125820965 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3707 microversion: 2.1 time: 0.139695 Jun 18 22:13:33.681529 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1544/3067] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:13:33 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3707 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:33.687514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:33.688353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:33.694856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:33.695673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:33.696619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:33.697251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:33.940099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:33.952081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3bcaa55-edb6-420c-9506-75dcfc260d1a tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.269243 Jun 18 22:13:33.963585 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1545/3068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:33 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:33.974298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5e57606-0c6a-41af-ac36-039d5cd3a076 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea0783b040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:34.107338 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5e57606-0c6a-41af-ac36-039d5cd3a076 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.142200 Jun 18 22:13:34.111625 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1546/3069] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:13:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:34.117658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:34.118548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:34.126776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.127228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.128217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.128840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.623928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:34.636709 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88b490bb-f753-415e-bd27-f5e60bd524a4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.523144 Jun 18 22:13:34.638582 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1547/3070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:34 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:34.652585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a802aecb-6f0c-43df-855e-aa838ad8bfbd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea078714c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:34.756690 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e61ea4c8-9119-4687-8bcb-69222c629d9b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.481860 Jun 18 22:13:34.758118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1524/3071] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:13:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:34.765456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-adea70a6-688c-42f4-be0f-eef3584186dd req-1e5d7ffb-3a6f-45d3-be34-09b00a55e557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93252f6-2582-403c-973f-e17f4a9f03fd", "name": "network-vif-plugged", "status": "completed", "tag": "a9dd753b-6694-48fe-8e25-b5c2ba258d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:34.779129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a802aecb-6f0c-43df-855e-aa838ad8bfbd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.131433 Jun 18 22:13:34.786937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1548/3072] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:13:34 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:34.788970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-adea70a6-688c-42f4-be0f-eef3584186dd req-1e5d7ffb-3a6f-45d3-be34-09b00a55e557 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.791818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8d5f4cc8-8516-49c1-8cf4-93e1bcd83c0f req-c742c849-2474-4a06-8acd-212834293e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0193f858-2c0f-43e6-a811-27bb75b7708f", "tag": "972a9af1-f59f-41bb-8b18-9f56de6ec8b4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:34.793632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-adea70a6-688c-42f4-be0f-eef3584186dd req-1e5d7ffb-3a6f-45d3-be34-09b00a55e557 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.802989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8d5f4cc8-8516-49c1-8cf4-93e1bcd83c0f req-c742c849-2474-4a06-8acd-212834293e15 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.803841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8d5f4cc8-8516-49c1-8cf4-93e1bcd83c0f req-c742c849-2474-4a06-8acd-212834293e15 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.816276 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-adea70a6-688c-42f4-be0f-eef3584186dd req-1e5d7ffb-3a6f-45d3-be34-09b00a55e557 service nova] Creating event network-vif-plugged:a9dd753b-6694-48fe-8e25-b5c2ba258d2f for instance d93252f6-2582-403c-973f-e17f4a9f03fd on nch2-master-1 Jun 18 22:13:34.824036 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-adea70a6-688c-42f4-be0f-eef3584186dd req-1e5d7ffb-3a6f-45d3-be34-09b00a55e557 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063967 Jun 18 22:13:34.825087 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1525/3073] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:34.832636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:34.833865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:34.835384 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8d5f4cc8-8516-49c1-8cf4-93e1bcd83c0f req-c742c849-2474-4a06-8acd-212834293e15 service nova] Creating event network-changed:972a9af1-f59f-41bb-8b18-9f56de6ec8b4 for instance 0193f858-2c0f-43e6-a811-27bb75b7708f on nch1-master-1 Jun 18 22:13:34.842226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.843036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.844917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.845554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.848775 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8d5f4cc8-8516-49c1-8cf4-93e1bcd83c0f req-c742c849-2474-4a06-8acd-212834293e15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060490 Jun 18 22:13:34.853262 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1549/3074] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:34.861627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.2.249"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:34.868867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:34.887110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.887824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.888733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:34.894839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:34.929133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Acquired lock "refresh_cache-40a9b61c-f4b3-4970-a1cf-0f99f076e072" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:13:35.512953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:35.553922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:35.636280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:35.648777 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23dc57e3-5517-4150-9443-7daebe3d8cb7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.822201 Jun 18 22:13:35.659815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1526/3075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:34 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:35.667605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-caa03294-cea1-4eb9-998a-f7a0858ea6a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1423d700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:35.929985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-caa03294-cea1-4eb9-998a-f7a0858ea6a8 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-06-18T22%3A10%3A52Z" status: 200 len: 7022 microversion: 2.1 time: 0.268571 Jun 18 22:13:35.930642 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1527/3076] 10.222.0.30 () {58 vars in 1219 bytes} [Sat Jun 18 22:13:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-06-18T22%3A10%3A52Z => generated 7022 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:35.935404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:35.936036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:35.943675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:35.944366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:35.945786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:35.946390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:36.187553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:36.203113 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06e2cca7-6409-412e-86d6-b3c5f6a7cf49 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1351 microversion: 2.1 time: 0.268044 Jun 18 22:13:36.216662 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1528/3077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:35 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1351 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:36.228698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-73c7caf5-28fd-4c30-9828-8cee1d83dce0 req-75882cda-dfcb-4a85-b938-5eb1f0fd5db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "tag": "e82aea74-0ff1-4853-b959-c6713a07c673"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:36.238730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-73c7caf5-28fd-4c30-9828-8cee1d83dce0 req-75882cda-dfcb-4a85-b938-5eb1f0fd5db2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:36.239311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-73c7caf5-28fd-4c30-9828-8cee1d83dce0 req-75882cda-dfcb-4a85-b938-5eb1f0fd5db2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:36.253482 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-73c7caf5-28fd-4c30-9828-8cee1d83dce0 req-75882cda-dfcb-4a85-b938-5eb1f0fd5db2 service nova] Creating event network-changed:e82aea74-0ff1-4853-b959-c6713a07c673 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:13:36.259058 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-73c7caf5-28fd-4c30-9828-8cee1d83dce0 req-75882cda-dfcb-4a85-b938-5eb1f0fd5db2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039559 Jun 18 22:13:36.260030 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1529/3078] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:36.269149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:36.269149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:36.271322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:36.274419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:36.275355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:36.275941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:36.276195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:36.358017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:36.572848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:36.586323 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73cf49f6-ef05-4fea-8634-811d334d657c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.325152 Jun 18 22:13:36.588035 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1530/3079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:36 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:36.595005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a68275c-5a8f-433d-bcb3-b18b9107b341 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dc3e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:36.691424 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a68275c-5a8f-433d-bcb3-b18b9107b341 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-387753032" status: 200 len: 664 microversion: 2.1 time: 0.101982 Jun 18 22:13:36.692456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1531/3080] 10.222.0.30 () {58 vars in 1249 bytes} [Sat Jun 18 22:13:36 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-387753032 => generated 664 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:36.700901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:36.702404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:36.711012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:36.711878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:36.713161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:36.713837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:36.968682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:36.985353 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c4ce0ec-7d9a-4d8e-8f74-39c4d83cad6f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.291334 Jun 18 22:13:36.999578 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1532/3081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:36 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:37.008506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88aa55d2-c575-4548-9494-c0b5f50e4c6c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea144eadc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:37.062736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:37.093312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88aa55d2-c575-4548-9494-c0b5f50e4c6c tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1467 microversion: 2.1 time: 0.091357 Jun 18 22:13:37.093896 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1533/3082] 10.222.0.30 () {58 vars in 1337 bytes} [Sat Jun 18 22:13:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046 => generated 1467 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:37.105582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b544835f-2b11-4122-861a-fa4f3b87b9f1 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19c63280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:37.168627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b544835f-2b11-4122-861a-fa4f3b87b9f1 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1467 microversion: 2.1 time: 0.066632 Jun 18 22:13:37.169800 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1534/3083] 10.222.0.30 () {58 vars in 1323 bytes} [Sat Jun 18 22:13:37 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F64809918-45ff-4e75-9136-72b4a53b4046 => generated 1467 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:37.183708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18958984-c0c4-4bb9-a29f-579947ce35f9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14bc6a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:37.207536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Building network info cache for instance {{(pid=130903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:13:37.285365 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18958984-c0c4-4bb9-a29f-579947ce35f9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7797 microversion: 2.1 time: 0.106367 Jun 18 22:13:37.297284 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1535/3084] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:13:37 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7797 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:37.297284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:37.297284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:37.304458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:37.305091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:37.305889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:37.306335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:37.649765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:37.660346 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a479d368-dd8f-45b1-8186-c01bd9d1ff16 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1541 microversion: 2.1 time: 0.372811 Jun 18 22:13:37.660931 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1536/3085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:37 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1541 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:37.667293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-36273370-0745-4f8f-98dd-671275a7ccdb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea144eadc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:37.741205 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-36273370-0745-4f8f-98dd-671275a7ccdb tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.078500 Jun 18 22:13:37.742235 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1537/3086] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:13:37 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:37.747081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:37.747967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:37.754973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:37.755555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:37.756621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:37.757206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:38.537591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:38.554236 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9281c4ca-6ca0-4b2b-a26d-beedd32494b1 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.810623 Jun 18 22:13:38.567362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1538/3087] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:37 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:38.575393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:38.578094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:38.588429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:38.589444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:38.590987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:38.591627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:38.764627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46de84a5-ac9f-497e-aff2-1e2d3d1fe32d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195324 Jun 18 22:13:38.771062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1539/3088] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:13:38 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:38.777547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dabdbe94-7437-43b8-b56d-395ad12f4e1e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14c1ddc0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:38.824729 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dabdbe94-7437-43b8-b56d-395ad12f4e1e tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad" status: 200 len: 784 microversion: 2.1 time: 0.052121 Jun 18 22:13:38.825676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1540/3089] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:13:38 2022] GET /compute/v2.1/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad => generated 784 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:38.838537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:38.839338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:38.847507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:38.848287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:38.849320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:38.849967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:38.873580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:38.958155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Updating instance_info_cache with network_info: [{"id": "745ab995-24dc-4566-b192-a1e4deba6d79", "address": "fa:16:3e:bf:22:cb", "network": {"id": "c8d8d130-6cbb-4e46-8637-13f50b7c8bf8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-542505623-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.2.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c66aab4ab90e4ee1be5a36496447d1a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap745ab995-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:13:38.975376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Releasing lock "refresh_cache-40a9b61c-f4b3-4970-a1cf-0f99f076e072" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:13:38.976472 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d17acbd7-afb8-4ddf-b752-8170b20d8eb5 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action" status: 202 len: 0 microversion: 2.1 time: 4.121883 Jun 18 22:13:38.977271 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1550/3090] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:34 2022] POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action => generated 0 bytes in 4123 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:13:38.985625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b47ed65f-0d93-4a89-bbbc-14da9ca7d728 req-06167945-9899-4dcc-8774-96ecc4fb40dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:38.995869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b47ed65f-0d93-4a89-bbbc-14da9ca7d728 req-06167945-9899-4dcc-8774-96ecc4fb40dd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:38.996702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b47ed65f-0d93-4a89-bbbc-14da9ca7d728 req-06167945-9899-4dcc-8774-96ecc4fb40dd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:39.009252 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b47ed65f-0d93-4a89-bbbc-14da9ca7d728 req-06167945-9899-4dcc-8774-96ecc4fb40dd service nova] Creating event network-changed:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:13:39.014822 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b47ed65f-0d93-4a89-bbbc-14da9ca7d728 req-06167945-9899-4dcc-8774-96ecc4fb40dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035294 Jun 18 22:13:39.015791 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1551/3091] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:39.021116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-164cd841-3982-4227-ab2b-48969448ed30 req-f9d32b08-6f54-4a66-b10e-cdc53d93ddfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "name": "network-vif-plugged", "status": "completed", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:39.046397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-164cd841-3982-4227-ab2b-48969448ed30 req-f9d32b08-6f54-4a66-b10e-cdc53d93ddfc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:39.046852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-164cd841-3982-4227-ab2b-48969448ed30 req-f9d32b08-6f54-4a66-b10e-cdc53d93ddfc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:39.059295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-164cd841-3982-4227-ab2b-48969448ed30 req-f9d32b08-6f54-4a66-b10e-cdc53d93ddfc service nova] Creating event network-vif-plugged:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch1-master-1 Jun 18 22:13:39.064780 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-164cd841-3982-4227-ab2b-48969448ed30 req-f9d32b08-6f54-4a66-b10e-cdc53d93ddfc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047576 Jun 18 22:13:39.065474 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1552/3092] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:39.071119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5437658-9185-4047-bcc6-c1a1755c99b5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea1404e310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:39.144569 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5437658-9185-4047-bcc6-c1a1755c99b5 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.077572 Jun 18 22:13:39.145497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1553/3093] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:13:39 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:39.154426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.2.249"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:39.165463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:39.173499 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee13fef6-fa57-4787-b5f8-de77d78b872b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.338931 Jun 18 22:13:39.177426 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1541/3094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:38 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:39.183839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce734fcb-53f0-4628-a721-1cbdf50e33dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14526e50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:39.484720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:39.492982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:39.494266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:39.496127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:39.496947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:39.721177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce734fcb-53f0-4628-a721-1cbdf50e33dd tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da" status: 204 len: 0 microversion: 2.1 time: 0.540775 Jun 18 22:13:39.722434 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1542/3095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:39 2022] DELETE /compute/v2.1/images/a3346586-622f-49ea-917e-0f43540710da => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:39.728010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:39.728990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:39.735735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:39.736313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:39.737225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:39.737921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:39.957472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Acquired lock "refresh_cache-40a9b61c-f4b3-4970-a1cf-0f99f076e072" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 18 22:13:40.138659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:40.150618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-91fa3f80-06ad-484c-be56-52c77a7a1a06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.426143 Jun 18 22:13:40.152575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1543/3096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:39 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:40.163747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5897a4b-5c69-447b-a8cd-7ed400aba5f7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14bc63a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:40.804206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e5897a4b-5c69-447b-a8cd-7ed400aba5f7 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0" status: 204 len: 0 microversion: 2.1 time: 0.650176 Jun 18 22:13:40.805411 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1544/3097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:40 2022] DELETE /compute/v2.1/images/cc15200d-3aec-43da-8f8a-2f83b5b8d2c0 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:40.814832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:40.815798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:40.825641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:40.826512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:40.827534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:40.828235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:41.311088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:41.325478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eeeb8c89-9037-4e99-9ab5-bed7d95d924d tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1313 microversion: 2.1 time: 0.514928 Jun 18 22:13:41.341165 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1545/3098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:40 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:41.347168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b241242c-e29c-40a1-8d4b-2e47592f14b0 req-01d80f2c-1e8a-4f09-9e17-bb0aa2dcbdf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93252f6-2582-403c-973f-e17f4a9f03fd", "tag": "a9dd753b-6694-48fe-8e25-b5c2ba258d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:41.364235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b241242c-e29c-40a1-8d4b-2e47592f14b0 req-01d80f2c-1e8a-4f09-9e17-bb0aa2dcbdf7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:41.366717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b241242c-e29c-40a1-8d4b-2e47592f14b0 req-01d80f2c-1e8a-4f09-9e17-bb0aa2dcbdf7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:41.387946 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b241242c-e29c-40a1-8d4b-2e47592f14b0 req-01d80f2c-1e8a-4f09-9e17-bb0aa2dcbdf7 service nova] Creating event network-changed:a9dd753b-6694-48fe-8e25-b5c2ba258d2f for instance d93252f6-2582-403c-973f-e17f4a9f03fd on nch2-master-1 Jun 18 22:13:41.394495 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b241242c-e29c-40a1-8d4b-2e47592f14b0 req-01d80f2c-1e8a-4f09-9e17-bb0aa2dcbdf7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051888 Jun 18 22:13:41.395486 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1546/3099] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:41.403822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-683183be-2cd9-4f4f-99dc-b94a611fcb9d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dcb8b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:42.073184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Building network info cache for instance {{(pid=130903) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 18 22:13:42.147959 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-683183be-2cd9-4f4f-99dc-b94a611fcb9d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f" status: 204 len: 0 microversion: 2.1 time: 0.751055 Jun 18 22:13:42.148537 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1547/3100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:41 2022] DELETE /compute/v2.1/images/34adce15-bc55-41d7-806b-e375bad5a35f => generated 0 bytes in 752 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:42.154474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:42.155280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:42.171956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.172429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:42.175573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.176186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:42.605822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:42.615222 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bd318f1a-5a63-4680-ad9e-14d72ea7e251 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.465438 Jun 18 22:13:42.626621 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1548/3101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:42 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:42.631850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9107c7c9-1bf9-4214-9b91-d0ea9d135f8b req-ecb544f8-72c7-426e-8feb-64e94077a93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:42.641715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9107c7c9-1bf9-4214-9b91-d0ea9d135f8b req-ecb544f8-72c7-426e-8feb-64e94077a93d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.642558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9107c7c9-1bf9-4214-9b91-d0ea9d135f8b req-ecb544f8-72c7-426e-8feb-64e94077a93d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:42.657130 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9107c7c9-1bf9-4214-9b91-d0ea9d135f8b req-ecb544f8-72c7-426e-8feb-64e94077a93d service nova] Creating event network-changed:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:13:42.662796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9107c7c9-1bf9-4214-9b91-d0ea9d135f8b req-ecb544f8-72c7-426e-8feb-64e94077a93d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034562 Jun 18 22:13:42.663998 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1549/3102] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:42.675634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:42.678850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:42.690389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.691282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:42.692296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.692971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:42.725975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:13:42.832390 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-881c1057-4867-41ae-9f53-9ef4f88f9335 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 204 len: 0 microversion: 2.1 time: 0.166574 Jun 18 22:13:42.833360 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1550/3103] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:13:42 2022] DELETE /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:42.841993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:42.844030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:42.852091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.852991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:42.854057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:42.854760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:43.190208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:43.204496 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39a500f7-1798-4213-84ce-eaaa691ed3e4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1463 microversion: 2.1 time: 0.369476 Jun 18 22:13:43.206099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1551/3104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:42 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1463 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:43.214985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:43.225557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:43.229872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Updating instance_info_cache with network_info: [{"id": "745ab995-24dc-4566-b192-a1e4deba6d79", "address": "fa:16:3e:bf:22:cb", "network": {"id": "c8d8d130-6cbb-4e46-8637-13f50b7c8bf8", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-542505623-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c66aab4ab90e4ee1be5a36496447d1a2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap745ab995-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130903) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:13:43.246162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:43.247618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:43.249325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:43.249994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:43.263891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Releasing lock "refresh_cache-40a9b61c-f4b3-4970-a1cf-0f99f076e072" {{(pid=130903) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 18 22:13:43.266185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4cfaf674-bc9f-4c3d-8a1b-391c6469517b tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action" status: 202 len: 0 microversion: 2.1 time: 4.119000 Jun 18 22:13:43.269218 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1554/3105] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:39 2022] POST /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072/action => generated 0 bytes in 4122 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 18 22:13:43.283280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e15b9d87-e971-48fb-8138-309eb0b4f0b1 req-9d7a908a-38b6-45e9-b3bc-f432bd40ce3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0193f858-2c0f-43e6-a811-27bb75b7708f", "name": "network-vif-plugged", "status": "completed", "tag": "972a9af1-f59f-41bb-8b18-9f56de6ec8b4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:43.304223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e15b9d87-e971-48fb-8138-309eb0b4f0b1 req-9d7a908a-38b6-45e9-b3bc-f432bd40ce3d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:43.304688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e15b9d87-e971-48fb-8138-309eb0b4f0b1 req-9d7a908a-38b6-45e9-b3bc-f432bd40ce3d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:43.317816 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e15b9d87-e971-48fb-8138-309eb0b4f0b1 req-9d7a908a-38b6-45e9-b3bc-f432bd40ce3d service nova] Creating event network-vif-plugged:972a9af1-f59f-41bb-8b18-9f56de6ec8b4 for instance 0193f858-2c0f-43e6-a811-27bb75b7708f on nch1-master-1 Jun 18 22:13:43.324549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e15b9d87-e971-48fb-8138-309eb0b4f0b1 req-9d7a908a-38b6-45e9-b3bc-f432bd40ce3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052835 Jun 18 22:13:43.326677 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1555/3106] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:43.335338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:43.336085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:43.354256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:43.354713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:43.358479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:43.359157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:43.472250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:43.484228 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c1cfb1f-46e3-4855-8385-0e3c16b7f6a6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1474 microversion: 2.1 time: 0.275722 Jun 18 22:13:43.486369 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1552/3107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:43 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1474 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:43.493490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5ec0181-f44d-4ecb-9aab-e38c71122953 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '.version_select at 0x7fea19dcb670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:44.020490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73e06c4b-ed6f-4b49-a396-fe35d887b912 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1614 microversion: 2.1 time: 0.692523 Jun 18 22:13:44.021178 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1556/3108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:43 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1614 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:44.031266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:44.032175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:44.049854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:44.050631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:44.051623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:44.052256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:44.382834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:44.394957 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5ba5840-c63e-4aae-9d2f-fff88f73dcfb tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.368322 Jun 18 22:13:44.395557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1557/3109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:44 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:44.401101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:44.401980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:44.408752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:44.409315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:44.410337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:44.410984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:44.721193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7fa98fb81589488fa53a6f07a208b7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9654b224af4e6d9705c4a622c32a01', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:44.722707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] flavor_id is None. Assuming migration. {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 18 22:13:44.724117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:13:44.985268 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5ec0181-f44d-4ecb-9aab-e38c71122953 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/29673df5-d311-42be-97a4-3e4324e0fef7" status: 202 len: 0 microversion: 2.1 time: 1.496650 Jun 18 22:13:44.986409 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1553/3110] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:13:43 2022] DELETE /compute/v2.1/os-floating-ips/29673df5-d311-42be-97a4-3e4324e0fef7 => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:44.992606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:44.993483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:45.002283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.002951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.003882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.004470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.059056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:45.169081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5a2a861-6315-421f-8af7-c19f2a3598d1 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3/action" status: 202 len: 0 microversion: 2.1 time: 0.771445 Jun 18 22:13:45.172948 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1558/3111] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:13:44 2022] POST /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:45.178526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a202c30b-7d24-42e8-8f5d-0420d781ef45 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '.version_select at 0x7fea0786e940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:45.226716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:45.236348 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e5715354-0d4e-4af9-9961-8b35b4c100a9 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1474 microversion: 2.1 time: 0.248741 Jun 18 22:13:45.237314 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1554/3112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:44 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1474 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:45.242762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:45.243821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:45.250595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.251329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.252513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.253125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.468990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:45.482545 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7adaf1e9-6515-4022-9e84-05895b773d0e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1472 microversion: 2.1 time: 0.243593 Jun 18 22:13:45.485709 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1555/3113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:45 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:45.490627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:45.491249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:45.500931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.501911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.502861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.503539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.522303 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a202c30b-7d24-42e8-8f5d-0420d781ef45 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/399a58a2-82ca-4d54-9ea8-5460bfaab64e" status: 202 len: 0 microversion: 2.1 time: 0.347898 Jun 18 22:13:45.523337 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1559/3114] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:13:45 2022] DELETE /compute/v2.1/os-security-groups/399a58a2-82ca-4d54-9ea8-5460bfaab64e => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:13:45.531128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:45.531780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:45.541232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.541890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.542878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.543371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.591839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:13:45.693655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:45.705429 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23455968-8524-4829-bf9d-cf34266aa04f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.218018 Jun 18 22:13:45.706497 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1556/3115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:45 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:45.712616 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2813e01d-edd8-49e4-a9cf-3b7953db0ea8 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 204 len: 0 microversion: 2.1 time: 0.180283 Jun 18 22:13:45.713271 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1560/3116] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:13:45 2022] DELETE /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:45.721798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:45.722960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:45.729577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.730033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.731073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:45.731616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:45.921792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:45.931529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c512d6c2-ff91-449c-bfa7-1c671a4e6a22 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1508 microversion: 2.1 time: 0.213384 Jun 18 22:13:45.932979 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1557/3117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:45 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:46.254920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:46.255753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:46.263961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.264442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.265482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.266026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.316523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3e5c0181-7180-45d6-af33-bfcc6a0b7c3b req-1d8f83d7-01fa-4043-8e38-4a5024fe52cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64809918-45ff-4e75-9136-72b4a53b4046", "name": "network-vif-deleted", "tag": "02edfb5d-e4f7-4f79-bd38-14abde92e757"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:46.330359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3e5c0181-7180-45d6-af33-bfcc6a0b7c3b req-1d8f83d7-01fa-4043-8e38-4a5024fe52cf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.330810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3e5c0181-7180-45d6-af33-bfcc6a0b7c3b req-1d8f83d7-01fa-4043-8e38-4a5024fe52cf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.347995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3e5c0181-7180-45d6-af33-bfcc6a0b7c3b req-1d8f83d7-01fa-4043-8e38-4a5024fe52cf service nova] Creating event network-vif-deleted:02edfb5d-e4f7-4f79-bd38-14abde92e757 for instance 64809918-45ff-4e75-9136-72b4a53b4046 on nch1-master-1 Jun 18 22:13:46.354020 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3e5c0181-7180-45d6-af33-bfcc6a0b7c3b req-1d8f83d7-01fa-4043-8e38-4a5024fe52cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043612 Jun 18 22:13:46.355338 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1558/3118] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:13:46.359608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:46.362048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:46.373348 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de78ff9b-bb26-499d-9ed5-617a127e6e0b tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1432 microversion: 2.1 time: 0.123188 Jun 18 22:13:46.373949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1561/3119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:46 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1432 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:46.503973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:46.504956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:46.512041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.512488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.513289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.513725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.680448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:46.689443 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b01ebc7f-703a-48f4-9b36-a83b434fc6ec tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1472 microversion: 2.1 time: 0.189528 Jun 18 22:13:46.690745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1559/3120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:46 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:46.732853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:46.734987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:46.765257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.765953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.766921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.768027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.916272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:46.924403 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56783f23-2d11-4089-a5f0-3349557dcfb5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.201274 Jun 18 22:13:46.925380 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1562/3121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:46 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:46.949934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:46.950546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:46.962611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.963070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:46.963866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:46.964314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:47.130478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:47.139647 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19a13681-b12b-4446-922e-92829588dd39 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1508 microversion: 2.1 time: 0.194077 Jun 18 22:13:47.140293 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1560/3122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:46 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:47.390544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:47.391179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:47.397637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:47.398095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:47.399072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:47.399690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:47.474099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:47.482637 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49d462fa-fa70-4cbb-a0bc-e1d4ac894b6d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1432 microversion: 2.1 time: 0.095996 Jun 18 22:13:47.483321 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1563/3123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:47 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1432 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:47.709680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:47.711145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:47.718449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:47.718902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:47.719806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:47.720217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:47.870160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:47.878536 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a75e8ce6-4d2d-4ce4-941e-560941f67667 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1472 microversion: 2.1 time: 0.173300 Jun 18 22:13:47.879316 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1561/3124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:47 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:47.944899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:47.946530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:47.955233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:47.956093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:47.957303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:47.958003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.146401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:48.162277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:48.165796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:48.183984 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8953226c-6b2a-4e3d-bd32-6af3cd29ab00 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1372 microversion: 2.1 time: 0.242585 Jun 18 22:13:48.195219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.195473 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1564/3125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:47 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:48.195593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.195593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.195593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.200878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:48.426404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:48.435188 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-59779074-11df-4f56-bc22-fbb35a186298 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1508 microversion: 2.1 time: 0.282438 Jun 18 22:13:48.436607 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1562/3126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:48 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:48.500110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:48.500798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:48.507232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.507697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.508492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.508938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.545191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.545645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.546112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lazy-loading 'fault' on Instance uuid 64809918-45ff-4e75-9136-72b4a53b4046 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:13:48.624198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:48.640530 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51497745-2bc2-4262-8d0b-7805262f4afc tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 200 len: 1308 microversion: 2.1 time: 0.144492 Jun 18 22:13:48.641589 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1565/3127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:48 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:48.897099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:48.898669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:48.907078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.907758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:48.908743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:48.909346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.109865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:49.124120 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c46945c-eced-4b92-ad02-cb5d407ab49e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1472 microversion: 2.1 time: 0.231156 Jun 18 22:13:49.124740 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1563/3128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:48 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:49.205514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:49.207430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:49.216923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.217726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.218796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.219644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.379498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:49.396386 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5f7a619-7dd0-46b8-8629-3d21c02aa547 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1566 microversion: 2.1 time: 0.196637 Jun 18 22:13:49.397273 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1566/3129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:49 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1566 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:49.414409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:49.415183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:49.425209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.426040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.427064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.427720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.455318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:49.456838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:49.464078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.464946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.466148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.466793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.541611 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3921e686-9585-45d0-9cb3-e98a2201cbbc tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131491 Jun 18 22:13:49.550274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1564/3130] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:13:49 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:49.636453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:49.644646 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3729e472-08b3-45ca-9b03-318049a37e00 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1508 microversion: 2.1 time: 0.194269 Jun 18 22:13:49.645563 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1567/3131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:49 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:13:49.660593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:49.661274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 64809918-45ff-4e75-9136-72b4a53b4046] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:49.668188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.668662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.669486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.669935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.684831 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] HTTP exception thrown: Instance 64809918-45ff-4e75-9136-72b4a53b4046 could not be found. Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Request method failure captured: Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 HTTP/1.1 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk1rHpakU06_KDIJ9PHg7HCsG0W9XM4spIN2nznkCapQALIaZOgzLzNuUlaljAkVN412Ogo2PpoxO5V9earABMH3hnxJYY7JgL-KX8V4npVuAYbIP9-s9ft__7HDp_ROZ-HiMfatOo0w3sifWX_DgtzqpUzVuvEbPsfKeLrXOA8IPWU Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e29bd993bde443a7ae41414b603e05d5 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListImageFiltersTestJSON-1456212537 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e29bd993bde443a7ae41414b603e05d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e29bd993bde443a7ae41414b603e05d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e29bd993bde443a7ae41414b603e05d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e29bd993bde443a7ae41414b603e05d5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListImageFiltersTestJSON-1456212537 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e29bd993bde443a7ae41414b603e05d5 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1456212537 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListImageFiltersTestJSON-1456212537-project Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: c121277893cc4640a85bc96dcef6aef7 Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListImageFiltersTestJSON-1456212537-project Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 64809918-45ff-4e75-9136-72b4a53b4046 could not be found. Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '64809918-45ff-4e75-9136-72b4a53b4046'} Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64809918-45ff-4e75-9136-72b4a53b4046 could not be found. Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64809918-45ff-4e75-9136-72b4a53b4046 could not be found. Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:49.686765 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64809918-45ff-4e75-9136-72b4a53b4046 could not be found. Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Returning 404 to user: Instance 64809918-45ff-4e75-9136-72b4a53b4046 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5e3f581-0c66-4dc3-bb35-c93042cda252 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046" status: 404 len: 111 microversion: 2.1 time: 0.032001 Jun 18 22:13:49.691655 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1565/3132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:49 2022] GET /compute/v2.1/servers/64809918-45ff-4e75-9136-72b4a53b4046 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:49.697605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:49.698111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:49.704948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.705795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.706207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.707070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.733139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:13:49.817122 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55aa6293-9de9-42ff-a60f-31e66162e717 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 204 len: 0 microversion: 2.1 time: 0.122886 Jun 18 22:13:49.817717 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1568/3133] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:13:49 2022] DELETE /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:49.826777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:49.827634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:49.836357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.836814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.837657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:49.838099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:49.974247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:49.983021 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8f7aace-3589-42da-a655-fc28faf829de tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1474 microversion: 2.1 time: 0.160649 Jun 18 22:13:49.983752 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1566/3134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:49 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1474 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:50.142808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:50.143526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:50.150090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:50.150545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:50.151555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:50.151995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:50.311539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d4d5fb93-972e-453f-a344-ad0eed6bcc3e req-6bf0b3b9-5dda-415f-82dd-7b34718cab45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a9b61c-f4b3-4970-a1cf-0f99f076e072", "name": "network-vif-deleted", "tag": "745ab995-24dc-4566-b192-a1e4deba6d79"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:50.320169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d4d5fb93-972e-453f-a344-ad0eed6bcc3e req-6bf0b3b9-5dda-415f-82dd-7b34718cab45 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:50.320949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d4d5fb93-972e-453f-a344-ad0eed6bcc3e req-6bf0b3b9-5dda-415f-82dd-7b34718cab45 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:50.339209 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d4d5fb93-972e-453f-a344-ad0eed6bcc3e req-6bf0b3b9-5dda-415f-82dd-7b34718cab45 service nova] Creating event network-vif-deleted:745ab995-24dc-4566-b192-a1e4deba6d79 for instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 on nch1-master-1 Jun 18 22:13:50.346324 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d4d5fb93-972e-453f-a344-ad0eed6bcc3e req-6bf0b3b9-5dda-415f-82dd-7b34718cab45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038534 Jun 18 22:13:50.347638 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1567/3135] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:13:50.386572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:50.394547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f7e93a79-33ee-4286-98fd-9ff5b87db5c8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1472 microversion: 2.1 time: 0.256126 Jun 18 22:13:50.395119 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1569/3136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:50 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:50.663201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:50.664532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:50.676410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:50.677295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:50.679431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:50.680228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:50.798047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:50.809367 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5743d96f-6451-4da4-b300-7b861269ec90 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1466 microversion: 2.1 time: 0.150802 Jun 18 22:13:50.810268 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1568/3137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:50 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:51.001696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:51.002762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:51.010163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.011324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.012395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.013138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.319263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:51.330306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f90c7d97-aed5-498c-b21d-fb9b4b350cd2 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1474 microversion: 2.1 time: 0.333810 Jun 18 22:13:51.331312 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1570/3138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:50 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:51.418349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:51.419254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:51.429079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.430263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.431594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.432826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.785593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:51.797671 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1295941-192b-492d-ae88-e9b848ddec97 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1472 microversion: 2.1 time: 0.388182 Jun 18 22:13:51.799372 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1569/3139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:51 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:51.830452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:51.832135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:51.841716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.842530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.844308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.845282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.888622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:51.889375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:51.889992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lazy-loading 'fault' on Instance uuid 40a9b61c-f4b3-4970-a1cf-0f99f076e072 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:13:51.968697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '519822988db142fba7e027f3dd1109a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c66aab4ab90e4ee1be5a36496447d1a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:51.980843 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49cf6610-b7f4-4548-9580-d03394b80a38 tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 200 len: 1312 microversion: 2.1 time: 0.157577 Jun 18 22:13:51.982298 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1571/3140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:51 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:52.349834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:52.350762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:52.368648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:52.371492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:52.374645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:52.375878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:52.425056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1bf9f425-0388-4be2-b3e7-64958d3af0b9 req-833079ba-b7e0-4db6-9e0b-b19386a71c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0193f858-2c0f-43e6-a811-27bb75b7708f", "tag": "972a9af1-f59f-41bb-8b18-9f56de6ec8b4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:52.443673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bf9f425-0388-4be2-b3e7-64958d3af0b9 req-833079ba-b7e0-4db6-9e0b-b19386a71c8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:52.444586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bf9f425-0388-4be2-b3e7-64958d3af0b9 req-833079ba-b7e0-4db6-9e0b-b19386a71c8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:52.498640 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1bf9f425-0388-4be2-b3e7-64958d3af0b9 req-833079ba-b7e0-4db6-9e0b-b19386a71c8d service nova] Creating event network-changed:972a9af1-f59f-41bb-8b18-9f56de6ec8b4 for instance 0193f858-2c0f-43e6-a811-27bb75b7708f on nch1-master-1 Jun 18 22:13:52.509627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1bf9f425-0388-4be2-b3e7-64958d3af0b9 req-833079ba-b7e0-4db6-9e0b-b19386a71c8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095786 Jun 18 22:13:52.521012 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1572/3141] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:52.816870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:52.817645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:52.835422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:52.836133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:52.836704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:52.837181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:53.364414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c121277893cc4640a85bc96dcef6aef7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29bd993bde443a7ae41414b603e05d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:53.375173 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0564afc8-ec96-4b4d-b2d2-7dbc1d668464 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 200 len: 1474 microversion: 2.1 time: 1.031267 Jun 18 22:13:53.383449 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1570/3142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:52 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 1474 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:53.392132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:53.392768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] [instance: 40a9b61c-f4b3-4970-a1cf-0f99f076e072] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:53.400493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:53.400944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:53.401847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:53.402279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:53.418059 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] HTTP exception thrown: Instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 could not be found. Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Request method failure captured: Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 HTTP/1.1 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk3FZOzgf-AFGBCX8oeucJAYOQDyHLq6yFIabzg25UwSIqPVvxpdPa4cJ2IhXn7YFW-5ME5zsoArSe-QLYJ2pm0-uXqrpLfVmoH3aczs7yF6rlNwJ5U4Zj7xh9NWLCDmFOD8eK0zSps2j8sXvFvnrNOKsKsqEyLocNg4-YTcV4EaR2U Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c66aab4ab90e4ee1be5a36496447d1a2 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1775677503 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c66aab4ab90e4ee1be5a36496447d1a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c66aab4ab90e4ee1be5a36496447d1a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c66aab4ab90e4ee1be5a36496447d1a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c66aab4ab90e4ee1be5a36496447d1a2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1775677503 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c66aab4ab90e4ee1be5a36496447d1a2 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1775677503 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerRescueTestJSONUnderV235-1775677503-project Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 519822988db142fba7e027f3dd1109a7 Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1775677503-project Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 could not be found. Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '40a9b61c-f4b3-4970-a1cf-0f99f076e072'} Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 could not be found. Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 could not be found. Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:53.421000 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 could not be found. Jun 18 22:13:53.426189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:13:53.427852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] Returning 404 to user: Instance 40a9b61c-f4b3-4970-a1cf-0f99f076e072 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:53.428955 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6dd24f33-45e3-4dd7-96c8-800e3b9debee tempest-ServerRescueTestJSONUnderV235-1775677503 tempest-ServerRescueTestJSONUnderV235-1775677503-project] 10.222.0.30 "GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072" status: 404 len: 111 microversion: 2.1 time: 0.044291 Jun 18 22:13:53.430076 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1571/3143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:53 2022] GET /compute/v2.1/servers/40a9b61c-f4b3-4970-a1cf-0f99f076e072 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:53.584215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:53.593746 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b2a3d8b-baf6-4245-ae82-1e939858d8ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.781288 Jun 18 22:13:53.595220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1573/3144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:52 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:53.884394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-839777569", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "bb9d27f4-5248-45ac-b6ea-49c26d0f2d71"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:53.973621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] validate_networks() for [('bb9d27f4-5248-45ac-b6ea-49c26d0f2d71', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:13:54.394689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:54.395327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] [instance: 417dc01e-91d1-4843-8c11-b0081ea68469] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:54.402984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:54.403460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:54.404530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:54.405325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:54.432439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] HTTP exception thrown: Instance 417dc01e-91d1-4843-8c11-b0081ea68469 could not be found. Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Request method failure captured: Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 HTTP/1.1 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk1rHpakU06_KDIJ9PHg7HCsG0W9XM4spIN2nznkCapQALIaZOgzLzNuUlaljAkVN412Ogo2PpoxO5V9earABMH3hnxJYY7JgL-KX8V4npVuAYbIP9-s9ft__7HDp_ROZ-HiMfatOo0w3sifWX_DgtzqpUzVuvEbPsfKeLrXOA8IPWU Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e29bd993bde443a7ae41414b603e05d5 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ListImageFiltersTestJSON-1456212537 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e29bd993bde443a7ae41414b603e05d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e29bd993bde443a7ae41414b603e05d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e29bd993bde443a7ae41414b603e05d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e29bd993bde443a7ae41414b603e05d5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ListImageFiltersTestJSON-1456212537 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e29bd993bde443a7ae41414b603e05d5 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1456212537 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ListImageFiltersTestJSON-1456212537-project Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c121277893cc4640a85bc96dcef6aef7 Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ListImageFiltersTestJSON-1456212537-project Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 417dc01e-91d1-4843-8c11-b0081ea68469 could not be found. Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '417dc01e-91d1-4843-8c11-b0081ea68469'} Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417dc01e-91d1-4843-8c11-b0081ea68469 could not be found. Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417dc01e-91d1-4843-8c11-b0081ea68469 could not be found. Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:13:54.434416 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417dc01e-91d1-4843-8c11-b0081ea68469 could not be found. Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Returning 404 to user: Instance 417dc01e-91d1-4843-8c11-b0081ea68469 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:13:54.439170 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bbf1888c-2643-4cf3-9cfd-098e94be53ed tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469" status: 404 len: 111 microversion: 2.1 time: 0.047786 Jun 18 22:13:54.440914 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1574/3145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:54 2022] GET /compute/v2.1/servers/417dc01e-91d1-4843-8c11-b0081ea68469 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:13:54.448276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aad81611-514b-4803-a928-3cd0ffa0d986 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19cbe820>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:54.991747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:13:54.992242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:13:54.992632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:13:54.993079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:13:54.993496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:13:55.009923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.012188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.013006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.016446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.042574 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aad81611-514b-4803-a928-3cd0ffa0d986 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/images/fc2db7bb-9458-4317-9c6c-5cd1d29a4f98" status: 204 len: 0 microversion: 2.1 time: 0.600477 Jun 18 22:13:55.043275 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1575/3146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:54 2022] DELETE /compute/v2.1/images/fc2db7bb-9458-4317-9c6c-5cd1d29a4f98 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:55.048060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Getting quotas for project deaa53169cbd4a83aa39a825ee4a3a70. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:13:55.052339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b4667f05-93d6-4cb8-8fa2-89ac22d3514a req-bd8d2b4c-a01d-460b-b8af-28aaa9399f7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dc01e-91d1-4843-8c11-b0081ea68469", "name": "network-vif-deleted", "tag": "5e05d58d-64b0-4696-a8f7-f635404f5ba0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:55.054150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Getting quotas for user 556851fde980466c99cb1873cdb30dea and project deaa53169cbd4a83aa39a825ee4a3a70. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:13:55.066189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4667f05-93d6-4cb8-8fa2-89ac22d3514a req-bd8d2b4c-a01d-460b-b8af-28aaa9399f7d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.066925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4667f05-93d6-4cb8-8fa2-89ac22d3514a req-bd8d2b4c-a01d-460b-b8af-28aaa9399f7d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.068074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Going to run 3 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:13:55.070451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:13:55.080264 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b4667f05-93d6-4cb8-8fa2-89ac22d3514a req-bd8d2b4c-a01d-460b-b8af-28aaa9399f7d service nova] Creating event network-vif-deleted:5e05d58d-64b0-4696-a8f7-f635404f5ba0 for instance 417dc01e-91d1-4843-8c11-b0081ea68469 on nch1-master-1 Jun 18 22:13:55.085631 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b4667f05-93d6-4cb8-8fa2-89ac22d3514a req-bd8d2b4c-a01d-460b-b8af-28aaa9399f7d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037345 Jun 18 22:13:55.086484 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1576/3147] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:55.096380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:55.097362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:55.104786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.105366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.106305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.106954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.107457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=39fe75a5-fa2d-4543-a057-e641723072f3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:13:55.147355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=f0109410-45b6-4ed8-8d84-b525ef5970db,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:13:55.231791 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-612f79c8-58f0-47f3-9485-eaaedb9a3930 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.644758 Jun 18 22:13:55.232990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1572/3148] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:13:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:13:55.243072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8692e229-a2f0-4bc9-991b-7f8f9e29ed7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea14bc6c10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:55.429787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:55.444340 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-426ea55b-7110-4d57-b7e4-261481569c73 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.350483 Jun 18 22:13:55.445534 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1577/3149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:55 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:55.467543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01bad54a-272a-4e26-871e-beb4a6d0498e"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:13:55.469536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:55.485118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.486130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.488148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.488837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.618858 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8692e229-a2f0-4bc9-991b-7f8f9e29ed7d tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/images/16ecb526-da8c-4b1e-ae24-0fc968c60798" status: 204 len: 0 microversion: 2.1 time: 0.384436 Jun 18 22:13:55.619782 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1573/3150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:55 2022] DELETE /compute/v2.1/images/16ecb526-da8c-4b1e-ae24-0fc968c60798 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:55.627547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:55.631511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:55.632356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:13:55.715036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.715542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.716449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:55.722885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:55.732156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:13:55.837245 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b97bd3a-0d5f-4bbc-a68b-cdac663a3b98 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.216015 Jun 18 22:13:55.839874 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1574/3151] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:13:55 2022] GET /compute/v2.1/servers => generated 1015 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:55.847442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-917ce518-edb5-4df6-9fa3-dc455e444fa6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] Calling method '.version_select at 0x7fea19dcb8b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:56.013996 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-018fb8fc-b681-4255-8ebd-30be86b98812 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "POST /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536245 Jun 18 22:13:56.030782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1578/3152] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:13:55 2022] POST /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments => generated 194 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:13:56.089846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9a3b236-6ea4-4a07-b0f5-a5ffc8707433 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:56.096324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9a3b236-6ea4-4a07-b0f5-a5ffc8707433 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:56.299802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9a3b236-6ea4-4a07-b0f5-a5ffc8707433 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:56.321138 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-917ce518-edb5-4df6-9fa3-dc455e444fa6 tempest-ListImageFiltersTestJSON-1456212537 tempest-ListImageFiltersTestJSON-1456212537-project] 10.222.0.30 "DELETE /compute/v2.1/images/e8217fc6-9161-4117-8def-5286a7d89d26" status: 204 len: 0 microversion: 2.1 time: 0.479554 Jun 18 22:13:56.322094 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1575/3153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:55 2022] DELETE /compute/v2.1/images/e8217fc6-9161-4117-8def-5286a7d89d26 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:13:56.326624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9a3b236-6ea4-4a07-b0f5-a5ffc8707433 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1222 microversion: 2.1 time: 0.283842 Jun 18 22:13:56.328651 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1579/3154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:56 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1222 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:56.470649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:56.471597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:56.487602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:56.492563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:56.496280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:56.498416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:56.969442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:56.983996 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-890cb4bd-cbff-4e04-8ee6-5ad169b2745f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.523004 Jun 18 22:13:56.996661 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1576/3155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:56 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:57.347752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:57.350391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:57.375173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:57.387811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:57.391806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:57.393397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:57.626355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:57.651170 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82e97357-e4ef-45e5-8fcf-c1b02b0a73c3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1226 microversion: 2.1 time: 0.308729 Jun 18 22:13:57.653898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1580/3156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:57 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1226 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:58.004552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:58.005267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:58.029777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:58.032993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:58.036489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:58.038372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:58.671892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:58.673335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:13:58.688061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:58.695414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:58.696951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:58.698779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:59.015887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:59.020037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:13:59.037404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-909abca2-8d77-4e03-b642-51941918066c tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1282 microversion: 2.1 time: 0.370837 Jun 18 22:13:59.038014 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1581/3157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:58 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1282 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:59.060392 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b99606a9-269f-4fa7-909b-df7bb46ee6f6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 1.061177 Jun 18 22:13:59.067261 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1577/3158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:13:57 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:13:59.594132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e15f477d-cb44-4dba-affd-d67e970d0c84 tempest-AbsoluteLimitsTestJSON-113365396 tempest-AbsoluteLimitsTestJSON-113365396-project] Calling method '.version_select at 0x7fea07912d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:13:59.630001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e15f477d-cb44-4dba-affd-d67e970d0c84 tempest-AbsoluteLimitsTestJSON-113365396 tempest-AbsoluteLimitsTestJSON-113365396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:59.631714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e15f477d-cb44-4dba-affd-d67e970d0c84 tempest-AbsoluteLimitsTestJSON-113365396 tempest-AbsoluteLimitsTestJSON-113365396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:59.637193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e15f477d-cb44-4dba-affd-d67e970d0c84 tempest-AbsoluteLimitsTestJSON-113365396 tempest-AbsoluteLimitsTestJSON-113365396-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:13:59.639853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e15f477d-cb44-4dba-affd-d67e970d0c84 tempest-AbsoluteLimitsTestJSON-113365396 tempest-AbsoluteLimitsTestJSON-113365396-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:13:59.676704 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e15f477d-cb44-4dba-affd-d67e970d0c84 tempest-AbsoluteLimitsTestJSON-113365396 tempest-AbsoluteLimitsTestJSON-113365396-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.262178 Jun 18 22:13:59.678476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1582/3159] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:13:59 2022] GET /compute/v2.1/limits => generated 511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:00.057573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:00.058238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:00.075262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:00.079899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.079899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.084268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:00.085165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:00.090543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.092425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.103668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.104151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.105076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.107184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.347482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:00.371172 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7ab0f78-76b0-466a-9b26-b904c97eccd1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1280 microversion: 2.1 time: 0.319711 Jun 18 22:14:00.374049 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1578/3160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:00 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:00.447731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:00.461712 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b3cff150-ef58-4d77-8e7d-7be85536e46e tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.381811 Jun 18 22:14:00.463318 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1583/3161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:00 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:00.928183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:00.929878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:00.937170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.937717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.938512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.939137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.974860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf723bb3-5f85-4b92-82dc-9ed5a280cc8a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053121 Jun 18 22:14:00.975452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1579/3162] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:14:00 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:00.986694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:00.987267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:00.994555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.995117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:00.996177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:00.997072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:01.113878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lazy-loading 'services' on Instance uuid 74e0fe1a-5120-4953-8610-19c8bb8dab59 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:01.232078 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8413345a-6fef-4431-b8dd-c803fdea328b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments/01bad54a-272a-4e26-871e-beb4a6d0498e" status: 202 len: 0 microversion: 2.1 time: 0.248590 Jun 18 22:14:01.233413 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1584/3163] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:14:00 2022] DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments/01bad54a-272a-4e26-871e-beb4a6d0498e => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:14:01.397991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:01.399229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:01.406186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:01.407058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:01.408245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:01.408835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:01.486518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:01.487365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:01.500452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:01.502140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:01.503277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:01.504129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:01.830049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:01.838955 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bd3c0095-9767-4010-80b0-82956a4025ac tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.451576 Jun 18 22:14:01.839841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1580/3164] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:01 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:01.876098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:01.884573 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-21e1d3ae-ed30-471b-ab0c-f9892ec2e188 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.407264 Jun 18 22:14:01.885187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1585/3165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:01 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:02.459305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:02.460450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:02.475866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.477666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.481583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.482181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.534567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c793247-01c8-4c64-8ab2-bc9c4e9494dc tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079256 Jun 18 22:14:02.535859 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1581/3166] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:14:02 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:14:02.612478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:02.621531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:02.639638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.640115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.640920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.641924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.685507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d5ef7bb-8005-4d73-8285-51af7082eba5 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084360 Jun 18 22:14:02.686170 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1586/3167] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:14:02 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:14:02.788797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:02.789899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:02.799252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.799983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.801407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.801998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.840581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:02.858750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:02.859939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:02.869391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.870412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.871541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:02.872352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:02.967593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:03.053260 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e782294-1aac-4f5a-bdc6-df0988d58e47 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 204 len: 0 microversion: 2.1 time: 0.271518 Jun 18 22:14:03.061676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1582/3168] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:02 2022] DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:03.075017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:03.075756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:03.087976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:03.088692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:03.090424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:03.091402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:03.312106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:03.322342 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc6eff4a-d910-40b0-ac41-dc498436066f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.468849 Jun 18 22:14:03.338895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1587/3169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:02 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:03.349762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:03.352752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:03.368564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:03.369409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:03.370499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:03.371661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:03.541991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:03.556212 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.490531 Jun 18 22:14:03.558051 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1583/3170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:03 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:03.559909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:03.562240 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-485e1ba0-997a-4945-9b9f-dc7dddf4ad50 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003150 Jun 18 22:14:03.562706 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1584/3171] 10.222.0.30 () {56 vars in 885 bytes} [Sat Jun 18 22:14:03 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 18 22:14:03.715404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-05cadcbb-dee6-4d64-88b6-ebb8abf8049e req-ae343175-ff1d-45b3-bd1d-363ea6421242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0109410-45b6-4ed8-8d84-b525ef5970db", "tag": "276c3885-02c4-4b79-aea4-fd7f1c433b7d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:03.731458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-05cadcbb-dee6-4d64-88b6-ebb8abf8049e req-ae343175-ff1d-45b3-bd1d-363ea6421242 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:03.731819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-05cadcbb-dee6-4d64-88b6-ebb8abf8049e req-ae343175-ff1d-45b3-bd1d-363ea6421242 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:03.749352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:03.755849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-05cadcbb-dee6-4d64-88b6-ebb8abf8049e req-ae343175-ff1d-45b3-bd1d-363ea6421242 service nova] Creating event network-changed:276c3885-02c4-4b79-aea4-fd7f1c433b7d for instance f0109410-45b6-4ed8-8d84-b525ef5970db on nch1-master-1 Jun 18 22:14:03.766661 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-077f9723-fee8-4e88-844e-ef69dccdb6c3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1680 microversion: 2.1 time: 0.425970 Jun 18 22:14:03.768721 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1588/3172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:03 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1680 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:03.771203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-05cadcbb-dee6-4d64-88b6-ebb8abf8049e req-ae343175-ff1d-45b3-bd1d-363ea6421242 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061248 Jun 18 22:14:03.771815 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1585/3173] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:14:04.217299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4baede7d-4759-4d65-b09a-b305d61f4f22 req-05a7227e-a281-48b4-98a6-c29934f8fe73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39fe75a5-fa2d-4543-a057-e641723072f3", "tag": "7557f70f-58da-425a-b58d-854db53bf485"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:04.237621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4baede7d-4759-4d65-b09a-b305d61f4f22 req-05a7227e-a281-48b4-98a6-c29934f8fe73 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.238561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4baede7d-4759-4d65-b09a-b305d61f4f22 req-05a7227e-a281-48b4-98a6-c29934f8fe73 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:04.254759 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4baede7d-4759-4d65-b09a-b305d61f4f22 req-05a7227e-a281-48b4-98a6-c29934f8fe73 service nova] Creating event network-changed:7557f70f-58da-425a-b58d-854db53bf485 for instance 39fe75a5-fa2d-4543-a057-e641723072f3 on nch2-master-1 Jun 18 22:14:04.263201 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4baede7d-4759-4d65-b09a-b305d61f4f22 req-05a7227e-a281-48b4-98a6-c29934f8fe73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050134 Jun 18 22:14:04.264508 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1589/3174] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:04.346367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:04.347453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:04.361591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.362032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:04.362825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.375480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:04.582047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:04.583550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:04.601914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.602663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:04.603748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.604397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:04.799328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:04.819411 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f168d024-73f9-43e5-b343-df93a502edcb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.477716 Jun 18 22:14:04.822649 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1586/3175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:04 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:04.837566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:04.838478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:04.845453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.846397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:04.847386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:04.848165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:05.009212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:05.040292 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32c3a4ff-80e6-4d54-9320-7b5d408c83ce tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.464844 Jun 18 22:14:05.041942 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1590/3176] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:04 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:05.063311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:05.317563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:05.329463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc19115a-f610-4095-8c5a-dc42301e039c tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1680 microversion: 2.1 time: 0.495600 Jun 18 22:14:05.330417 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1587/3177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:04 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1680 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:05.798214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-104a1878-6106-4168-b104-ceef7e54c19b req-8ce33f1c-4bd8-46a0-957e-dfec625ce057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eadd466-efb5-4b81-9c7d-dde3679e1b38", "tag": "bf912c0d-6de7-41ec-bdbf-19ca16b8b3c2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:05.809677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-104a1878-6106-4168-b104-ceef7e54c19b req-8ce33f1c-4bd8-46a0-957e-dfec625ce057 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:05.810314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-104a1878-6106-4168-b104-ceef7e54c19b req-8ce33f1c-4bd8-46a0-957e-dfec625ce057 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:05.827075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-104a1878-6106-4168-b104-ceef7e54c19b req-8ce33f1c-4bd8-46a0-957e-dfec625ce057 service nova] Creating event network-changed:bf912c0d-6de7-41ec-bdbf-19ca16b8b3c2 for instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 on nch2-master-1 Jun 18 22:14:05.840940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:05.841664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:05.844557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:05.846439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-104a1878-6106-4168-b104-ceef7e54c19b req-8ce33f1c-4bd8-46a0-957e-dfec625ce057 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040298 Jun 18 22:14:05.847192 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1591/3178] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:05.854194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:05.855023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:05.856111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:05.857161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:06.061852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:06.063466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:06.072672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:06.073919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:06.075447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:06.077367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:06.363660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:06.373983 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-043386f3-c97f-4596-96b8-b8fa71581f03 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.537959 Jun 18 22:14:06.374615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1588/3179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:05 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:06.398286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:06.398938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:06.417640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:06.418476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:06.419620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:06.423119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:06.726901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27c40405bf7547b4b1b896b142ea4156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07a129b1f88f4c4f97cc3a9f76ef47f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:06.752580 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db2bb77f-36a2-4df6-a9eb-930e0ab5c26b tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 200 len: 1613 microversion: 2.1 time: 0.360942 Jun 18 22:14:06.756017 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1589/3180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:06 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 1613 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:06.821602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:06.852268 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1fd2aa74-0171-4b34-a52f-c677478b4c15 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.796055 Jun 18 22:14:06.852534 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1592/3181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:06 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:07.394676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:07.395643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:07.419541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:07.421763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:07.423435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:07.425081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:07.773681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:07.775085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:07.791405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:07.793983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:07.794888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:07.796331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:07.823843 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] HTTP exception thrown: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Request method failure captured: Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 HTTP/1.1 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2eEq2fF6VRxEtBDiBY2lvVBTaF4Vd3dHfmDW5vc3H9ZrpydP9OGlNPm4TtoxZc8ebFQ1U8emT2NurNWOP2ksMPYctRhHofU-UX2yIGgXjKBxtHxO-UAvHU8yAX29VuGX1n4fREAqTVhUKyLnpn_X03Wo1zKXLhaWaaGrcyuD3njLg Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 07a129b1f88f4c4f97cc3a9f76ef47f1 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_07a129b1f88f4c4f97cc3a9f76ef47f1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 07a129b1f88f4c4f97cc3a9f76ef47f1 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachSCSIVolumeTestJSON-1926732602-project Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 27c40405bf7547b4b1b896b142ea4156 Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1926732602-project Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74e0fe1a-5120-4953-8610-19c8bb8dab59'} Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:07.827429 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:07.834561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Returning 404 to user: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:07.837123 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea0a5edc-72c3-4d89-8b3f-5c55875f0bfd tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 404 len: 111 microversion: 2.1 time: 0.067273 Jun 18 22:14:07.838568 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1593/3182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:07 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:14:07.847881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f65de8b-ec58-4623-b64a-387bb5a9077a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '.version_select at 0x7fea07912310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:07.905841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f65de8b-ec58-4623-b64a-387bb5a9077a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405650717" status: 202 len: 0 microversion: 2.1 time: 0.062624 Jun 18 22:14:07.909690 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1594/3183] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:14:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405650717 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:14:07.922229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:07.923894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:07.943716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:07.944651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:07.945701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:07.946442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:08.664236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:08.675048 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d624cf3e-06d6-4726-9ca5-f22bb305e007 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 1.286459 Jun 18 22:14:08.676251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1590/3184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:07 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:08.679296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:08.684381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-495e100e-634d-4083-81f7-502517157912 req-e494d4c8-de72-4347-93a1-20e5139319ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e0fe1a-5120-4953-8610-19c8bb8dab59", "name": "network-vif-deleted", "tag": "e067ed6e-b170-4963-97d6-d82c9599c977"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:08.694782 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c97cf564-9e31-47ea-adf0-32ea87188d58 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1477 microversion: 2.1 time: 0.783870 Jun 18 22:14:08.696595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-495e100e-634d-4083-81f7-502517157912 req-e494d4c8-de72-4347-93a1-20e5139319ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:08.697373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-495e100e-634d-4083-81f7-502517157912 req-e494d4c8-de72-4347-93a1-20e5139319ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:08.697757 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1595/3185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:07 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1477 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:08.714684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-495e100e-634d-4083-81f7-502517157912 req-e494d4c8-de72-4347-93a1-20e5139319ad service nova] Creating event network-vif-deleted:e067ed6e-b170-4963-97d6-d82c9599c977 for instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 on nch2-master-1 Jun 18 22:14:08.725495 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-495e100e-634d-4083-81f7-502517157912 req-e494d4c8-de72-4347-93a1-20e5139319ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046058 Jun 18 22:14:08.726847 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1591/3186] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:09.693853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:09.695361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:09.700144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:09.702646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:09.716442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:09.718666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:09.722485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:09.724003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:09.724889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:09.725068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:09.765584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:09.767098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:09.769479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:09.769999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:10.672215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:10.690971 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eeaf5dc9-6787-4171-994b-de7c704a37d3 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 1.000768 Jun 18 22:14:10.692656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1596/3187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:09 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:10.741349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:10.760574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-51b753a0-f9d2-4a9c-b6b6-6f8555ca751c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1476 microversion: 2.1 time: 1.047285 Jun 18 22:14:10.761882 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1592/3188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:09 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1476 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:11.241729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3f138ef4-78a5-4541-abe5-64d2c73155c8 req-dee417b9-94aa-41f3-a9ff-81fa76a0e0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "name": "network-vif-unplugged", "status": "completed", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:11.262265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3f138ef4-78a5-4541-abe5-64d2c73155c8 req-dee417b9-94aa-41f3-a9ff-81fa76a0e0bb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:11.263830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3f138ef4-78a5-4541-abe5-64d2c73155c8 req-dee417b9-94aa-41f3-a9ff-81fa76a0e0bb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:11.305932 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3f138ef4-78a5-4541-abe5-64d2c73155c8 req-dee417b9-94aa-41f3-a9ff-81fa76a0e0bb service nova] Creating event network-vif-unplugged:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch2-master-1 Jun 18 22:14:11.332196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-3f138ef4-78a5-4541-abe5-64d2c73155c8 req-dee417b9-94aa-41f3-a9ff-81fa76a0e0bb service nova] Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:14:11.371442 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3f138ef4-78a5-4541-abe5-64d2c73155c8 req-dee417b9-94aa-41f3-a9ff-81fa76a0e0bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129669 Jun 18 22:14:11.374196 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1597/3189] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:11.526395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3511ca4c-f62a-4e45-8eed-c57de7c46769 req-39733f71-fc7b-45a5-9426-bd72686e4ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0109410-45b6-4ed8-8d84-b525ef5970db", "name": "network-vif-plugged", "status": "completed", "tag": "276c3885-02c4-4b79-aea4-fd7f1c433b7d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:11.547165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3511ca4c-f62a-4e45-8eed-c57de7c46769 req-39733f71-fc7b-45a5-9426-bd72686e4ea3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:11.549137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3511ca4c-f62a-4e45-8eed-c57de7c46769 req-39733f71-fc7b-45a5-9426-bd72686e4ea3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:11.585371 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3511ca4c-f62a-4e45-8eed-c57de7c46769 req-39733f71-fc7b-45a5-9426-bd72686e4ea3 service nova] Creating event network-vif-plugged:276c3885-02c4-4b79-aea4-fd7f1c433b7d for instance f0109410-45b6-4ed8-8d84-b525ef5970db on nch1-master-1 Jun 18 22:14:11.601109 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3511ca4c-f62a-4e45-8eed-c57de7c46769 req-39733f71-fc7b-45a5-9426-bd72686e4ea3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081951 Jun 18 22:14:11.605618 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1593/3190] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:11.710638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:11.711363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:11.732784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:11.738420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:11.740825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:11.745492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:11.746111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:11.786375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:11.790021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:11.833695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:11.839576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:11.843916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:11.848877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:12.302646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:12.310070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:12.314998 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5059dce-f1f6-4956-8d3f-a8ea3c6a02c0 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.608411 Jun 18 22:14:12.315888 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1598/3191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:11 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:12.338870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:12.339841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:12.356201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:12.357159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:12.358103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:12.358876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:12.378049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] HTTP exception thrown: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Request method failure captured: Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 HTTP/1.1 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2eEq2fF6VRxEtBDiBY2lvVBTaF4Vd3dHfmDW5vc3H9ZrpydP9OGlNPm4TtoxZc8ebFQ1U8emT2NurNWOP2ksMPYctRhHofU-UX2yIGgXjKBxtHxO-UAvHU8yAX29VuGX1n4fREAqTVhUKyLnpn_X03Wo1zKXLhaWaaGrcyuD3njLg Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 07a129b1f88f4c4f97cc3a9f76ef47f1 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_07a129b1f88f4c4f97cc3a9f76ef47f1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 07a129b1f88f4c4f97cc3a9f76ef47f1 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachSCSIVolumeTestJSON-1926732602-project Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 27c40405bf7547b4b1b896b142ea4156 Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1926732602-project Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74e0fe1a-5120-4953-8610-19c8bb8dab59'} Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:12.380512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.386084 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.396376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Returning 404 to user: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:12.397873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a4babf0-8c74-4b67-8847-886ee1b1c95a tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 404 len: 111 microversion: 2.1 time: 0.070149 Jun 18 22:14:12.399211 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1599/3192] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:12 2022] DELETE /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:12.419153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:12.421089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] [instance: 74e0fe1a-5120-4953-8610-19c8bb8dab59] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:12.432289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:12.433230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:12.434399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:12.435156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:12.465026 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] HTTP exception thrown: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Request method failure captured: Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 HTTP/1.1 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2eEq2fF6VRxEtBDiBY2lvVBTaF4Vd3dHfmDW5vc3H9ZrpydP9OGlNPm4TtoxZc8ebFQ1U8emT2NurNWOP2ksMPYctRhHofU-UX2yIGgXjKBxtHxO-UAvHU8yAX29VuGX1n4fREAqTVhUKyLnpn_X03Wo1zKXLhaWaaGrcyuD3njLg Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 07a129b1f88f4c4f97cc3a9f76ef47f1 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07a129b1f88f4c4f97cc3a9f76ef47f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_07a129b1f88f4c4f97cc3a9f76ef47f1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 07a129b1f88f4c4f97cc3a9f76ef47f1 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1926732602 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachSCSIVolumeTestJSON-1926732602-project Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 27c40405bf7547b4b1b896b142ea4156 Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1926732602-project Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74e0fe1a-5120-4953-8610-19c8bb8dab59'} Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:12.467477 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. Jun 18 22:14:12.472845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:12.476147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] Returning 404 to user: Instance 74e0fe1a-5120-4953-8610-19c8bb8dab59 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:12.477574 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a323000c-9d8b-4e5b-a14e-ab4ccd4127b3 tempest-AttachSCSIVolumeTestJSON-1926732602 tempest-AttachSCSIVolumeTestJSON-1926732602-project] 10.222.0.30 "GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59" status: 404 len: 111 microversion: 2.1 time: 0.066086 Jun 18 22:14:12.482273 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1600/3193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:12 2022] GET /compute/v2.1/servers/74e0fe1a-5120-4953-8610-19c8bb8dab59 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:12.516781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:12.530724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1bdc690-4238-49d4-85d0-82ef62fbee33 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1476 microversion: 2.1 time: 0.753089 Jun 18 22:14:12.539123 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1594/3194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:11 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1476 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:13.333979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:13.334678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:13.344560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:13.345324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:13.346323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:13.346762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:13.415447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-66ca64a6-dfaf-46c2-96fe-7b57a66b8d27 req-d9eb39fa-d60a-4f57-8c68-ef5b7a4e4aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:13.433296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-66ca64a6-dfaf-46c2-96fe-7b57a66b8d27 req-d9eb39fa-d60a-4f57-8c68-ef5b7a4e4aa7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:13.433753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-66ca64a6-dfaf-46c2-96fe-7b57a66b8d27 req-d9eb39fa-d60a-4f57-8c68-ef5b7a4e4aa7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:13.464390 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-66ca64a6-dfaf-46c2-96fe-7b57a66b8d27 req-d9eb39fa-d60a-4f57-8c68-ef5b7a4e4aa7 service nova] Creating event network-changed:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch2-master-1 Jun 18 22:14:13.495452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-66ca64a6-dfaf-46c2-96fe-7b57a66b8d27 req-d9eb39fa-d60a-4f57-8c68-ef5b7a4e4aa7 service nova] Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:14:13.512088 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-66ca64a6-dfaf-46c2-96fe-7b57a66b8d27 req-d9eb39fa-d60a-4f57-8c68-ef5b7a4e4aa7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100347 Jun 18 22:14:13.513353 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1595/3195] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:13.565279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:13.566112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:13.573573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:13.574196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:13.575497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:13.576473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:14.019549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:14.033713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:14.036580 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7512a788-7fc6-4202-aca5-7e69f7ccdce2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.703475 Jun 18 22:14:14.037376 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1601/3196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:13 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:14.044374 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c90ef78-fdd8-452d-a907-e803654e69c0 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1476 microversion: 2.1 time: 0.492961 Jun 18 22:14:14.045602 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1596/3197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:13 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1476 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:14.065260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-94a70be2-909f-4010-9973-02aeb199788f req-80abb39f-2967-41bc-b3f3-839c47541f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eadd466-efb5-4b81-9c7d-dde3679e1b38", "name": "network-vif-plugged", "status": "completed", "tag": "bf912c0d-6de7-41ec-bdbf-19ca16b8b3c2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:14.108406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-94a70be2-909f-4010-9973-02aeb199788f req-80abb39f-2967-41bc-b3f3-839c47541f92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:14.109680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-94a70be2-909f-4010-9973-02aeb199788f req-80abb39f-2967-41bc-b3f3-839c47541f92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:14.151293 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-94a70be2-909f-4010-9973-02aeb199788f req-80abb39f-2967-41bc-b3f3-839c47541f92 service nova] Creating event network-vif-plugged:bf912c0d-6de7-41ec-bdbf-19ca16b8b3c2 for instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 on nch2-master-1 Jun 18 22:14:14.165743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-94a70be2-909f-4010-9973-02aeb199788f req-80abb39f-2967-41bc-b3f3-839c47541f92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123634 Jun 18 22:14:14.166775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1602/3198] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:15.055348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:15.056050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:15.067641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:15.070568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:15.071635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:15.072971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:15.101390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fdb25d2-d55e-414c-b511-d6bfb2609b42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'create', calling method: .version_select at 0x7fea14199a60>, body: {"keypair": {"name": "tempest-keypair-688489798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKsUz0f9z63gPDnh33zzmuyNm8YwbWMQG4vEMqYIPq8k3hFUVkAc/eD4RXLwZtoF9QjQCeTEV1umC/sGB1PgYgTCgSrQ3PB0b4+JLyLe8P1P+rA6bbVKGvWLMNZ2fmD7A=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:15.121957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-0fdb25d2-d55e-414c-b511-d6bfb2609b42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:14:15.128972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-0fdb25d2-d55e-414c-b511-d6bfb2609b42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for user ab975e8ffd0448939b2105aed58003fe and project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:14:15.180547 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fdb25d2-d55e-414c-b511-d6bfb2609b42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.651862 Jun 18 22:14:15.181781 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1597/3199] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:14:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:15.187702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:15.188849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:15.195893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:15.197026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:15.197994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:15.236491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:15.309408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:15.319996 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bedf6ef6-d61b-46e8-864e-cbd437d23d53 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.269950 Jun 18 22:14:15.321829 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1603/3200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:15 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:15.557642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:15.630313 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a9efdb3-7e61-4061-a43d-8f36971ba60f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1474 microversion: 2.1 time: 0.433743 Jun 18 22:14:15.636821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1598/3201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:15 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1474 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:16.209845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1341d49e-0ac1-4edd-bc68-1afcfbf5643a req-f685bcc4-aee3-44ad-95a8-3bb5b0bed110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fe75a5-fa2d-4543-a057-e641723072f3", "name": "network-vif-plugged", "status": "completed", "tag": "7557f70f-58da-425a-b58d-854db53bf485"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:16.232771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1341d49e-0ac1-4edd-bc68-1afcfbf5643a req-f685bcc4-aee3-44ad-95a8-3bb5b0bed110 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:16.233283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1341d49e-0ac1-4edd-bc68-1afcfbf5643a req-f685bcc4-aee3-44ad-95a8-3bb5b0bed110 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:16.279971 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1341d49e-0ac1-4edd-bc68-1afcfbf5643a req-f685bcc4-aee3-44ad-95a8-3bb5b0bed110 service nova] Creating event network-vif-plugged:7557f70f-58da-425a-b58d-854db53bf485 for instance 39fe75a5-fa2d-4543-a057-e641723072f3 on nch2-master-1 Jun 18 22:14:16.302987 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1341d49e-0ac1-4edd-bc68-1afcfbf5643a req-f685bcc4-aee3-44ad-95a8-3bb5b0bed110 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100559 Jun 18 22:14:16.306936 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1604/3202] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:16.339885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:16.341142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:16.361141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:16.364593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:16.367420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:16.367699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:16.653588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:16.654432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:16.669415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:16.669859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:16.670903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:16.671507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:16.791818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:16.810605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c3f7483-e8da-45af-b216-8da1f0186076 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1322 microversion: 2.1 time: 0.475993 Jun 18 22:14:16.818086 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1599/3203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:16 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:17.093968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:17.113441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-344b3dba-a4f1-40e0-85c2-7813ea60de70 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1471 microversion: 2.1 time: 0.464960 Jun 18 22:14:17.130017 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1605/3204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:16 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:17.136117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:17.136887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:17.149635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.150117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.150948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.151389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.241082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:17.241645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:17.261894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.262409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.266148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.266614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.369634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:17.536841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3f7879fc-a96f-4cd3-9823-0edfefa595b9 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 204 len: 0 microversion: 2.1 time: 0.298374 Jun 18 22:14:17.538851 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1606/3205] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:17 2022] DELETE /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:17.544401 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f4cd1f3-df65-4d0b-8d75-44c261effc06 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "POST /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3/action" status: 202 len: 0 microversion: 2.1 time: 0.404335 Jun 18 22:14:17.545829 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1600/3206] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:14:17 2022] POST /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:14:17.561435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:17.563368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:17.564070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:17.566520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:17.583643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.584767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.586673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.588151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.590239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.591385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:17.594077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:17.595023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:18.008287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:18.032408 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f09b1de6-ca42-410c-a21d-524c1718319d tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1666 microversion: 2.1 time: 0.488520 Jun 18 22:14:18.042247 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1607/3207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:17 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1666 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:18.048917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:18.056967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:18.071604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:18.072077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:18.072880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:18.073371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:18.092468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:18.102082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec0758ad-a30c-4068-9d5a-5f5c80f8680a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.550849 Jun 18 22:14:18.110240 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1601/3208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:17 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:18.499322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:18.514430 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec542407-f6ac-4a0a-b2d0-d6fc17f0a108 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 200 len: 1514 microversion: 2.1 time: 0.469593 Jun 18 22:14:18.520570 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1608/3209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:18 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 1514 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:18.533305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:18.538896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:18.568809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:18.570187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:18.576496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:18.578135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:18.588676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:18.834073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:18.846799 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-322f5fea-9ac3-4d69-89d6-c92292cd5975 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 200 len: 1515 microversion: 2.1 time: 0.319290 Jun 18 22:14:18.849398 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1602/3210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:18 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:18.867689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:18.871448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:18.891427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:18.901735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:18.903523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:18.905570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:19.053119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:19.054257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:19.101647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:19.102517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:19.103568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:19.105276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:20.117502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:20.131817 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a63915dd-3466-4a8c-82d1-983fd44c7a55 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 200 len: 1322 microversion: 2.1 time: 1.264288 Jun 18 22:14:20.136375 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1609/3211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:18 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 1322 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:20.154047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:20.160062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:20.181411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:20.182253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:20.183624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:20.187744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:20.367345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:20.377896 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b1f1550-4ea3-4896-b9bd-4ca9d0f05aab tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1666 microversion: 2.1 time: 1.331968 Jun 18 22:14:20.381741 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1603/3212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:19 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1666 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:20.755842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:20.769166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b7320d11-84b3-4b4d-a570-ca87eed1354c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.630322 Jun 18 22:14:20.770544 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1610/3213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:20 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:20.870756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-11d3915c-e75c-45ed-88e1-13430d570b07 req-427715a1-8b69-4208-be03-10449c88be4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "name": "network-vif-plugged", "status": "completed", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:20.883523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-11d3915c-e75c-45ed-88e1-13430d570b07 req-427715a1-8b69-4208-be03-10449c88be4f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:20.884430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-11d3915c-e75c-45ed-88e1-13430d570b07 req-427715a1-8b69-4208-be03-10449c88be4f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:20.904338 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-11d3915c-e75c-45ed-88e1-13430d570b07 req-427715a1-8b69-4208-be03-10449c88be4f service nova] Creating event network-vif-plugged:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch2-master-1 Jun 18 22:14:20.915354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-11d3915c-e75c-45ed-88e1-13430d570b07 req-427715a1-8b69-4208-be03-10449c88be4f service nova] Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:14:20.931783 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-11d3915c-e75c-45ed-88e1-13430d570b07 req-427715a1-8b69-4208-be03-10449c88be4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064934 Jun 18 22:14:20.934265 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1604/3214] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:21.151712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:21.152420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:21.159275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:21.160084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:21.161171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:21.161884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:21.411135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:21.412010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:21.421130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:21.421981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:21.423110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:21.424466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:21.712087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:21.723757 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dd4d3a43-07f5-4f2c-a9d4-dc531d45e854 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1666 microversion: 2.1 time: 0.323256 Jun 18 22:14:21.724991 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1605/3215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:21 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1666 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:21.742178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-896872259", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4647eff-e46f-4758-90a6-f87dcd82bc48"}], "security_groups": [{"name": "tempest-securitygroup--55952505"}], "key_name": "tempest-keypair-688489798", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:21.901006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:21.913101 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-297f508e-94ae-4023-bf9b-9cefc21e1748 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 200 len: 1514 microversion: 2.1 time: 0.763595 Jun 18 22:14:21.914216 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1611/3216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:21 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 1514 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:21.931110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:21.932287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:21.941461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:21.950092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:21.953606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:21.954438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.007943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] validate_networks() for [('a4647eff-e46f-4758-90a6-f87dcd82bc48', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:14:22.387951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:22.406046 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e31daf5e-b341-4e0f-8367-a180120c1114 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.490320 Jun 18 22:14:22.416019 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1612/3217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:21 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:22.421121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:22.421647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:22.438609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.439305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.446153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.448427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.551805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:22.743664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca5b7a2d-6fb1-44e0-af51-8faf545b9be7 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 204 len: 0 microversion: 2.1 time: 0.325464 Jun 18 22:14:22.744568 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1613/3218] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:22 2022] DELETE /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:22.753270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a260ef6b-5b8d-47ab-bcc6-636b37cc78f5 req-7485a827-9de5-43a9-8b9f-2b8be7b523ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93252f6-2582-403c-973f-e17f4a9f03fd", "name": "network-vif-deleted", "tag": "a9dd753b-6694-48fe-8e25-b5c2ba258d2f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:22.769177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a260ef6b-5b8d-47ab-bcc6-636b37cc78f5 req-7485a827-9de5-43a9-8b9f-2b8be7b523ea service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.771172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a260ef6b-5b8d-47ab-bcc6-636b37cc78f5 req-7485a827-9de5-43a9-8b9f-2b8be7b523ea service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.789713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a260ef6b-5b8d-47ab-bcc6-636b37cc78f5 req-7485a827-9de5-43a9-8b9f-2b8be7b523ea service nova] Creating event network-vif-deleted:a9dd753b-6694-48fe-8e25-b5c2ba258d2f for instance d93252f6-2582-403c-973f-e17f4a9f03fd on nch2-master-1 Jun 18 22:14:22.797690 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a260ef6b-5b8d-47ab-bcc6-636b37cc78f5 req-7485a827-9de5-43a9-8b9f-2b8be7b523ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050872 Jun 18 22:14:22.798772 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1614/3219] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:22.811531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:22.812471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:22.822719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.824658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.827693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.828373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.860784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:22.950208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:22.965173 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-048cbc7d-e7d0-45fe-9909-84689862a064 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1598 microversion: 2.1 time: 0.157995 Jun 18 22:14:22.966136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1615/3220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:22 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:22.971919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:22.972784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:22.984634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.985203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:22.987456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:22.987875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:23.288482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:14:23.289755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:14:23.290232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:14:23.290677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:14:23.291130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:14:23.312493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:23.313349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:23.314389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:23.315090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:23.338083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:14:23.344483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for user ab975e8ffd0448939b2105aed58003fe and project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:14:23.358888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:14:23.361798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:14:23.419093 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-01021a5e-7f64-466e-b379-9efc686d7a02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.681777 Jun 18 22:14:23.420161 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1606/3221] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:21 2022] POST /compute/v2.1/servers => generated 407 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:14:23.427264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:23.428489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:23.438185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:23.439297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:23.440625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:23.441518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:23.458387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:23.471928 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66073792-c43b-4ba3-a8af-94fcf24b1b5d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 200 len: 1520 microversion: 2.1 time: 0.504440 Jun 18 22:14:23.474471 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1616/3222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:22 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 1520 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:23.486516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1009a57-3a96-4610-a742-917746c85760 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:23.489275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1009a57-3a96-4610-a742-917746c85760 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:23.675004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a1009a57-3a96-4610-a742-917746c85760 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:23.686538 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1009a57-3a96-4610-a742-917746c85760 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1237 microversion: 2.1 time: 0.209716 Jun 18 22:14:23.687856 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1617/3223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:23 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1237 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:23.809072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:23.820080 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3ca3dc1-06ac-4e9e-8de9-a4bd0db1a9f5 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.397958 Jun 18 22:14:23.820929 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1607/3224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:23 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:23.987094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:23.988257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:24.009165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.011244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.013059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.014348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.117188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:24.131235 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31159307-4034-4789-9180-384d030379c2 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1310 microversion: 2.1 time: 0.149624 Jun 18 22:14:24.131932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1618/3225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:23 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1310 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:24.491263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:24.492039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:24.512814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.517024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.521607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.521908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.706427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:24.707563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:24.725319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.726323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.727574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.728375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.892776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:24.906566 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee9b2c5b-c31d-4378-b174-4322b0342af7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1289 microversion: 2.1 time: 0.205353 Jun 18 22:14:24.909357 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1619/3226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:24 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1289 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:24.921748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:24.922377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:24.938656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.939137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.939851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:24.947442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:24.998007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:25.011873 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dcce2961-4cd4-474b-8e88-0ec2978e9f7d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 200 len: 1520 microversion: 2.1 time: 0.524881 Jun 18 22:14:25.041627 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1608/3227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:24 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:25.150383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:25.151051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:25.160490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:25.161010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:25.162002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:25.164187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:25.210428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:25.211603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:25.212220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lazy-loading 'fault' on Instance uuid d93252f6-2582-403c-973f-e17f4a9f03fd {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:25.278420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a7f3b25d8234bf881b76473dbfd8fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4f6c403962a44408ce491f377e5ab11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:25.287922 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-602b5582-7546-44f6-b3f5-472804d1e618 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 200 len: 1315 microversion: 2.1 time: 0.141780 Jun 18 22:14:25.305053 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1609/3228] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:25 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:25.309998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:25.319598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8f737c6e-8465-4a14-8081-72829a953570 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.409082 Jun 18 22:14:25.332517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1620/3229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:24 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:25.608853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e13ce2eb-f29c-4619-bd16-1043d3f33e2b req-5330b4c7-ebba-41f1-aaee-7297d8cbda70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39fe75a5-fa2d-4543-a057-e641723072f3", "name": "network-vif-deleted", "tag": "7557f70f-58da-425a-b58d-854db53bf485"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:25.643839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:25.665783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e13ce2eb-f29c-4619-bd16-1043d3f33e2b req-5330b4c7-ebba-41f1-aaee-7297d8cbda70 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:25.666817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e13ce2eb-f29c-4619-bd16-1043d3f33e2b req-5330b4c7-ebba-41f1-aaee-7297d8cbda70 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:25.712063 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e13ce2eb-f29c-4619-bd16-1043d3f33e2b req-5330b4c7-ebba-41f1-aaee-7297d8cbda70 service nova] Creating event network-vif-deleted:7557f70f-58da-425a-b58d-854db53bf485 for instance 39fe75a5-fa2d-4543-a057-e641723072f3 on nch2-master-1 Jun 18 22:14:25.721509 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e13ce2eb-f29c-4619-bd16-1043d3f33e2b req-5330b4c7-ebba-41f1-aaee-7297d8cbda70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117593 Jun 18 22:14:25.723607 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1610/3230] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:25.924911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:25.925680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:25.943704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:25.944717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:25.946156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:25.946978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.031265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:26.031993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:26.046082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.047088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.052432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.054421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.145390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.145923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.146401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lazy-loading 'fault' on Instance uuid 39fe75a5-fa2d-4543-a057-e641723072f3 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:26.218365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:26.232492 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4c92b0f-5b40-4573-a874-e6367a4f5ba9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1295 microversion: 2.1 time: 0.312316 Jun 18 22:14:26.246544 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1621/3231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:25 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1295 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:26.286061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:26.314881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:26.316016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] [instance: d93252f6-2582-403c-973f-e17f4a9f03fd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:26.328412 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-922d9fe1-1311-4c96-a595-71b4cca14c49 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 200 len: 1312 microversion: 2.1 time: 0.300262 Jun 18 22:14:26.331831 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1611/3232] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:26 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:26.333989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.335308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.338028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.338906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.355540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:26.361895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:26.384804 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] HTTP exception thrown: Instance d93252f6-2582-403c-973f-e17f4a9f03fd could not be found. Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Request method failure captured: Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd HTTP/1.1 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk3wgah1SG5bBMnXgNVFw0znv-C7EI2vwIHGQ4ivkTaVcOpTwFOSBDbeTDKjXJaDYbC_LEtE1T3SN2zxEM09zTh6QjbrzQu3P4rxx2MSWOgWUa8eK8M72iRfKtxz-w_ogf6hndb11w52rhxCd-Ub3fAV1t-H5YdgAGl028cKzXzA6bw Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: f4f6c403962a44408ce491f377e5ab11 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestFqdnHostnames-1664969292 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f4f6c403962a44408ce491f377e5ab11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f4f6c403962a44408ce491f377e5ab11"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f4f6c403962a44408ce491f377e5ab11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f4f6c403962a44408ce491f377e5ab11", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestFqdnHostnames-1664969292 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: f4f6c403962a44408ce491f377e5ab11 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1664969292 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestFqdnHostnames-1664969292-project Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 2a7f3b25d8234bf881b76473dbfd8fc7 Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestFqdnHostnames-1664969292-project Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d93252f6-2582-403c-973f-e17f4a9f03fd could not be found. Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd93252f6-2582-403c-973f-e17f4a9f03fd'} Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93252f6-2582-403c-973f-e17f4a9f03fd could not be found. Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93252f6-2582-403c-973f-e17f4a9f03fd could not be found. Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:26.390587 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93252f6-2582-403c-973f-e17f4a9f03fd could not be found. Jun 18 22:14:26.395505 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:26.396069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.399238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.400353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:26.400907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:26.403634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Returning 404 to user: Instance d93252f6-2582-403c-973f-e17f4a9f03fd could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:26.404810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da68a747-4c68-4eaa-a630-d945a3698940 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd" status: 404 len: 111 microversion: 2.1 time: 0.095908 Jun 18 22:14:26.407180 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1622/3233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:26 2022] GET /compute/v2.1/servers/d93252f6-2582-403c-973f-e17f4a9f03fd => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:14:26.419047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cfd304bc-43a3-47dd-a1ae-352a49e88bd3 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] Calling method '.version_select at 0x7fea1455c430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:26.494978 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cfd304bc-43a3-47dd-a1ae-352a49e88bd3 tempest-ServersTestFqdnHostnames-1664969292 tempest-ServersTestFqdnHostnames-1664969292-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409594677" status: 202 len: 0 microversion: 2.1 time: 0.082708 Jun 18 22:14:26.506557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1623/3234] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409594677 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:14:27.056068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:27.069178 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bfa2de4d-f9ff-4432-a61d-28980b365be4 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.729052 Jun 18 22:14:27.072006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1612/3235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:26 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:27.256739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:27.258274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:27.285303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.286964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.290078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.292249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.352810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:27.353659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:27.361345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.361799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.363101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.363732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.393889 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] HTTP exception thrown: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 HTTP/1.1 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '39fe75a5-fa2d-4543-a057-e641723072f3'} Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:27.396117 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:27.404488 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.411291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 404 to user: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:27.412560 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3354b2a9-0a85-411c-b829-d7c56bed75d5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 404 len: 111 microversion: 2.1 time: 0.065305 Jun 18 22:14:27.413798 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1613/3236] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:27 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:27.429857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:27.442238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:27.446611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:27.467013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.470921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.475037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.476236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.629812 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b841a624-a5d5-42d2-ae42-9052fc5d7702 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.207131 Jun 18 22:14:27.631781 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1614/3237] 10.222.0.30 () {58 vars in 1229 bytes} [Sat Jun 18 22:14:27 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:14:27.647808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8fcf8e23-d387-452b-a770-66c788efebb9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8fcf8e23-d387-452b-a770-66c788efebb9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi '2011/01/01' Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 18 22:14:27.669907 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8fcf8e23-d387-452b-a770-66c788efebb9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:27.674398 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8fcf8e23-d387-452b-a770-66c788efebb9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.033146 Jun 18 22:14:27.677303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1615/3238] 10.222.0.30 () {58 vars in 1181 bytes} [Sat Jun 18 22:14:27 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:14:27.693537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:27.705059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:27.709303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:27.724660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.727418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.728941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.729452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.771397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:14:27.835337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-708c1ba7-2c9f-4c7a-a12d-ebda3bb8d9fc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.151701 Jun 18 22:14:27.836291 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1616/3239] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:14:27 2022] GET /compute/v2.1/servers => generated 681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:27.843023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5e1160b4-8cf8-45b2-aa07-d1332b4ae1b7 req-99187fe5-b224-4542-b6d6-60a71445fe96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "name": "network-vif-unplugged", "status": "completed", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:27.861210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5e1160b4-8cf8-45b2-aa07-d1332b4ae1b7 req-99187fe5-b224-4542-b6d6-60a71445fe96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.863357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5e1160b4-8cf8-45b2-aa07-d1332b4ae1b7 req-99187fe5-b224-4542-b6d6-60a71445fe96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.886437 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5e1160b4-8cf8-45b2-aa07-d1332b4ae1b7 req-99187fe5-b224-4542-b6d6-60a71445fe96 service nova] Creating event network-vif-unplugged:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch1-master-1 Jun 18 22:14:27.895844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-5e1160b4-8cf8-45b2-aa07-d1332b4ae1b7 req-99187fe5-b224-4542-b6d6-60a71445fe96 service nova] Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:14:27.917843 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5e1160b4-8cf8-45b2-aa07-d1332b4ae1b7 req-99187fe5-b224-4542-b6d6-60a71445fe96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079399 Jun 18 22:14:27.919174 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1617/3240] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:27.926936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:27.934012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:27.935200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.compute.servers [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Removing options 'limit' from query {{(pid=130902) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 18 22:14:27.936191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:27.945371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.946147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.947272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:27.947938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:27.988172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:14:27.989464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.008718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af1697f4-bc5a-4d90-b515-36732b382dd3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.760939 Jun 18 22:14:28.009359 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1624/3241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:27 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:28.040093 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75891351-fac0-4b1d-916f-3510b5959aea tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.119311 Jun 18 22:14:28.053532 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1618/3242] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Jun 18 22:14:27 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:28.055667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c62e1b86-7f60-4609-880a-a5d4a13b278e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c62e1b86-7f60-4609-880a-a5d4a13b278e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: action_args: {} Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi '-1' Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 18 22:14:28.058595 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c62e1b86-7f60-4609-880a-a5d4a13b278e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c62e1b86-7f60-4609-880a-a5d4a13b278e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008186 Jun 18 22:14:28.068331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1625/3243] 10.222.0.30 () {58 vars in 1141 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:14:28.070662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2f0ade1-0702-4315-9d68-f4c4d7839321 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2f0ade1-0702-4315-9d68-f4c4d7839321 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: action_args: {} Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'testing' Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 18 22:14:28.080314 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2f0ade1-0702-4315-9d68-f4c4d7839321 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:28.087649 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b2f0ade1-0702-4315-9d68-f4c4d7839321 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.015831 Jun 18 22:14:28.095351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.096025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:28.104390 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1619/3244] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:14:28.117384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c03ed9e4-73b0-4fb2-aff1-9f2b55c3b0f2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.129600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.130739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.132182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.134854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c03ed9e4-73b0-4fb2-aff1-9f2b55c3b0f2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.135636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.145565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c03ed9e4-73b0-4fb2-aff1-9f2b55c3b0f2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:28.175435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.compute.servers [None req-c03ed9e4-73b0-4fb2-aff1-9f2b55c3b0f2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Flavor 'non_existing_flavor' could not be found {{(pid=130902) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jun 18 22:14:28.183776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c03ed9e4-73b0-4fb2-aff1-9f2b55c3b0f2 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.071955 Jun 18 22:14:28.189205 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1620/3245] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:14:28.210238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.221683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.224542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:28.243739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.246357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.247599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.251232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.450129 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80ee5f05-3e85-4269-9301-e1431601ddd5 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.256968 Jun 18 22:14:28.450983 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1621/3246] 10.222.0.30 () {58 vars in 1173 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:14:28.469430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.484153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.487971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:28.521900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.522366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.523228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.523665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.769777 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0942ae2a-b090-46b3-886e-deead32fb9bc tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.310932 Jun 18 22:14:28.770996 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1622/3247] 10.222.0.30 () {58 vars in 1183 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:14:28.790937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:28.806018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.806803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:28.819952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.819952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.820707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.821185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:28.857478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.883550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:14:28.891865 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1095af5-9b3d-42d7-b46c-4a28fd82f534 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.801522 Jun 18 22:14:28.911021 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1626/3248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:28.953241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:28.966478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:28.967043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.028227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.029718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.048914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.050074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.051206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.051801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.232618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3663509-6f1a-4f61-ae8c-98ca92ab2e0e tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.453401 Jun 18 22:14:29.233809 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1623/3249] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:14:28 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:29.253780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37be9039-3ec9-4a94-ba00-a9afa67f73dd tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.258321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37be9039-3ec9-4a94-ba00-a9afa67f73dd tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:29.260419 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37be9039-3ec9-4a94-ba00-a9afa67f73dd tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011088 Jun 18 22:14:29.262597 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1624/3250] 10.222.0.30 () {58 vars in 1177 bytes} [Sat Jun 18 22:14:29 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:14:29.280332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.284934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:29.285784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Searching by: {'deleted': False, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:14:29.291928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.292486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.293386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.293827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.322175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:29.323129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:29.329831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:14:29.336242 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f784242a-1a62-420b-bd3c-f5c636840a37 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.313610 Jun 18 22:14:29.338371 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1627/3251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:29 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:29.367795 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fd40a7c-4b9a-4595-b4e9-356cdb51cfdb tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.097785 Jun 18 22:14:29.369147 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1625/3252] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:14:29 2022] GET /compute/v2.1/servers => generated 681 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:29.382637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.385585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.399268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.400030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.400853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.401331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.444274 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] HTTP exception thrown: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 HTTP/1.1 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '39fe75a5-fa2d-4543-a057-e641723072f3'} Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:29.447094 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.453206 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.455450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 404 to user: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:29.456786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-733b5629-d0c0-401a-bcc6-4667bdefe236 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 404 len: 111 microversion: 2.1 time: 0.078412 Jun 18 22:14:29.457977 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1628/3253] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:29 2022] DELETE /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:29.470249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.471138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.480304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.480304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.480613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.481205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.510933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:29.651724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-373ab3b0-c303-44c6-807b-1d4f0752cd56 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 204 len: 0 microversion: 2.1 time: 0.187105 Jun 18 22:14:29.652591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1626/3254] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:29 2022] DELETE /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:29.662261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.662871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.670510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.671240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.672541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.673316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.705674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:29.811956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31e8201c-c96a-4754-b40c-92e451334179 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 204 len: 0 microversion: 2.1 time: 0.154340 Jun 18 22:14:29.815699 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1629/3255] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:29 2022] DELETE /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:14:29.824208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.825509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 39fe75a5-fa2d-4543-a057-e641723072f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.839548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.839548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.839797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.840239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.865112 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] HTTP exception thrown: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 HTTP/1.1 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '39fe75a5-fa2d-4543-a057-e641723072f3'} Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:29.867411 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. Jun 18 22:14:29.871958 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:29.873602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 404 to user: Instance 39fe75a5-fa2d-4543-a057-e641723072f3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:29.874985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46e7339c-c5d7-4993-a3e4-0d76e59b080f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3" status: 404 len: 111 microversion: 2.1 time: 0.057432 Jun 18 22:14:29.876045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1627/3256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:29 2022] GET /compute/v2.1/servers/39fe75a5-fa2d-4543-a057-e641723072f3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:29.886195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.887535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.895840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.896302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.897832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.898293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.910756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:29.911581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:29.921331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.940939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:29.942008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:29.951592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:30.272863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:30.285175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-371c255f-31fe-4eef-9beb-5a73393ed6b9 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 200 len: 1521 microversion: 2.1 time: 0.402862 Jun 18 22:14:30.288015 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1630/3257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:29 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:30.294659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}, {"name": "network-changed", "server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:30.316152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:30.317006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:30.317006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:30.333354 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-82649d9b-0e36-4e9b-896b-93e4ea85eadd tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.426651 Jun 18 22:14:30.338751 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1628/3258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:29 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:30.358708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:30.359536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:30.363659 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] Creating event network-changed:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch1-master-1 Jun 18 22:14:30.364523 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] Creating event network-changed:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:14:30.374859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:14:30.378026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:30.378496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:30.379500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:30.380126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:30.403279 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-42eee065-fb4a-4039-a2ee-1fb6c236881b req-9060f94b-5f6c-41f1-9a2b-c5bf7aac22b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112453 Jun 18 22:14:30.404288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1631/3259] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:30.620337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:30.631365 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-206818a0-eb06-4bca-ae7f-6d9f06dc8f42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.280392 Jun 18 22:14:30.632522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1629/3260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:30 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:31.308746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:31.311021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:31.322767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:31.323221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:31.324302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:31.324752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:31.355340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:31.356632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:31.377211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:31.378418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:31.379311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:31.379774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:31.788339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:31.803816 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3355963-90ec-4c04-b5a1-ef2c2d08233d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 200 len: 1521 microversion: 2.1 time: 0.502627 Jun 18 22:14:31.804018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:31.804848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1632/3261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:31 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:31.818708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:31.821713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:31.824549 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0789f3b8-8d86-46d9-9265-61ac1b99c4eb tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.473076 Jun 18 22:14:31.825805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1630/3262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:31 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:31.847784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:31.848269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:31.852607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:31.853750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:32.172014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:32.184700 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79fb9a16-4ad8-4cbc-8223-3a95ce639684 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.377779 Jun 18 22:14:32.185606 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1633/3263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:31 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:32.393018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-70daad1a-7e32-4c57-ac1f-6f0b34985cbf req-bfd6f985-e1a5-409b-bf79-3bbeb52f8add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eadd466-efb5-4b81-9c7d-dde3679e1b38", "name": "network-vif-deleted", "tag": "bf912c0d-6de7-41ec-bdbf-19ca16b8b3c2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:32.433571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-70daad1a-7e32-4c57-ac1f-6f0b34985cbf req-bfd6f985-e1a5-409b-bf79-3bbeb52f8add service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:32.436686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-70daad1a-7e32-4c57-ac1f-6f0b34985cbf req-bfd6f985-e1a5-409b-bf79-3bbeb52f8add service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:32.489219 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-70daad1a-7e32-4c57-ac1f-6f0b34985cbf req-bfd6f985-e1a5-409b-bf79-3bbeb52f8add service nova] Creating event network-vif-deleted:bf912c0d-6de7-41ec-bdbf-19ca16b8b3c2 for instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 on nch2-master-1 Jun 18 22:14:32.510158 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-70daad1a-7e32-4c57-ac1f-6f0b34985cbf req-bfd6f985-e1a5-409b-bf79-3bbeb52f8add service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122648 Jun 18 22:14:32.514498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1631/3264] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:32.823492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:32.825714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:32.849073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:32.850450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:32.860184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:32.864055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:32.864934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:32.865496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:32.884536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:32.886793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:32.887627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:32.888126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:33.179780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:33.191828 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22e1b361-5199-41e4-a5b4-6e7df64a7b8f tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 200 len: 1479 microversion: 2.1 time: 0.372957 Jun 18 22:14:33.192358 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1634/3265] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:32 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 1479 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:33.214194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:33.215597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:33.247626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:33.249491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:33.252980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:33.254127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:33.268000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:33.316037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:33.347864 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a894dab-c4b0-41e6-80d2-f17d5746e6ea tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.508660 Jun 18 22:14:33.351177 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1632/3266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:32 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:33.578965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:33.591761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fdca36e-2d54-4708-9228-d3d7bba59d82 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.391033 Jun 18 22:14:33.592370 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1635/3267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:33 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:34.213393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:34.215898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:34.225024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.225659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.226785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.227284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.271992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.273444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.273751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lazy-loading 'fault' on Instance uuid f0109410-45b6-4ed8-8d84-b525ef5970db {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:34.323631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:34.339263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed6d02b7-0eaf-474a-94e4-2392904b7bf1 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 200 len: 1312 microversion: 2.1 time: 0.131156 Jun 18 22:14:34.349575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1633/3268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:34 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:34.370348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:34.371331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:34.374524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:34.387016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.387479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.388778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.389792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.539847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a72b13ed-c7c5-41df-a703-1c5c4e6602d4 req-e9963009-68d8-487c-b2f5-27e2b089d274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0109410-45b6-4ed8-8d84-b525ef5970db", "name": "network-vif-deleted", "tag": "276c3885-02c4-4b79-aea4-fd7f1c433b7d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:34.550941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a72b13ed-c7c5-41df-a703-1c5c4e6602d4 req-e9963009-68d8-487c-b2f5-27e2b089d274 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.551392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a72b13ed-c7c5-41df-a703-1c5c4e6602d4 req-e9963009-68d8-487c-b2f5-27e2b089d274 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.579662 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a72b13ed-c7c5-41df-a703-1c5c4e6602d4 req-e9963009-68d8-487c-b2f5-27e2b089d274 service nova] Creating event network-vif-deleted:276c3885-02c4-4b79-aea4-fd7f1c433b7d for instance f0109410-45b6-4ed8-8d84-b525ef5970db on nch1-master-1 Jun 18 22:14:34.595166 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a72b13ed-c7c5-41df-a703-1c5c4e6602d4 req-e9963009-68d8-487c-b2f5-27e2b089d274 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058779 Jun 18 22:14:34.597839 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1634/3269] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:14:34.605556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:34.616042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:34.616953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:34.617525 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49a3d680-e51a-453f-ac70-bf21fa062255 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.251960 Jun 18 22:14:34.618876 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1636/3270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:34 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:34.636865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.637577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.639358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:34.640873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:34.957012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:34.965793 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4e78d8b-2551-4109-9085-6ba5de81cce9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.361691 Jun 18 22:14:34.970762 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1635/3271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:34 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:35.360720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:35.362702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:35.377069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:35.378774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:35.381823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:35.382756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:35.445235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:35.467567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:35.468472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:35.469947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lazy-loading 'fault' on Instance uuid f0109410-45b6-4ed8-8d84-b525ef5970db {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:35.550308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556851fde980466c99cb1873cdb30dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaa53169cbd4a83aa39a825ee4a3a70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:35.565366 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-032c6a23-0be6-4d3f-ad29-06059af59513 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 200 len: 1312 microversion: 2.1 time: 0.211507 Jun 18 22:14:35.566761 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1637/3272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:35 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:35.636042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:35.636950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:35.653277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:35.653702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:35.654598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:35.655064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:35.876673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:35.892295 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fb0ebc04-ed97-4d38-b4d2-f125cb5ca1be tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.258945 Jun 18 22:14:35.893092 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1636/3273] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:35 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:35.989009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:35.990190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:36.007761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.010317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.011911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.014963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.262782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:36.271757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cac0e57-5cfb-4e76-ae2a-21400058948e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.289894 Jun 18 22:14:36.281974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1638/3274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:35 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:36.584939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:36.585697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: f0109410-45b6-4ed8-8d84-b525ef5970db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:36.597723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.599885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.601798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.603738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.639965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] HTTP exception thrown: Instance f0109410-45b6-4ed8-8d84-b525ef5970db could not be found. Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db HTTP/1.1 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance f0109410-45b6-4ed8-8d84-b525ef5970db could not be found. Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f0109410-45b6-4ed8-8d84-b525ef5970db'} Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0109410-45b6-4ed8-8d84-b525ef5970db could not be found. Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0109410-45b6-4ed8-8d84-b525ef5970db could not be found. Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:36.646513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0109410-45b6-4ed8-8d84-b525ef5970db could not be found. Jun 18 22:14:36.652309 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.655123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 404 to user: Instance f0109410-45b6-4ed8-8d84-b525ef5970db could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:36.658674 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fcf3510a-ada6-4588-8b00-6db1585efa72 tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db" status: 404 len: 111 microversion: 2.1 time: 0.076716 Jun 18 22:14:36.659697 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1637/3275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:36 2022] GET /compute/v2.1/servers/f0109410-45b6-4ed8-8d84-b525ef5970db => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:36.671680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:36.672590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] [instance: 4eadd466-efb5-4b81-9c7d-dde3679e1b38] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:36.680548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.681818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.683211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.683929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.704685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] HTTP exception thrown: Instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 could not be found. Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Request method failure captured: Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 HTTP/1.1 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk4hc-sIzksNP6GuUmymKmZAsqUg6-pF_IMfc4G6GXZykUoLyBhLyPnnpcxNtDkf-oCaxDG17VXRI6qdczTGmRN7bXYyqVlrWBwhIRbPVgMPVCjna-WSfyVSmWg0I0qdySGMf5ZaDLIHZZtxRG1BO17TCX1Uhsf1h6Vgjo9OyLlTbLQ Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/deaa53169cbd4a83aa39a825ee4a3a70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_deaa53169cbd4a83aa39a825ee4a3a70", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: deaa53169cbd4a83aa39a825ee4a3a70 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1563672505 Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 556851fde980466c99cb1873cdb30dea Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ListServersNegativeTestJSON-1563672505-project Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 could not be found. Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '4eadd466-efb5-4b81-9c7d-dde3679e1b38'} Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 could not be found. Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 could not be found. Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:36.706927 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 could not be found. Jun 18 22:14:36.714479 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:36.716627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] Returning 404 to user: Instance 4eadd466-efb5-4b81-9c7d-dde3679e1b38 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:36.717875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2242e30b-2d29-469f-83c1-2a033932bd6d tempest-ListServersNegativeTestJSON-1563672505 tempest-ListServersNegativeTestJSON-1563672505-project] 10.222.0.30 "GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38" status: 404 len: 111 microversion: 2.1 time: 0.053911 Jun 18 22:14:36.719982 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1639/3276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:36 2022] GET /compute/v2.1/servers/4eadd466-efb5-4b81-9c7d-dde3679e1b38 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:36.916312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:36.917754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:36.938637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.940611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:36.943918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:36.944578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:37.387551 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d5e41e0-305f-4e59-879b-04d5c0bcefcd tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.483442 Jun 18 22:14:37.388620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1638/3277] 10.222.0.30 () {58 vars in 1127 bytes} [Sat Jun 18 22:14:36 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 22:14:37.397011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:37.398567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:37.416224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:37.418423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:37.419437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:37.421882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:37.455636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:37.467380 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e8716cfd-6c68-4a1b-88ce-89b801418ba6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.560089 Jun 18 22:14:37.468215 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1640/3278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:36 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:37.480472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c32971c-37e0-4c56-bbc9-1c4b2caf8c04 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Calling method '.version_select at 0x7fea078e6ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:37.534101 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6c32971c-37e0-4c56-bbc9-1c4b2caf8c04 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] HTTP exception thrown: Image not found. Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c32971c-37e0-4c56-bbc9-1c4b2caf8c04 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Request method failure captured: Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5MfpvPiv0FofQCRFjJ-PqbQztF-bPylT54Tx9YYJq5H35_Qxn4jrKkPlvsdGFRTdyFYkyfykQ8oQVlVGURgwUwxAQck7NviSmzSuXHGh_Hn90E4l2fDXQGK1iED0qT-ClmZfjsoFzdBFuY-UjvgfRx7YXY1ocS0Xcbcqordbak0ww Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2081fc5f4c6409398efe4fab6ee56a4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: bc000376129246968d4bed35176afb29 Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '-1'} Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.546942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c32971c-37e0-4c56-bbc9-1c4b2caf8c04 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6c32971c-37e0-4c56-bbc9-1c4b2caf8c04 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.076943 Jun 18 22:14:37.557288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1641/3279] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:14:37 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:14:37.562646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e06c2205-37df-47ca-bcb5-7bc2cf459043 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Calling method '.version_select at 0x7fea146e8dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:37.601247 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e06c2205-37df-47ca-bcb5-7bc2cf459043 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] HTTP exception thrown: Image not found. Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e06c2205-37df-47ca-bcb5-7bc2cf459043 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Request method failure captured: Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/02fc3332-abbb-4710-8a23-360d79f667fj HTTP/1.1 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5MfpvPiv0FofQCRFjJ-PqbQztF-bPylT54Tx9YYJq5H35_Qxn4jrKkPlvsdGFRTdyFYkyfykQ8oQVlVGURgwUwxAQck7NviSmzSuXHGh_Hn90E4l2fDXQGK1iED0qT-ClmZfjsoFzdBFuY-UjvgfRx7YXY1ocS0Xcbcqordbak0ww Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2081fc5f4c6409398efe4fab6ee56a4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: bc000376129246968d4bed35176afb29 Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '02fc3332-abbb-4710-8a23-360d79f667fj'} Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 02fc3332-abbb-4710-8a23-360d79f667fj to delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02fc3332-abbb-4710-8a23-360d79f667fj could not be found. Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.603215 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e06c2205-37df-47ca-bcb5-7bc2cf459043 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e06c2205-37df-47ca-bcb5-7bc2cf459043 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] 10.222.0.30 "DELETE /compute/v2.1/images/02fc3332-abbb-4710-8a23-360d79f667fj" status: 404 len: 62 microversion: 2.1 time: 0.046079 Jun 18 22:14:37.607820 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1642/3280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:37 2022] DELETE /compute/v2.1/images/02fc3332-abbb-4710-8a23-360d79f667fj => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:14:37.616947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-126cad1f-c328-46f1-851f-0c0d0e96bf83 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Calling method '.version_select at 0x7fea140b55e0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:37.666618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-126cad1f-c328-46f1-851f-0c0d0e96bf83 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] HTTP exception thrown: Image not found. Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-126cad1f-c328-46f1-851f-0c0d0e96bf83 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Request method failure captured: Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/f1fe6789-787a-42c9-867c-38bd7accb89b1 HTTP/1.1 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5MfpvPiv0FofQCRFjJ-PqbQztF-bPylT54Tx9YYJq5H35_Qxn4jrKkPlvsdGFRTdyFYkyfykQ8oQVlVGURgwUwxAQck7NviSmzSuXHGh_Hn90E4l2fDXQGK1iED0qT-ClmZfjsoFzdBFuY-UjvgfRx7YXY1ocS0Xcbcqordbak0ww Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2081fc5f4c6409398efe4fab6ee56a4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: bc000376129246968d4bed35176afb29 Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f1fe6789-787a-42c9-867c-38bd7accb89b1'} Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1fe6789-787a-42c9-867c-38bd7accb89b1 to delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1fe6789-787a-42c9-867c-38bd7accb89b1 could not be found. Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.668633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-126cad1f-c328-46f1-851f-0c0d0e96bf83 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-126cad1f-c328-46f1-851f-0c0d0e96bf83 tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] 10.222.0.30 "DELETE /compute/v2.1/images/f1fe6789-787a-42c9-867c-38bd7accb89b1" status: 404 len: 62 microversion: 2.1 time: 0.058475 Jun 18 22:14:37.678544 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1643/3281] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:37 2022] DELETE /compute/v2.1/images/f1fe6789-787a-42c9-867c-38bd7accb89b1 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:14:37.681576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b37a10f-8d1f-4792-9b8b-2b27a319760e tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Calling method '.version_select at 0x7fea14a51a60>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:37.721095 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8b37a10f-8d1f-4792-9b8b-2b27a319760e tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] HTTP exception thrown: Image not found. Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b37a10f-8d1f-4792-9b8b-2b27a319760e tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Request method failure captured: Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/tempest-invalid-185885211 HTTP/1.1 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5MfpvPiv0FofQCRFjJ-PqbQztF-bPylT54Tx9YYJq5H35_Qxn4jrKkPlvsdGFRTdyFYkyfykQ8oQVlVGURgwUwxAQck7NviSmzSuXHGh_Hn90E4l2fDXQGK1iED0qT-ClmZfjsoFzdBFuY-UjvgfRx7YXY1ocS0Xcbcqordbak0ww Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2081fc5f4c6409398efe4fab6ee56a4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: bc000376129246968d4bed35176afb29 Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'tempest-invalid-185885211'} Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-185885211 to delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-185885211 could not be found. Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.722861 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b37a10f-8d1f-4792-9b8b-2b27a319760e tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8b37a10f-8d1f-4792-9b8b-2b27a319760e tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-185885211" status: 404 len: 62 microversion: 2.1 time: 0.048357 Jun 18 22:14:37.729823 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1644/3282] 10.222.0.30 () {58 vars in 1202 bytes} [Sat Jun 18 22:14:37 2022] DELETE /compute/v2.1/images/tempest-invalid-185885211 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:14:37.733797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c86b827-19d9-4cdd-871d-0d0d7fb5187b tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Calling method '.version_select at 0x7fea1729dca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:37.757520 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3c86b827-19d9-4cdd-871d-0d0d7fb5187b tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] HTTP exception thrown: Image not found. Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c86b827-19d9-4cdd-871d-0d0d7fb5187b tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Request method failure captured: Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/979ba02e-cd1b-428b-a37f-2432d2790694 HTTP/1.1 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5MfpvPiv0FofQCRFjJ-PqbQztF-bPylT54Tx9YYJq5H35_Qxn4jrKkPlvsdGFRTdyFYkyfykQ8oQVlVGURgwUwxAQck7NviSmzSuXHGh_Hn90E4l2fDXQGK1iED0qT-ClmZfjsoFzdBFuY-UjvgfRx7YXY1ocS0Xcbcqordbak0ww Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2081fc5f4c6409398efe4fab6ee56a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2081fc5f4c6409398efe4fab6ee56a4", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e2081fc5f4c6409398efe4fab6ee56a4 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: bc000376129246968d4bed35176afb29 Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1030292884-project Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '979ba02e-cd1b-428b-a37f-2432d2790694'} Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 979ba02e-cd1b-428b-a37f-2432d2790694 to delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 979ba02e-cd1b-428b-a37f-2432d2790694 could not be found. Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.759606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c86b827-19d9-4cdd-871d-0d0d7fb5187b tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c86b827-19d9-4cdd-871d-0d0d7fb5187b tempest-ImagesDeleteNegativeTestJSON-1030292884 tempest-ImagesDeleteNegativeTestJSON-1030292884-project] 10.222.0.30 "DELETE /compute/v2.1/images/979ba02e-cd1b-428b-a37f-2432d2790694" status: 404 len: 62 microversion: 2.1 time: 0.031722 Jun 18 22:14:37.766440 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1645/3283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:37 2022] DELETE /compute/v2.1/images/979ba02e-cd1b-428b-a37f-2432d2790694 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:14:37.941418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:37.957363 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22735efb-6328-41ae-a726-7fdda6471902 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.565432 Jun 18 22:14:37.958315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1639/3284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:37 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:38.491121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:38.492076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:38.513989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:38.513989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:38.514392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:38.519627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:38.749934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:38.763273 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e53c01e3-5a32-4231-b820-d2cd1cf134e7 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1470 microversion: 2.1 time: 0.281630 Jun 18 22:14:38.765193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1646/3285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:38 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:38.975133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:38.979077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:38.990130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:39.006660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:39.013193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:39.017202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:39.017875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:39.300787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:39.386575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:39.397776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4399cd7b-5292-47b1-b940-d2c3fa284230 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.426744 Jun 18 22:14:39.400792 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1640/3286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:38 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:39.785205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:39.786704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:39.798235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:39.802735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:39.803836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:39.805737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.073370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:40.086692 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e9095490-f5bb-4737-b43e-2f240800dff3 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1463 microversion: 2.1 time: 0.306829 Jun 18 22:14:40.089830 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1647/3287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:39 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1463 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:40.101166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-103e92ae-9cf5-4b1d-a7de-aefbe467b551 req-05ffca39-5edd-44e7-8e47-5195852bf705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-plugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:40.121818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:40.125772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:40.136288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-103e92ae-9cf5-4b1d-a7de-aefbe467b551 req-05ffca39-5edd-44e7-8e47-5195852bf705 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.143795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-103e92ae-9cf5-4b1d-a7de-aefbe467b551 req-05ffca39-5edd-44e7-8e47-5195852bf705 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.152622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.159451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.163690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.170212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.207323 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-103e92ae-9cf5-4b1d-a7de-aefbe467b551 req-05ffca39-5edd-44e7-8e47-5195852bf705 service nova] Creating event network-vif-plugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:14:40.226679 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-103e92ae-9cf5-4b1d-a7de-aefbe467b551 req-05ffca39-5edd-44e7-8e47-5195852bf705 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128068 Jun 18 22:14:40.230945 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1641/3288] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:14:40.422863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:40.424489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:40.437306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.437777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.444307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.444901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.489716 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40545733-2b32-4a12-9159-0c8a07a877f7 tempest-MigrationsAdminTest-174349502 tempest-MigrationsAdminTest-174349502-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1614 microversion: 2.1 time: 0.383446 Jun 18 22:14:40.491706 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1648/3289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:40 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1614 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:40.517184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:40.517758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:40.524345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.525104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.526843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.528412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.624647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:40.754980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:40.769281 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6883c347-9721-466f-91cf-0bfb50e82ce0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.351241 Jun 18 22:14:40.770857 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1642/3290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:40 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:40.789537 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e732bd48-fb61-454f-86f8-45f69839234c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 204 len: 0 microversion: 2.1 time: 0.276355 Jun 18 22:14:40.793464 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1649/3291] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:40 2022] DELETE /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:40.800365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:40.801091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:40.811377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.811838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:40.813813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:40.814976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:41.110400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:41.127712 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bdacd00b-e0cb-4bec-a1d2-77920c0f0dd2 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1469 microversion: 2.1 time: 0.332392 Jun 18 22:14:41.131065 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1643/3292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:40 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1469 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:41.787166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:41.787964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:41.795209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:41.796495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:41.797337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:41.797934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:42.000084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:42.012965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58db4e3a-8499-43ac-950f-f2052a596f89 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.229418 Jun 18 22:14:42.015021 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1650/3293] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:41 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:42.153265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:42.154729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:42.167958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:42.168343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:42.169242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:42.169679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:42.180454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:42.456659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:42.480814 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c75c2234-6fb1-4b2c-96b1-c41843c57115 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1469 microversion: 2.1 time: 0.334694 Jun 18 22:14:42.482605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1644/3294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:42 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:43.032789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:43.034056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:43.047144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:43.047700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:43.049402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:43.050137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:43.303451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9975bdfd-7a30-48fa-93a8-1822f82d8879 req-4c3ffa76-2163-4a2f-9ac3-6696efee3276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "name": "network-vif-plugged", "status": "completed", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:43.327454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9975bdfd-7a30-48fa-93a8-1822f82d8879 req-4c3ffa76-2163-4a2f-9ac3-6696efee3276 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:43.328222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9975bdfd-7a30-48fa-93a8-1822f82d8879 req-4c3ffa76-2163-4a2f-9ac3-6696efee3276 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:43.351945 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9975bdfd-7a30-48fa-93a8-1822f82d8879 req-4c3ffa76-2163-4a2f-9ac3-6696efee3276 service nova] Creating event network-vif-plugged:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch1-master-1 Jun 18 22:14:43.367854 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9975bdfd-7a30-48fa-93a8-1822f82d8879 req-4c3ffa76-2163-4a2f-9ac3-6696efee3276 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068398 Jun 18 22:14:43.369091 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1645/3295] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:14:43.391434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:43.408053 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f47a20f3-3977-4838-9d0f-6670cd3f66e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1361 microversion: 2.1 time: 0.376979 Jun 18 22:14:43.417223 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1651/3296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:43 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1361 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:43.500266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:43.501344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:43.515578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:43.516516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:43.518794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:43.523890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:43.960134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:43.980289 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ebdda775-bed6-4829-b1b2-ac80381097f1 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 200 len: 1469 microversion: 2.1 time: 0.483725 Jun 18 22:14:43.995823 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1646/3297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:43 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 1469 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:44.430331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:44.431616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:44.446848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:44.447343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:44.448235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:44.451876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:44.858933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d180cf5e-a780-465d-9818-a71597a47c54 req-5ba715ef-2563-49e0-9c6f-b94834451b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9b35d8-9839-4992-807f-07e54ada20f3", "name": "network-vif-deleted", "tag": "22b1a13e-fa91-4a68-bb38-e787df31d4d1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:44.876313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d180cf5e-a780-465d-9818-a71597a47c54 req-5ba715ef-2563-49e0-9c6f-b94834451b71 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:44.880544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d180cf5e-a780-465d-9818-a71597a47c54 req-5ba715ef-2563-49e0-9c6f-b94834451b71 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:44.923789 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d180cf5e-a780-465d-9818-a71597a47c54 req-5ba715ef-2563-49e0-9c6f-b94834451b71 service nova] Creating event network-vif-deleted:22b1a13e-fa91-4a68-bb38-e787df31d4d1 for instance 2b9b35d8-9839-4992-807f-07e54ada20f3 on nch1-master-1 Jun 18 22:14:44.940761 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d180cf5e-a780-465d-9818-a71597a47c54 req-5ba715ef-2563-49e0-9c6f-b94834451b71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085886 Jun 18 22:14:44.942238 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1647/3298] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:14:45.746381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:45.747223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 2b9b35d8-9839-4992-807f-07e54ada20f3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:45.762954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:45.764465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:45.765577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:45.766323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:45.785403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] HTTP exception thrown: Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 could not be found. Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Request method failure captured: Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 HTTP/1.1 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk0oegh0Umr9nRkOPpOeD8eEf8sXzDtd-eAviqbyjQyNa4HXoMmzzkZL4n1TqWIDYWrwsE5QhIH9KxaQh3wch4OZSsYl7KVSxNirSUUBiNcIBhmiePGMtDDN1ID0_-LJQd3xdMfo3BGPgBWla2vwtiVtPH-F3prMuLiNxB_piz42314 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac774f9b327041a887378bd2725853c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac774f9b327041a887378bd2725853c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MigrationsAdminTest-869669657 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MigrationsAdminTest-869669657-project Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 0e8a394c0a284416ac893321bd860e51 Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MigrationsAdminTest-869669657-project Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 could not be found. Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2b9b35d8-9839-4992-807f-07e54ada20f3'} Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 could not be found. Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 could not be found. Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:45.789326 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 could not be found. Jun 18 22:14:45.793814 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:14:45.796533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Returning 404 to user: Instance 2b9b35d8-9839-4992-807f-07e54ada20f3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:45.800144 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db6e3057-1c07-4c39-a904-f6eb19a99fde tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3" status: 404 len: 111 microversion: 2.1 time: 0.803084 Jun 18 22:14:45.800887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1648/3299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:44 2022] GET /compute/v2.1/servers/2b9b35d8-9839-4992-807f-07e54ada20f3 => generated 111 bytes in 805 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:14:45.811774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:45.812792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:45.859780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:45.864464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:45.872153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:45.872153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:45.919339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:45.991581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:46.008862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15d48e89-7c08-4819-ae90-50d30d955d50 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1548 microversion: 2.1 time: 1.581536 Jun 18 22:14:46.011500 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1652/3300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:44 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1548 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:46.035574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:46.036467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:46.055384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:46.056187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:46.057935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:46.059669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:46.108798 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c302e29-f9d9-47e7-afab-364788281b0b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 204 len: 0 microversion: 2.1 time: 0.302350 Jun 18 22:14:46.109580 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1649/3301] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:45 2022] DELETE /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:46.124524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:46.125177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:46.140432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:46.140889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:46.141766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:46.142376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:46.339758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-78dc1775-b29a-44e8-a8cc-7aefd555511c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.308890 Jun 18 22:14:46.341068 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1653/3302] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:14:46 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:14:46.774591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:46.793517 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f9fcad1b-1da6-4eff-8452-e7593a73730b tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1535 microversion: 2.1 time: 0.675211 Jun 18 22:14:46.798987 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1650/3303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:46 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1535 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:47.817059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:47.818513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:47.827291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:47.828174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:47.829560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:47.830323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:48.226096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-323106802", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": "none"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:48.280093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:48.289009 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7df219c1-7e31-43f4-ade9-2ca88e560df8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1535 microversion: 2.1 time: 0.477950 Jun 18 22:14:48.296435 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1654/3304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:47 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1535 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:48.385024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:14:48.385693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:14:48.386438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:14:48.387306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:14:48.387978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:14:48.435876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:48.436814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:48.438074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:48.439340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:48.502374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Getting quotas for project ae3925ea552446688a7a1aacff545c10. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:14:48.509957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Getting quotas for user da2c009d56ae402f90518199c3e5c171 and project ae3925ea552446688a7a1aacff545c10. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:14:48.515068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:48.534406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:14:48.538016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:14:48.629696 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-204f8d54-3dd9-46e4-9678-492132d0ef6a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.721814 Jun 18 22:14:48.632940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1651/3305] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:14:48.646223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ee8ea8b-8e39-458a-baa9-a9a9f2ffd558 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:48.647317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ee8ea8b-8e39-458a-baa9-a9a9f2ffd558 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:48.820095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ee8ea8b-8e39-458a-baa9-a9a9f2ffd558 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:48.833304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ee8ea8b-8e39-458a-baa9-a9a9f2ffd558 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:48.835157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ee8ea8b-8e39-458a-baa9-a9a9f2ffd558 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:48.836383 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ee8ea8b-8e39-458a-baa9-a9a9f2ffd558 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1280 microversion: 2.47 time: 0.197002 Jun 18 22:14:48.854329 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1655/3306] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:48 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:49.311630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:49.312276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:49.334006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.335016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:49.335310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.335775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:49.527028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f6c7844c-354d-4c9b-8816-87b42c151b0a req-3753981c-77e7-4787-a566-1e8dff570a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6203d3bf-280e-4506-b9e7-5c3fa7fbc97a", "name": "network-vif-deleted", "tag": "a79eafa1-ec1d-4c45-baad-4959cc4db7f2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:49.545211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f6c7844c-354d-4c9b-8816-87b42c151b0a req-3753981c-77e7-4787-a566-1e8dff570a61 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.545760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f6c7844c-354d-4c9b-8816-87b42c151b0a req-3753981c-77e7-4787-a566-1e8dff570a61 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:49.572799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:49.578443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f6c7844c-354d-4c9b-8816-87b42c151b0a req-3753981c-77e7-4787-a566-1e8dff570a61 service nova] Creating event network-vif-deleted:a79eafa1-ec1d-4c45-baad-4959cc4db7f2 for instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a on nch2-master-1 Jun 18 22:14:49.585170 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b911fcf-4ba8-4bf4-9335-829834754017 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1493 microversion: 2.1 time: 0.276939 Jun 18 22:14:49.588699 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1652/3307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:49 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1493 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:49.592151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f6c7844c-354d-4c9b-8816-87b42c151b0a req-3753981c-77e7-4787-a566-1e8dff570a61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069383 Jun 18 22:14:49.592970 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1656/3308] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:49.680853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:49.681512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:49.698531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.699376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:49.700549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.704896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:49.860052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:49.860992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:49.884811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.893192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:49.895137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:49.895577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:50.006969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:50.614663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:50.634360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:50.647652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:50.649338 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d760a75a-4c43-4aed-a584-262adebafd0e tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1332 microversion: 2.47 time: 0.797328 Jun 18 22:14:50.652928 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1657/3309] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:49 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1332 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:50.680322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:50.684897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:50.710646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:50.718705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:50.723337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:50.733981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:50.847913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:50.848726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:50.849459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lazy-loading 'fault' on Instance uuid 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:51.086111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.095247 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fa9a9ec-aefa-4e7d-a5fa-caddf7534f4a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 200 len: 1369 microversion: 2.1 time: 0.440931 Jun 18 22:14:51.096563 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1658/3310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:50 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 1369 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:51.102523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-07c5bbef-376d-4fb8-9e43-428e8eeed671 req-ced14ff5-21a1-4002-96c9-07b4dcd0a038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:51.114820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-07c5bbef-376d-4fb8-9e43-428e8eeed671 req-ced14ff5-21a1-4002-96c9-07b4dcd0a038 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:51.115623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-07c5bbef-376d-4fb8-9e43-428e8eeed671 req-ced14ff5-21a1-4002-96c9-07b4dcd0a038 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:51.133344 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-07c5bbef-376d-4fb8-9e43-428e8eeed671 req-ced14ff5-21a1-4002-96c9-07b4dcd0a038 service nova] Creating event network-changed:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:14:51.143521 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-07c5bbef-376d-4fb8-9e43-428e8eeed671 req-ced14ff5-21a1-4002-96c9-07b4dcd0a038 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043951 Jun 18 22:14:51.144801 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1659/3311] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:51.168795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.190692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.208512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.209895 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a10d0c8f-da5d-4229-95a6-051128539bfd tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2952 microversion: 2.42 time: 1.533993 Jun 18 22:14:51.210490 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1653/3312] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:49 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2952 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:51.235002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:51.235604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:51.259110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:51.259564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:51.260382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:51.260902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:51.672515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:51.673172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:51.702978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:51.703722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:51.704577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:51.705016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:51.797958 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-63b13d9d-496f-4b03-97d8-8667960c5d32 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.571439 Jun 18 22:14:51.801507 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1660/3313] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:14:51 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce/os-interface => generated 1833 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:51.960312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.977470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.986062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:51.994827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d629bd0f-ccf8-4dd9-ab05-50f5ddabefe9 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1338 microversion: 2.47 time: 0.321938 Jun 18 22:14:51.998887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1654/3314] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:51 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1338 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:52.117348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:52.118620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:52.139457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:52.140035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:52.147687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:52.150123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:52.204107 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] HTTP exception thrown: Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a could not be found. Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Request method failure captured: Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a HTTP/1.1 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk0oegh0Umr9nRkOPpOeD8eEf8sXzDtd-eAviqbyjQyNa4HXoMmzzkZL4n1TqWIDYWrwsE5QhIH9KxaQh3wch4OZSsYl7KVSxNirSUUBiNcIBhmiePGMtDDN1ID0_-LJQd3xdMfo3BGPgBWla2vwtiVtPH-F3prMuLiNxB_piz42314 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac774f9b327041a887378bd2725853c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac774f9b327041a887378bd2725853c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-MigrationsAdminTest-869669657 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-MigrationsAdminTest-869669657-project Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 0e8a394c0a284416ac893321bd860e51 Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-MigrationsAdminTest-869669657-project Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a could not be found. Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6203d3bf-280e-4506-b9e7-5c3fa7fbc97a'} Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a could not be found. Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a could not be found. Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:14:52.206027 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a could not be found. Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Returning 404 to user: Instance 6203d3bf-280e-4506-b9e7-5c3fa7fbc97a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:14:52.210970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0101cbae-7757-4623-8d38-4a373dd4e770 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a" status: 404 len: 111 microversion: 2.1 time: 0.095371 Jun 18 22:14:52.213707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1661/3315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:52 2022] GET /compute/v2.1/servers/6203d3bf-280e-4506-b9e7-5c3fa7fbc97a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:14:52.221615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93bc31fe-7286-4c09-9baa-ed88d6f88a31 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '.version_select at 0x7fea079583a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:52.272622 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93bc31fe-7286-4c09-9baa-ed88d6f88a31 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915367950" status: 202 len: 0 microversion: 2.1 time: 0.055577 Jun 18 22:14:52.274832 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1655/3316] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:14:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1915367950 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:14:53.017213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:53.020157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:53.035848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:53.038693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:53.043016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:53.044655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:53.295198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:53.352616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:53.354841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:53.359770 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4ae4bdbf-3fcf-48d6-afa3-0323ccb962bc tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1338 microversion: 2.47 time: 0.346928 Jun 18 22:14:53.361379 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1662/3317] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:53 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1338 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:54.386902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:54.389218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:54.401207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:54.401911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:54.403771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:54.404460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:54.734384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:54.736306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:54.753721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:54.768621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:54.781175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:54.783836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:54.787688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:54.790904 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f76cb6b-8462-4b9a-a1c7-d13860caa98a tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1359 microversion: 2.47 time: 0.413075 Jun 18 22:14:54.791906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:54.792891 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1656/3318] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:54 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1359 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:54.793919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:54.819861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1321844747"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:54.823177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:54.837053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:54.838983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:54.843396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:54.844420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:54.888030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:55.111530 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-84194103-4830-45d5-a008-6037ef7c670f tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 204 len: 0 microversion: 2.1 time: 0.388851 Jun 18 22:14:55.120179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1663/3319] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:14:54 2022] DELETE /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:14:55.569606 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff51b816-4fee-4d96-b53c-dcf94cfc7351 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "POST /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904/action" status: 202 len: 52 microversion: 2.47 time: 0.754820 Jun 18 22:14:55.591863 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1657/3320] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:14:54 2022] POST /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904/action => generated 52 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:14:55.600874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:55.603505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:55.617628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:55.618669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:55.619938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:55.620770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:55.731695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d2d56c2-b2bf-4082-9bc6-13af1bc39904 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Action: 'create', calling method: .version_select at 0x7fea141080d0>, body: {"keypair": {"name": "tempest-keypair-962286419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkZtA0lq5jY3fJ55oorD6IIIsHr5WQpZT5z7kHS8p9CoPyi88hWrOtdzJB117ONqR7bR9jLey+tMTZO7B75tooPNTk+sA2Lfw1g0+4IC3LML6zL03bA1iGaDU9pPuiFzg=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:55.772556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6d2d56c2-b2bf-4082-9bc6-13af1bc39904 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Getting quotas for project be43b4b4305647cfb63bdcaa91331b55. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:14:55.792586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6d2d56c2-b2bf-4082-9bc6-13af1bc39904 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Getting quotas for user 79eddf3b96304e86a213d7238783e960 and project be43b4b4305647cfb63bdcaa91331b55. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:14:55.889287 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d2d56c2-b2bf-4082-9bc6-13af1bc39904 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.767641 Jun 18 22:14:55.890364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1664/3321] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:14:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:55.898242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:55.900007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:55.910842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:55.911712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:55.912699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:55.913747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:55.970440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:14:56.161526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36cce903-ef88-44e9-9921-04d483177678 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 204 len: 0 microversion: 2.47 time: 0.267056 Jun 18 22:14:56.164226 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1665/3322] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:14:55 2022] DELETE /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:14:56.195387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:56.196641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:56.217128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:56.221617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:56.223208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:56.225249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:56.710552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:56.729518 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39e4baf5-d84f-4592-bb7c-0198d905e157 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1469 microversion: 2.1 time: 1.133618 Jun 18 22:14:56.734051 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1658/3323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:55 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1469 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:56.791903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:56.811687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:56.815275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:56.816545 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-13833a73-97a5-4f9a-84ee-56ddd8eac4cd tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1365 microversion: 2.47 time: 0.634217 Jun 18 22:14:56.830467 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1666/3324] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:56 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1365 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:57.727151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3b38470c-4ec9-46f6-a4f3-24c77f29780a req-eae5d184-1926-492b-aa22-d6bd7d41cda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92830c8-3210-4136-9abf-efdf84adfd89", "name": "network-vif-deleted", "tag": "b4a9b468-9c40-4049-8455-b484be445a4d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:57.737854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3b38470c-4ec9-46f6-a4f3-24c77f29780a req-eae5d184-1926-492b-aa22-d6bd7d41cda8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:57.739325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3b38470c-4ec9-46f6-a4f3-24c77f29780a req-eae5d184-1926-492b-aa22-d6bd7d41cda8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:57.753143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:57.755383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:57.758442 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3b38470c-4ec9-46f6-a4f3-24c77f29780a req-eae5d184-1926-492b-aa22-d6bd7d41cda8 service nova] Creating event network-vif-deleted:b4a9b468-9c40-4049-8455-b484be445a4d for instance c92830c8-3210-4136-9abf-efdf84adfd89 on nch2-master-1 Jun 18 22:14:57.766076 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3b38470c-4ec9-46f6-a4f3-24c77f29780a req-eae5d184-1926-492b-aa22-d6bd7d41cda8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051842 Jun 18 22:14:57.767437 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1659/3325] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:14:57.773260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:57.773884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:57.776836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:57.777516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:57.853467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:57.855275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:57.869808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:57.873545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:57.874853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:57.875554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:57.985704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:57.988581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:58.000222 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4f3cec5e-e1d7-4c5b-b42e-86b3b0d74c53 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1427 microversion: 2.1 time: 0.253279 Jun 18 22:14:58.003971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1667/3326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:57 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1427 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:14:58.021679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:58.043814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:58.045454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5d9b11c5-d8b2-44d6-930d-f9c998962b35 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1365 microversion: 2.47 time: 0.200471 Jun 18 22:14:58.046558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1660/3327] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:57 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:14:58.455406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-945138661", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "06f01546-3fac-4b0c-928c-5b39cb427d1d"}, {"uuid": "37c94774-6dc4-4bfa-8411-52224315a575"}, {"uuid": "06f01546-3fac-4b0c-928c-5b39cb427d1d"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:14:58.567774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] validate_networks() for [('06f01546-3fac-4b0c-928c-5b39cb427d1d', None, None, None, None, None), ('37c94774-6dc4-4bfa-8411-52224315a575', None, None, None, None, None), ('06f01546-3fac-4b0c-928c-5b39cb427d1d', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:14:59.020961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:59.021617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:59.063484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:59.067669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:59.077549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:59.078142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:59.081073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:59.081993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:59.134399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:59.135236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:59.135967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lazy-loading 'fault' on Instance uuid c92830c8-3210-4136-9abf-efdf84adfd89 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:14:59.432995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:14:59.436901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:14:59.443998 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ac418fe-7315-4560-adfd-6e3c0e2686af tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 200 len: 1303 microversion: 2.1 time: 0.427439 Jun 18 22:14:59.449302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1661/3328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:14:59 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 1303 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:14:59.459143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:14:59.459768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:14:59.479081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:59.479561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:59.484113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:59.484787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:59.581572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:14:59.584342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:14:59.585181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lazy-loading 'fault' on Instance uuid f346df0d-da96-412b-b8cc-41f488c40904 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:15:00.311959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:00.323994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:00.328008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da2c009d56ae402f90518199c3e5c171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae3925ea552446688a7a1aacff545c10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:00.333673 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f65e5fe6-8a8e-4d3a-9c92-a638c0a7c15b tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 200 len: 1370 microversion: 2.47 time: 0.878421 Jun 18 22:15:00.335740 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1662/3329] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:14:59 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 1370 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:15:00.462614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:00.463472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: c92830c8-3210-4136-9abf-efdf84adfd89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:00.482386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:00.483132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:00.484009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:00.484695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:00.515613 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] HTTP exception thrown: Instance c92830c8-3210-4136-9abf-efdf84adfd89 could not be found. Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Request method failure captured: Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 HTTP/1.1 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk0oegh0Umr9nRkOPpOeD8eEf8sXzDtd-eAviqbyjQyNa4HXoMmzzkZL4n1TqWIDYWrwsE5QhIH9KxaQh3wch4OZSsYl7KVSxNirSUUBiNcIBhmiePGMtDDN1ID0_-LJQd3xdMfo3BGPgBWla2vwtiVtPH-F3prMuLiNxB_piz42314 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac774f9b327041a887378bd2725853c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac774f9b327041a887378bd2725853c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MigrationsAdminTest-869669657 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MigrationsAdminTest-869669657-project Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 0e8a394c0a284416ac893321bd860e51 Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MigrationsAdminTest-869669657-project Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance c92830c8-3210-4136-9abf-efdf84adfd89 could not be found. Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'c92830c8-3210-4136-9abf-efdf84adfd89'} Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92830c8-3210-4136-9abf-efdf84adfd89 could not be found. Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92830c8-3210-4136-9abf-efdf84adfd89 could not be found. Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:00.518688 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92830c8-3210-4136-9abf-efdf84adfd89 could not be found. Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Returning 404 to user: Instance c92830c8-3210-4136-9abf-efdf84adfd89 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:00.522660 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1775102b-44f9-4fa9-862d-83d908dfffd6 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89" status: 404 len: 111 microversion: 2.1 time: 0.062243 Jun 18 22:15:00.524114 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1663/3330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:00 2022] GET /compute/v2.1/servers/c92830c8-3210-4136-9abf-efdf84adfd89 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:15:00.529279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:00.529998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:00.536897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:00.537668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:00.539923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:00.541609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:00.591984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:15:00.758197 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4e8034b-7fc3-4c55-a081-f1a5da328aa8 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 204 len: 0 microversion: 2.1 time: 0.232498 Jun 18 22:15:00.762581 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1664/3331] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:15:00 2022] DELETE /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:00.768672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:00.769426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:00.782497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:00.783193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:00.783891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:00.784339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:01.202846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:01.214935 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d1247189-43fb-475c-a67b-4bb5679da595 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1468 microversion: 2.1 time: 0.450809 Jun 18 22:15:01.220475 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1665/3332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:00 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1468 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:01.285444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:15:01.286789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:15:01.287398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:15:01.287997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:15:01.289789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:15:01.300979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:01.303518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:01.304416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:01.304861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:01.335927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Getting quotas for project 635aa1d3d9b24f59a1b25f107438855e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:01.343355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Getting quotas for user cc3d993686bc4416a4015ac3e96b029c and project 635aa1d3d9b24f59a1b25f107438855e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:01.356651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:01.358135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:15:01.358698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] [instance: f346df0d-da96-412b-b8cc-41f488c40904] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:01.360839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:15:01.373255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:01.374020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:01.374991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:01.377385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:01.421959 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] HTTP exception thrown: Instance f346df0d-da96-412b-b8cc-41f488c40904 could not be found. Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Request method failure captured: Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 HTTP/1.1 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk5XQq_F2ODp7W9EYNB8_vHWqPOOtdA26M1QbZlpf3i3SY1o-2i_62YUQvBLkM80sn83qOKiwwdOlSzvskA-LJ3g60Zn-JCH92o3zeEzA1vdvPJ5CnR2qI99uA_zHdiwl0f94NIPgVl-GEkmbO7Z4ua_3mmMS_-j6q-8IDReoQG54z8 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.47 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: ae3925ea552446688a7a1aacff545c10 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAaction247Test-1455928215 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ae3925ea552446688a7a1aacff545c10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae3925ea552446688a7a1aacff545c10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ae3925ea552446688a7a1aacff545c10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ae3925ea552446688a7a1aacff545c10", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAaction247Test-1455928215 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: ae3925ea552446688a7a1aacff545c10 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAaction247Test-1455928215 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAaction247Test-1455928215-project Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: da2c009d56ae402f90518199c3e5c171 Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAaction247Test-1455928215-project Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance f346df0d-da96-412b-b8cc-41f488c40904 could not be found. Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f346df0d-da96-412b-b8cc-41f488c40904'} Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f346df0d-da96-412b-b8cc-41f488c40904 could not be found. Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f346df0d-da96-412b-b8cc-41f488c40904 could not be found. Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:01.426342 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f346df0d-da96-412b-b8cc-41f488c40904 could not be found. Jun 18 22:15:01.430591 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:01.442697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] Returning 404 to user: Instance f346df0d-da96-412b-b8cc-41f488c40904 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:01.443773 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c45483de-82e5-45e0-8557-c4a8d047c1f8 tempest-ServersAaction247Test-1455928215 tempest-ServersAaction247Test-1455928215-project] 10.222.0.30 "GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904" status: 404 len: 111 microversion: 2.47 time: 0.093395 Jun 18 22:15:01.447413 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1666/3333] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:15:01 2022] GET /compute/v2.1/servers/f346df0d-da96-412b-b8cc-41f488c40904 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:15:01.503901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2f414ae-d1da-419a-a56b-86f704755c48 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.065228 Jun 18 22:15:01.516033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2f2e83d-a723-4b93-abe3-de65cf55c7b0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:01.516938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d2f2e83d-a723-4b93-abe3-de65cf55c7b0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:01.521450 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1668/3334] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:15:01.746423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d2f2e83d-a723-4b93-abe3-de65cf55c7b0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:01.754803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d2f2e83d-a723-4b93-abe3-de65cf55c7b0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1212 microversion: 2.1 time: 0.243222 Jun 18 22:15:01.774347 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1667/3335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:01 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1212 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:02.237432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:02.237939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:02.242017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:02.252362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:02.263862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:02.267993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:02.268639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:02.284725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-218568472", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "dde132b3-d6f0-4c80-bb02-5df5dfb553fe"}], "security_groups": [{"name": "tempest-securitygroup--289199600"}], "key_name": "tempest-keypair-962286419", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:02.616588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] validate_networks() for [('dde132b3-d6f0-4c80-bb02-5df5dfb553fe', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:15:02.773002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:02.786100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73054e50-5f3f-495e-a6cb-2f2b6854aa4c tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1468 microversion: 2.1 time: 0.552790 Jun 18 22:15:02.788705 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1669/3336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:02 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1468 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:02.794905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:02.795735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:02.816805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:02.818614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:02.819608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:02.821485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.060441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:03.073727 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b54487ea-9459-4f86-8701-0e2edd80e211 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1208 microversion: 2.1 time: 0.283698 Jun 18 22:15:03.075328 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1670/3337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:02 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1208 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:03.398434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f1f3883f-733b-4240-b270-f17d0d018726 req-42f14228-e4e7-42ae-b978-c0ca6a7ddec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e989fc58-3640-4eca-893e-43e4582d5efa", "name": "network-vif-deleted", "tag": "995acddb-4f18-4c41-a76f-e684f04860ee"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:03.434579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f1f3883f-733b-4240-b270-f17d0d018726 req-42f14228-e4e7-42ae-b978-c0ca6a7ddec9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:03.435363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f1f3883f-733b-4240-b270-f17d0d018726 req-42f14228-e4e7-42ae-b978-c0ca6a7ddec9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.466549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f1f3883f-733b-4240-b270-f17d0d018726 req-42f14228-e4e7-42ae-b978-c0ca6a7ddec9 service nova] Creating event network-vif-deleted:995acddb-4f18-4c41-a76f-e684f04860ee for instance e989fc58-3640-4eca-893e-43e4582d5efa on nch2-master-1 Jun 18 22:15:03.476227 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f1f3883f-733b-4240-b270-f17d0d018726 req-42f14228-e4e7-42ae-b978-c0ca6a7ddec9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081997 Jun 18 22:15:03.478223 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1671/3338] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:03.726397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Getting quotas for project be43b4b4305647cfb63bdcaa91331b55. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:03.732264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Getting quotas for user 79eddf3b96304e86a213d7238783e960 and project be43b4b4305647cfb63bdcaa91331b55. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:03.748757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:15:03.749491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:15:03.750028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:15:03.750451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:15:03.754848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:15:03.775209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:03.776615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.779303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:03.779919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.805739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:03.806758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:03.817296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:03.818031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.819263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:03.819848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.829279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Getting quotas for project be43b4b4305647cfb63bdcaa91331b55. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:03.844859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Getting quotas for user 79eddf3b96304e86a213d7238783e960 and project be43b4b4305647cfb63bdcaa91331b55. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:03.895155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:15:03.898495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:15:03.915626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:03.915871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:03.919848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lazy-loading 'fault' on Instance uuid e989fc58-3640-4eca-893e-43e4582d5efa {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:15:04.049690 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cac0365e-992c-49c0-b3df-a5308a8747fb tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.768595 Jun 18 22:15:04.057599 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1668/3339] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:15:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:15:04.077055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d8535587-4669-484c-b751-ef5b0afc3051 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:04.078074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d8535587-4669-484c-b751-ef5b0afc3051 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:04.113351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e8a394c0a284416ac893321bd860e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac774f9b327041a887378bd2725853c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:04.125962 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bdc89c8f-c30d-4ba8-9d59-3ba1ad054919 tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 200 len: 1302 microversion: 2.1 time: 0.323780 Jun 18 22:15:04.141431 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1672/3340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:03 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 1302 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:04.175518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:04.182607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:04.211611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:04.212947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:04.215432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:04.221420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:04.302589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d8535587-4669-484c-b751-ef5b0afc3051 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:04.316704 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d8535587-4669-484c-b751-ef5b0afc3051 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1268 microversion: 2.1 time: 0.249267 Jun 18 22:15:04.319034 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1669/3341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:04 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1268 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:04.368370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:04.381249 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab127aaf-ceea-426d-99aa-bab9a33708e6 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1270 microversion: 2.1 time: 0.238579 Jun 18 22:15:04.381860 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1673/3342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:04 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:05.152649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:05.155396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] [instance: e989fc58-3640-4eca-893e-43e4582d5efa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:05.168597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:05.169283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:05.172690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:05.173390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:05.193219 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] HTTP exception thrown: Instance e989fc58-3640-4eca-893e-43e4582d5efa could not be found. Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Request method failure captured: Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa HTTP/1.1 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk0oegh0Umr9nRkOPpOeD8eEf8sXzDtd-eAviqbyjQyNa4HXoMmzzkZL4n1TqWIDYWrwsE5QhIH9KxaQh3wch4OZSsYl7KVSxNirSUUBiNcIBhmiePGMtDDN1ID0_-LJQd3xdMfo3BGPgBWla2vwtiVtPH-F3prMuLiNxB_piz42314 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac774f9b327041a887378bd2725853c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac774f9b327041a887378bd2725853c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac774f9b327041a887378bd2725853c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MigrationsAdminTest-869669657 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: ac774f9b327041a887378bd2725853c6 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MigrationsAdminTest-869669657 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MigrationsAdminTest-869669657-project Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 0e8a394c0a284416ac893321bd860e51 Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MigrationsAdminTest-869669657-project Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance e989fc58-3640-4eca-893e-43e4582d5efa could not be found. Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e989fc58-3640-4eca-893e-43e4582d5efa'} Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e989fc58-3640-4eca-893e-43e4582d5efa could not be found. Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e989fc58-3640-4eca-893e-43e4582d5efa could not be found. Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:05.195700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e989fc58-3640-4eca-893e-43e4582d5efa could not be found. Jun 18 22:15:05.200199 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:05.204633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] Returning 404 to user: Instance e989fc58-3640-4eca-893e-43e4582d5efa could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:05.205843 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6ab4b730-1e7c-44cc-b7d0-ebb6336a292a tempest-MigrationsAdminTest-869669657 tempest-MigrationsAdminTest-869669657-project] 10.222.0.30 "GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa" status: 404 len: 111 microversion: 2.1 time: 0.065416 Jun 18 22:15:05.206999 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1670/3343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:05 2022] GET /compute/v2.1/servers/e989fc58-3640-4eca-893e-43e4582d5efa => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:05.335940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:05.336559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:05.361456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:05.362354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:05.365170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:05.366096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:05.375612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:05.399803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:05.400546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:05.414439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:05.414901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:05.415693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:05.416130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:05.636968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:05.646490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e31bc40-c203-4057-bfc1-3003eebd44f6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1264 microversion: 2.1 time: 0.314985 Jun 18 22:15:05.650655 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1674/3344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:05 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:05.874105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:05.888488 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7dc9d684-05de-43c4-a859-16f3f5b088a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1312 microversion: 2.1 time: 0.492921 Jun 18 22:15:05.889124 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1671/3345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:05 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1312 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:06.665517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:06.666062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:06.676528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:06.677119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:06.677766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:06.678212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:06.799319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:06.809366 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65973f84-26d5-428d-9fa1-970f94612c7a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1326 microversion: 2.1 time: 0.146132 Jun 18 22:15:06.811742 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1675/3346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:06 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:06.905613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:06.906954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:06.917130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:06.917500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:06.918294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:06.924612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:07.137897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d48035a-208e-4c79-b4c3-8bbff016c991"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:07.139138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:07.162635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:07.162635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:07.162635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:07.162635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:07.570349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:07.581821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fec4ff67-cbfb-4ed2-a2ef-5f7e854a0963 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1333 microversion: 2.1 time: 0.679640 Jun 18 22:15:07.593135 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1672/3347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:06 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1333 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:07.624297 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d2980b9-4938-49de-9b3a-0d01b4a421f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490899 Jun 18 22:15:07.642430 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1676/3348] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:15:07 2022] POST /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:07.826644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:07.827564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:07.834764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:07.835682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:07.836774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:07.837805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:08.207769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:08.216419 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df29e70e-49be-4c2b-88a6-b121a93e0e72 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.394598 Jun 18 22:15:08.220497 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1673/3349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:07 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:08.611111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:08.612504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:08.642954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:08.648951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:08.653224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:08.655340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:09.185216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:09.199163 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-78e36119-2d2d-4725-bb87-7eea8a320472 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.602332 Jun 18 22:15:09.199893 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1677/3350] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:08 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:09.235838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:09.238175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:09.259030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:09.267510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:09.270764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:09.271291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:10.218264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:10.219151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:10.247448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:10.251813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:10.252985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:10.256032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:10.366139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:10.376430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-63467c5f-d15a-44b2-9720-8cda4c33751c tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 1.144332 Jun 18 22:15:10.377993 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1674/3351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:09 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:10.384268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7db6c968-c357-4cd9-b3ca-a3a3e8c94806 req-ccbc2d69-c410-48fa-9669-6df29a6413c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7822f3b2-02ac-49c5-9e0c-63679ee2313a", "tag": "8a095026-e585-4959-ae97-2207497eea20"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:10.395324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7db6c968-c357-4cd9-b3ca-a3a3e8c94806 req-ccbc2d69-c410-48fa-9669-6df29a6413c2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:10.396086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7db6c968-c357-4cd9-b3ca-a3a3e8c94806 req-ccbc2d69-c410-48fa-9669-6df29a6413c2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:10.424444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7db6c968-c357-4cd9-b3ca-a3a3e8c94806 req-ccbc2d69-c410-48fa-9669-6df29a6413c2 service nova] Creating event network-changed:8a095026-e585-4959-ae97-2207497eea20 for instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a on nch2-master-1 Jun 18 22:15:10.433079 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7db6c968-c357-4cd9-b3ca-a3a3e8c94806 req-ccbc2d69-c410-48fa-9669-6df29a6413c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053542 Jun 18 22:15:10.443192 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1675/3352] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:10.756835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:10.768676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed9dec20-5885-4196-a7bf-3a682aa3d1f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.556707 Jun 18 22:15:10.769320 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1678/3353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:10 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:11.399244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:11.400497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:11.452795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:11.456089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:11.457655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:11.458309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:11.553183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0f49a098-60d4-40dc-83ff-fabfe3e0c560 req-3cbf863d-df43-43c4-ab5e-d9af62ab0cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "tag": "3aef7989-de2e-4277-9706-6de25e9482eb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:11.590940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:11.592535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:11.595791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0f49a098-60d4-40dc-83ff-fabfe3e0c560 req-3cbf863d-df43-43c4-ab5e-d9af62ab0cd7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:11.596574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0f49a098-60d4-40dc-83ff-fabfe3e0c560 req-3cbf863d-df43-43c4-ab5e-d9af62ab0cd7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:11.616562 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0f49a098-60d4-40dc-83ff-fabfe3e0c560 req-3cbf863d-df43-43c4-ab5e-d9af62ab0cd7 service nova] Creating event network-changed:3aef7989-de2e-4277-9706-6de25e9482eb for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:11.629447 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0f49a098-60d4-40dc-83ff-fabfe3e0c560 req-3cbf863d-df43-43c4-ab5e-d9af62ab0cd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085493 Jun 18 22:15:11.630887 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1679/3354] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:11.803757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38578d88-bc66-4a27-8b33-8990ef2ea6ee tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Action: 'update', calling method: .version_select at 0x7fea142c1820>, body: {"quota_set": {"ram": "5120"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:11.920992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38578d88-bc66-4a27-8b33-8990ef2ea6ee tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:11.921744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38578d88-bc66-4a27-8b33-8990ef2ea6ee tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:11.922725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38578d88-bc66-4a27-8b33-8990ef2ea6ee tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:11.923472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38578d88-bc66-4a27-8b33-8990ef2ea6ee tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:11.999890 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-38578d88-bc66-4a27-8b33-8990ef2ea6ee tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2" status: 200 len: 240 microversion: 2.36 time: 0.366763 Jun 18 22:15:12.001260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1680/3355] 10.222.0.30 () {62 vars in 1302 bytes} [Sat Jun 18 22:15:11 2022] PUT /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2 => generated 240 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:15:12.007280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:12.008250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:12.017565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.018485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.019510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.020495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.238345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:12.246527 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-770dd621-3b83-46ec-b311-d1927d890ada tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.854669 Jun 18 22:15:12.248969 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1676/3356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:11 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:12.266455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f0e20ca9-a134-42c3-bd80-4b80429f08b0 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Calling method '.version_select at 0x7fea07929b80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:12.357057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e20ca9-a134-42c3-bd80-4b80429f08b0 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.357661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e20ca9-a134-42c3-bd80-4b80429f08b0 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.358581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e20ca9-a134-42c3-bd80-4b80429f08b0 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.359130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e20ca9-a134-42c3-bd80-4b80429f08b0 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.374331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:12.388304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f0e20ca9-a134-42c3-bd80-4b80429f08b0 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2/detail" status: 200 len: 672 microversion: 2.36 time: 0.126706 Jun 18 22:15:12.389603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1677/3357] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Jun 18 22:15:12 2022] GET /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2/detail => generated 672 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:15:12.406725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:12.407406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:12.410677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:12.425614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-05e505ac-e38c-4dd6-855f-bd8dffe1312f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.422791 Jun 18 22:15:12.425856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.426527 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1681/3358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:12 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:12.435058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.436722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.438090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.484860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lazy-loading 'flavor' on Instance uuid 0193f858-2c0f-43e6-a811-27bb75b7708f {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:15:12.640232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Action: 'update', calling method: .version_select at 0x7fea14278790>, body: {"quota_set": {"ram": "2048"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:12.754296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.755007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.756120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.757535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.767389 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fdabd724-11a1-4a20-a1a0-4319090e426c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/action" status: 200 len: 32 microversion: 2.1 time: 0.376161 Jun 18 22:15:12.773053 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1678/3359] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:15:12 2022] POST /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:15:12.790856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:12.795371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:12.814005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.815795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.818959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.819606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.918640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.919440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:12.920547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:12.924681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:13.089904 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be9d5043-72ac-4397-91ea-cdbac82e0e03 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2?user_id=3fe9fc91651c4a299069cc25c63fcb9a" status: 200 len: 240 microversion: 2.36 time: 0.449740 Jun 18 22:15:13.095629 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1682/3360] 10.222.0.30 () {62 vars in 1383 bytes} [Sat Jun 18 22:15:12 2022] PUT /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2?user_id=3fe9fc91651c4a299069cc25c63fcb9a => generated 240 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:15:13.101160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c5fa1ee-e887-4f1f-9317-1653d4abf6a6 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] Calling method '.version_select at 0x7fea14147280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:13.250444 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c5fa1ee-e887-4f1f-9317-1653d4abf6a6 tempest-QuotasAdminTestV236-1711209681 tempest-QuotasAdminTestV236-1711209681-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2?user_id=3fe9fc91651c4a299069cc25c63fcb9a" status: 200 len: 282 microversion: 2.36 time: 0.152542 Jun 18 22:15:13.256586 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1683/3361] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Jun 18 22:15:13 2022] GET /compute/v2.1/os-quota-sets/4621db39d40d4d0796341acdcd95a4a2?user_id=3fe9fc91651c4a299069cc25c63fcb9a => generated 282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:15:13.266378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:13.267004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:13.274190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:13.274923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:13.275950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:13.276548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:13.488150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:13.517925 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ded92196-12c3-4247-b4d5-da6a2a8163aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.737059 Jun 18 22:15:13.518714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1679/3362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:12 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:13.531474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:13.532977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:13.554060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:13.554619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:13.555634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:13.556215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:13.596613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:13.844792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:13.853252 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cdebcdfd-5583-41ae-806b-1eb3c8d2e1b3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.591931 Jun 18 22:15:13.855360 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1684/3363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:13 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:14.054883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:14.067356 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc1a770e-86fc-47f5-9025-d73c17597861 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.542299 Jun 18 22:15:14.067356 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1680/3364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:13 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:14.148177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9a0709ad-a8eb-4476-b334-158c89597baa req-832106d4-3ea9-4675-883d-4889a58df48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "tag": "a9c700c1-d35f-4f88-9be7-e858e6879a80"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:14.165140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9a0709ad-a8eb-4476-b334-158c89597baa req-832106d4-3ea9-4675-883d-4889a58df48b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:14.165811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9a0709ad-a8eb-4476-b334-158c89597baa req-832106d4-3ea9-4675-883d-4889a58df48b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:14.190947 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9a0709ad-a8eb-4476-b334-158c89597baa req-832106d4-3ea9-4675-883d-4889a58df48b service nova] Creating event network-changed:a9c700c1-d35f-4f88-9be7-e858e6879a80 for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:14.203181 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9a0709ad-a8eb-4476-b334-158c89597baa req-832106d4-3ea9-4675-883d-4889a58df48b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058760 Jun 18 22:15:14.203811 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1685/3365] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:14.540102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:14.546712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:14.559871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:14.565094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:14.568155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:14.570904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:14.884360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:14.885345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:14.892991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:14.894381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:14.895303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:14.898264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:15.336362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:15.351785 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fe59cd3-60f9-40ee-b4cb-6caf04090607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.815870 Jun 18 22:15:15.354301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:15.363324 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1681/3366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:14 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:15.371274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:15.372165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:15.372852 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b8f09dc5-ebc4-4cfd-aec1-51349a55eaf6 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.502901 Jun 18 22:15:15.375959 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1686/3367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:14 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:15.395156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:15.396093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:15.398408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:15.399479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:15.755295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:15.776466 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cfd8c342-4194-472e-b13d-bdb5bf800e5a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.409269 Jun 18 22:15:15.778860 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1682/3368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:15 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:16.377851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:16.382279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:16.392585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:16.393478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:16.406111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:16.406646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:16.406784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:16.408526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:16.409000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:16.410398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:16.411611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:16.412223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:16.889940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:16.899277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc638309-befe-4d00-814a-0d9d8b5abbe5 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.511049 Jun 18 22:15:16.901770 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1683/3369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:16 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:16.914555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ff2cd29b-d666-4ea5-acbd-ff1509a4bd1f req-d7b3e2d9-ff96-435d-816d-1ec936c1c85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "tag": "04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:16.936492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ff2cd29b-d666-4ea5-acbd-ff1509a4bd1f req-d7b3e2d9-ff96-435d-816d-1ec936c1c85a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:16.937456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ff2cd29b-d666-4ea5-acbd-ff1509a4bd1f req-d7b3e2d9-ff96-435d-816d-1ec936c1c85a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:16.970187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:16.976225 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ff2cd29b-d666-4ea5-acbd-ff1509a4bd1f req-d7b3e2d9-ff96-435d-816d-1ec936c1c85a service nova] Creating event network-changed:04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:16.982318 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c6cf732-1b66-49bf-b53d-e4cf082fdc0a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.616217 Jun 18 22:15:16.984368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ff2cd29b-d666-4ea5-acbd-ff1509a4bd1f req-d7b3e2d9-ff96-435d-816d-1ec936c1c85a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073935 Jun 18 22:15:16.985522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1684/3370] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:16.988279 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1687/3371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:16 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:17.004980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:17.006427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:17.017602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:17.018654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:17.019670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:17.020336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:17.327773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:17.346219 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b595c22-0b97-4d06-a0b6-db26ac7522a7 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.357777 Jun 18 22:15:17.346739 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1685/3372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:16 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:17.921950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:17.922586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:17.948700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:17.951664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:17.955648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:17.956330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:18.215599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:18.224946 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4eb793c0-8fd5-4932-97c5-94501c688ec3 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.310551 Jun 18 22:15:18.225804 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1688/3373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:17 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:18.250359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:18.253682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:18.271980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:18.273920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:18.276633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:18.277545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:18.431825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-478ad74f-42f4-4665-be16-2cda136c074a tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Action: 'create', calling method: .version_select at 0x7fea079a08b0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:18.480932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-478ad74f-42f4-4665-be16-2cda136c074a tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Getting quotas for project b98348e8bdf54b388b5612512ca5252d. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:18.495467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-478ad74f-42f4-4665-be16-2cda136c074a tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Getting quotas for user ae87f94c39ba403195516e259f4fa6fc and project b98348e8bdf54b388b5612512ca5252d. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:18.607428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-478ad74f-42f4-4665-be16-2cda136c074a tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Getting quotas for project b98348e8bdf54b388b5612512ca5252d. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:18.623153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-478ad74f-42f4-4665-be16-2cda136c074a tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Getting quotas for user ae87f94c39ba403195516e259f4fa6fc and project b98348e8bdf54b388b5612512ca5252d. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:18.659036 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-478ad74f-42f4-4665-be16-2cda136c074a tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.736781 Jun 18 22:15:18.663784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:18.665365 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1686/3374] 10.222.0.30 () {62 vars in 1213 bytes} [Sat Jun 18 22:15:17 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:15:18.678542 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c7bea8f-ac1b-40b2-8b70-1e978f3389bf tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.451663 Jun 18 22:15:18.679214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:18.680121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:18.680479 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1689/3375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:18 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:18.693268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-233d7a79-a14f-4768-a35c-1c7e9be68465 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:18.697077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:18.697880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:18.699007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:18.699714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:18.735824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-233d7a79-a14f-4768-a35c-1c7e9be68465 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.053967 Jun 18 22:15:18.736694 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1690/3376] 10.222.0.30 () {60 vars in 1192 bytes} [Sat Jun 18 22:15:18 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:15:18.749736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-506ecd3e-88f3-4c2b-8b58-d9891522b8a0 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:18.768896 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-506ecd3e-88f3-4c2b-8b58-d9891522b8a0 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030" status: 200 len: 235 microversion: 2.64 time: 0.025891 Jun 18 22:15:18.776431 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1691/3377] 10.222.0.30 () {60 vars in 1303 bytes} [Sat Jun 18 22:15:18 2022] GET /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030 => generated 235 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:15:18.794457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88d349fd-f65e-40a7-9dde-82bdad80d4d8 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:18.870187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88d349fd-f65e-40a7-9dde-82bdad80d4d8 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030" status: 204 len: 0 microversion: 2.64 time: 0.087947 Jun 18 22:15:18.876585 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1692/3378] 10.222.0.30 () {60 vars in 1306 bytes} [Sat Jun 18 22:15:18 2022] DELETE /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 18 22:15:18.884519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cbcdfc14-b950-42fe-84c0-1934af9d2f19 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:18.903980 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-cbcdfc14-b950-42fe-84c0-1934af9d2f19 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] HTTP exception thrown: Instance group cd9b06e7-cd6e-4df8-a00e-e15a518bb030 could not be found. Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cbcdfc14-b950-42fe-84c0-1934af9d2f19 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Request method failure captured: Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030 HTTP/1.1 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk51MBHzJdyVreqV1fjFTEQgGaMVA8ttKMAz35HfJn-s8rz25HqAmaMmD-uU2fhO_I_LJbq5Z2iLum_usRo1LqAeBhx-AxJu8RXQrBUv_71VzKwCIGoEjqbaQKIHifr-ag3jsy7bPNSs3hkNtpkp5RkOdO-CgZvOsouGnJBE4P0MPr4 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.64 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b98348e8bdf54b388b5612512ca5252d Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerGroup264TestJSON-1453107603 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b98348e8bdf54b388b5612512ca5252d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b98348e8bdf54b388b5612512ca5252d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b98348e8bdf54b388b5612512ca5252d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b98348e8bdf54b388b5612512ca5252d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerGroup264TestJSON-1453107603 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b98348e8bdf54b388b5612512ca5252d Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1453107603 Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerGroup264TestJSON-1453107603-project Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ae87f94c39ba403195516e259f4fa6fc Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerGroup264TestJSON-1453107603-project Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance group cd9b06e7-cd6e-4df8-a00e-e15a518bb030 could not be found. Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'cd9b06e7-cd6e-4df8-a00e-e15a518bb030'} Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cd9b06e7-cd6e-4df8-a00e-e15a518bb030 could not be found. Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cd9b06e7-cd6e-4df8-a00e-e15a518bb030 could not be found. Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:18.926108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cd9b06e7-cd6e-4df8-a00e-e15a518bb030 could not be found. Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cbcdfc14-b950-42fe-84c0-1934af9d2f19 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] Returning 404 to user: Instance group cd9b06e7-cd6e-4df8-a00e-e15a518bb030 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cbcdfc14-b950-42fe-84c0-1934af9d2f19 tempest-ServerGroup264TestJSON-1453107603 tempest-ServerGroup264TestJSON-1453107603-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030" status: 404 len: 117 microversion: 2.64 time: 0.049939 Jun 18 22:15:18.934618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1693/3379] 10.222.0.30 () {60 vars in 1306 bytes} [Sat Jun 18 22:15:18 2022] DELETE /compute/v2.1/os-server-groups/cd9b06e7-cd6e-4df8-a00e-e15a518bb030 => generated 117 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:15:19.031657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:19.044207 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43583a93-c3ef-474a-8ae2-cc4454ee0793 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.373649 Jun 18 22:15:19.057947 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1687/3380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:18 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:19.242614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:19.243160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:19.262569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:19.263037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:19.264199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:19.264819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:19.342421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6dfac4cc-8330-44ab-91ca-eafd6aa74bbf req-14c526ab-a8fc-4fcd-a8f2-a469cfc53883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7822f3b2-02ac-49c5-9e0c-63679ee2313a", "name": "network-vif-plugged", "status": "completed", "tag": "8a095026-e585-4959-ae97-2207497eea20"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:19.360438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6dfac4cc-8330-44ab-91ca-eafd6aa74bbf req-14c526ab-a8fc-4fcd-a8f2-a469cfc53883 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:19.364626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6dfac4cc-8330-44ab-91ca-eafd6aa74bbf req-14c526ab-a8fc-4fcd-a8f2-a469cfc53883 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:19.384640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6dfac4cc-8330-44ab-91ca-eafd6aa74bbf req-14c526ab-a8fc-4fcd-a8f2-a469cfc53883 service nova] Creating event network-vif-plugged:8a095026-e585-4959-ae97-2207497eea20 for instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a on nch2-master-1 Jun 18 22:15:19.403379 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6dfac4cc-8330-44ab-91ca-eafd6aa74bbf req-14c526ab-a8fc-4fcd-a8f2-a469cfc53883 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064847 Jun 18 22:15:19.403946 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1688/3381] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:19.533361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:19.542224 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa0810a7-ca6f-4981-98af-09d218d4f204 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.303933 Jun 18 22:15:19.544897 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1694/3382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:19.699239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:19.700171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:19.718828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6625dd3-7b5f-42ec-8736-0ebf38295219 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:19.724929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:19.726832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:19.728491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:19.733475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:19.742605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6625dd3-7b5f-42ec-8736-0ebf38295219 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.301369 Jun 18 22:15:19.754013 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1689/3383] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:19.779175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c38bce0-ba44-438d-92d8-6b86fed63deb tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:19.831060 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7c38bce0-ba44-438d-92d8-6b86fed63deb tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.074301 Jun 18 22:15:19.832464 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1690/3384] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:19.846999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-317056c6-1330-4ede-8ae6-6cc3d7327500 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:19.894742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-317056c6-1330-4ede-8ae6-6cc3d7327500 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053011 Jun 18 22:15:19.910000 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1691/3385] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:19.918195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-386d7d7d-4d45-4d69-88b1-d787f6da899f tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:19.942356 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-386d7d7d-4d45-4d69-88b1-d787f6da899f tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030936 Jun 18 22:15:19.945953 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1692/3386] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:19.961007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4732c553-d7eb-4839-9791-461f239c2d33 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.000229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4732c553-d7eb-4839-9791-461f239c2d33 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.045468 Jun 18 22:15:20.001674 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1693/3387] 10.222.0.30 () {58 vars in 1164 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.018948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2e33e2ba-6a7b-4262-bb37-a63176f8b671 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.033829 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2e33e2ba-6a7b-4262-bb37-a63176f8b671 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020271 Jun 18 22:15:20.034777 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1694/3388] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:20.047590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bed4e10-6131-4e96-8b63-53fb9a081743 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.093778 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bed4e10-6131-4e96-8b63-53fb9a081743 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.049289 Jun 18 22:15:20.104568 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1695/3389] 10.222.0.30 () {58 vars in 1168 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.114087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.115241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:20.141339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:20.141994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:20.146423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:20.147050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:20.256443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:20.274811 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2129a820-b589-4405-bf52-20160b250cd4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.580343 Jun 18 22:15:20.275712 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1695/3390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:19 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.280562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39da7251-d464-4f44-ada3-5235ed1c5cd1 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.297376 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39da7251-d464-4f44-ada3-5235ed1c5cd1 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020544 Jun 18 22:15:20.297978 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1696/3391] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:20.312362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4bc14512-c1c3-4766-be74-4b4eaad2f5e2 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.315497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:20.327980 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4bc14512-c1c3-4766-be74-4b4eaad2f5e2 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019302 Jun 18 22:15:20.331584 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1697/3392] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:20.348935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-777c2aae-4532-4025-b43b-9d10e6c122df tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.462412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-777c2aae-4532-4025-b43b-9d10e6c122df tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.118961 Jun 18 22:15:20.473736 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1698/3393] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:20.485569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-afc06f48-8ab9-4a8f-84dc-cb539627b55e tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.509842 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-afc06f48-8ab9-4a8f-84dc-cb539627b55e tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030882 Jun 18 22:15:20.510478 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1699/3394] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:20.523480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c6623bae-edda-4c16-982e-5a1fd4339e69 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.577062 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c6623bae-edda-4c16-982e-5a1fd4339e69 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.058974 Jun 18 22:15:20.577719 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1700/3395] 10.222.0.30 () {58 vars in 1143 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.592687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.594748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:20.608781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:20.611548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:20.612923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:20.623354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:20.668599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:20.674500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:20.683122 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-673d4107-e783-4336-a3ea-420e29b18d58 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.579229 Jun 18 22:15:20.699458 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1696/3396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.702172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-96895d68-b2d6-4e9d-95ca-18698b6ffff0 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.724179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-96895d68-b2d6-4e9d-95ca-18698b6ffff0 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031461 Jun 18 22:15:20.724717 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1697/3397] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:20.737372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-99032561-f2b8-4b06-899a-b364db4f3fc4 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.765170 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-99032561-f2b8-4b06-899a-b364db4f3fc4 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029158 Jun 18 22:15:20.776958 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1698/3398] 10.222.0.30 () {58 vars in 1147 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.790986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54960407-30ea-4d42-8046-64226ffc512b tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.848118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-54960407-30ea-4d42-8046-64226ffc512b tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.068799 Jun 18 22:15:20.848709 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1699/3399] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:20.861833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1054dfdc-d387-40a1-b869-077e0ea062d7 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.874343 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1054dfdc-d387-40a1-b869-077e0ea062d7 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017582 Jun 18 22:15:20.880944 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1700/3400] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:20.886222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4388327c-f500-4da9-94d9-872f1ab21803 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.938258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4388327c-f500-4da9-94d9-872f1ab21803 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.056030 Jun 18 22:15:20.941225 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1701/3401] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.952395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d135978-2c22-4f0a-adc8-c48f9980f81c tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:20.956771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:20.966967 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66373597-e10d-4245-8dd6-0ec83d3d7099 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1393 microversion: 2.1 time: 0.388047 Jun 18 22:15:20.967554 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1701/3402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1393 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.977221 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d135978-2c22-4f0a-adc8-c48f9980f81c tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029612 Jun 18 22:15:20.978630 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1702/3403] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:20.995185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f8e3d3b-9157-43c3-a718-a7a6f6ce5375 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:21.005990 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f8e3d3b-9157-43c3-a718-a7a6f6ce5375 tempest-FlavorsV2TestJSON-109900745 tempest-FlavorsV2TestJSON-109900745-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015460 Jun 18 22:15:21.008897 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1702/3404] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:15:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:21.293145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:21.294066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:21.311730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:21.313832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:21.315102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:21.318203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:21.707691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:21.709061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:21.714648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:21.726082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5bbfc2bd-a344-4521-a5c6-4ba57360f61b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.438001 Jun 18 22:15:21.726741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:21.726741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:21.727351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:21.727789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:21.729513 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1703/3405] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:21 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:21.987708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:21.988730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:22.003478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:22.012237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:22.013221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:22.016979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:22.219120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:22.229567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf997676-6912-4482-b3b0-aabf0792e68f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.525790 Jun 18 22:15:22.230165 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1703/3406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:21 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:22.343628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:22.352043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-51dc023d-cb98-4e16-86e9-4297d03c8a29 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1574 microversion: 2.1 time: 0.369785 Jun 18 22:15:22.353648 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1704/3407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:21 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1574 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:22.370580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:22.371102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:22.378357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:22.379096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:22.380872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:22.383054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:22.499081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc5247a4-8539-4f71-9c42-7acb6b91cd08 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133996 Jun 18 22:15:22.500455 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1704/3408] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:15:22 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:22.745757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:22.746443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:22.759759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:22.766550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:22.767537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:22.773922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:22.774757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:23.250152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:23.253082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:23.257460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:23.260080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=24 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:23.279757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:23.283761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:23.285991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:23.287283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:23.289427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:23.297006 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e09b10d8-a049-4aaa-bc5d-ed5e12631f79 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.555276 Jun 18 22:15:23.303774 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1705/3409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:22 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:23.734570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:23.752745 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ee05f21-dd16-47e1-a8be-655b6a8f019f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.507642 Jun 18 22:15:23.754961 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1705/3410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:23 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:24.316979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:24.320698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:24.321313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:24.325855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:24.336576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.337073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:24.337880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.338314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:24.347377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.347698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:24.348921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.349621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:24.782815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:24.799239 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-76daae7d-fe5b-47c6-83fb-50e7a8d0ff0a tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1574 microversion: 2.1 time: 0.487356 Jun 18 22:15:24.800116 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1706/3411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:24 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1574 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:24.815736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b8e16a4c-7d70-488a-a8b0-44a035c27550 req-bcba327c-5fe2-4135-98a6-af4cd08c5dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7822f3b2-02ac-49c5-9e0c-63679ee2313a", "tag": "8a095026-e585-4959-ae97-2207497eea20"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:24.833335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b8e16a4c-7d70-488a-a8b0-44a035c27550 req-bcba327c-5fe2-4135-98a6-af4cd08c5dd4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.833876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b8e16a4c-7d70-488a-a8b0-44a035c27550 req-bcba327c-5fe2-4135-98a6-af4cd08c5dd4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:24.854827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:24.855027 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b8e16a4c-7d70-488a-a8b0-44a035c27550 req-bcba327c-5fe2-4135-98a6-af4cd08c5dd4 service nova] Creating event network-changed:8a095026-e585-4959-ae97-2207497eea20 for instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a on nch2-master-1 Jun 18 22:15:24.863848 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-38eb53a4-95e9-4c70-831d-3023aa61d9f7 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.550890 Jun 18 22:15:24.864549 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b8e16a4c-7d70-488a-a8b0-44a035c27550 req-bcba327c-5fe2-4135-98a6-af4cd08c5dd4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061430 Jun 18 22:15:24.866322 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1707/3412] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:24.867552 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1706/3413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:24 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:24.889619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:24.890661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:24.899501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.900345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:24.902093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:24.902938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:25.361290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:25.383529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8c7e736-2831-4c0f-bb5b-6f60d19d92dc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.515463 Jun 18 22:15:25.389175 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1708/3414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:24 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:25.884628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:25.886199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:25.898381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:25.899134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:25.901617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:25.904336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:26.305707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:26.315841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-04390c56-a5ca-4848-8ca6-e588b49c2356 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.435762 Jun 18 22:15:26.325081 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1707/3415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:25 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:26.407123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:26.408030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:26.423279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:26.425326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:26.427632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:26.428726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:26.716223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:26.737589 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-503b3f02-ef98-493c-b998-ef0eb9e1e54a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.336584 Jun 18 22:15:26.751172 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1709/3416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:26 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:27.339784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:27.341149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:27.352810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:27.353353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:27.359390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:27.360066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:27.463844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2f7d95ed-3aaf-40f9-9325-6657d342898c req-66cb1f8b-6cb0-4af7-a559-c201d0fb54ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-plugged", "status": "completed", "tag": "04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:27.489552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2f7d95ed-3aaf-40f9-9325-6657d342898c req-66cb1f8b-6cb0-4af7-a559-c201d0fb54ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:27.491615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2f7d95ed-3aaf-40f9-9325-6657d342898c req-66cb1f8b-6cb0-4af7-a559-c201d0fb54ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:27.537694 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2f7d95ed-3aaf-40f9-9325-6657d342898c req-66cb1f8b-6cb0-4af7-a559-c201d0fb54ec service nova] Creating event network-vif-plugged:04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:27.560731 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2f7d95ed-3aaf-40f9-9325-6657d342898c req-66cb1f8b-6cb0-4af7-a559-c201d0fb54ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098303 Jun 18 22:15:27.563861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1710/3417] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:27.757280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:27.758255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:27.759121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:27.771670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:27.772684 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ddf248b1-c4b7-4620-aeb3-0acaf6f58cb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.438536 Jun 18 22:15:27.773483 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1708/3418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:27 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:27.779219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:27.781300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:27.782057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:28.257198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:28.266076 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9b7eb521-ed28-47b4-8f28-42b765585bc4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.513261 Jun 18 22:15:28.270044 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1711/3419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:27 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:28.800017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:28.801647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:28.817286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:28.818563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:28.820565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:28.820866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:29.149117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:29.163371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d22a375e-cc05-46b4-8a1f-f3f94a7a42ff tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1737 microversion: 2.1 time: 0.375516 Jun 18 22:15:29.174117 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1709/3420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:28 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1737 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:29.286481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:29.287125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:29.290642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=24 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:29.306624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:29.307116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:29.307968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:29.308404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:29.645978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:29.661337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14c7ee14-7295-430d-b76c-e09aead88eb2 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.378631 Jun 18 22:15:29.663010 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1712/3421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:29 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:29.757412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1a70f118-9640-44d1-ab8d-5ec41ca3fbb8 req-3ae0a618-441c-4f16-8a93-f7be4524f85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-plugged", "status": "completed", "tag": "3aef7989-de2e-4277-9706-6de25e9482eb"}, {"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-plugged", "status": "completed", "tag": "a9c700c1-d35f-4f88-9be7-e858e6879a80"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:29.767686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1a70f118-9640-44d1-ab8d-5ec41ca3fbb8 req-3ae0a618-441c-4f16-8a93-f7be4524f85e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:29.768482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1a70f118-9640-44d1-ab8d-5ec41ca3fbb8 req-3ae0a618-441c-4f16-8a93-f7be4524f85e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:29.790112 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1a70f118-9640-44d1-ab8d-5ec41ca3fbb8 req-3ae0a618-441c-4f16-8a93-f7be4524f85e service nova] Creating event network-vif-plugged:3aef7989-de2e-4277-9706-6de25e9482eb for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:29.790784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1a70f118-9640-44d1-ab8d-5ec41ca3fbb8 req-3ae0a618-441c-4f16-8a93-f7be4524f85e service nova] Creating event network-vif-plugged:a9c700c1-d35f-4f88-9be7-e858e6879a80 for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:29.798052 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1a70f118-9640-44d1-ab8d-5ec41ca3fbb8 req-3ae0a618-441c-4f16-8a93-f7be4524f85e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043908 Jun 18 22:15:29.799447 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1710/3422] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:30.183866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:30.184334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:30.189482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:30.198286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.201807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.204987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.205754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.544155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:30.550479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:30.564277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f2fe297-cf4b-48c0-846b-1e21da5e6d43 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1717 microversion: 2.1 time: 0.386035 Jun 18 22:15:30.565338 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1713/3423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:30 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1717 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:30.680857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:30.682953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:30.693204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.696172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.697281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.697901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.745768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:30.746540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:30.753694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.754449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.755428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.756041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.859997 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Cannot 'detach_volume' instance 0193f858-2c0f-43e6-a811-27bb75b7708f while it is in vm_state rescued Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments/8d48035a-208e-4c79-b4c3-8bbff016c991 HTTP/1.1 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'detach_volume' instance 0193f858-2c0f-43e6-a811-27bb75b7708f while it is in vm_state rescued Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '0193f858-2c0f-43e6-a811-27bb75b7708f', 'id': '8d48035a-208e-4c79-b4c3-8bbff016c991'} Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0193f858-2c0f-43e6-a811-27bb75b7708f while it is in vm_state rescued Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:30.862013 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:30.866959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:30.866959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:30.866959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:30.866959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:30.866959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0193f858-2c0f-43e6-a811-27bb75b7708f while it is in vm_state rescued Jun 18 22:15:30.866959 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:30.868393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 409 to user: Cannot 'detach_volume' instance 0193f858-2c0f-43e6-a811-27bb75b7708f while it is in vm_state rescued {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:30.869601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46e35cb9-8979-46ec-bac5-a047060eeda5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments/8d48035a-208e-4c79-b4c3-8bbff016c991" status: 409 len: 152 microversion: 2.1 time: 0.128064 Jun 18 22:15:30.870649 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1714/3424] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:15:30 2022] DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments/8d48035a-208e-4c79-b4c3-8bbff016c991 => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:15:30.879971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:30.886463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:30.893627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.894447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.895477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:30.896392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:30.991407 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a849deea-8342-444d-adfb-62e71292072f tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/action" status: 202 len: 0 microversion: 2.1 time: 0.115321 Jun 18 22:15:30.993966 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1715/3425] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:15:30 2022] POST /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:15:31.006976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:31.008173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:31.018034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:31.018876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:31.021912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:31.023696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:31.043232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:31.063203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03cbeccf-0e8f-4af1-ae66-a1ab9f17636e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1354 microversion: 2.1 time: 0.381578 Jun 18 22:15:31.064196 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1711/3426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:30 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1354 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:31.306976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:31.327712 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be6ec379-614e-41ec-b5a1-054f1d2915b8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1725 microversion: 2.1 time: 0.327227 Jun 18 22:15:31.330775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1716/3427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:30 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1725 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:32.084014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:32.085555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:32.099775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:32.101261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:32.102464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:32.103161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:32.455821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:32.472424 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d59a01c-a447-4d01-bbc3-e563929b49f0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1805 microversion: 2.1 time: 0.396230 Jun 18 22:15:32.476507 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1712/3428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:32 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1805 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:32.482418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d7a3c7f-b07b-466a-9cad-03733e8c912c tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Action: 'create', calling method: .version_select at 0x7fea079bbc10>, body: {"pool": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:32.483083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:32.485418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:32.495878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:32.496620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:32.497901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:32.498544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.038510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:33.062377 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-45ad1ba4-3230-456e-9f41-d0fdcd6e6f48 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1725 microversion: 2.1 time: 0.583998 Jun 18 22:15:33.063960 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1713/3429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:32 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1725 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:33.069076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:33.074308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:33.095850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:33.097206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.101421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:33.104425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.199525 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1003331a-bbf5-4e34-acd4-aa2be1caa51b tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3/ips" status: 200 len: 219 microversion: 2.1 time: 0.134089 Jun 18 22:15:33.209106 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1714/3430] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:15:33 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3/ips => generated 219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:33.223659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:33.231960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:33.254727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:33.255437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.259158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:33.259935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.307590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:15:33.456389 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6157f7a7-d90d-48f9-8184-dd2430074bd8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 204 len: 0 microversion: 2.1 time: 0.245714 Jun 18 22:15:33.457242 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1715/3431] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:15:33 2022] DELETE /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:33.470085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:33.472229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:33.485725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:33.486730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.488517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:33.492486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:33.791032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:33.800187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3704f2ca-d91d-4371-8533-d5ad46629cb1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1811 microversion: 2.1 time: 0.337845 Jun 18 22:15:33.802783 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1716/3432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:33 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1811 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:34.080529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:34.081177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:34.096184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:34.096184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:34.096184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:34.096184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:34.750808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:34.765682 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9b446cc5-212c-458a-ab31-fd5d339b3619 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1725 microversion: 2.1 time: 0.686873 Jun 18 22:15:34.767443 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1717/3433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:34 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1725 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:34.821971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:34.823031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:34.849448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:34.850125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:34.852303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:34.856350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:35.783113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:35.787095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:35.792503 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5a70797-8277-477b-9743-122be4045bc8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1811 microversion: 2.1 time: 0.976188 Jun 18 22:15:35.793126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1718/3434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:34 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1811 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:35.809181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:35.810009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:35.823496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:35.831904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:35.833014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:35.833602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:36.311020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:36.332330 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49d733fa-202f-436d-bcdd-ef2ead419205 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1731 microversion: 2.1 time: 0.528176 Jun 18 22:15:36.334029 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1719/3435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:35 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1731 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:36.431445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d85a9070-cea3-4144-8ba7-6f51bcd16779 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Action: 'create', calling method: .version_select at 0x7fea14108160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-408813243", "policies": ["affinity"]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:36.453156 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d7a3c7f-b07b-466a-9cad-03733e8c912c tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.169572 Jun 18 22:15:36.454237 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1717/3436] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:15:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:36.459097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:36.460851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:36.471059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-d85a9070-cea3-4144-8ba7-6f51bcd16779 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:36.478534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-d85a9070-cea3-4144-8ba7-6f51bcd16779 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:36.486517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:36.499985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:36.501153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:36.504859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:36.539968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-d85a9070-cea3-4144-8ba7-6f51bcd16779 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:36.568414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-d85a9070-cea3-4144-8ba7-6f51bcd16779 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:36.599963 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d85a9070-cea3-4144-8ba7-6f51bcd16779 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.262922 Jun 18 22:15:36.601588 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1720/3437] 10.222.0.30 () {60 vars in 1173 bytes} [Sat Jun 18 22:15:36 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:36.614568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-558d2194-5014-4549-a6b2-be77bdce79c4 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Calling method '.version_select at 0x7fea1478ac10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:36.813408 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e070c90-3257-4bb1-97fb-8ed9909a26aa tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.353783 Jun 18 22:15:36.814342 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1718/3438] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:15:36 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-interface => generated 284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:36.819502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ac7b58a6-e338-48e1-9329-6a8f146327e3 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Action: 'create', calling method: .version_select at 0x7fea141b2ca0>, body: {"server_group": {"name": "tempest-server-group-21061826", "policies": ["affinity"]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:36.875586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ac7b58a6-e338-48e1-9329-6a8f146327e3 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:36.885740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ac7b58a6-e338-48e1-9329-6a8f146327e3 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:36.959963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ac7b58a6-e338-48e1-9329-6a8f146327e3 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:36.966922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ac7b58a6-e338-48e1-9329-6a8f146327e3 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:37.008642 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ac7b58a6-e338-48e1-9329-6a8f146327e3 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.191274 Jun 18 22:15:37.011043 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1719/3439] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Jun 18 22:15:36 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:37.027357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:37.028351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:37.058391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:37.059137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:37.064151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:37.064790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:37.244490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-558d2194-5014-4549-a6b2-be77bdce79c4 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/e0427124-96a3-44b4-ae0a-09379c633f54" status: 200 len: 141 microversion: 2.1 time: 0.641193 Jun 18 22:15:37.245339 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1721/3440] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:15:36 2022] GET /compute/v2.1/os-floating-ips/e0427124-96a3-44b4-ae0a-09379c633f54 => generated 141 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:37.250053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16673129-b6a9-4904-9772-1b1f9a87e121 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Action: 'create', calling method: .version_select at 0x7fea19d57160>, body: {"server_group": {"name": "tempest-server-group-21061826", "policies": ["affinity"]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:37.287721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-16673129-b6a9-4904-9772-1b1f9a87e121 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:37.302563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-16673129-b6a9-4904-9772-1b1f9a87e121 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:37.391734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:37.408163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-16673129-b6a9-4904-9772-1b1f9a87e121 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:37.416015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-16673129-b6a9-4904-9772-1b1f9a87e121 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:37.431262 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16673129-b6a9-4904-9772-1b1f9a87e121 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.184695 Jun 18 22:15:37.432078 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1722/3441] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Jun 18 22:15:37 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:37.440558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1812b491-36f3-426a-9dc6-8f867a12dbc8 req-aaf20ee8-c6e0-4a96-94ba-4d60db6230f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-deleted", "tag": "a9c700c1-d35f-4f88-9be7-e858e6879a80"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:37.460387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1812b491-36f3-426a-9dc6-8f867a12dbc8 req-aaf20ee8-c6e0-4a96-94ba-4d60db6230f3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:37.460858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1812b491-36f3-426a-9dc6-8f867a12dbc8 req-aaf20ee8-c6e0-4a96-94ba-4d60db6230f3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:37.475626 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1812b491-36f3-426a-9dc6-8f867a12dbc8 req-aaf20ee8-c6e0-4a96-94ba-4d60db6230f3 service nova] Creating event network-vif-deleted:a9c700c1-d35f-4f88-9be7-e858e6879a80 for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:37.501967 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1812b491-36f3-426a-9dc6-8f867a12dbc8 req-aaf20ee8-c6e0-4a96-94ba-4d60db6230f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054557 Jun 18 22:15:37.503013 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1723/3442] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:37.516947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ffb887f0-f66f-4f7d-ab33-dd9cfbf92eef tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Calling method '.version_select at 0x7fea14128b80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:37.845810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:37.868433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ff392f1-a4bf-4fe9-a39d-030416e02d64 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1790 microversion: 2.1 time: 0.845431 Jun 18 22:15:37.870923 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1720/3443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:37 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1790 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:37.882701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d99e370-e431-4964-9797-0a06c7f8eb91 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:37.954364 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d99e370-e431-4964-9797-0a06c7f8eb91 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/8ee41cc6-659b-4b5f-9e33-7d5963fd080b" status: 204 len: 0 microversion: 2.1 time: 0.080737 Jun 18 22:15:37.956545 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1721/3444] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:37 2022] DELETE /compute/v2.1/os-server-groups/8ee41cc6-659b-4b5f-9e33-7d5963fd080b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:37.964853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0e1b8a76-aa84-476f-adb3-29d0ec45028c req-299dc168-0f27-4b65-bf62-9f11bb64b958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-unplugged", "status": "completed", "tag": "04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:37.978890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0e1b8a76-aa84-476f-adb3-29d0ec45028c req-299dc168-0f27-4b65-bf62-9f11bb64b958 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:37.979864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0e1b8a76-aa84-476f-adb3-29d0ec45028c req-299dc168-0f27-4b65-bf62-9f11bb64b958 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:37.998047 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0e1b8a76-aa84-476f-adb3-29d0ec45028c req-299dc168-0f27-4b65-bf62-9f11bb64b958 service nova] Creating event network-vif-unplugged:04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:38.005107 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0e1b8a76-aa84-476f-adb3-29d0ec45028c req-299dc168-0f27-4b65-bf62-9f11bb64b958 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046531 Jun 18 22:15:38.006049 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1722/3445] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.012347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-622f1b7d-2d00-4178-a941-139fa4d32753 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.043217 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-622f1b7d-2d00-4178-a941-139fa4d32753 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.035649 Jun 18 22:15:38.044014 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1723/3446] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:15:38 2022] GET /compute/v2.1/os-server-groups => generated 332 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.057950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-76e009b0-f6d2-4919-94a9-1011cebf4288 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.097100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-76e009b0-f6d2-4919-94a9-1011cebf4288 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/26d9be4e-ccfc-467a-bac3-99947bce13cb" status: 204 len: 0 microversion: 2.1 time: 0.045621 Jun 18 22:15:38.098963 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1724/3447] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:38 2022] DELETE /compute/v2.1/os-server-groups/26d9be4e-ccfc-467a-bac3-99947bce13cb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:38.114031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80923d45-9cab-412d-a1df-1e77d23b2f83 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.133392 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80923d45-9cab-412d-a1df-1e77d23b2f83 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.028443 Jun 18 22:15:38.143565 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1725/3448] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:15:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.156715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4413446e-dc9f-4992-a029-fffd1ea857db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Action: 'create', calling method: .version_select at 0x7fea07956d30>, body: {"server_group": {"name": "tempest-server-group-725773216", "policies": ["affinity"]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:38.203084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4413446e-dc9f-4992-a029-fffd1ea857db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:38.219442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4413446e-dc9f-4992-a029-fffd1ea857db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:38.324814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4413446e-dc9f-4992-a029-fffd1ea857db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:38.333677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4413446e-dc9f-4992-a029-fffd1ea857db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:38.349009 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4413446e-dc9f-4992-a029-fffd1ea857db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.197916 Jun 18 22:15:38.351561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1726/3449] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Jun 18 22:15:38 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:38.356667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-51f1ae26-8425-426c-a0e5-be88351589e4 req-a87358ed-f8ed-46c6-8813-ea86376cdaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0193f858-2c0f-43e6-a811-27bb75b7708f", "tag": "972a9af1-f59f-41bb-8b18-9f56de6ec8b4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:38.367061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-51f1ae26-8425-426c-a0e5-be88351589e4 req-a87358ed-f8ed-46c6-8813-ea86376cdaf2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:38.367869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-51f1ae26-8425-426c-a0e5-be88351589e4 req-a87358ed-f8ed-46c6-8813-ea86376cdaf2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:38.389202 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-51f1ae26-8425-426c-a0e5-be88351589e4 req-a87358ed-f8ed-46c6-8813-ea86376cdaf2 service nova] Creating event network-changed:972a9af1-f59f-41bb-8b18-9f56de6ec8b4 for instance 0193f858-2c0f-43e6-a811-27bb75b7708f on nch1-master-1 Jun 18 22:15:38.395905 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-51f1ae26-8425-426c-a0e5-be88351589e4 req-a87358ed-f8ed-46c6-8813-ea86376cdaf2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042604 Jun 18 22:15:38.402096 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1727/3450] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.417112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8c8389a-3cd3-4c9d-95f0-f64b38c86a19 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.479669 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8c8389a-3cd3-4c9d-95f0-f64b38c86a19 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/d19713f8-56b4-42d4-bef0-220440afabe7" status: 204 len: 0 microversion: 2.1 time: 0.076444 Jun 18 22:15:38.483837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1728/3451] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:38 2022] DELETE /compute/v2.1/os-server-groups/d19713f8-56b4-42d4-bef0-220440afabe7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:38.502328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a916226-0170-47dd-b484-ea0a4946f007 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.526873 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a916226-0170-47dd-b484-ea0a4946f007 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040319 Jun 18 22:15:38.534820 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1729/3452] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:15:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.548135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd256e1e-87dc-44d2-aa8a-a028a20622d7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Action: 'create', calling method: .version_select at 0x7fea0792d9d0>, body: {"server_group": {"name": "tempest-server-group-1397196028", "policies": ["anti-affinity"]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:38.576349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:38.621083 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ffb887f0-f66f-4f7d-ab33-dd9cfbf92eef tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.113822 Jun 18 22:15:38.621804 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1724/3453] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:15:37 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.629335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-fd256e1e-87dc-44d2-aa8a-a028a20622d7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:38.633123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-629b8d30-6090-4076-8182-5d2d1a67115a tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Calling method '.version_select at 0x7fea19dbd280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.648216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-fd256e1e-87dc-44d2-aa8a-a028a20622d7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:38.850576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-fd256e1e-87dc-44d2-aa8a-a028a20622d7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:38.884157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-fd256e1e-87dc-44d2-aa8a-a028a20622d7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_groups'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:38.944916 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd256e1e-87dc-44d2-aa8a-a028a20622d7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.407462 Jun 18 22:15:38.946151 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1730/3454] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Jun 18 22:15:38 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:38.958200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:38.959095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:38.966782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:38.967378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:38.968310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:38.968837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:39.473624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:39.482546 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e67ffb2-b608-404e-a257-170dea10a2a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 200 len: 1610 microversion: 2.1 time: 0.535069 Jun 18 22:15:39.483706 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1731/3455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:38 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 1610 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:39.488880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cebed898-275d-4755-993c-64a713023679 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:39.520747 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cebed898-275d-4755-993c-64a713023679 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e5db2309-ac05-4a7a-81c6-3c4fa1644938" status: 204 len: 0 microversion: 2.1 time: 0.035591 Jun 18 22:15:39.522546 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1732/3456] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:39 2022] DELETE /compute/v2.1/os-server-groups/e5db2309-ac05-4a7a-81c6-3c4fa1644938 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:39.530662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9b060b65-655a-42ba-a023-0fd9146a1379 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:39.541449 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9b060b65-655a-42ba-a023-0fd9146a1379 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014529 Jun 18 22:15:39.542398 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1733/3457] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:15:39 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:39.601254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-508136627", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "11f544de-21c4-4f7b-b3cf-94f60ebe131e"}]}, "os:scheduler_hints": {"group": "118a1978-1977-4ae4-811e-2fc474986cfe"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:39.695094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] validate_networks() for [('11f544de-21c4-4f7b-b3cf-94f60ebe131e', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:15:41.242384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:15:41.243023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:15:41.243290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:15:41.245786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:15:41.246217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:15:41.274390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.276239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.278612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.280602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.312514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:41.320940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:41.366891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:15:41.374771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:15:41.465663 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-629b8d30-6090-4076-8182-5d2d1a67115a tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/e0427124-96a3-44b4-ae0a-09379c633f54" status: 202 len: 0 microversion: 2.1 time: 2.836772 Jun 18 22:15:41.466661 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1725/3458] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:15:38 2022] DELETE /compute/v2.1/os-floating-ips/e0427124-96a3-44b4-ae0a-09379c633f54 => generated 0 bytes in 2838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:15:41.474450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d5900ecb-31e5-423a-a820-bc867d202fcf req-fd543c9d-545a-44e4-9d59-3d4e90820228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-deleted", "tag": "04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:41.486990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d5900ecb-31e5-423a-a820-bc867d202fcf req-fd543c9d-545a-44e4-9d59-3d4e90820228 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.488551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d5900ecb-31e5-423a-a820-bc867d202fcf req-fd543c9d-545a-44e4-9d59-3d4e90820228 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.495912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:41.512508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:41.519312 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d5900ecb-31e5-423a-a820-bc867d202fcf req-fd543c9d-545a-44e4-9d59-3d4e90820228 service nova] Creating event network-vif-deleted:04ed4f48-f9b3-4c1d-93ba-18e5f6dbdfcf for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:41.527166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d5900ecb-31e5-423a-a820-bc867d202fcf req-fd543c9d-545a-44e4-9d59-3d4e90820228 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057463 Jun 18 22:15:41.527166 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1726/3459] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:41.535007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3c94b228-d716-4318-8e72-3c1a19075a34 req-92250035-d571-4bfb-a9bf-4927a6ff1349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-unplugged", "status": "completed", "tag": "3aef7989-de2e-4277-9706-6de25e9482eb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:41.546031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3c94b228-d716-4318-8e72-3c1a19075a34 req-92250035-d571-4bfb-a9bf-4927a6ff1349 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.546770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3c94b228-d716-4318-8e72-3c1a19075a34 req-92250035-d571-4bfb-a9bf-4927a6ff1349 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.581450 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3c94b228-d716-4318-8e72-3c1a19075a34 req-92250035-d571-4bfb-a9bf-4927a6ff1349 service nova] Creating event network-vif-unplugged:3aef7989-de2e-4277-9706-6de25e9482eb for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:41.595173 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3c94b228-d716-4318-8e72-3c1a19075a34 req-92250035-d571-4bfb-a9bf-4927a6ff1349 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065300 Jun 18 22:15:41.597936 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1727/3460] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:41.603898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:41.611683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f251f44d-ddaa-42a6-8f79-218449e4421b req-a9fc0d41-db88-4a72-a2e1-7401a1323908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0193f858-2c0f-43e6-a811-27bb75b7708f", "tag": "972a9af1-f59f-41bb-8b18-9f56de6ec8b4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:41.613519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Getting quotas for user b4f52f9c60b649679aaa6e98b575d43a and project d3167cc3e4a54982af2ec54124a5c730. Resources: {'server_group_members'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:41.636919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f251f44d-ddaa-42a6-8f79-218449e4421b req-a9fc0d41-db88-4a72-a2e1-7401a1323908 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.637756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f251f44d-ddaa-42a6-8f79-218449e4421b req-a9fc0d41-db88-4a72-a2e1-7401a1323908 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.652428 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f251f44d-ddaa-42a6-8f79-218449e4421b req-a9fc0d41-db88-4a72-a2e1-7401a1323908 service nova] Creating event network-changed:972a9af1-f59f-41bb-8b18-9f56de6ec8b4 for instance 0193f858-2c0f-43e6-a811-27bb75b7708f on nch1-master-1 Jun 18 22:15:41.659721 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f251f44d-ddaa-42a6-8f79-218449e4421b req-a9fc0d41-db88-4a72-a2e1-7401a1323908 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060068 Jun 18 22:15:41.663830 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1728/3461] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:41.681060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:41.682487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:41.692587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.692857 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61ec2430-1d2f-4994-a4d3-7689b80312f2 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.095756 Jun 18 22:15:41.693606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.694862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:41.695690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:41.697753 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1734/3462] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:15:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:15:41.703075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-398aebd5-9811-4c27-8066-ed0d50e18534 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Action: 'create', calling method: .version_select at 0x7fea079bb040>, body: {"pool": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:41.714972 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] HTTP exception thrown: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Request method failure captured: Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 HTTP/1.1 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5dv_bLGEDJNAYOQOZiKZOgO45Tp8o5pfU8ZAru0R6mAXO_dY-Z6d1bLww4-eVT9fW7RwhamsS01nrI2xV7lIApEyl2ZLW8YxdymhIXiPvkgmjfw3wVWHVfcBSioJHGkk_6jAOGb5gu--ZPVXAN9Zeu3LocrUJ6mWkAUYNekhydSw4 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_635aa1d3d9b24f59a1b25f107438855e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestMultiNic-2108772206 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cc3d993686bc4416a4015ac3e96b029c Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3'} Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:41.717668 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:15:41.723411 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:41.727366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Returning 404 to user: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:41.728914 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4104f4e3-18e5-4633-9af8-340f6af357f8 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 404 len: 111 microversion: 2.1 time: 0.060794 Jun 18 22:15:41.729807 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1729/3463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:41 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:41.735285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b669d452-fb1a-4fd9-9a18-5819dcee51f7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:41.736868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b669d452-fb1a-4fd9-9a18-5819dcee51f7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:41.921013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b669d452-fb1a-4fd9-9a18-5819dcee51f7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:41.930425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b669d452-fb1a-4fd9-9a18-5819dcee51f7 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1212 microversion: 2.1 time: 0.198023 Jun 18 22:15:41.934525 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1730/3464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:41 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:42.953937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:42.958399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:43.001343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:43.004021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:43.006463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:43.007550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:43.182956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:43.198673 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b4d8d2c-8e86-4642-ac5c-cc2c49355bb4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1272 microversion: 2.1 time: 0.252981 Jun 18 22:15:43.210961 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1731/3465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:42 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:43.546593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-79167acf-7f24-452a-9045-05929e3fd335 req-8a1579a2-c0b5-4571-8f22-1ab1c038474a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3", "name": "network-vif-deleted", "tag": "3aef7989-de2e-4277-9706-6de25e9482eb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:43.556675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-79167acf-7f24-452a-9045-05929e3fd335 req-8a1579a2-c0b5-4571-8f22-1ab1c038474a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:43.557157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-79167acf-7f24-452a-9045-05929e3fd335 req-8a1579a2-c0b5-4571-8f22-1ab1c038474a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:43.571113 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-79167acf-7f24-452a-9045-05929e3fd335 req-8a1579a2-c0b5-4571-8f22-1ab1c038474a service nova] Creating event network-vif-deleted:3aef7989-de2e-4277-9706-6de25e9482eb for instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 on nch2-master-1 Jun 18 22:15:43.597272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-79167acf-7f24-452a-9045-05929e3fd335 req-8a1579a2-c0b5-4571-8f22-1ab1c038474a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053686 Jun 18 22:15:43.599802 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1732/3466] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:44.231130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:44.233294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:44.254383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:44.261275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:44.262034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:44.262643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:44.387817 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-398aebd5-9811-4c27-8066-ed0d50e18534 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.688820 Jun 18 22:15:44.389986 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1735/3467] 10.222.0.30 () {60 vars in 1169 bytes} [Sat Jun 18 22:15:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:44.391731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:44.399737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3a98884-fd06-461c-a7b5-c0f9a743b6fb tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1270 microversion: 2.1 time: 0.185528 Jun 18 22:15:44.400601 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1733/3468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:44 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:44.407720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1eb8f0f9-8f05-4d5e-b267-a3a35b01c280 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Calling method '.version_select at 0x7fea07929670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:45.417611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:45.418827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:45.426500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:45.427214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:45.428157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:45.428783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:46.134279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:46.147801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-087358ea-0e61-4243-9484-ca27fe89b010 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1312 microversion: 2.1 time: 0.733589 Jun 18 22:15:46.149057 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1734/3469] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:45 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1312 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:46.511245 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1eb8f0f9-8f05-4d5e-b267-a3a35b01c280 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c" status: 202 len: 0 microversion: 2.1 time: 2.113868 Jun 18 22:15:46.514222 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1736/3470] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:15:44 2022] DELETE /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c => generated 0 bytes in 2118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:15:46.520962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a19a491-b388-4898-a7ab-1a16001555a5 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Calling method '.version_select at 0x7fea19dfc790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:46.592062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-8a19a491-b388-4898-a7ab-1a16001555a5 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5328b9bd-3398-4f33-8f2e-e439a0b2b88c could not be found", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:15:46.592771 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8a19a491-b388-4898-a7ab-1a16001555a5 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] HTTP exception thrown: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a19a491-b388-4898-a7ab-1a16001555a5 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Request method failure captured: Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c HTTP/1.1 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk6Egi9J_pGeZzawkcXE2_2Qrpt6zPcyJP-vaHftg32OBV9LFmdZs_0tWWukJ3Kj45CdUgQvOqcFEX25XNzaJnwOGb9ENyjFVRV6gvUvLNkGR8QstrDVKsG7myMqGDtb3Qa_NDvxxYponou3gvrIjshgWbcugewMh7TdGdVOOFpbP-A Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1de35489d4f8404193901d8cbb47d4a0 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-FloatingIPsTestJSON-451206082 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1de35489d4f8404193901d8cbb47d4a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1de35489d4f8404193901d8cbb47d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1de35489d4f8404193901d8cbb47d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1de35489d4f8404193901d8cbb47d4a0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-FloatingIPsTestJSON-451206082 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1de35489d4f8404193901d8cbb47d4a0 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-FloatingIPsTestJSON-451206082 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-FloatingIPsTestJSON-451206082-project Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 260479bb8ed0447e889d0be2a5bd2c8a Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-FloatingIPsTestJSON-451206082-project Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: exception: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '5328b9bd-3398-4f33-8f2e-e439a0b2b88c'} Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5328b9bd-3398-4f33-8f2e-e439a0b2b88c could not be found Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f36e558f-5fc6-4be9-a831-33f56fbdb585'] Jun 18 22:15:46.608901 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c. Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a19a491-b388-4898-a7ab-1a16001555a5 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Returning 404 to user: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a19a491-b388-4898-a7ab-1a16001555a5 tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c" status: 404 len: 111 microversion: 2.1 time: 0.094328 Jun 18 22:15:46.613873 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1735/3471] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:15:46 2022] GET /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:46.620770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d9a031b-47be-48d3-8208-1ed0ac3d51df tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Calling method '.version_select at 0x7fea079bbf70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:46.686399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-4d9a031b-47be-48d3-8208-1ed0ac3d51df tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5328b9bd-3398-4f33-8f2e-e439a0b2b88c could not be found", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:15:46.687726 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4d9a031b-47be-48d3-8208-1ed0ac3d51df tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] HTTP exception thrown: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d9a031b-47be-48d3-8208-1ed0ac3d51df tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Request method failure captured: Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c HTTP/1.1 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk6Egi9J_pGeZzawkcXE2_2Qrpt6zPcyJP-vaHftg32OBV9LFmdZs_0tWWukJ3Kj45CdUgQvOqcFEX25XNzaJnwOGb9ENyjFVRV6gvUvLNkGR8QstrDVKsG7myMqGDtb3Qa_NDvxxYponou3gvrIjshgWbcugewMh7TdGdVOOFpbP-A Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1de35489d4f8404193901d8cbb47d4a0 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPsTestJSON-451206082 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1de35489d4f8404193901d8cbb47d4a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1de35489d4f8404193901d8cbb47d4a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1de35489d4f8404193901d8cbb47d4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1de35489d4f8404193901d8cbb47d4a0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPsTestJSON-451206082 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1de35489d4f8404193901d8cbb47d4a0 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPsTestJSON-451206082 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPsTestJSON-451206082-project Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 260479bb8ed0447e889d0be2a5bd2c8a Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPsTestJSON-451206082-project Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: exception: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '5328b9bd-3398-4f33-8f2e-e439a0b2b88c'} Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5328b9bd-3398-4f33-8f2e-e439a0b2b88c could not be found Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-130ac95a-39c4-4073-a6ab-c84e61ada870'] Jun 18 22:15:46.691298 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c. Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c Jun 18 22:15:46.696130 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:46.701549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d9a031b-47be-48d3-8208-1ed0ac3d51df tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] Returning 404 to user: Floating IP not found for ID 5328b9bd-3398-4f33-8f2e-e439a0b2b88c {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:46.702586 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d9a031b-47be-48d3-8208-1ed0ac3d51df tempest-FloatingIPsTestJSON-451206082 tempest-FloatingIPsTestJSON-451206082-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c" status: 404 len: 111 microversion: 2.1 time: 0.086890 Jun 18 22:15:46.703307 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1737/3472] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:15:46 2022] DELETE /compute/v2.1/os-floating-ips/5328b9bd-3398-4f33-8f2e-e439a0b2b88c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:46.845824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e19d733b-738a-48d1-86b1-251626182179 req-14cd4599-f4d2-4f2d-9148-87b24d3101fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44", "tag": "6b94b9c6-03d8-402e-a5a5-c6aa2e188ab3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:46.873233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e19d733b-738a-48d1-86b1-251626182179 req-14cd4599-f4d2-4f2d-9148-87b24d3101fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:46.874149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e19d733b-738a-48d1-86b1-251626182179 req-14cd4599-f4d2-4f2d-9148-87b24d3101fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:46.908890 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e19d733b-738a-48d1-86b1-251626182179 req-14cd4599-f4d2-4f2d-9148-87b24d3101fe service nova] Creating event network-changed:6b94b9c6-03d8-402e-a5a5-c6aa2e188ab3 for instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 on nch2-master-1 Jun 18 22:15:46.914254 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e19d733b-738a-48d1-86b1-251626182179 req-14cd4599-f4d2-4f2d-9148-87b24d3101fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072960 Jun 18 22:15:46.923727 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1736/3473] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:47.164608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:47.165324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:47.173194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:47.173970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:47.174989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:47.175652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:47.442225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:47.453192 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fdcb4f2c-57aa-43c5-b880-98692596f0d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1312 microversion: 2.1 time: 0.291899 Jun 18 22:15:47.454700 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1738/3474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:47 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1312 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:48.380524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-28993400", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "693c1ea4-2247-4325-9684-38d70114efcd"}, {"uuid": "85f25246-f16b-4fbe-b389-adffab2487d4"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:48.442290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] validate_networks() for [('693c1ea4-2247-4325-9684-38d70114efcd', None, None, None, None, None), ('85f25246-f16b-4fbe-b389-adffab2487d4', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:15:48.472801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:48.474207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:48.484878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:48.494892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:48.496067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:48.496709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:49.082342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:49.096484 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6dd01a19-80b3-484e-a094-0f31086a6883 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1312 microversion: 2.1 time: 0.630406 Jun 18 22:15:49.097574 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1739/3475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:48 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1312 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:49.960867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:15:49.962620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:15:49.963466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:15:49.964586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:15:49.966033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:15:50.000988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:50.003684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:50.007098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:50.008335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:50.058862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Getting quotas for project 635aa1d3d9b24f59a1b25f107438855e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:15:50.067394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Getting quotas for user cc3d993686bc4416a4015ac3e96b029c and project 635aa1d3d9b24f59a1b25f107438855e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:15:50.085376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:15:50.089283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:15:50.114749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:50.115413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:50.130001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:50.132437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:50.135835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:50.136513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:50.172897 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb42682c-a0d3-4e7e-8062-4bcca152ce23 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796714 Jun 18 22:15:50.174171 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1737/3476] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:15:50.198122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-967e3abf-96f4-4f18-9ba9-19a0315a1305 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:50.199762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-967e3abf-96f4-4f18-9ba9-19a0315a1305 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:50.342092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-967e3abf-96f4-4f18-9ba9-19a0315a1305 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:50.354965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-967e3abf-96f4-4f18-9ba9-19a0315a1305 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1211 microversion: 2.1 time: 0.172343 Jun 18 22:15:50.364245 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1738/3477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:50 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1211 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:50.437551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:50.446213 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97ecd7eb-985f-4518-92e6-2f89673d4822 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1312 microversion: 2.1 time: 0.337094 Jun 18 22:15:50.447888 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1740/3478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:50 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1312 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:51.373818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:51.374986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:51.386721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:51.390894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:51.391975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:51.394082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:51.464442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:51.465518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:51.476850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:51.480856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:51.481342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:51.482156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:51.488326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:51.494295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:51.504504 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b9a27a1-7785-4e8c-9db8-5866c891f88d tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1263 microversion: 2.1 time: 0.134832 Jun 18 22:15:51.505858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1739/3479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:51 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1263 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:51.646214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=38 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:51.667664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1515eab3-675a-4159-8213-f8f41f2ddbb8 req-dcbd050e-d9ce-46d0-a00a-c9c93f63307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44", "name": "network-vif-plugged", "status": "completed", "tag": "6b94b9c6-03d8-402e-a5a5-c6aa2e188ab3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:51.687043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1515eab3-675a-4159-8213-f8f41f2ddbb8 req-dcbd050e-d9ce-46d0-a00a-c9c93f63307b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:51.687779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1515eab3-675a-4159-8213-f8f41f2ddbb8 req-dcbd050e-d9ce-46d0-a00a-c9c93f63307b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:51.711553 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1515eab3-675a-4159-8213-f8f41f2ddbb8 req-dcbd050e-d9ce-46d0-a00a-c9c93f63307b service nova] Creating event network-vif-plugged:6b94b9c6-03d8-402e-a5a5-c6aa2e188ab3 for instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 on nch2-master-1 Jun 18 22:15:51.718528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1515eab3-675a-4159-8213-f8f41f2ddbb8 req-dcbd050e-d9ce-46d0-a00a-c9c93f63307b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056253 Jun 18 22:15:51.720059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1740/3480] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:51.991823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:52.007298 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-073e8e57-b9d3-478c-8f05-b2c4c39fc22b tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1312 microversion: 2.1 time: 0.547416 Jun 18 22:15:52.008437 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1741/3481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:51 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:52.523737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:52.524679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:52.538625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:52.539091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:52.539874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:52.540396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:52.626928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:52.641816 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64cdfda5-0fd5-4609-b87c-21b5a9660777 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1269 microversion: 2.1 time: 0.122808 Jun 18 22:15:52.643502 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1741/3482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:52 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1269 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:53.044558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:53.047042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:53.083165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:53.084780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:53.087615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:53.087615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:53.446392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:53.455911 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-047edf3c-2c86-4883-aba4-d2f58b02ebf9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1312 microversion: 2.1 time: 0.424888 Jun 18 22:15:53.469212 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1742/3483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:53 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1312 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:53.660057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:53.661375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:53.672508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:53.673074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:53.673981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:53.674581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:53.865213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:53.875600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0908e2a9-62b8-4d8e-bf83-be3eb43b8e2a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1311 microversion: 2.1 time: 0.219483 Jun 18 22:15:53.876537 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1742/3484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:53 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:54.474325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:54.474810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:54.492289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.492754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:54.493618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.494051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:54.769899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:54.781911 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6adc012e-51a4-4e70-b8f6-f7c010adbd2d tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1497 microversion: 2.1 time: 0.312058 Jun 18 22:15:54.782832 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1743/3485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:54 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1497 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:54.804133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-339cb268-05b2-4625-abd6-a0a9eb8ec408 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:54.822965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_groups [None req-339cb268-05b2-4625-abd6-a0a9eb8ec408 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Querying cell d349766c-949b-4923-9574-b93ba690371c(cell1) for 1 instances {{(pid=130903) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 18 22:15:54.823993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-339cb268-05b2-4625-abd6-a0a9eb8ec408 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.824449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-339cb268-05b2-4625-abd6-a0a9eb8ec408 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:54.842522 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-339cb268-05b2-4625-abd6-a0a9eb8ec408 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/118a1978-1977-4ae4-811e-2fc474986cfe" status: 200 len: 221 microversion: 2.1 time: 0.044848 Jun 18 22:15:54.843102 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1743/3486] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:15:54 2022] GET /compute/v2.1/os-server-groups/118a1978-1977-4ae4-811e-2fc474986cfe => generated 221 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:54.853114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:54.853769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:54.859756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.860192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:54.861099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.861421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:54.890044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:15:54.893638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:54.894502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:54.902045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.902834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:54.903930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:54.904751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.016972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68153f84-6cc2-4f98-9ff1-1ff5c1839d9f tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 204 len: 0 microversion: 2.1 time: 0.167400 Jun 18 22:15:55.017817 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1744/3487] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:15:54 2022] DELETE /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:15:55.025233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:55.025947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:55.028362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:55.037444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.037830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.039466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.040374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.063773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:55.200186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:55.215699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d50142d-60f1-49e3-ba71-656884022296 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.326420 Jun 18 22:15:55.216666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1744/3488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:54 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:55.230600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:55.231357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:55.238019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.238468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.239464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.239895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.711804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:55.741697 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1cdaa4f4-e574-4571-ad8a-e0fb89c4a203 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.720552 Jun 18 22:15:55.742668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1745/3489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:55 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:55.749943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d5c962ca-92d7-4cc1-b905-025f8723c6fd req-5a75aa6d-d83d-4e15-b882-a7836ffd06dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464ce092-6cd1-4866-beac-038784f1ec17", "tag": "5719b3e2-de0a-4a43-80d5-4e9babaf206b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:55.766701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d5c962ca-92d7-4cc1-b905-025f8723c6fd req-5a75aa6d-d83d-4e15-b882-a7836ffd06dd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.767511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d5c962ca-92d7-4cc1-b905-025f8723c6fd req-5a75aa6d-d83d-4e15-b882-a7836ffd06dd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.781633 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d5c962ca-92d7-4cc1-b905-025f8723c6fd req-5a75aa6d-d83d-4e15-b882-a7836ffd06dd service nova] Creating event network-changed:5719b3e2-de0a-4a43-80d5-4e9babaf206b for instance 464ce092-6cd1-4866-beac-038784f1ec17 on nch1-master-1 Jun 18 22:15:55.787590 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d5c962ca-92d7-4cc1-b905-025f8723c6fd req-5a75aa6d-d83d-4e15-b882-a7836ffd06dd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041954 Jun 18 22:15:55.788270 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1746/3490] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:55.793989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:55.794933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:55.804563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.805279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.806298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:55.807109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:55.894126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:55.905442 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15669919-ac8b-4dc0-9f4b-95b25a9fd0ff tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1503 microversion: 2.1 time: 0.678746 Jun 18 22:15:55.906583 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1745/3491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:55 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1503 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:56.142542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:56.175734 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-297d028f-d3bb-4c08-9678-d4949c09dc74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.385787 Jun 18 22:15:56.176385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1747/3492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:55 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:56.193742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:56.194479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:56.202658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.203112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.204391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.204850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.233407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:56.234418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:56.245993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.246520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.253228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.253817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.782393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:56.797084 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-db9f6a14-7eed-4fbe-94f8-360e5ce4730c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.606066 Jun 18 22:15:56.808129 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1746/3493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:56 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:56.821293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:56.822559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-412679900"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:56.824277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:56.835167 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3bc9a6af-c236-4737-801d-9e9d768621a0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.605770 Jun 18 22:15:56.835962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.837244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.837388 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1748/3494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:56 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:15:56.838989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.839679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.924592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:56.925370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:56.940976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.942659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:56.945311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:56.946640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:57.263445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:57.271828 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ebf0690-3a84-4dc3-89b9-2e6bdc7e05db tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1503 microversion: 2.1 time: 0.353177 Jun 18 22:15:57.272749 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1749/3495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:56 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:57.281999 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d707e2ef-721b-4c2b-bfde-de375c6da4c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.468425 Jun 18 22:15:57.287382 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1747/3496] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:15:56 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 18 22:15:57.734545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cbf28a14-bbe0-4142-8e11-a1c4cb00c545 req-db2f6aca-5fe3-450d-a1e4-f25a3e3e3bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44", "name": "network-vif-deleted", "tag": "6b94b9c6-03d8-402e-a5a5-c6aa2e188ab3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:57.764105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cbf28a14-bbe0-4142-8e11-a1c4cb00c545 req-db2f6aca-5fe3-450d-a1e4-f25a3e3e3bfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:57.766582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cbf28a14-bbe0-4142-8e11-a1c4cb00c545 req-db2f6aca-5fe3-450d-a1e4-f25a3e3e3bfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:57.790876 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cbf28a14-bbe0-4142-8e11-a1c4cb00c545 req-db2f6aca-5fe3-450d-a1e4-f25a3e3e3bfd service nova] Creating event network-vif-deleted:6b94b9c6-03d8-402e-a5a5-c6aa2e188ab3 for instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 on nch2-master-1 Jun 18 22:15:57.800076 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cbf28a14-bbe0-4142-8e11-a1c4cb00c545 req-db2f6aca-5fe3-450d-a1e4-f25a3e3e3bfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069875 Jun 18 22:15:57.805710 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1750/3497] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:57.819714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5c79fc35-a23c-4ca0-bfaa-496464474179 req-c96faba5-e077-4355-9b8d-11860020b639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464ce092-6cd1-4866-beac-038784f1ec17", "tag": "2668703d-4d8d-4378-b3a9-396d53df4136"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:15:57.839183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5c79fc35-a23c-4ca0-bfaa-496464474179 req-c96faba5-e077-4355-9b8d-11860020b639 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:57.840950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5c79fc35-a23c-4ca0-bfaa-496464474179 req-c96faba5-e077-4355-9b8d-11860020b639 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:57.860195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:57.861523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:57.890151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:57.897888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:57.901799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:57.902468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:57.916319 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5c79fc35-a23c-4ca0-bfaa-496464474179 req-c96faba5-e077-4355-9b8d-11860020b639 service nova] Creating event network-changed:2668703d-4d8d-4378-b3a9-396d53df4136 for instance 464ce092-6cd1-4866-beac-038784f1ec17 on nch1-master-1 Jun 18 22:15:57.934591 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5c79fc35-a23c-4ca0-bfaa-496464474179 req-c96faba5-e077-4355-9b8d-11860020b639 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120708 Jun 18 22:15:57.939604 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1748/3498] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:58.263124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:58.278788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4eff875-9244-4259-9c63-ac693eb5fc9e tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.427973 Jun 18 22:15:58.280142 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1751/3499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:57 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:58.296389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:58.298300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:58.307945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:58.309375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:58.310924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:58.311861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:58.317365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:15:58.361758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:58.363968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:58.364705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lazy-loading 'fault' on Instance uuid 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:15:58.464369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4f52f9c60b649679aaa6e98b575d43a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3167cc3e4a54982af2ec54124a5c730', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:58.479960 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c16dd30-cfc9-4244-80ba-3957c3ddab18 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 200 len: 1302 microversion: 2.1 time: 0.189638 Jun 18 22:15:58.480775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1749/3500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:58 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 1302 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:59.298242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.299639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:59.309885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.310552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.311469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.312117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.500070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.501002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:59.513224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.515657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.516833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.518584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.539177 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 HTTP/1.1 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44'} Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.542827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.549152 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.552269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.553654 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6e27f06-539f-4003-acde-8f85223664a1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 404 len: 111 microversion: 2.1 time: 0.059005 Jun 18 22:15:59.560665 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1750/3501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:59 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:15:59.568226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2742542e-a05c-4442-8748-8c8966d0e342 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.594790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_groups [None req-2742542e-a05c-4442-8748-8c8966d0e342 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Querying cell d349766c-949b-4923-9574-b93ba690371c(cell1) for 1 instances {{(pid=130903) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 18 22:15:59.595997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2742542e-a05c-4442-8748-8c8966d0e342 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.596723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2742542e-a05c-4442-8748-8c8966d0e342 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.609054 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2742542e-a05c-4442-8748-8c8966d0e342 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.046480 Jun 18 22:15:59.609937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1751/3502] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:15:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:15:59.622922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-260a9c85-561d-4621-aded-f381000a1cc4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.649793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:15:59.659839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_groups [None req-260a9c85-561d-4621-aded-f381000a1cc4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Querying cell d349766c-949b-4923-9574-b93ba690371c(cell1) for 1 instances {{(pid=130903) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 18 22:15:59.661015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-260a9c85-561d-4621-aded-f381000a1cc4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.661700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-260a9c85-561d-4621-aded-f381000a1cc4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.666624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-090dabed-c714-403d-9d62-1f00cc947895 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.373940 Jun 18 22:15:59.669907 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1752/3503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:59 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:15:59.686802 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-260a9c85-561d-4621-aded-f381000a1cc4 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/118a1978-1977-4ae4-811e-2fc474986cfe" status: 200 len: 183 microversion: 2.1 time: 0.069774 Jun 18 22:15:59.687683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1752/3504] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:15:59 2022] GET /compute/v2.1/os-server-groups/118a1978-1977-4ae4-811e-2fc474986cfe => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:15:59.698860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.699752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:59.707732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.708451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.709801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.710424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.730019 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 HTTP/1.1 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44'} Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:59.732606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c642940-7cc2-4d74-a9f4-1474fa0cf11c tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 404 len: 111 microversion: 2.1 time: 0.040039 Jun 18 22:15:59.740471 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1753/3505] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:15:59 2022] DELETE /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:15:59.743334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.743968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] [instance: 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:15:59.753339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.754075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.754990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:15:59.755845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:15:59.773794 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 HTTP/1.1 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44'} Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.775638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. Jun 18 22:15:59.780395 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.783003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance 6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.783980 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fce870ef-528a-43e2-b0e2-2b1f09d6d5a9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44" status: 404 len: 111 microversion: 2.1 time: 0.044860 Jun 18 22:15:59.784919 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1753/3506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:15:59 2022] GET /compute/v2.1/servers/6ae9dba0-cf98-42c4-a961-c1b1e3ecdd44 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:59.796392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c4bd783-d223-4565-ab23-919d04bf8ce9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.808209 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6c4bd783-d223-4565-ab23-919d04bf8ce9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance group e5db2309-ac05-4a7a-81c6-3c4fa1644938 could not be found. Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c4bd783-d223-4565-ab23-919d04bf8ce9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-server-groups/e5db2309-ac05-4a7a-81c6-3c4fa1644938 HTTP/1.1 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance group e5db2309-ac05-4a7a-81c6-3c4fa1644938 could not be found. Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e5db2309-ac05-4a7a-81c6-3c4fa1644938'} Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e5db2309-ac05-4a7a-81c6-3c4fa1644938 could not be found. Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e5db2309-ac05-4a7a-81c6-3c4fa1644938 could not be found. Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.811859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e5db2309-ac05-4a7a-81c6-3c4fa1644938 could not be found. Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c4bd783-d223-4565-ab23-919d04bf8ce9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance group e5db2309-ac05-4a7a-81c6-3c4fa1644938 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.816573 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c4bd783-d223-4565-ab23-919d04bf8ce9 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e5db2309-ac05-4a7a-81c6-3c4fa1644938" status: 404 len: 117 microversion: 2.1 time: 0.027516 Jun 18 22:15:59.820425 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1754/3507] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:59 2022] DELETE /compute/v2.1/os-server-groups/e5db2309-ac05-4a7a-81c6-3c4fa1644938 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:59.827124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-46b25d3b-e3cc-4f37-afb0-e67233ab75b1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.838484 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-46b25d3b-e3cc-4f37-afb0-e67233ab75b1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance group d19713f8-56b4-42d4-bef0-220440afabe7 could not be found. Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-46b25d3b-e3cc-4f37-afb0-e67233ab75b1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-server-groups/d19713f8-56b4-42d4-bef0-220440afabe7 HTTP/1.1 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance group d19713f8-56b4-42d4-bef0-220440afabe7 could not be found. Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd19713f8-56b4-42d4-bef0-220440afabe7'} Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d19713f8-56b4-42d4-bef0-220440afabe7 could not be found. Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d19713f8-56b4-42d4-bef0-220440afabe7 could not be found. Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.840440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d19713f8-56b4-42d4-bef0-220440afabe7 could not be found. Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-46b25d3b-e3cc-4f37-afb0-e67233ab75b1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance group d19713f8-56b4-42d4-bef0-220440afabe7 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-46b25d3b-e3cc-4f37-afb0-e67233ab75b1 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/d19713f8-56b4-42d4-bef0-220440afabe7" status: 404 len: 117 microversion: 2.1 time: 0.022493 Jun 18 22:15:59.848603 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1754/3508] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:59 2022] DELETE /compute/v2.1/os-server-groups/d19713f8-56b4-42d4-bef0-220440afabe7 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:15:59.863315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a36f4eb-63ec-406c-92bc-b9a32def92d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1a36f4eb-63ec-406c-92bc-b9a32def92d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance group 26d9be4e-ccfc-467a-bac3-99947bce13cb could not be found. Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a36f4eb-63ec-406c-92bc-b9a32def92d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-server-groups/26d9be4e-ccfc-467a-bac3-99947bce13cb HTTP/1.1 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance group 26d9be4e-ccfc-467a-bac3-99947bce13cb could not be found. Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '26d9be4e-ccfc-467a-bac3-99947bce13cb'} Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 26d9be4e-ccfc-467a-bac3-99947bce13cb could not be found. Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.881026 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 26d9be4e-ccfc-467a-bac3-99947bce13cb could not be found. Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 26d9be4e-ccfc-467a-bac3-99947bce13cb could not be found. Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a36f4eb-63ec-406c-92bc-b9a32def92d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance group 26d9be4e-ccfc-467a-bac3-99947bce13cb could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a36f4eb-63ec-406c-92bc-b9a32def92d6 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/26d9be4e-ccfc-467a-bac3-99947bce13cb" status: 404 len: 117 microversion: 2.1 time: 0.031760 Jun 18 22:15:59.886269 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1755/3509] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:59 2022] DELETE /compute/v2.1/os-server-groups/26d9be4e-ccfc-467a-bac3-99947bce13cb => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:15:59.891652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a7cecc2-c9b9-424d-affa-067ea40fbb24 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.899160 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5a7cecc2-c9b9-424d-affa-067ea40fbb24 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] HTTP exception thrown: Instance group 8ee41cc6-659b-4b5f-9e33-7d5963fd080b could not be found. Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a7cecc2-c9b9-424d-affa-067ea40fbb24 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Request method failure captured: Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-server-groups/8ee41cc6-659b-4b5f-9e33-7d5963fd080b HTTP/1.1 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk6IUiUZoSquOzqu3UjGC0HzrJ8G8ZxVIui5YP7nMi8UUj0gFLcu7pwl9vxRKFqiz73vaeLbHW1Cvf9NjoCt5dp_1kxpPyo5mq0WQh8r38EtyaqB1U573DkQCOQS3GAGoMOdsbJmcylFSaUVPsjiNVE8Trl4M6CHXWB9LDru9I2GehA Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3167cc3e4a54982af2ec54124a5c730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3167cc3e4a54982af2ec54124a5c730", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d3167cc3e4a54982af2ec54124a5c730 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerGroupTestJSON-1660055676 Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: b4f52f9c60b649679aaa6e98b575d43a Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerGroupTestJSON-1660055676-project Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance group 8ee41cc6-659b-4b5f-9e33-7d5963fd080b could not be found. Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8ee41cc6-659b-4b5f-9e33-7d5963fd080b'} Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8ee41cc6-659b-4b5f-9e33-7d5963fd080b could not be found. Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8ee41cc6-659b-4b5f-9e33-7d5963fd080b could not be found. Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.900997 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:15:59.906078 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:15:59.906078 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:15:59.906078 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:15:59.906078 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:15:59.906078 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8ee41cc6-659b-4b5f-9e33-7d5963fd080b could not be found. Jun 18 22:15:59.906078 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:15:59.907396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a7cecc2-c9b9-424d-affa-067ea40fbb24 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Returning 404 to user: Instance group 8ee41cc6-659b-4b5f-9e33-7d5963fd080b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:15:59.908536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a7cecc2-c9b9-424d-affa-067ea40fbb24 tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/8ee41cc6-659b-4b5f-9e33-7d5963fd080b" status: 404 len: 117 microversion: 2.1 time: 0.022798 Jun 18 22:15:59.909328 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1755/3510] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:59 2022] DELETE /compute/v2.1/os-server-groups/8ee41cc6-659b-4b5f-9e33-7d5963fd080b => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:15:59.918793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed005df3-fbae-4ebb-818a-e19aa948f6ce tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:15:59.948411 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed005df3-fbae-4ebb-818a-e19aa948f6ce tempest-ServerGroupTestJSON-1660055676 tempest-ServerGroupTestJSON-1660055676-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/118a1978-1977-4ae4-811e-2fc474986cfe" status: 204 len: 0 microversion: 2.1 time: 0.033384 Jun 18 22:15:59.950704 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1756/3511] 10.222.0.30 () {58 vars in 1265 bytes} [Sat Jun 18 22:15:59 2022] DELETE /compute/v2.1/os-server-groups/118a1978-1977-4ae4-811e-2fc474986cfe => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:16:00.310294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:00.315877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:00.317512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Searching by: {'deleted': False, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:16:00.320097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:00.326888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.327637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.330269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.331089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.348706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=26 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:00.371607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:16:00.427112 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-520d7ef0-c668-479b-978c-04045ce31df7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.125874 Jun 18 22:16:00.437972 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1756/3512] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:16:00 2022] GET /compute/v2.1/servers => generated 333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:00.443540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:00.448475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:00.452290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Searching by: {'deleted': False, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:16:00.465021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.471377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.473254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.473254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.529789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:16:00.582758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:00.591352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.592141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.688929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:00.689624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:00.703940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.705500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.706641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:00.709013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:00.793462 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d72d5ac7-4974-4804-8b86-923354c5356d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.356168 Jun 18 22:16:00.794329 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1757/3513] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:16:00 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:16:00.822087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0e4ceabf-6af3-4245-8e88-d38d9417cd73 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:00.856347 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0e4ceabf-6af3-4245-8e88-d38d9417cd73 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037029 Jun 18 22:16:00.864705 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1758/3514] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:16:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:01.038744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:01.057594 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7539d33-fd20-449c-a66e-c08d69758ffe tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.371494 Jun 18 22:16:01.059033 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1757/3515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:00 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:01.229352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:01.230302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:01.242237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:01.243463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:01.249721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:01.252339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:01.282718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:01.409845 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a93ec91-e2b6-43ae-a4fb-227cfb9cd33d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 204 len: 0 microversion: 2.1 time: 0.185078 Jun 18 22:16:01.411127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1759/3516] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:01 2022] DELETE /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:16:01.420310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:01.421288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:01.429353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:01.430101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:01.431291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:01.432103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:01.639410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:01.653121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1fe3e30-b614-484b-9c48-48a2e8dff0f9 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1698 microversion: 2.1 time: 0.236602 Jun 18 22:16:01.654185 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1758/3517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:01 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1698 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:02.077485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:02.079256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:02.088263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:02.089164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:02.090323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:02.091184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:02.384386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:02.394817 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a760ae0e-c125-48da-8c8b-2a4e3bba4f37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.321834 Jun 18 22:16:02.395752 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1760/3518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:02 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:02.673960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:02.682829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:02.687971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:02.695954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:02.696934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:02.698759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:02.699457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:03.180082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:03.195855 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f458e515-9320-474e-bc34-c9d83366a397 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1698 microversion: 2.1 time: 0.527560 Jun 18 22:16:03.197085 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1759/3519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:02 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1698 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:03.413589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:03.415131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:03.428843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:03.429665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:03.430913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:03.431586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:03.826202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:03.848155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43ae503e-abb7-4118-9e90-44e9436b4df9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.438560 Jun 18 22:16:03.850583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1761/3520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:03 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:04.213331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:04.214741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:04.223967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:04.224789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:04.226049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:04.226858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:04.339943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79eddf3b96304e86a213d7238783e960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be43b4b4305647cfb63bdcaa91331b55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:04.355002 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09039151-bca6-4a8c-8f7a-1314f1fbaec7 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 200 len: 1631 microversion: 2.1 time: 0.145720 Jun 18 22:16:04.358962 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1760/3521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:04 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 1631 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:04.523128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-28fda3b2-f990-4560-9c29-2c74edf1a82f req-e341f74f-5cdd-4ab5-bf26-edb7ccad3b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7822f3b2-02ac-49c5-9e0c-63679ee2313a", "name": "network-vif-deleted", "tag": "8a095026-e585-4959-ae97-2207497eea20"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:04.542067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-28fda3b2-f990-4560-9c29-2c74edf1a82f req-e341f74f-5cdd-4ab5-bf26-edb7ccad3b8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:04.549177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-28fda3b2-f990-4560-9c29-2c74edf1a82f req-e341f74f-5cdd-4ab5-bf26-edb7ccad3b8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:04.607280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-28fda3b2-f990-4560-9c29-2c74edf1a82f req-e341f74f-5cdd-4ab5-bf26-edb7ccad3b8d service nova] Creating event network-vif-deleted:8a095026-e585-4959-ae97-2207497eea20 for instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a on nch2-master-1 Jun 18 22:16:04.639324 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-28fda3b2-f990-4560-9c29-2c74edf1a82f req-e341f74f-5cdd-4ab5-bf26-edb7ccad3b8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119615 Jun 18 22:16:04.643539 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1762/3522] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:04.872577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:04.873229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:04.884808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:04.885335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:04.889789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:04.890335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:05.354396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:05.364394 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0abd5835-4959-4bb6-9aba-d158a27145d4 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.498094 Jun 18 22:16:05.370775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1761/3523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:04 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:05.376380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:05.376995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] [instance: 7822f3b2-02ac-49c5-9e0c-63679ee2313a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:05.422727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:05.423185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:05.423974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:05.432987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:05.485793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] HTTP exception thrown: Instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a could not be found. Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Request method failure captured: Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a HTTP/1.1 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5eGdcpa--XEdUP1BJX6osI1Ge7h5sLoZl5-DsEJR8TX9Strccs33ntAMzyu7tC4FDEBhDjoypyy-4MQR52HxOwAM2GDwdBXo8EMYgWiJSqMalyjkqAcTh7i4WWXPBn-Iib4Nv1ir67RsKfQc_N-HMwg5aNu0uKVCcQHm-4uCBUoXM Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: be43b4b4305647cfb63bdcaa91331b55 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-838461634 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/be43b4b4305647cfb63bdcaa91331b55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/be43b4b4305647cfb63bdcaa91331b55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/be43b4b4305647cfb63bdcaa91331b55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_be43b4b4305647cfb63bdcaa91331b55", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-838461634 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: be43b4b4305647cfb63bdcaa91331b55 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-838461634 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-838461634-project Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 79eddf3b96304e86a213d7238783e960 Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-838461634-project Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a could not be found. Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7822f3b2-02ac-49c5-9e0c-63679ee2313a'} Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a could not be found. Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a could not be found. Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.487402 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a could not be found. Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Returning 404 to user: Instance 7822f3b2-02ac-49c5-9e0c-63679ee2313a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2cfd06bb-3c1e-48e7-8c38-e2de59bb0ea1 tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a" status: 404 len: 111 microversion: 2.1 time: 0.116415 Jun 18 22:16:05.494302 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1762/3524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:05 2022] GET /compute/v2.1/servers/7822f3b2-02ac-49c5-9e0c-63679ee2313a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:05.512185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a0853d0-1891-4d61-ac1e-868666feb01d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] Calling method '.version_select at 0x7fea19d888b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:05.554875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a0853d0-1891-4d61-ac1e-868666feb01d tempest-ServersTestJSON-838461634 tempest-ServersTestJSON-838461634-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962286419" status: 202 len: 0 microversion: 2.1 time: 0.052273 Jun 18 22:16:05.555508 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1763/3525] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:16:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962286419 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:16:05.578247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0bce4ef2-0c89-4060-bc25-a336879cdd17 tempest-FloatingIPDetailsNegativeTestJSON-854804370 tempest-FloatingIPDetailsNegativeTestJSON-854804370-project] Calling method '.version_select at 0x7fea0799ae50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:05.783581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-0bce4ef2-0c89-4060-bc25-a336879cdd17 tempest-FloatingIPDetailsNegativeTestJSON-854804370 tempest-FloatingIPDetailsNegativeTestJSON-854804370-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e could not be found", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:16:05.784601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0bce4ef2-0c89-4060-bc25-a336879cdd17 tempest-FloatingIPDetailsNegativeTestJSON-854804370 tempest-FloatingIPDetailsNegativeTestJSON-854804370-project] HTTP exception thrown: Floating IP not found for ID 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0bce4ef2-0c89-4060-bc25-a336879cdd17 tempest-FloatingIPDetailsNegativeTestJSON-854804370 tempest-FloatingIPDetailsNegativeTestJSON-854804370-project] Request method failure captured: Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/os-floating-ips/9c7b7ddc-be9e-4f96-b5e9-734f63a2778e HTTP/1.1 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk6lDGCdPHJcZGQZxfco7K3UAmhfRUuB5AtZ8eSu8HmSwlNVRF04qqdmmBKk5nZ1oEnlytiUkXQyT_qLmSuCAFbjc2VUy-9Fk8wy3BEtRaogtlH2lOXJCuPKxIpQLwJPQLFN8pMkyrlhQASd0jiLv_TVcj5xf7yWSvZxwuBWSjafV7A Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: da420173beee4ad89d07cd4776311263 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-854804370 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da420173beee4ad89d07cd4776311263"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da420173beee4ad89d07cd4776311263"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da420173beee4ad89d07cd4776311263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da420173beee4ad89d07cd4776311263", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-854804370 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: da420173beee4ad89d07cd4776311263 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-854804370 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-854804370-project Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d4eaaa82838b4e2b91d3fedead03a1eb Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-854804370-project Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: exception: Floating IP not found for ID 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '9c7b7ddc-be9e-4f96-b5e9-734f63a2778e'} Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e could not be found Jun 18 22:16:05.787742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-022e71b3-549f-402e-9e1a-76e5e97faffb'] Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e. Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0bce4ef2-0c89-4060-bc25-a336879cdd17 tempest-FloatingIPDetailsNegativeTestJSON-854804370 tempest-FloatingIPDetailsNegativeTestJSON-854804370-project] Returning 404 to user: Floating IP not found for ID 9c7b7ddc-be9e-4f96-b5e9-734f63a2778e {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:05.792214 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0bce4ef2-0c89-4060-bc25-a336879cdd17 tempest-FloatingIPDetailsNegativeTestJSON-854804370 tempest-FloatingIPDetailsNegativeTestJSON-854804370-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/9c7b7ddc-be9e-4f96-b5e9-734f63a2778e" status: 404 len: 111 microversion: 2.1 time: 0.466713 Jun 18 22:16:05.800234 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1763/3526] 10.222.0.30 () {58 vars in 1259 bytes} [Sat Jun 18 22:16:05 2022] GET /compute/v2.1/os-floating-ips/9c7b7ddc-be9e-4f96-b5e9-734f63a2778e => generated 111 bytes in 470 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:16:06.384077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:06.384689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:06.395102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:06.401722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:06.402799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:06.403401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:06.468144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-862c6c76-9478-45a3-aa94-1a62e035015a req-f617c1ce-3ce8-464f-997e-33ccfcdc543b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464ce092-6cd1-4866-beac-038784f1ec17", "name": "network-vif-plugged", "status": "completed", "tag": "5719b3e2-de0a-4a43-80d5-4e9babaf206b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:06.487332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-862c6c76-9478-45a3-aa94-1a62e035015a req-f617c1ce-3ce8-464f-997e-33ccfcdc543b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:06.488232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-862c6c76-9478-45a3-aa94-1a62e035015a req-f617c1ce-3ce8-464f-997e-33ccfcdc543b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:06.507066 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-862c6c76-9478-45a3-aa94-1a62e035015a req-f617c1ce-3ce8-464f-997e-33ccfcdc543b service nova] Creating event network-vif-plugged:5719b3e2-de0a-4a43-80d5-4e9babaf206b for instance 464ce092-6cd1-4866-beac-038784f1ec17 on nch1-master-1 Jun 18 22:16:06.522731 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-862c6c76-9478-45a3-aa94-1a62e035015a req-f617c1ce-3ce8-464f-997e-33ccfcdc543b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057218 Jun 18 22:16:06.529269 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1764/3527] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:16:07.332350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:07.346259 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2ba3cd0-def7-4bdf-b694-9797cb682606 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.965178 Jun 18 22:16:07.355981 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1764/3528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:06 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:08.371970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:08.372646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:08.395060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:08.395506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:08.396284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:08.396717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:08.986158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-30d72fbf-7a4e-4b8f-b0f2-0d59e5af3214 req-f083a88b-a16d-43b0-bc4b-73fbd773009f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-plugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:09.002771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-30d72fbf-7a4e-4b8f-b0f2-0d59e5af3214 req-f083a88b-a16d-43b0-bc4b-73fbd773009f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:09.005657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-30d72fbf-7a4e-4b8f-b0f2-0d59e5af3214 req-f083a88b-a16d-43b0-bc4b-73fbd773009f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:09.031866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-30d72fbf-7a4e-4b8f-b0f2-0d59e5af3214 req-f083a88b-a16d-43b0-bc4b-73fbd773009f service nova] Creating event network-vif-plugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:16:09.045533 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-30d72fbf-7a4e-4b8f-b0f2-0d59e5af3214 req-f083a88b-a16d-43b0-bc4b-73fbd773009f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065187 Jun 18 22:16:09.053005 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1765/3529] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:16:09.149123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:09.158358 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aaadf311-0688-4b8b-8256-1d55b3fe7c3f tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.798236 Jun 18 22:16:09.167053 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1765/3530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:08 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:10.192725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:10.195586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:10.215247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:10.216174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:10.217267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:10.217908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:10.349022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:10.666672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:10.705175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-192b6cdc-8115-40a7-aed8-d59d74c97b37 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.523271 Jun 18 22:16:10.707117 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1766/3531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:10 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:11.210136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4af085f5-d73d-4196-96c1-b365879e1bae req-0f74018a-db9c-44c3-99f2-5b8bff8fad89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464ce092-6cd1-4866-beac-038784f1ec17", "name": "network-vif-plugged", "status": "completed", "tag": "2668703d-4d8d-4378-b3a9-396d53df4136"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:11.255317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:11.256094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:11.264814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4af085f5-d73d-4196-96c1-b365879e1bae req-0f74018a-db9c-44c3-99f2-5b8bff8fad89 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:11.272476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4af085f5-d73d-4196-96c1-b365879e1bae req-0f74018a-db9c-44c3-99f2-5b8bff8fad89 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:11.311390 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4af085f5-d73d-4196-96c1-b365879e1bae req-0f74018a-db9c-44c3-99f2-5b8bff8fad89 service nova] Creating event network-vif-plugged:2668703d-4d8d-4378-b3a9-396d53df4136 for instance 464ce092-6cd1-4866-beac-038784f1ec17 on nch1-master-1 Jun 18 22:16:11.323794 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4af085f5-d73d-4196-96c1-b365879e1bae req-0f74018a-db9c-44c3-99f2-5b8bff8fad89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116486 Jun 18 22:16:11.324610 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1766/3532] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:11.726880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:11.727735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:11.761638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:11.762757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:11.764740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:11.766935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:12.214412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:12.226272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8f30b08d-49b2-4a26-b156-442fcb2a5e99 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.503392 Jun 18 22:16:12.231656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1767/3533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:11 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:13.249298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:13.249910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:13.278036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:13.281966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:13.283540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:13.286125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:13.748971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:13.759545 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-921cef73-32c1-4767-b67d-c281a69e0021 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1332 microversion: 2.1 time: 0.515290 Jun 18 22:16:13.771135 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1767/3534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:13 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1332 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:13.925292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1887587193", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": "none"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:14.032609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:16:14.033319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:16:14.034015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:16:14.034782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:16:14.035368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:16:14.066796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:14.068877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:14.071744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:14.073070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:14.114297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Getting quotas for project 7a2876fd37d44561940f36cc02783e7e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:16:14.120650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Getting quotas for user f21b927a5dc54a9d822b54984257b792 and project 7a2876fd37d44561940f36cc02783e7e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:16:14.136220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:16:14.139544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:16:14.331564 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e60a1b5-3764-47ad-a247-3d41f88a08a4 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.623405 Jun 18 22:16:14.345477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1768/3535] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:16:14.349257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6678d26a-55fc-467e-870a-67d8618302cb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:14.349874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6678d26a-55fc-467e-870a-67d8618302cb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:14.538138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6678d26a-55fc-467e-870a-67d8618302cb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:14.556240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6678d26a-55fc-467e-870a-67d8618302cb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:14.560216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6678d26a-55fc-467e-870a-67d8618302cb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:14.564613 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6678d26a-55fc-467e-870a-67d8618302cb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1278 microversion: 2.54 time: 0.221300 Jun 18 22:16:14.566804 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1768/3536] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:14 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:16:14.777926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:14.779411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:14.789568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:14.790096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:14.791313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:14.792061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.289681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:15.303701 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b7cdc32a-37f4-4db1-baee-f0bff2ecb517 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1668 microversion: 2.1 time: 0.528802 Jun 18 22:16:15.307113 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1769/3537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:14 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1668 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:15.331304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:15.341465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:15.420143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:15.420978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.421588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:15.425500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.512663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:15.529564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24b36ab3-ab95-4308-b2a5-35fc931e8562 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17/ips" status: 200 len: 180 microversion: 2.1 time: 0.207536 Jun 18 22:16:15.545536 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1769/3538] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:16:15 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17/ips => generated 180 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:15.551989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:15.552530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:15.569591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:15.570913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.572372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:15.572372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.584912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:15.585715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:15.616116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:15.634013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.635014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:15.653418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:15.728141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:15.946904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:15.958021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:15.965418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:15.968648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-20fb5add-0254-48b8-aaec-96c596c03c5a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1282 microversion: 2.54 time: 0.387657 Jun 18 22:16:15.970539 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1770/3539] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:15 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1282 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:16:16.113026 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8c236836-fd71-4acd-9e6b-f9539f976eb9 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 204 len: 0 microversion: 2.1 time: 0.564701 Jun 18 22:16:16.115966 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1770/3540] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:15 2022] DELETE /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:16:16.125092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:16.125928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:16.150678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:16.154732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:16.154732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:16.160172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:16.538592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:16.562218 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92f21dd1-ead4-4d99-b3c4-4175857de6d1 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1674 microversion: 2.1 time: 0.440796 Jun 18 22:16:16.564357 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1771/3541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:16 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1674 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:16.989889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:16.991625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:17.003100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:17.004115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:17.005388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:17.006227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:17.012819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:17.581706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:17.582583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:17.616318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:17.619343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:17.627353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:17.629659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:17.747575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:17.761889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:17.766271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:17.769993 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f6d7c5c-fe58-44f2-8771-02b5ab1b8853 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1336 microversion: 2.54 time: 0.785520 Jun 18 22:16:17.785998 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1771/3542] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:16 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1336 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:18.104019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:18.114889 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d138203-0254-4884-84a3-cbb94e0ff6c0 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1674 microversion: 2.1 time: 0.536667 Jun 18 22:16:18.116191 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1772/3543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:17 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1674 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:18.792091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:18.792908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:18.815352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:18.816124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:18.821394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:18.824047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:18.935741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-59d7a687-6690-4f55-97ea-15133d547b50 req-fb16640a-6d37-462a-90a9-e1a8a4e4aab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464ce092-6cd1-4866-beac-038784f1ec17", "name": "network-vif-deleted", "tag": "5719b3e2-de0a-4a43-80d5-4e9babaf206b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:18.972687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-59d7a687-6690-4f55-97ea-15133d547b50 req-fb16640a-6d37-462a-90a9-e1a8a4e4aab0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:18.973547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-59d7a687-6690-4f55-97ea-15133d547b50 req-fb16640a-6d37-462a-90a9-e1a8a4e4aab0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.026472 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-59d7a687-6690-4f55-97ea-15133d547b50 req-fb16640a-6d37-462a-90a9-e1a8a4e4aab0 service nova] Creating event network-vif-deleted:5719b3e2-de0a-4a43-80d5-4e9babaf206b for instance 464ce092-6cd1-4866-beac-038784f1ec17 on nch1-master-1 Jun 18 22:16:19.048173 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-59d7a687-6690-4f55-97ea-15133d547b50 req-fb16640a-6d37-462a-90a9-e1a8a4e4aab0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119601 Jun 18 22:16:19.050846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1773/3544] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:19.136484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:19.137315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:19.149933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.150404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.151222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.161317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.224240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:19.247300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:19.249435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:19.251044 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75c2b46f-16e3-442d-a134-f1a9af8f257e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1357 microversion: 2.54 time: 0.464225 Jun 18 22:16:19.252516 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1772/3545] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:18 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1357 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:19.273962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-608ca97d-a3e2-4609-8356-896ce30fdfa8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Action: 'create', calling method: .version_select at 0x7fea19d57280>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1577623835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0dXP/lXAFyU8iAvVIHyTyb0XpmV7jC0TQ/I52d1V+qd3DXe7ha37GM5Ldv3towVPwY8hfL8yIWn2FgbrriXrF8x5EPC4HQD//c4rrMVVtjoh7iRFbBqa+Sw6G+7frbSQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:19.310697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-608ca97d-a3e2-4609-8356-896ce30fdfa8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Getting quotas for project 7a2876fd37d44561940f36cc02783e7e. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:16:19.324582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-608ca97d-a3e2-4609-8356-896ce30fdfa8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Getting quotas for user f21b927a5dc54a9d822b54984257b792 and project 7a2876fd37d44561940f36cc02783e7e. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:16:19.377684 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-608ca97d-a3e2-4609-8356-896ce30fdfa8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.108356 Jun 18 22:16:19.379081 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1773/3546] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:16:19 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 18 22:16:19.391689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1577623835", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:19.393287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:19.407924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.408383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.410215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.413367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.615402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:16:19.615823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:16:19.619627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:16:19.620240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:16:19.620838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:16:19.826094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:19.850166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.852356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.853740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.856136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.927806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98d4c99e-4cda-4146-b6a4-5e59f5e5bd8d tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "POST /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1/action" status: 202 len: 1140 microversion: 2.54 time: 0.542494 Jun 18 22:16:19.938560 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1774/3547] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Jun 18 22:16:19 2022] POST /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1/action => generated 1140 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 18 22:16:19.952530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:19.954264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:19.962023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.962648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:19.964267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:19.964904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:20.260101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3d993686bc4416a4015ac3e96b029c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635aa1d3d9b24f59a1b25f107438855e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:20.266259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:20.284890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:20.295143 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0077815-899c-42fc-b886-516edf2dcedf tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 200 len: 1494 microversion: 2.1 time: 1.156258 Jun 18 22:16:20.295477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:20.297351 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1774/3548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:19 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 1494 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:20.299049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fd3d9cd-5ade-42ac-b9c4-1e16b5bf8505 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.353362 Jun 18 22:16:20.301476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1775/3549] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:19 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:21.111596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-11033535-02d9-4865-a3f4-d590431779c8 req-c4fedaae-cccf-42dc-b11d-56ade6c9e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464ce092-6cd1-4866-beac-038784f1ec17", "name": "network-vif-deleted", "tag": "2668703d-4d8d-4378-b3a9-396d53df4136"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:21.126804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-11033535-02d9-4865-a3f4-d590431779c8 req-c4fedaae-cccf-42dc-b11d-56ade6c9e8da service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:21.128418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-11033535-02d9-4865-a3f4-d590431779c8 req-c4fedaae-cccf-42dc-b11d-56ade6c9e8da service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:21.160348 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-11033535-02d9-4865-a3f4-d590431779c8 req-c4fedaae-cccf-42dc-b11d-56ade6c9e8da service nova] Creating event network-vif-deleted:2668703d-4d8d-4378-b3a9-396d53df4136 for instance 464ce092-6cd1-4866-beac-038784f1ec17 on nch1-master-1 Jun 18 22:16:21.169934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-11033535-02d9-4865-a3f4-d590431779c8 req-c4fedaae-cccf-42dc-b11d-56ade6c9e8da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067283 Jun 18 22:16:21.174491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1775/3550] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:21.320811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:21.321803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:21.328134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:21.329639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:21.370226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:21.371814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:21.372651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:21.373116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:21.375145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:21.376537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:21.377999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:21.378599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:21.414476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] HTTP exception thrown: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Request method failure captured: Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 HTTP/1.1 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5dv_bLGEDJNAYOQOZiKZOgO45Tp8o5pfU8ZAru0R6mAXO_dY-Z6d1bLww4-eVT9fW7RwhamsS01nrI2xV7lIApEyl2ZLW8YxdymhIXiPvkgmjfw3wVWHVfcBSioJHGkk_6jAOGb5gu--ZPVXAN9Zeu3LocrUJ6mWkAUYNekhydSw4 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_635aa1d3d9b24f59a1b25f107438855e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cc3d993686bc4416a4015ac3e96b029c Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '464ce092-6cd1-4866-beac-038784f1ec17'} Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:21.419776 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Returning 404 to user: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:21.424611 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a09e9aa-d6f2-4792-8bf8-9bd279f4efbb tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 404 len: 111 microversion: 2.1 time: 0.115218 Jun 18 22:16:21.428470 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1776/3551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:21 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:21.559684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:21.579541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:21.582384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:21.585732 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-76a8f6fb-8a0e-4157-b07d-bd7898bd09a8 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.268847 Jun 18 22:16:21.604196 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1776/3552] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:21 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:22.604687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:22.605398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:22.619920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:22.620385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:22.631041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:22.631924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:22.881668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:22.890784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:22.902918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:22.904427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b5460fb-2bd0-4714-a5c4-41fb8dda06be tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.303784 Jun 18 22:16:22.913612 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1777/3553] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:22 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:23.933739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:23.935427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:23.969484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:23.969949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:23.970750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:23.971189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:24.190070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:24.215983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:24.217992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:24.219561 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3616f8ec-53eb-480b-ba92-d471d5a63d30 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.292401 Jun 18 22:16:24.220336 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1777/3554] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:23 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:25.238451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:25.239784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:25.245635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:25.252611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:25.253094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:25.260217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:25.260691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:25.526355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:25.544926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:25.548245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:25.557584 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb6a18ec-3001-4389-80f5-bb4b36af230c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.320317 Jun 18 22:16:25.558867 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1778/3555] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:25 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:26.581741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:26.583036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:26.589795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:26.595024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:26.610018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:26.610780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:26.611952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:26.614904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:26.996119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:27.015753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:27.022296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:27.024047 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-009f65ab-55ed-4159-875a-9259c65091c0 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.448591 Jun 18 22:16:27.026791 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1778/3556] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:26 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:28.045517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:28.046149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:28.068514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:28.069365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:28.070559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:28.073225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:28.300778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:28.312285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:28.324538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:28.327032 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ffe0a20-5890-4000-a1a2-acaf5b45fc36 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.285553 Jun 18 22:16:28.327610 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1779/3557] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:28 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:29.346963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:29.347954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:29.360673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.361170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.361977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.362417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.595294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:29.596026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:29.598707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:29.627163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.627535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.628706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.629388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.653991 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] HTTP exception thrown: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Request method failure captured: Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 HTTP/1.1 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5dv_bLGEDJNAYOQOZiKZOgO45Tp8o5pfU8ZAru0R6mAXO_dY-Z6d1bLww4-eVT9fW7RwhamsS01nrI2xV7lIApEyl2ZLW8YxdymhIXiPvkgmjfw3wVWHVfcBSioJHGkk_6jAOGb5gu--ZPVXAN9Zeu3LocrUJ6mWkAUYNekhydSw4 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_635aa1d3d9b24f59a1b25f107438855e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cc3d993686bc4416a4015ac3e96b029c Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '464ce092-6cd1-4866-beac-038784f1ec17'} Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:29.671733 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.676522 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.679611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Returning 404 to user: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:29.680676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d648df09-9c1b-4da0-bfac-15bc7337071a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 404 len: 111 microversion: 2.1 time: 0.090619 Jun 18 22:16:29.681782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1780/3558] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:29 2022] DELETE /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:29.694288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:29.699913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:29.710959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 464ce092-6cd1-4866-beac-038784f1ec17] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:29.723592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:29.725636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:29.737015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f3cec79-d53d-4dda-b51b-bfdfd1d308e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.392766 Jun 18 22:16:29.738439 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1779/3559] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:29 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:29.740132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.740827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.742241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.742915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.767469 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] HTTP exception thrown: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Request method failure captured: Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 HTTP/1.1 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5dv_bLGEDJNAYOQOZiKZOgO45Tp8o5pfU8ZAru0R6mAXO_dY-Z6d1bLww4-eVT9fW7RwhamsS01nrI2xV7lIApEyl2ZLW8YxdymhIXiPvkgmjfw3wVWHVfcBSioJHGkk_6jAOGb5gu--ZPVXAN9Zeu3LocrUJ6mWkAUYNekhydSw4 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_635aa1d3d9b24f59a1b25f107438855e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cc3d993686bc4416a4015ac3e96b029c Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '464ce092-6cd1-4866-beac-038784f1ec17'} Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.769387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. Jun 18 22:16:29.774419 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.779067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Returning 404 to user: Instance 464ce092-6cd1-4866-beac-038784f1ec17 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:29.780263 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8915505d-2173-4655-8533-495c04fbfe01 tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17" status: 404 len: 111 microversion: 2.1 time: 0.094281 Jun 18 22:16:29.781402 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1781/3560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:29 2022] GET /compute/v2.1/servers/464ce092-6cd1-4866-beac-038784f1ec17 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:29.790357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:29.791152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:29.805920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.806788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.807962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.808784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.863046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] HTTP exception thrown: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Request method failure captured: Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 HTTP/1.1 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk5dv_bLGEDJNAYOQOZiKZOgO45Tp8o5pfU8ZAru0R6mAXO_dY-Z6d1bLww4-eVT9fW7RwhamsS01nrI2xV7lIApEyl2ZLW8YxdymhIXiPvkgmjfw3wVWHVfcBSioJHGkk_6jAOGb5gu--ZPVXAN9Zeu3LocrUJ6mWkAUYNekhydSw4 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_635aa1d3d9b24f59a1b25f107438855e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: cc3d993686bc4416a4015ac3e96b029c Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3'} Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:29.872420 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.876568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Returning 404 to user: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:29.879994 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5097b1da-1f72-4449-8306-f6adc175eb8a tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 404 len: 111 microversion: 2.1 time: 0.088677 Jun 18 22:16:29.879994 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1780/3561] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:29 2022] DELETE /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:29.887168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:29.887789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] [instance: 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:29.903863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.904554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.906081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:29.910848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:29.950365 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] HTTP exception thrown: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Request method failure captured: Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 HTTP/1.1 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk5dv_bLGEDJNAYOQOZiKZOgO45Tp8o5pfU8ZAru0R6mAXO_dY-Z6d1bLww4-eVT9fW7RwhamsS01nrI2xV7lIApEyl2ZLW8YxdymhIXiPvkgmjfw3wVWHVfcBSioJHGkk_6jAOGb5gu--ZPVXAN9Zeu3LocrUJ6mWkAUYNekhydSw4 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/635aa1d3d9b24f59a1b25f107438855e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_635aa1d3d9b24f59a1b25f107438855e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 635aa1d3d9b24f59a1b25f107438855e Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestMultiNic-2108772206 Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cc3d993686bc4416a4015ac3e96b029c Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestMultiNic-2108772206-project Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3'} Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:29.958059 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] Returning 404 to user: Instance 2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:29.963926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b8c9d73-cbda-42ec-b5fd-75da305066bc tempest-ServersTestMultiNic-2108772206 tempest-ServersTestMultiNic-2108772206-project] 10.222.0.30 "GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3" status: 404 len: 111 microversion: 2.1 time: 0.081218 Jun 18 22:16:29.972671 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1782/3562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:29 2022] GET /compute/v2.1/servers/2bff8ee1-a531-4f3c-aa92-3fdeab74c3e3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:30.756560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:30.757339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:30.775860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:30.778519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:30.779428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:30.781371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:31.514284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:31.525861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:31.531597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:31.532945 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b7f13059-409a-498a-adb8-cb5d94ed4c8b tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.780713 Jun 18 22:16:31.533787 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1781/3563] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:30 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:32.164027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:32.164751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:32.177995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:32.180068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:32.186837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:32.188668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:32.535125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:32.548954 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9483e606-1f7e-4085-827f-ba7f59d5f0a3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.390416 Jun 18 22:16:32.551052 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1783/3564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:32 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:32.551781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:32.552524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:32.566177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1297952012"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:32.567435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:32.567814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:32.568092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:32.568993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:32.569559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:32.580880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:32.581663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:32.582642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:32.583246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:32.732463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:32.742449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:32.744608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:32.745870 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-597bc11c-68aa-4465-811a-a91bdc64533a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.198355 Jun 18 22:16:32.746777 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1782/3565] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:32 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:33.035925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1934618519", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6f884a5b-00a5-4f6a-8bba-891f7422f1ef"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:33.123558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] validate_networks() for [('6f884a5b-00a5-4f6a-8bba-891f7422f1ef', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:16:33.146228 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff8ea694-2eed-4812-a545-db95e8f387c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.584084 Jun 18 22:16:33.146928 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1784/3566] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:16:32 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 18 22:16:33.767929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:33.768723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:33.789094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:33.800622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:33.801851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:33.804575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:33.806450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:33.959511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:16:33.961745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:16:33.962952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:16:33.964251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:16:33.965551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:16:34.015261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:34.020476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:34.042305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:34.042972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:34.057229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:34.071942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:34.073770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:34.079069 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-84c1f81a-564d-4398-a91c-7e36c32c3230 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.317878 Jun 18 22:16:34.082479 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1785/3567] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:33 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:34.098291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Getting quotas for project 851177a639b248a0b4508112a9b6e6bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:16:34.115643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Getting quotas for user 4c071daa57f24e9fa1ae5d173a99d2ca and project 851177a639b248a0b4508112a9b6e6bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:16:34.133950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Going to run 2 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:16:34.148714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:16:34.199062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=43ceb40b-8f70-4641-a1cb-b8ee8c6a5814,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:16:34.291945 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-322275ec-84e9-47fc-a5d2-8227fd702f55 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543605 Jun 18 22:16:34.305361 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1783/3568] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:16:34.319570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:34.332254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:34.333654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Searching by: {'deleted': False, 'project_id': '851177a639b248a0b4508112a9b6e6bf'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:16:34.399918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:34.400530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:34.403732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:34.405003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:34.443637 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9910813b-ab49-4586-8085-35f40e09a52d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.131357 Jun 18 22:16:34.445642 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1786/3569] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:16:34 2022] GET /compute/v2.1/servers => generated 677 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:34.457000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-13a4550f-58b7-4709-b980-1af9792dadba tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:34.458229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-13a4550f-58b7-4709-b980-1af9792dadba tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:34.564079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-13a4550f-58b7-4709-b980-1af9792dadba tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:34.578853 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-13a4550f-58b7-4709-b980-1af9792dadba tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1220 microversion: 2.1 time: 0.124485 Jun 18 22:16:34.583491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1784/3570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:34 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1220 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:35.111285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:35.113169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:35.131833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:35.133431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:35.149535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:35.149535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:35.337313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:35.346398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:35.349060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:35.350701 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1fa9be88-3f49-4bbd-960f-7a11cc5a5abd tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.254786 Jun 18 22:16:35.351435 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1787/3571] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:35 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:35.408710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-281008241", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "cbcb4bc6-4ebe-4797-ba04-d1451a91835b"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:35.499485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] validate_networks() for [('cbcb4bc6-4ebe-4797-ba04-d1451a91835b', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:16:35.600352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c1b538b-3b4d-4fa7-86ce-6e7f91d26502 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:35.601058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c1b538b-3b4d-4fa7-86ce-6e7f91d26502 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:35.823861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c1b538b-3b4d-4fa7-86ce-6e7f91d26502 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:35.834746 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c1b538b-3b4d-4fa7-86ce-6e7f91d26502 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1220 microversion: 2.1 time: 0.237690 Jun 18 22:16:35.838792 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1788/3572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:35 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1220 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:16:36.372052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:36.372715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:36.389993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:36.402515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:36.408343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:36.409581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:36.521460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:36.764710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:36.779018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:36.782556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:36.787623 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d0722086-be5b-4d36-9cd3-c8658349cd84 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.420551 Jun 18 22:16:36.794147 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1789/3573] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:36 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:36.812191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:16:36.812829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:16:36.813517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:16:36.814055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:16:36.814988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:16:36.846263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:36.847091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:36.850982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:36.851769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:36.851917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:36.852887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:36.862106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:36.863648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:36.864526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:36.864985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:36.929358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:16:36.946850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for user d5516d85f0ee482facf6a96e2709c41d and project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:16:36.984906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:16:36.999567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:16:37.042362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:37.060752 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aac8966a-9d26-40d5-93e9-19cc56ca03cb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1272 microversion: 2.1 time: 0.212036 Jun 18 22:16:37.074689 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1790/3574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:36 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:37.110831 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ea5edef-df72-4cb8-a73c-51cf80832813 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806599 Jun 18 22:16:37.119266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1785/3575] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:16:37.123348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c6cacbaa-2c16-47df-980a-46253fe66e4f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:37.124230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c6cacbaa-2c16-47df-980a-46253fe66e4f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:37.238294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c6cacbaa-2c16-47df-980a-46253fe66e4f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:37.252938 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c6cacbaa-2c16-47df-980a-46253fe66e4f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1224 microversion: 2.1 time: 0.132452 Jun 18 22:16:37.256858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1791/3576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:37 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1224 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:37.687950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3ce1d865-532d-4834-9f39-d66a0338e8a1 req-eb961cf2-dad8-4837-b24a-c5313bf3999c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-unplugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:37.733578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3ce1d865-532d-4834-9f39-d66a0338e8a1 req-eb961cf2-dad8-4837-b24a-c5313bf3999c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:37.734210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3ce1d865-532d-4834-9f39-d66a0338e8a1 req-eb961cf2-dad8-4837-b24a-c5313bf3999c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:37.766204 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3ce1d865-532d-4834-9f39-d66a0338e8a1 req-eb961cf2-dad8-4837-b24a-c5313bf3999c service nova] Creating event network-vif-unplugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:16:37.778752 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3ce1d865-532d-4834-9f39-d66a0338e8a1 req-eb961cf2-dad8-4837-b24a-c5313bf3999c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098307 Jun 18 22:16:37.781195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1786/3577] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:37.811856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:37.812573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:37.845807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:37.853366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:37.856437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:37.859995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:38.080906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:38.081547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:38.091961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:38.093918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:38.095833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:38.097553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:38.159923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:38.191324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:38.195989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:38.204515 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3b312ce4-8af7-40be-a29c-7c28d10cbc91 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.397061 Jun 18 22:16:38.206437 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1792/3578] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:37 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:38.275646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:38.279717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:38.280349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:38.296094 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba3f383f-0f49-4606-905b-5ef35a0cbb20 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1278 microversion: 2.1 time: 0.219566 Jun 18 22:16:38.304827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:38.305328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:38.306129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:38.307093 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1787/3579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:38 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:16:38.310314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:38.561524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:38.577683 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e53a2e28-2119-4d37-a6a0-ddc472ebd8cd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1228 microversion: 2.1 time: 0.306494 Jun 18 22:16:38.580199 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1793/3580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:38 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1228 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:39.224250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:39.225466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:39.243077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:39.243752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:39.244709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:39.245360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:39.324243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:39.324873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:39.344088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:39.344783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:39.345793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:39.346395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:39.530609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:39.549999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:39.565947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:39.567323 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cd610f47-442e-49d9-9eef-d577fce7eb28 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.347737 Jun 18 22:16:39.570464 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1788/3581] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:39 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:39.598614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:39.599299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:39.614020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:39.614852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:39.617027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:39.619651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:39.756814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:39.773913 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8cfecbcb-f2d1-4168-acf0-ec944be609ee tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1282 microversion: 2.1 time: 0.177049 Jun 18 22:16:39.774825 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1789/3582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:39 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:16:39.863619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:39.873764 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7177a000-d755-454f-bb4e-1c0de66a73b7 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.553448 Jun 18 22:16:39.875166 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1794/3583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:39 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:40.588785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:40.589926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:40.604903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:40.608713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:40.609561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:40.610294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:40.691867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:40.703377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:40.705242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:40.707699 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-373801a5-0ff5-40ad-9d96-8bb3d6781741 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.123434 Jun 18 22:16:40.718677 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1790/3584] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:40 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:40.791427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:40.792053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:40.799606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:40.800316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:40.801995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:40.802900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:40.896442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:40.898140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:40.906073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:40.907061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:40.908246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:40.910479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:40.949801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:40.958902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:40.964355 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11c607ba-12e1-4614-886f-8468a587e731 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1282 microversion: 2.1 time: 0.175627 Jun 18 22:16:40.966451 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1795/3585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:40 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:41.472916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:41.485545 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba4ba1a7-6a86-4c15-a1b7-3c03bbd68273 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.595980 Jun 18 22:16:41.487610 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1791/3586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:40 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:41.696028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:41.697460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:41.709708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:41.727674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:41.728987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:41.734491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:41.735902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:41.742193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:41.751110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:41.755420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:41.756423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:41.756854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:41.913412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:41.926226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:41.933104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:41.935937 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f00667e5-8713-4e9f-af6c-865d64938737 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.214435 Jun 18 22:16:41.950082 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1792/3587] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:41 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:16:41.985686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:41.986342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:41.994593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.001470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.002321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.002760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.051965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lazy-loading 'services' on Instance uuid 0193f858-2c0f-43e6-a811-27bb75b7708f {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:16:42.194738 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-016e4dc9-03ae-4a40-99eb-5e9ae93b1850 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments/8d48035a-208e-4c79-b4c3-8bbff016c991" status: 202 len: 0 microversion: 2.1 time: 0.502927 Jun 18 22:16:42.203879 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1796/3588] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:16:41 2022] DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments/8d48035a-208e-4c79-b4c3-8bbff016c991 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:16:42.680454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:42.695992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-afb2e551-73a2-4bfb-ae87-ac8ce6bf0570 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.712281 Jun 18 22:16:42.697853 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1793/3589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:41 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:42.715022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:42.717262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:42.737407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.738670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.740541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.745389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.809796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c9f2ffc9-0263-4efb-b510-5b4bb3f34497 req-5d5624b5-4ac5-4278-a34e-3401b382188d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ceb40b-8f70-4641-a1cb-b8ee8c6a5814", "tag": "b9e5857f-f7b3-48a3-8e67-ffe607ad0985"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:42.827587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c9f2ffc9-0263-4efb-b510-5b4bb3f34497 req-5d5624b5-4ac5-4278-a34e-3401b382188d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.833697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c9f2ffc9-0263-4efb-b510-5b4bb3f34497 req-5d5624b5-4ac5-4278-a34e-3401b382188d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.849342 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80be8ad2-a715-45ac-84e8-9265385f7ea5 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145818 Jun 18 22:16:42.854781 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1794/3590] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:16:42 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:42.873897 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c9f2ffc9-0263-4efb-b510-5b4bb3f34497 req-5d5624b5-4ac5-4278-a34e-3401b382188d service nova] Creating event network-changed:b9e5857f-f7b3-48a3-8e67-ffe607ad0985 for instance 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 on nch1-master-1 Jun 18 22:16:42.881685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:42.882352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:42.891923 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c9f2ffc9-0263-4efb-b510-5b4bb3f34497 req-5d5624b5-4ac5-4278-a34e-3401b382188d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.685973 Jun 18 22:16:42.898227 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1797/3591] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:42.898427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.898966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.899727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.900163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.908087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-bb9a67b4-208e-449e-95d1-b7aeb45841eb req-8050e2f5-cadf-4a06-b229-5da693074d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04986286-8cad-465b-b4cf-f19a1055e97d", "tag": "03124600-94fc-436b-bb14-3c4729f2fe53"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:42.942830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bb9a67b4-208e-449e-95d1-b7aeb45841eb req-8050e2f5-cadf-4a06-b229-5da693074d9a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:42.943291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bb9a67b4-208e-449e-95d1-b7aeb45841eb req-8050e2f5-cadf-4a06-b229-5da693074d9a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:42.973129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-bb9a67b4-208e-449e-95d1-b7aeb45841eb req-8050e2f5-cadf-4a06-b229-5da693074d9a service nova] Creating event network-changed:03124600-94fc-436b-bb14-3c4729f2fe53 for instance 04986286-8cad-465b-b4cf-f19a1055e97d on nch2-master-1 Jun 18 22:16:42.991734 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-bb9a67b4-208e-449e-95d1-b7aeb45841eb req-8050e2f5-cadf-4a06-b229-5da693074d9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090610 Jun 18 22:16:42.998212 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1798/3592] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:43.018327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-20d188f2-9b95-4965-8850-3e076065740d req-c9e61b51-95b6-4ac1-bcf0-712834e0b4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-plugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:43.063383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-20d188f2-9b95-4965-8850-3e076065740d req-c9e61b51-95b6-4ac1-bcf0-712834e0b4e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.064950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-20d188f2-9b95-4965-8850-3e076065740d req-c9e61b51-95b6-4ac1-bcf0-712834e0b4e6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.095834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-20d188f2-9b95-4965-8850-3e076065740d req-c9e61b51-95b6-4ac1-bcf0-712834e0b4e6 service nova] Creating event network-vif-plugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:16:43.110805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-20d188f2-9b95-4965-8850-3e076065740d req-c9e61b51-95b6-4ac1-bcf0-712834e0b4e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109598 Jun 18 22:16:43.111430 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1799/3593] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:43.136092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:43.138110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:43.174189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.176272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.185434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.186474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.488149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:43.500599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:43.504752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:43.506501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b10165a-651b-4d37-8103-02b84f34636a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.390930 Jun 18 22:16:43.507715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1800/3594] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:43 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:43.508934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:43.521381 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e7de6c0-ad20-4bae-bf7d-e82c6e3f2eb5 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.668176 Jun 18 22:16:43.523821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1795/3595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:42 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:43.722210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:43.723344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:43.731587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.732679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.733752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.734538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.863469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:43.874546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:43.898470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.899064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.901436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:43.911088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:43.991557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:44.004304 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-94973a63-e74b-4339-a532-fa35c1715351 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.288095 Jun 18 22:16:44.005562 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1801/3596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:43 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:44.015728 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80eeff63-ca55-4de0-b14b-b6be15de0607 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.156729 Jun 18 22:16:44.016807 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1796/3597] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:16:43 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f/os-volume_attachments => generated 25 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:16:44.141939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:44.144088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:44.153093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.153822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.155074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.155681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.228336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Cannot 'reboot' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action HTTP/1.1 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 28 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: {"reboot": {"type": "HARD"}} Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'reboot' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74506814-2e86-4ead-b8f8-f5713285226f', 'body': {'reboot': {'type': 'HARD'}}} Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74506814-2e86-4ead-b8f8-f5713285226f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:16:44.230185 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 409 to user: Cannot 'reboot' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0741c602-69b3-43ac-8ff2-14503313127b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action" status: 409 len: 145 microversion: 2.1 time: 0.094620 Jun 18 22:16:44.241744 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1802/3598] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:16:44 2022] POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:16:44.249585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:44.251392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:44.260215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.260851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.261912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.262508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.308494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Cannot 'rebuild' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action HTTP/1.1 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 65 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'rebuild' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '74506814-2e86-4ead-b8f8-f5713285226f', 'body': {'rebuild': {'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad'}}} Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74506814-2e86-4ead-b8f8-f5713285226f in vm_state rescued. Cannot rebuild while the instance is in this state. Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.310940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued Jun 18 22:16:44.316008 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.318634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 409 to user: Cannot 'rebuild' instance 74506814-2e86-4ead-b8f8-f5713285226f while it is in vm_state rescued {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:44.319603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c669a12f-9719-4e28-8f9d-727abcdf344b tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action" status: 409 len: 146 microversion: 2.1 time: 0.074764 Jun 18 22:16:44.325368 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1797/3599] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:16:44 2022] POST /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f/action => generated 146 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:16:44.333528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:44.334138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:44.342857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.343493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.345986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.346498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.378301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:44.431092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:44.530322 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-66af696e-ed37-4098-8ca4-7ce121d16384 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 204 len: 0 microversion: 2.1 time: 0.202045 Jun 18 22:16:44.531042 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1798/3600] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:44 2022] DELETE /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:16:44.543803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43d5e71f-84ac-4cd0-b005-3bb38bbd92ea tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-16573567", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:44.545888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:44.546018 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-43d5e71f-84ac-4cd0-b005-3bb38bbd92ea tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] HTTP exception thrown: min_count must be <= max_count Jun 18 22:16:44.547272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43d5e71f-84ac-4cd0-b005-3bb38bbd92ea tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Request method failure captured: Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 182 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7MXHcd8IZ_YTN-YbIf2xq2BxkJdVH-8oWkKePLs6O0y362d3ew2nU0bHqCAlrhxpb8wbVGjzyS0Lmbe8aiO-xXHOhY-k-p6vFBhpjWHlHPC5-TpWZtybOMjF2qcsP_7P0W9PM0FHPwOHXljZ8hVcmz9HE1ciTjbc-WSXwghd3Q8q0 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ed1dce6dabe4bad91282d31153e2698", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cf632c9596904fd494c0d6190ede1d67 Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-16573567", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: exception: min_count must be <= max_count Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-16573567', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 18 22:16:44.547455 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:44.554016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43d5e71f-84ac-4cd0-b005-3bb38bbd92ea tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Returning 400 to user: min_count must be <= max_count {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:44.555119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.555493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-43d5e71f-84ac-4cd0-b005-3bb38bbd92ea tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.275335 Jun 18 22:16:44.556084 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1803/3601] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:16:44.556489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.557317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.557755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.580932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:44.584201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:44.599845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.603188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.606287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.606942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.807787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:44.816849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:44.819185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:44.820668 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b2314c26-3cd5-46e6-b280-27eab376c1e6 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.280650 Jun 18 22:16:44.835823 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1799/3602] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:44 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:44.842027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:44.842962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:44.849445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.850230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:44.851288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:44.851940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:45.169904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:45.184739 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9647453-f362-498e-a934-48a06b1a40e4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1691 microversion: 2.1 time: 0.345911 Jun 18 22:16:45.185666 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1800/3603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:44 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1691 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:45.186309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:45.198076 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b8f3a8c-2d3f-464a-8ad3-c7389478eaed tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.623113 Jun 18 22:16:45.198922 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1804/3604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:44 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:45.203866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1d61131-ba8e-49e7-9154-0ffb625ffa1b tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-55776686", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "max_count": 0}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:45.204442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-faf71715-0979-4297-98d2-61ef1e2e10be req-e346e048-83fa-425a-9a76-a705c287fb42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fbf8789-21b7-46a1-9b8f-be1e66d4546c", "tag": "b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1d61131-ba8e-49e7-9154-0ffb625ffa1b tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Request method failure captured: Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 166 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7MXHcd8IZ_YTN-YbIf2xq2BxkJdVH-8oWkKePLs6O0y362d3ew2nU0bHqCAlrhxpb8wbVGjzyS0Lmbe8aiO-xXHOhY-k-p6vFBhpjWHlHPC5-TpWZtybOMjF2qcsP_7P0W9PM0FHPwOHXljZ8hVcmz9HE1ciTjbc-WSXwghd3Q8q0 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ed1dce6dabe4bad91282d31153e2698", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: cf632c9596904fd494c0d6190ede1d67 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-55776686", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "max_count": 0}} Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-55776686', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'max_count': 0}}} Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 0 Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:16:45.211677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 18 22:16:45.217465 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.220094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1d61131-ba8e-49e7-9154-0ffb625ffa1b tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:45.221255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1d61131-ba8e-49e7-9154-0ffb625ffa1b tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033400 Jun 18 22:16:45.222325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1801/3605] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:16:45.227716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:45.228539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:45.236787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-faf71715-0979-4297-98d2-61ef1e2e10be req-e346e048-83fa-425a-9a76-a705c287fb42 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:45.237272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-faf71715-0979-4297-98d2-61ef1e2e10be req-e346e048-83fa-425a-9a76-a705c287fb42 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:45.251548 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-faf71715-0979-4297-98d2-61ef1e2e10be req-e346e048-83fa-425a-9a76-a705c287fb42 service nova] Creating event network-changed:b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa for instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c on nch1-master-1 Jun 18 22:16:45.258566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:45.259989 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-faf71715-0979-4297-98d2-61ef1e2e10be req-e346e048-83fa-425a-9a76-a705c287fb42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059529 Jun 18 22:16:45.260652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:45.262248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1805/3606] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:45.263123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:45.265115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:45.437401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8ce6523-5219-4a6e-b2c5-5ec87e7f709f tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1201732447", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "max_count": 2.5}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8ce6523-5219-4a6e-b2c5-5ec87e7f709f tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Request method failure captured: Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 170 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7MXHcd8IZ_YTN-YbIf2xq2BxkJdVH-8oWkKePLs6O0y362d3ew2nU0bHqCAlrhxpb8wbVGjzyS0Lmbe8aiO-xXHOhY-k-p6vFBhpjWHlHPC5-TpWZtybOMjF2qcsP_7P0W9PM0FHPwOHXljZ8hVcmz9HE1ciTjbc-WSXwghd3Q8q0 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ed1dce6dabe4bad91282d31153e2698", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cf632c9596904fd494c0d6190ede1d67 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1201732447", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "max_count": 2.5}} Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1201732447', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'max_count': 2.5}}} Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 2.5 Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:16:45.440796 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.446528 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.451388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8ce6523-5219-4a6e-b2c5-5ec87e7f709f tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:45.453804 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a8ce6523-5219-4a6e-b2c5-5ec87e7f709f tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021372 Jun 18 22:16:45.454621 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1806/3607] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:16:45.510508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:45.519610 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35f66e5e-8092-40e2-9f2c-898c7ba6110f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.296081 Jun 18 22:16:45.520192 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1802/3608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:45 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:45.551054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-187ee34f-299f-4e8c-8af9-a0bd38c54f5a tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2091985697", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 0}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-187ee34f-299f-4e8c-8af9-a0bd38c54f5a tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Request method failure captured: Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 168 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7MXHcd8IZ_YTN-YbIf2xq2BxkJdVH-8oWkKePLs6O0y362d3ew2nU0bHqCAlrhxpb8wbVGjzyS0Lmbe8aiO-xXHOhY-k-p6vFBhpjWHlHPC5-TpWZtybOMjF2qcsP_7P0W9PM0FHPwOHXljZ8hVcmz9HE1ciTjbc-WSXwghd3Q8q0 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ed1dce6dabe4bad91282d31153e2698", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: cf632c9596904fd494c0d6190ede1d67 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2091985697", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 0}} Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2091985697', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'min_count': 0}}} Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 0 Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:16:45.553888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 18 22:16:45.559158 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.561481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-187ee34f-299f-4e8c-8af9-a0bd38c54f5a tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:45.562505 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-187ee34f-299f-4e8c-8af9-a0bd38c54f5a tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.015507 Jun 18 22:16:45.566920 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1807/3609] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:16:45.638739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e05fec9-ef42-4867-a78e-98a9e48fa29c tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-836728264", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 2.5}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e05fec9-ef42-4867-a78e-98a9e48fa29c tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Request method failure captured: Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 169 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7MXHcd8IZ_YTN-YbIf2xq2BxkJdVH-8oWkKePLs6O0y362d3ew2nU0bHqCAlrhxpb8wbVGjzyS0Lmbe8aiO-xXHOhY-k-p6vFBhpjWHlHPC5-TpWZtybOMjF2qcsP_7P0W9PM0FHPwOHXljZ8hVcmz9HE1ciTjbc-WSXwghd3Q8q0 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7ed1dce6dabe4bad91282d31153e2698"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7ed1dce6dabe4bad91282d31153e2698", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7ed1dce6dabe4bad91282d31153e2698 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1254560471 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: cf632c9596904fd494c0d6190ede1d67 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1254560471-project Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-836728264", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 2.5}} Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-836728264', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'min_count': 2.5}}} Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 2.5 Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:16:45.641423 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e05fec9-ef42-4867-a78e-98a9e48fa29c tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e05fec9-ef42-4867-a78e-98a9e48fa29c tempest-MultipleCreateNegativeTestJSON-1254560471 tempest-MultipleCreateNegativeTestJSON-1254560471-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008242 Jun 18 22:16:45.650385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1803/3610] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:16:45.848500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:45.849803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:45.871484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:45.874955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:45.879687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:45.880184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.003552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:46.016895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:46.018990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:46.020612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc65bdaa-2293-4ebf-a160-20dc7518094a tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1409 microversion: 2.54 time: 0.185126 Jun 18 22:16:46.022228 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1808/3611] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:45 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:46.230583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:46.231238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:46.239988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:46.244166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:46.278507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:46.280792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.283335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:46.284199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.286024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:46.286500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.290057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:46.290518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.617544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:46.626269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6c98ea5-2ad5-4fec-b04a-e3a13dce7bb4 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1691 microversion: 2.1 time: 0.427696 Jun 18 22:16:46.642169 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1804/3612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:46 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1691 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:46.647787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:46.648630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:46.658595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:46.659202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.660132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:46.660632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:46.706510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:46.716023 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3bf6cd08-97fd-407f-a2f2-13890b585508 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.503658 Jun 18 22:16:46.722257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1809/3613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:46 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:46.895099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:46.937699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:46.947470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a32f5ac-e59e-4472-bac2-31877e9eb519 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.303782 Jun 18 22:16:46.951423 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1805/3614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:46 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:47.040384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:47.043511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:47.051518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.052059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:47.053058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.053619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:47.136303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:47.150884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:47.152861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:47.154820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f4574aa-2cb4-4ab3-9d7f-c249c1a05345 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1415 microversion: 2.54 time: 0.117902 Jun 18 22:16:47.155139 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1810/3615] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:47 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1415 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:47.647261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:47.647979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:47.652056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=14 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:47.653639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-286a7df1-fc22-4366-a336-a2db34176cd6 req-72dd9cbd-c574-42bd-9c46-bd35fbfca9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04986286-8cad-465b-b4cf-f19a1055e97d", "name": "network-vif-plugged", "status": "completed", "tag": "03124600-94fc-436b-bb14-3c4729f2fe53"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:47.664280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.669081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:47.669611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:47.670575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.671058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:47.671790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-286a7df1-fc22-4366-a336-a2db34176cd6 req-72dd9cbd-c574-42bd-9c46-bd35fbfca9b5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.674869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-286a7df1-fc22-4366-a336-a2db34176cd6 req-72dd9cbd-c574-42bd-9c46-bd35fbfca9b5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:47.722553 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-286a7df1-fc22-4366-a336-a2db34176cd6 req-72dd9cbd-c574-42bd-9c46-bd35fbfca9b5 service nova] Creating event network-vif-plugged:03124600-94fc-436b-bb14-3c4729f2fe53 for instance 04986286-8cad-465b-b4cf-f19a1055e97d on nch2-master-1 Jun 18 22:16:47.744382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-286a7df1-fc22-4366-a336-a2db34176cd6 req-72dd9cbd-c574-42bd-9c46-bd35fbfca9b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094239 Jun 18 22:16:47.760782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1811/3616] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:47.772252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:47.776829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:47.786037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.786998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:47.788008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:47.788696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:48.195596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:48.210100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17ef74d2-fc78-4625-8d4a-7d73db8b2b22 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1691 microversion: 2.1 time: 0.566698 Jun 18 22:16:48.212929 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1806/3617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:47 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1691 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:48.224873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:48.226611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:48.244411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:48.245345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:48.246190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:48.246638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:48.261834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:48.272952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d3aca42-d01c-4c63-aa9d-60526a0e27d3 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.507884 Jun 18 22:16:48.274112 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1812/3618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:47 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:48.286665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:48.287902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:48.303451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:48.305128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:48.306358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:48.307010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:48.312976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:48.867622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:48.878173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:48.885059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:48.889480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4805d476-6885-4a3a-8239-e0a3bf6bd0fb tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1415 microversion: 2.54 time: 0.611376 Jun 18 22:16:48.893257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1813/3619] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:48 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1415 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:48.980272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:48.991695 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d323f286-fd9c-4ab8-914c-d738d8895cb5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.773372 Jun 18 22:16:48.992923 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1807/3620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:48 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:49.240749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:49.251548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:49.292571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:49.298804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:49.300885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:49.309781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:49.320921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:49.323046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:49.329634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:49.332188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:49.333277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:49.335394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.018032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:50.022582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:50.035232 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb84dabd-11c2-49ca-8688-c7fa0df91141 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1320 microversion: 2.1 time: 0.740487 Jun 18 22:16:50.039416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:50.050402 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1808/3621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:49 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1320 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:50.055612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:50.056547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:50.060701 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3f176f89-d455-471a-8b32-58da77c32006 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1691 microversion: 2.1 time: 0.833520 Jun 18 22:16:50.067479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.068336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.070129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.070588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.073201 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1814/3622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:49 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1691 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:50.089128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:50.091973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:50.112911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.113769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.115564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.116299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.567496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:50.595476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:50.602755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:50.605435 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f16a9909-c715-4b40-aa82-559686441bbf tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1400 microversion: 2.54 time: 0.554158 Jun 18 22:16:50.611637 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1809/3623] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:50 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1400 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:50.631882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1fb2acac-f0d9-437f-a604-eaa026b43bba tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '.version_select at 0x7fea076689d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:50.656397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:50.706241 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1fb2acac-f0d9-437f-a604-eaa026b43bba tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1577623835" status: 204 len: 0 microversion: 2.54 time: 0.079439 Jun 18 22:16:50.711787 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1810/3624] 10.222.0.30 () {60 vars in 1318 bytes} [Sat Jun 18 22:16:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1577623835 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:16:50.723500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:50.723940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:50.739154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.739626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.741686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.744491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.788172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:50.957882 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43e12900-91f3-47e9-b065-6b621e41783c tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 204 len: 0 microversion: 2.54 time: 0.238992 Jun 18 22:16:50.958481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1811/3625] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:16:50 2022] DELETE /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 18 22:16:50.967973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:50.974707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:50.987596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.990260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:50.991230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:50.995212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:51.206603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:51.224543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:51.226572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:51.227963 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a2dd145-0631-44e0-9e19-5ca2bb162aed tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1406 microversion: 2.54 time: 0.264994 Jun 18 22:16:51.234487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:51.239136 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1812/3626] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:50 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:51.243785 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-26762897-8c1a-4523-8a5e-7b14e3a1ed09 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 1.168943 Jun 18 22:16:51.254838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1815/3627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:50 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:51.260974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:51.261640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:51.273505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:51.273662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:51.286294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:51.286931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:51.287729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:51.288176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:51.308392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:51.308937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:51.311449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:51.316213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:51.854814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:51.867234 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0706af3f-71de-40d3-a633-534c59a4837e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1691 microversion: 2.1 time: 0.609098 Jun 18 22:16:51.879051 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1816/3628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:51 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1691 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:51.887962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:51.899620 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8c87372d-38d2-4720-aed7-046190aae58d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 200 len: 1509 microversion: 2.1 time: 0.653665 Jun 18 22:16:51.918935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:51.919800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:51.923173 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1813/3629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:51 2022] GET /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 1509 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:51.926742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:51.927391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:51.928396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:51.929084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.116758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ef82609d-e87c-4003-8fc6-c539caec4885 req-70206497-6bc6-45fd-9917-e3b15f6eac3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ceb40b-8f70-4641-a1cb-b8ee8c6a5814", "name": "network-vif-plugged", "status": "completed", "tag": "b9e5857f-f7b3-48a3-8e67-ffe607ad0985"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:52.130302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ef82609d-e87c-4003-8fc6-c539caec4885 req-70206497-6bc6-45fd-9917-e3b15f6eac3d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.133668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ef82609d-e87c-4003-8fc6-c539caec4885 req-70206497-6bc6-45fd-9917-e3b15f6eac3d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.161624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ef82609d-e87c-4003-8fc6-c539caec4885 req-70206497-6bc6-45fd-9917-e3b15f6eac3d service nova] Creating event network-vif-plugged:b9e5857f-f7b3-48a3-8e67-ffe607ad0985 for instance 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 on nch1-master-1 Jun 18 22:16:52.171471 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ef82609d-e87c-4003-8fc6-c539caec4885 req-70206497-6bc6-45fd-9917-e3b15f6eac3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058315 Jun 18 22:16:52.173459 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1814/3630] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:16:52.257987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:52.258731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:52.271634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.273695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.275263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.276576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.422010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:52.433299 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-38086390-2d66-4e6f-a520-7d519947d45e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814" status: 200 len: 1320 microversion: 2.1 time: 0.519080 Jun 18 22:16:52.438126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1817/3631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:51 2022] GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:52.451289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:52.452431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:52.471693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:52.474338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.474896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.475846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.476319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.486675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:52.493679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:52.495357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6691bb49-3fd1-4dfb-a8f9-b114fd59872f tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1406 microversion: 2.54 time: 0.242408 Jun 18 22:16:52.504071 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1815/3632] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:52 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:16:52.644383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3b198a00-3d69-4c54-926e-96e31fc2c0bb req-84fa35a2-ba87-4e10-a646-f9c02efe3ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0193f858-2c0f-43e6-a811-27bb75b7708f", "name": "network-vif-deleted", "tag": "972a9af1-f59f-41bb-8b18-9f56de6ec8b4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:52.658940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3b198a00-3d69-4c54-926e-96e31fc2c0bb req-84fa35a2-ba87-4e10-a646-f9c02efe3ad3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.665945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3b198a00-3d69-4c54-926e-96e31fc2c0bb req-84fa35a2-ba87-4e10-a646-f9c02efe3ad3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.697804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3b198a00-3d69-4c54-926e-96e31fc2c0bb req-84fa35a2-ba87-4e10-a646-f9c02efe3ad3 service nova] Creating event network-vif-deleted:972a9af1-f59f-41bb-8b18-9f56de6ec8b4 for instance 0193f858-2c0f-43e6-a811-27bb75b7708f on nch1-master-1 Jun 18 22:16:52.715493 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3b198a00-3d69-4c54-926e-96e31fc2c0bb req-84fa35a2-ba87-4e10-a646-f9c02efe3ad3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073861 Jun 18 22:16:52.716807 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1816/3633] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:16:52.748667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:52.757360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fcceba6-2d20-4466-99bb-59a40b32667c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.317740 Jun 18 22:16:52.760151 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1818/3634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:52 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:52.887464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:52.888420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:52.905015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.905950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:52.907156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:52.907770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:53.125483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:53.135692 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-063020c9-5caf-4870-8123-af117fd5a253 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1623 microversion: 2.1 time: 0.253723 Jun 18 22:16:53.137323 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1817/3635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:52 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1623 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:53.455475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:53.456667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:53.488243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:53.489552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:53.495459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:53.496703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:53.522625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:53.524107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:53.540409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:53.541528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:53.542495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:53.543097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:53.679758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:53.680427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:53.681070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lazy-loading 'fault' on Instance uuid c6b079d6-51da-4783-b154-bf80e55865b1 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:16:54.020974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:54.072213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:54.080303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f21b927a5dc54a9d822b54984257b792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a2876fd37d44561940f36cc02783e7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:54.093542 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08c824a6-f660-4c6b-b53c-7f14b52a5ef9 tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 200 len: 1411 microversion: 2.54 time: 0.568643 Jun 18 22:16:54.095052 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1818/3636] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:53 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 1411 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:16:54.122094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:54.126073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:54.135795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:54.166437 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aae1916e-d9be-4584-9df7-667fabbae426 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814" status: 200 len: 1320 microversion: 2.1 time: 0.711757 Jun 18 22:16:54.184650 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1819/3637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:53 2022] GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 => generated 1320 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:54.194377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:54.206607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:54.230235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:54.241304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:54.252917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:54.257751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:54.295776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:54.304697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:54.310500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:54.312374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:54.441685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:54.447378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:54.448196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lazy-loading 'fault' on Instance uuid 0193f858-2c0f-43e6-a811-27bb75b7708f {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:16:54.675935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:54.685316 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ff157e1-de3d-4285-9ffd-7bd132e8224d tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 200 len: 1336 microversion: 2.1 time: 0.498570 Jun 18 22:16:54.696057 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1820/3638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:54 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 1336 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:54.906795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:54.918900 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41898a8b-e5e1-46b7-a38d-1cc75d1316e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.817425 Jun 18 22:16:54.933246 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1819/3639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:54 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:55.117603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:55.118222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] [instance: c6b079d6-51da-4783-b154-bf80e55865b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:55.127491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.137902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.139052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.139659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.172058 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] HTTP exception thrown: Instance c6b079d6-51da-4783-b154-bf80e55865b1 could not be found. Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Request method failure captured: Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 HTTP/1.1 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk6ttAww6Rw6i1cMnGWJyUJwEgBj4rqU77dtO6WhtuXJVXPrHf7yotcBRe-bIECzC_N7ZReeqdrPWje5azslec29fKln2RiF07-iiwA8ZJJQkk2F1picDssKbypRT8IMSpKEpUPsGArA2nhJMyD8Sve7WIpXpU27oNQesLNTj9IMsig Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.54 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7a2876fd37d44561940f36cc02783e7e Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerShowV254Test-1222860827 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7a2876fd37d44561940f36cc02783e7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a2876fd37d44561940f36cc02783e7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7a2876fd37d44561940f36cc02783e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7a2876fd37d44561940f36cc02783e7e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerShowV254Test-1222860827 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7a2876fd37d44561940f36cc02783e7e Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerShowV254Test-1222860827 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerShowV254Test-1222860827-project Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: f21b927a5dc54a9d822b54984257b792 Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerShowV254Test-1222860827-project Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance c6b079d6-51da-4783-b154-bf80e55865b1 could not be found. Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c6b079d6-51da-4783-b154-bf80e55865b1'} Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b079d6-51da-4783-b154-bf80e55865b1 could not be found. Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b079d6-51da-4783-b154-bf80e55865b1 could not be found. Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:55.180430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b079d6-51da-4783-b154-bf80e55865b1 could not be found. Jun 18 22:16:55.185947 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.187492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:55.187492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:55.189992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] Returning 404 to user: Instance c6b079d6-51da-4783-b154-bf80e55865b1 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:55.197585 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab55dfe5-f19e-4a80-9cc6-51cb6151c40e tempest-ServerShowV254Test-1222860827 tempest-ServerShowV254Test-1222860827-project] 10.222.0.30 "GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1" status: 404 len: 111 microversion: 2.54 time: 0.083896 Jun 18 22:16:55.200092 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1821/3640] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:55 2022] GET /compute/v2.1/servers/c6b079d6-51da-4783-b154-bf80e55865b1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:16:55.200825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.209463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.210455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.214161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.633963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:55.649541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c437e43d-c8f8-405d-84d0-f6ca6086463d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814" status: 200 len: 1320 microversion: 2.1 time: 0.468230 Jun 18 22:16:55.660293 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1820/3641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:55 2022] GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:55.704000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:55.704627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 0193f858-2c0f-43e6-a811-27bb75b7708f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:55.716081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.716337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.717166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.717609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.756774 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f could not be found. Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f HTTP/1.1 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f could not be found. Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0193f858-2c0f-43e6-a811-27bb75b7708f'} Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f could not be found. Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f could not be found. Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.758652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f could not be found. Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 404 to user: Instance 0193f858-2c0f-43e6-a811-27bb75b7708f could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5bb78d97-ada8-492e-9e36-d79ee972152c tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f" status: 404 len: 111 microversion: 2.1 time: 0.060810 Jun 18 22:16:55.764633 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1822/3642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:55 2022] GET /compute/v2.1/servers/0193f858-2c0f-43e6-a811-27bb75b7708f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:16:55.770617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-154a5804-1603-4504-8bc1-b17f3eb72b26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '.version_select at 0x7fea07668a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:55.804801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-154a5804-1603-4504-8bc1-b17f3eb72b26 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030554409" status: 202 len: 0 microversion: 2.1 time: 0.039534 Jun 18 22:16:55.807717 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1821/3643] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030554409 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:16:55.940510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:55.941195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:55.950261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.954980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:55.966228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:55.970969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:56.667087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:56.667719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:56.684416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:56.684893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:56.685774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:56.686215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:57.496005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:57.507894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da4577e1-3757-42e9-adb4-534f827ec70d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 1.571577 Jun 18 22:16:57.514417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1823/3644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:55 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:57.941574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:57.958512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92071f8b-c75c-4e24-b953-464b3c09c8fb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814" status: 200 len: 1509 microversion: 2.1 time: 1.295377 Jun 18 22:16:57.969137 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1822/3645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:56 2022] GET /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 => generated 1509 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:57.978153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:57.979254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:57.993883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:57.994393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:57.995366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:57.995967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.029293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:58.277877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7802af8b-cdd8-40df-9c5e-d621690c7e71 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "DELETE /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814" status: 204 len: 0 microversion: 2.1 time: 0.304491 Jun 18 22:16:58.279500 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1823/3646] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:57 2022] DELETE /compute/v2.1/servers/43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:16:58.299247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:58.300139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:58.322525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.322980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.328948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.329438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.447795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 04986286-8cad-465b-b4cf-f19a1055e97d] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:58.496097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:58.496766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:58.513197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.514551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.516120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.519250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.567865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:16:58.629881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:16:58.691275 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-59c319ea-be36-4f5e-85f8-ded756163eab tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d" status: 204 len: 0 microversion: 2.1 time: 0.406646 Jun 18 22:16:58.692173 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1824/3647] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:16:58 2022] DELETE /compute/v2.1/servers/04986286-8cad-465b-b4cf-f19a1055e97d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:16:58.703419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:58.704372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:58.720152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.720927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.722185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.722792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.916935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f31e30c9-8b39-4922-b0d3-4aea766fded7 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 204 len: 0 microversion: 2.42 time: 1.400744 Jun 18 22:16:58.917899 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1824/3648] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:16:57 2022] DELETE /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 0 bytes in 1403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:16:58.931587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:16:58.933307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:16:58.948844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.949506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:58.952087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:16:58.952799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:16:59.494048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:59.507163 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be5ca200-71e5-4730-bbd4-37a69cbd1391 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.811659 Jun 18 22:16:59.509118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1825/3649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:16:58 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:16:59.520726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2045287712", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6f884a5b-00a5-4f6a-8bba-891f7422f1ef"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:16:59.620643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] validate_networks() for [('6f884a5b-00a5-4f6a-8bba-891f7422f1ef', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:16:59.908484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:59.923237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:59.932043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:16:59.933454 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9027b5d5-1456-4a45-b533-cae04161d163 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2958 microversion: 2.42 time: 1.009649 Jun 18 22:16:59.934011 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1825/3650] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:16:58 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2958 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:00.625730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ac9357f3-c939-4f3e-bc79-d3e7b65aa0da req-a45bac7e-2356-49fb-a770-cf05fc5accc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbf8789-21b7-46a1-9b8f-be1e66d4546c", "name": "network-vif-plugged", "status": "completed", "tag": "b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:00.651226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ac9357f3-c939-4f3e-bc79-d3e7b65aa0da req-a45bac7e-2356-49fb-a770-cf05fc5accc9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:00.651955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ac9357f3-c939-4f3e-bc79-d3e7b65aa0da req-a45bac7e-2356-49fb-a770-cf05fc5accc9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:00.691373 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ac9357f3-c939-4f3e-bc79-d3e7b65aa0da req-a45bac7e-2356-49fb-a770-cf05fc5accc9 service nova] Creating event network-vif-plugged:b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa for instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c on nch1-master-1 Jun 18 22:17:00.710615 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ac9357f3-c939-4f3e-bc79-d3e7b65aa0da req-a45bac7e-2356-49fb-a770-cf05fc5accc9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.762877 Jun 18 22:17:00.712131 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1826/3651] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:00.726137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:00.729522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:00.737597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:00.738569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:00.741729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:00.742306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:01.589724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:01.601912 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dafb623c-eec9-4e96-91d5-8c54202c80b1 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 0.882480 Jun 18 22:17:01.602525 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1827/3652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:00 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:01.616666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:01.620377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:01.631240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:01.632206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:01.635853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:01.645087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.058210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:17:02.058738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:17:02.060547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:17:02.060982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:17:02.061425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:17:02.086134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:02.089528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.096470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:02.097628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.170221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Getting quotas for project 851177a639b248a0b4508112a9b6e6bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:17:02.187769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Getting quotas for user 4c071daa57f24e9fa1ae5d173a99d2ca and project 851177a639b248a0b4508112a9b6e6bf. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:17:02.227092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Going to run 2 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:17:02.234396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:17:02.293530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=8d8ead93-21d1-4ed2-8b54-d855890fe754,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:17:02.419588 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-84d28a1c-05d4-483b-a412-e63ffa39c51d tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.904136 Jun 18 22:17:02.421925 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1826/3653] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:16:59 2022] POST /compute/v2.1/servers => generated 32 bytes in 2907 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 18 22:17:02.429225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:02.433920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:02.436671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Searching by: {'deleted': False, 'project_id': '851177a639b248a0b4508112a9b6e6bf'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:17:02.483096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:02.484330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.488660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:02.489494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.527848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:17:02.567871 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d45b9c32-a852-40f4-81ff-fbc9eafe6d22 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.142143 Jun 18 22:17:02.569234 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1827/3654] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:17:02 2022] GET /compute/v2.1/servers => generated 1337 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:02.581855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3c8d28c-a6f3-4e04-8e34-5a41e4ce5ac0 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:02.584013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3c8d28c-a6f3-4e04-8e34-5a41e4ce5ac0 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:02.865278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3c8d28c-a6f3-4e04-8e34-5a41e4ce5ac0 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:02.883206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3c8d28c-a6f3-4e04-8e34-5a41e4ce5ac0 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1218 microversion: 2.1 time: 0.307373 Jun 18 22:17:02.883817 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1828/3655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:02 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1218 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:02.889901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:02.890963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:02.911985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:02.912542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.913493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:02.914000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:02.968847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:17:03.167157 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad8e818f-2a9f-46ee-96fc-e25b40bf4f7a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 204 len: 0 microversion: 2.1 time: 0.281553 Jun 18 22:17:03.169212 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1829/3656] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:17:02 2022] DELETE /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:17:03.185954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:03.187963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:03.202516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:03.202974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:03.203772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:03.204215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:03.451488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:03.475160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:03.476920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:03.478266 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-884c61e6-1f49-46b9-9106-6210d45d75b0 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2958 microversion: 2.42 time: 1.871473 Jun 18 22:17:03.478836 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1828/3657] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:01 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2958 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:03.487563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:03.488390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:03.496651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:03.497377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:03.498588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:03.499204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:04.088001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:04.100562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:04.109717 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab5b51d4-ddd2-4d74-8ee3-66ae7c2c4d9a tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1508 microversion: 2.1 time: 0.625479 Jun 18 22:17:04.110727 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1829/3658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:03 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:04.125678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:04.126300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:04.149957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:04.159089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:04.159546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:04.164070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:04.164758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:04.552798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:04.567321 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e8abf74-ba43-4315-a174-b07f583ef163 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1270 microversion: 2.1 time: 0.455221 Jun 18 22:17:04.579385 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1830/3659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:04 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1270 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:04.604639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c033b1b8-0b7f-442f-8de8-3d7661212508 req-a99f4419-beae-41cb-9c33-e5f469d7c0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04986286-8cad-465b-b4cf-f19a1055e97d", "name": "network-vif-deleted", "tag": "03124600-94fc-436b-bb14-3c4729f2fe53"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:04.652445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c033b1b8-0b7f-442f-8de8-3d7661212508 req-a99f4419-beae-41cb-9c33-e5f469d7c0b0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:04.652817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c033b1b8-0b7f-442f-8de8-3d7661212508 req-a99f4419-beae-41cb-9c33-e5f469d7c0b0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:04.716183 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c033b1b8-0b7f-442f-8de8-3d7661212508 req-a99f4419-beae-41cb-9c33-e5f469d7c0b0 service nova] Creating event network-vif-deleted:03124600-94fc-436b-bb14-3c4729f2fe53 for instance 04986286-8cad-465b-b4cf-f19a1055e97d on nch2-master-1 Jun 18 22:17:04.738208 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c033b1b8-0b7f-442f-8de8-3d7661212508 req-a99f4419-beae-41cb-9c33-e5f469d7c0b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153683 Jun 18 22:17:04.742080 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1831/3660] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:04.768388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:04.768388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:04.807367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:04.809392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:04.811590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:04.816190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:04.923173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:04.941723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8eea399c-85e8-404b-b9f2-e58e23503a53 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1324 microversion: 2.1 time: 1.762041 Jun 18 22:17:04.942611 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1830/3661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:03 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1324 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:05.128619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:05.130007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:05.156038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:05.159272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:05.164077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:05.165839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:06.236962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:06.248009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:06.263846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:06.275122 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c80bfb26-5a8b-4dd8-8df7-29175c566ae2 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2958 microversion: 2.42 time: 1.521684 Jun 18 22:17:06.276488 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1832/3662] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:04 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2958 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:06.320733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:06.322545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:06.344100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:06.347456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:06.356827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:06.358891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:06.646195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:06.687307 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-07b0f702-3f7a-4686-8d47-0735704ac975 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1508 microversion: 2.1 time: 1.563037 Jun 18 22:17:06.694574 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1831/3663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:05 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1508 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:06.714155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:06.717691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:06.744921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:06.749107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:06.750642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:06.752468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:06.773716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:06.804479 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-543d1eab-2f16-4c5d-ba6c-87566a24cdad tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1276 microversion: 2.1 time: 0.502262 Jun 18 22:17:06.831125 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1833/3664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:06 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1276 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:06.996785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-562b1865-ee89-4bc8-b8ac-d3f8b89d6790 req-2313f1d3-0892-47a6-9108-cd36c96a2f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ceb40b-8f70-4641-a1cb-b8ee8c6a5814", "name": "network-vif-deleted", "tag": "b9e5857f-f7b3-48a3-8e67-ffe607ad0985"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:07.009921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-562b1865-ee89-4bc8-b8ac-d3f8b89d6790 req-2313f1d3-0892-47a6-9108-cd36c96a2f46 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:07.012797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-562b1865-ee89-4bc8-b8ac-d3f8b89d6790 req-2313f1d3-0892-47a6-9108-cd36c96a2f46 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:07.069280 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-562b1865-ee89-4bc8-b8ac-d3f8b89d6790 req-2313f1d3-0892-47a6-9108-cd36c96a2f46 service nova] Creating event network-vif-deleted:b9e5857f-f7b3-48a3-8e67-ffe607ad0985 for instance 43ceb40b-8f70-4641-a1cb-b8ee8c6a5814 on nch1-master-1 Jun 18 22:17:07.090469 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-562b1865-ee89-4bc8-b8ac-d3f8b89d6790 req-2313f1d3-0892-47a6-9108-cd36c96a2f46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104078 Jun 18 22:17:07.097463 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1834/3665] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 18 22:17:07.297172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:07.297856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:07.332740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:07.335142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:07.336022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:07.341761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.144431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:08.159322 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1312b03f-386d-4f00-9969-c8c58dae88f2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 1.460799 Jun 18 22:17:08.163533 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1832/3666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:06 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:08.173278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:08.177182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:08.204705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.206611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.222452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.225672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.408129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:08.421330 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a108b35e-523f-4d31-bdf9-93ee1e379296 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 200 len: 1466 microversion: 2.1 time: 0.251484 Jun 18 22:17:08.432917 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1833/3667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:08 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 1466 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:08.449962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:08.451461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:08.465319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.470140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.471027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.471472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.494648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:08.513654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:08.517664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:08.521694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39965ccb-06df-4e25-847a-a8781f75d888 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2958 microversion: 2.42 time: 1.229578 Jun 18 22:17:08.527364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1835/3668] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:07 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2958 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:17:08.545619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-fe9b88a2-d737-460f-af07-42e948da7953 req-6358d146-fb2a-4329-9e75-c2cc6c0d785b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-unplugged", "status": "completed", "tag": "f9640cbc-f56e-4a87-9083-cba5d2310a57"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:08.584306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fe9b88a2-d737-460f-af07-42e948da7953 req-6358d146-fb2a-4329-9e75-c2cc6c0d785b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.585085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fe9b88a2-d737-460f-af07-42e948da7953 req-6358d146-fb2a-4329-9e75-c2cc6c0d785b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.606160 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-fe9b88a2-d737-460f-af07-42e948da7953 req-6358d146-fb2a-4329-9e75-c2cc6c0d785b service nova] Creating event network-vif-unplugged:f9640cbc-f56e-4a87-9083-cba5d2310a57 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:08.629652 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-fe9b88a2-d737-460f-af07-42e948da7953 req-6358d146-fb2a-4329-9e75-c2cc6c0d785b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100082 Jun 18 22:17:08.630691 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1836/3669] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:08.642974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:08.644122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:08.661736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.662562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.663966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:08.666315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:08.690667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:08.707773 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a9fac62-866c-48be-869e-50379cc2ec21 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1276 microversion: 2.1 time: 0.271954 Jun 18 22:17:08.709276 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1834/3670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:08 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:09.331214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:09.351649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:09.352273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:09.359892 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d8e0845f-c845-4a4b-b6ed-07ed3114d7ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.727585 Jun 18 22:17:09.362648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:09.363544 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1837/3671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:08 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:09.365503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:09.369826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:09.370866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:09.373999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:09.380620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79e181e5-34ae-4a8c-a3fc-2c8bf2ae0b57 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1599874033", "metadata": {"": ""}}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79e181e5-34ae-4a8c-a3fc-2c8bf2ae0b57 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action HTTP/1.1 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 107 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1599874033", "metadata": {"": ""}}} Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1599874033', 'metadata': {'': ''}}}} Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'': ''} Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:17:09.384817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:09.390848 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:09.401801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79e181e5-34ae-4a8c-a3fc-2c8bf2ae0b57 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:09.405631 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79e181e5-34ae-4a8c-a3fc-2c8bf2ae0b57 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action" status: 400 len: 170 microversion: 2.1 time: 0.027077 Jun 18 22:17:09.407174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1838/3672] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Jun 18 22:17:09 2022] POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action => generated 170 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:17:09.416975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:09.430837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:09.461310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:09.464131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:09.472461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:09.473481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.246028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:10.260133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:10.266121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0795f910-061c-4f00-8ac9-8825042a414d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.854000 Jun 18 22:17:10.266968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1839/3673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:09 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:10.283852 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-54a35aee-e7ea-4376-82db-df5a5c733b45 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.936498 Jun 18 22:17:10.297088 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1835/3674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:09 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:10.304627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:10.305573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: 74506814-2e86-4ead-b8f8-f5713285226f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:10.307059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:10.309689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:10.319622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.320726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.324522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.324856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.326083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.326486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.330228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.330679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.346321 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Instance 74506814-2e86-4ead-b8f8-f5713285226f could not be found. Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f HTTP/1.1 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74506814-2e86-4ead-b8f8-f5713285226f could not be found. Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74506814-2e86-4ead-b8f8-f5713285226f'} Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74506814-2e86-4ead-b8f8-f5713285226f could not be found. Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74506814-2e86-4ead-b8f8-f5713285226f could not be found. Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:10.359463 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74506814-2e86-4ead-b8f8-f5713285226f could not be found. Jun 18 22:17:10.364711 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:10.367963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 404 to user: Instance 74506814-2e86-4ead-b8f8-f5713285226f could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:10.375696 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7feccd8f-c968-45cc-970c-210614a4ad8e tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f" status: 404 len: 111 microversion: 2.1 time: 0.107637 Jun 18 22:17:10.376650 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1840/3675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:10 2022] GET /compute/v2.1/servers/74506814-2e86-4ead-b8f8-f5713285226f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:17:10.388018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-83aa3684-6242-4b50-99a5-b072f08de07c req-cea8fbc1-5498-4c6a-a337-3533bf55eb92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74506814-2e86-4ead-b8f8-f5713285226f", "name": "network-vif-deleted", "tag": "a680c731-229e-4690-a78d-4c886894a41d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:10.418228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-83aa3684-6242-4b50-99a5-b072f08de07c req-cea8fbc1-5498-4c6a-a337-3533bf55eb92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.418933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-83aa3684-6242-4b50-99a5-b072f08de07c req-cea8fbc1-5498-4c6a-a337-3533bf55eb92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.431028 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-83aa3684-6242-4b50-99a5-b072f08de07c req-cea8fbc1-5498-4c6a-a337-3533bf55eb92 service nova] Creating event network-vif-deleted:a680c731-229e-4690-a78d-4c886894a41d for instance 74506814-2e86-4ead-b8f8-f5713285226f on nch1-master-1 Jun 18 22:17:10.438031 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-83aa3684-6242-4b50-99a5-b072f08de07c req-cea8fbc1-5498-4c6a-a337-3533bf55eb92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056439 Jun 18 22:17:10.439212 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1841/3676] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:10.444647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:10.445763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:10.453155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.453864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.454816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.455412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.885647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:10.903962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:10.906843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:10.909880 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2799d0d0-9b2d-43ff-a30e-d0ff63a3902d tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2937 microversion: 2.42 time: 0.611320 Jun 18 22:17:10.913273 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1836/3677] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:10 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2937 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:10.919468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:10.920539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:10.931543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.933412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:10.938574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:10.939418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.045708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:11.056255 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e81bac44-ae38-439e-8bd5-de92760f7064 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 0.615496 Jun 18 22:17:11.057238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1842/3678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:10 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:11.071703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1831221863"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:11.073239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:11.083025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.083682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.084774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.085455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.484447 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c4449aee-473f-4dd6-b920-f46cf730a7e3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.416654 Jun 18 22:17:11.490054 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1843/3679] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:17:11 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 18 22:17:11.497565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:11.498853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:11.510060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.511390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.512801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.513802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.554427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:17:11.797703 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9fa0312a-7661-46d4-b966-9e2d1c946852 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 204 len: 0 microversion: 2.1 time: 0.305550 Jun 18 22:17:11.798530 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1844/3680] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:17:11 2022] DELETE /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:17:11.821454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7ca9bf1f-20c6-4f3a-96c7-490be6e6a8a6 req-561ad300-9b73-4368-975e-9a04b45f369c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-unplugged", "status": "completed", "tag": "56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6f5ea1-9aec-43dd-9351-058a6528ebba"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:11.850025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7ca9bf1f-20c6-4f3a-96c7-490be6e6a8a6 req-561ad300-9b73-4368-975e-9a04b45f369c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.861056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:11.868857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7ca9bf1f-20c6-4f3a-96c7-490be6e6a8a6 req-561ad300-9b73-4368-975e-9a04b45f369c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.876848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b33f5ab-80f9-4fde-ab03-ac3630e982ad tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.962076 Jun 18 22:17:11.880648 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1837/3681] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:10 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:11.890158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:11.896071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:11.900073 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7ca9bf1f-20c6-4f3a-96c7-490be6e6a8a6 req-561ad300-9b73-4368-975e-9a04b45f369c service nova] Creating event network-vif-unplugged:56fd41d6-4ad9-40cc-b9bf-1e5d2e65a507 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:11.901281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7ca9bf1f-20c6-4f3a-96c7-490be6e6a8a6 req-561ad300-9b73-4368-975e-9a04b45f369c service nova] Creating event network-vif-unplugged:6f6f5ea1-9aec-43dd-9351-058a6528ebba for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:11.912739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.914753 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7ca9bf1f-20c6-4f3a-96c7-490be6e6a8a6 req-561ad300-9b73-4368-975e-9a04b45f369c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.108392 Jun 18 22:17:11.915442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.916480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.918607 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1845/3682] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:11.919249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.932641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:11.936504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:11.955988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.956452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:11.957297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:11.962149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:12.359661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:12.371771 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c652fdb6-be85-4fcf-92c5-fa160560039b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.487596 Jun 18 22:17:12.374549 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1838/3683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:11 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:12.384218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0db08a83-16d5-4c8a-88ec-491cb95198c5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-669389139", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0db08a83-16d5-4c8a-88ec-491cb95198c5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action HTTP/1.1 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 618 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-669389139", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-669389139', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:17:12.394763 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:17:12.397916 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:12.405876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0db08a83-16d5-4c8a-88ec-491cb95198c5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:12.409455 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0db08a83-16d5-4c8a-88ec-491cb95198c5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action" status: 400 len: 938 microversion: 2.1 time: 0.032917 Jun 18 22:17:12.410657 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1839/3684] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Jun 18 22:17:12 2022] POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action => generated 938 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:17:12.419349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:12.420390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:12.431447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:12.432556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:12.433656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:12.434428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:12.499705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:12.740799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:12.755511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3708b93b-4eee-4393-ab31-a5ae280b4875 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.833083 Jun 18 22:17:12.757627 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1846/3685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:11 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:12.769990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:12.770615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:12.788736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:12.789225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:12.790017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:12.790458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:12.869864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:13.139978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:13.145880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:13.173943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:13.175499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:13.176782 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97d6dc9b-4626-4373-8255-e2bc54936c63 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2916 microversion: 2.42 time: 0.764978 Jun 18 22:17:13.189143 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1840/3686] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:12 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2916 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:13.200079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:13.204133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:13.219623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.227762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.228925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.229425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.475201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:13.484874 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca76f51d-7913-4980-8775-eb3364aed5bd tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 0.723338 Jun 18 22:17:13.500368 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1847/3687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:12 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:13.514508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7715ea00-6444-4cac-acfb-a795c00fe70c req-bc473720-20b9-48f3-9981-3e5d061b56cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d8ead93-21d1-4ed2-8b54-d855890fe754", "tag": "3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:13.544031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7715ea00-6444-4cac-acfb-a795c00fe70c req-bc473720-20b9-48f3-9981-3e5d061b56cb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.544477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7715ea00-6444-4cac-acfb-a795c00fe70c req-bc473720-20b9-48f3-9981-3e5d061b56cb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.574738 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7715ea00-6444-4cac-acfb-a795c00fe70c req-bc473720-20b9-48f3-9981-3e5d061b56cb service nova] Creating event network-changed:3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7 for instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 on nch2-master-1 Jun 18 22:17:13.586526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7715ea00-6444-4cac-acfb-a795c00fe70c req-bc473720-20b9-48f3-9981-3e5d061b56cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075774 Jun 18 22:17:13.587152 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1848/3688] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:13.593637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:13.594339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:13.612169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.612624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.613430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.618560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.623421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:13.866446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:13.877997 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5d8f3010-5a12-4c0a-9ac7-bbeb1d267653 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.687291 Jun 18 22:17:13.880416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1841/3689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:13 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:13.893146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:13.893795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:13.908961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:13.925633 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc5c7c6a-3a2e-452b-9fd7-f39521b78beb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.332706 Jun 18 22:17:13.926444 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1849/3690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:13 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:13.934611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.939799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.941967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:13.942418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.943164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:13.943976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.959364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.960151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:13.961251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:13.963003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:14.502184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:14.513318 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca3c6b70-0a36-4f7a-aaa1-5fb059946de4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.582149 Jun 18 22:17:14.526680 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1850/3691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:13 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:14.531899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-unplugged", "status": "completed", "tag": "e82aea74-0ff1-4853-b959-c6713a07c673"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-unplugged", "status": "completed", "tag": "6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-unplugged", "status": "completed", "tag": "a3aec98b-5ee4-4848-9035-2ba72eaa628a"}, {"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-unplugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:14.542075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:14.542857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:14.553425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:14.560326 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Creating event network-vif-unplugged:e82aea74-0ff1-4853-b959-c6713a07c673 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:14.561262 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Creating event network-vif-unplugged:6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:14.563306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Creating event network-vif-unplugged:a3aec98b-5ee4-4848-9035-2ba72eaa628a for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:14.564280 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] Creating event network-vif-unplugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:17:14.574696 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7730f155-f5d5-472a-8acb-2d881a6a1bc8 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.692893 Jun 18 22:17:14.575893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1842/3692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:13 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:14.581597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:14.585489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:14.588163 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-98ad89df-09a1-4d44-bfbf-ee8719b2d93b req-7f533d77-1375-4eec-9c94-0d4e0dfe97ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.059678 Jun 18 22:17:14.589147 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1851/3693] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:14.605967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:14.611595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:14.612218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:14.612824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:14.613257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:14.613984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:14.630777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:14.634105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:14.635756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:14.637565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:15.567394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:15.573945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:15.591318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:15.592865 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2981f10-460b-499c-9047-4e06f63d4158 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 0.992337 Jun 18 22:17:15.604733 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1852/3694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:14 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:15.610310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:15.613638 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22eb909e-e763-4125-a37e-a7de693bc1bc tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2870 microversion: 2.42 time: 1.035756 Jun 18 22:17:15.614333 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1843/3695] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:14 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2870 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:15.615480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2af06e15-5b3d-48e1-9df7-983645c780d5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2af06e15-5b3d-48e1-9df7-983645c780d5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action HTTP/1.1 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 285 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.620579 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:17:15.625009 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:15.639257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2af06e15-5b3d-48e1-9df7-983645c780d5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:15.640253 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2af06e15-5b3d-48e1-9df7-983645c780d5 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action" status: 400 len: 619 microversion: 2.1 time: 0.033819 Jun 18 22:17:15.641312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-621a2876-e8a9-4c90-92b3-978cbcdf8cd8 req-5a8aa96c-8fe9-4104-bfe4-7e6aaa7301f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88b2790-a5fa-4836-a254-c6ee7f19ab61", "tag": "778f525b-c23e-4863-a019-441fd9ed7ba6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:15.644580 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1853/3696] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Jun 18 22:17:15 2022] POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:17:15.653292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:15.656888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:15.663942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-621a2876-e8a9-4c90-92b3-978cbcdf8cd8 req-5a8aa96c-8fe9-4104-bfe4-7e6aaa7301f6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:15.664514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-621a2876-e8a9-4c90-92b3-978cbcdf8cd8 req-5a8aa96c-8fe9-4104-bfe4-7e6aaa7301f6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:15.674461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:15.677572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:15.678508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:15.681387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:15.682595 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-621a2876-e8a9-4c90-92b3-978cbcdf8cd8 req-5a8aa96c-8fe9-4104-bfe4-7e6aaa7301f6 service nova] Creating event network-changed:778f525b-c23e-4863-a019-441fd9ed7ba6 for instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 on nch2-master-1 Jun 18 22:17:15.687959 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-621a2876-e8a9-4c90-92b3-978cbcdf8cd8 req-5a8aa96c-8fe9-4104-bfe4-7e6aaa7301f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070657 Jun 18 22:17:15.688955 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1844/3697] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:15.694534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:15.695571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:15.703314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:15.704116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:15.705158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:15.705820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:16.533775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:16.550599 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b9b33e1-7d07-4362-a627-98606e45366d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1684 microversion: 2.1 time: 0.901574 Jun 18 22:17:16.551495 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1854/3698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:15 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1684 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:16.556300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:16.561023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:16.585832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:16.586623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:16.587071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:16.587509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:16.654846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:16.663705 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50e86422-554f-41ac-80a0-95027d0c9c06 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1522 microversion: 2.1 time: 0.973251 Jun 18 22:17:16.664360 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1845/3699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:15 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1522 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:16.688247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:16.688893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:16.702386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:16.702843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:16.703644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:16.704082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.086834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:17.087751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:17.096217 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0018eb85-c2c5-4bc4-b99a-b914a5aae449 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 0.430839 Jun 18 22:17:17.097145 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28eb9575-f479-4134-84c1-8312d6e00275 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.544413 Jun 18 22:17:17.097680 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1846/3700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:16 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:17.103503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:17.104613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:17.111569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.112413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.113464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.114131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.126153 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1855/3701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:16 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:17.134942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:17.135550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:17.142836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.143295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.144070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.144707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.627038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:17.643200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:17.650904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:17.657645 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e97deb73-818e-433c-b47d-65c01107ca52 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2870 microversion: 2.42 time: 0.558549 Jun 18 22:17:17.661233 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1847/3702] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:17 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2870 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:17.673449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:17.682827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f4f438c0-cdc7-476c-8b44-d29906bc51d0 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.550354 Jun 18 22:17:17.683621 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1856/3703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:17 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:17.688146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:17.690356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:17.698425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:17.703227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:17.722041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.724691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.725748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.728560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.735781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.737080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:17.740366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:17.741805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:18.228287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fa96c0dcf948d185e7d5fdcf280fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a765e6391f4d36bd54b8119d4c84eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:18.240428 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6793a071-f797-4fc0-bc58-46d779b14635 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 200 len: 1480 microversion: 2.1 time: 0.555661 Jun 18 22:17:18.241478 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1857/3704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:17 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 1480 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:18.255425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-352280635"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:18.260992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:18.279041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:18.280045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:18.281072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:18.282138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:18.485922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:18.518160 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d87acbc1-bd79-42e2-acfb-bfde71c40069 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1684 microversion: 2.1 time: 0.855663 Jun 18 22:17:18.523098 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1848/3705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:17 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1684 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:18.535261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-deleted", "tag": "a3aec98b-5ee4-4848-9035-2ba72eaa628a"}, {"server_uuid": "c421b265-a2ca-42cf-8eed-603f694967a1", "name": "network-vif-deleted", "tag": "c6489495-ef26-4bfc-9180-23df81823434"}, {"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-deleted", "tag": "f9640cbc-f56e-4a87-9083-cba5d2310a57"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:18.567227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:18.567910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:18.599973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] Creating event network-vif-deleted:a3aec98b-5ee4-4848-9035-2ba72eaa628a for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:18.600489 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] Creating event network-vif-deleted:c6489495-ef26-4bfc-9180-23df81823434 for instance c421b265-a2ca-42cf-8eed-603f694967a1 on nch2-master-1 Jun 18 22:17:18.601155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] Creating event network-vif-deleted:f9640cbc-f56e-4a87-9083-cba5d2310a57 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:18.642004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ef8ae45f-51a9-4220-901f-bc314bcb6fee req-7ac11cad-9552-4ca1-bfe8-ca0d4471d09b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.117556 Jun 18 22:17:18.643159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1849/3706] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:18.649318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:18.650196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:18.659360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:18.660727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:18.661755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:18.662460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.107822 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28182fa5-3e84-4321-a25f-76d5bc6b5506 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action" status: 202 len: 0 microversion: 2.1 time: 0.862446 Jun 18 22:17:19.108770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1858/3707] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:17:18 2022] POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action => generated 0 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:17:19.128179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:19.151122 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b437eff-0100-4614-9ce4-5d5cdeb2cc12 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 0.503463 Jun 18 22:17:19.151673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:19.152321 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1850/3708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:18 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:19.155559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:19.181235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.182944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.184395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.185055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.186924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1130291642"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:19.207079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:19.232668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.234112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.242296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.243016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.353463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Cannot 'createImage' instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c while it is in task_state image_snapshot_pending Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action HTTP/1.1 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 85 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1130291642"}} Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'createImage' instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c while it is in task_state image_snapshot_pending Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1130291642'}}} Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:17:19.356148 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c while it is in task_state image_snapshot_pending Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c while it is in task_state image_snapshot_pending Jun 18 22:17:19.361527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.364107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 409 to user: Cannot 'createImage' instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c while it is in task_state image_snapshot_pending {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:19.365256 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dca2009b-6433-47d8-8e9c-0b456225559d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action" status: 409 len: 167 microversion: 2.1 time: 0.184527 Jun 18 22:17:19.366643 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1851/3709] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:17:19 2022] POST /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c/action => generated 167 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:17:19.389084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:19.391681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] [instance: c421b265-a2ca-42cf-8eed-603f694967a1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:19.419996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.420675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.421729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.422531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.455977 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] HTTP exception thrown: Instance c421b265-a2ca-42cf-8eed-603f694967a1 could not be found. Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Request method failure captured: Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 HTTP/1.1 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2M3gH29rjrQvutbF_wugvzzM9qYFHA6TjKj_D6IUq772s6gcugIokP2sJZl3Or37SuQ1qwGyxeLTxy_xK6bladHN3C8xsPzjklWjddV5en6GPem9LFVOHUqxyTEB4eA3PsjRiTkP6SPGEklCe4azXUSmtnntssxkDa_YvQx6yqp0k Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9a765e6391f4d36bd54b8119d4c84eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9a765e6391f4d36bd54b8119d4c84eb", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a9a765e6391f4d36bd54b8119d4c84eb Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1217932637 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 65fa96c0dcf948d185e7d5fdcf280fa4 Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1217932637-project Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance c421b265-a2ca-42cf-8eed-603f694967a1 could not be found. Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'c421b265-a2ca-42cf-8eed-603f694967a1'} Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c421b265-a2ca-42cf-8eed-603f694967a1 could not be found. Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c421b265-a2ca-42cf-8eed-603f694967a1 could not be found. Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.457818 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c421b265-a2ca-42cf-8eed-603f694967a1 could not be found. Jun 18 22:17:19.463302 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:19.480524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] Returning 404 to user: Instance c421b265-a2ca-42cf-8eed-603f694967a1 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:19.481938 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c31c904-03df-47cb-8a69-2f05fd4584a6 tempest-ServerRescueNegativeTestJSON-1217932637 tempest-ServerRescueNegativeTestJSON-1217932637-project] 10.222.0.30 "GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1" status: 404 len: 111 microversion: 2.1 time: 0.113047 Jun 18 22:17:19.486689 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1852/3710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:19 2022] GET /compute/v2.1/servers/c421b265-a2ca-42cf-8eed-603f694967a1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:17:19.504386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b07f4e8c-c6ce-423d-969d-cf484e70b316 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '.version_select at 0x7fea076681f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:19.626067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:19.653593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:19.663490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:19.664830 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-84357991-d649-4c37-a181-aebb5d40fe74 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2507 microversion: 2.42 time: 0.555015 Jun 18 22:17:19.674364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1859/3711] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:19 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:19.692732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:19.698913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:19.717313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.719435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.720694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.723304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.895835 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b07f4e8c-c6ce-423d-969d-cf484e70b316 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/images/4f0bb6f1-512a-4185-9b46-169a22e8770f" status: 204 len: 0 microversion: 2.1 time: 0.404496 Jun 18 22:17:19.896412 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1853/3712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:19 2022] DELETE /compute/v2.1/images/4f0bb6f1-512a-4185-9b46-169a22e8770f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:17:19.904427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:19.905327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:19.922466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.923427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:19.925890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:19.927327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:20.342551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:20.356725 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-42f3d4b3-a7e2-4a8e-a9b3-756b650e5a01 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1684 microversion: 2.1 time: 0.678457 Jun 18 22:17:20.360148 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1860/3713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:19 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1684 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:20.373959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d5dc1701-95aa-49dd-a541-ff3b18abbe52 req-967b64da-cb70-4f93-95f6-6531e7dc3d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-plugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:20.402992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d5dc1701-95aa-49dd-a541-ff3b18abbe52 req-967b64da-cb70-4f93-95f6-6531e7dc3d8e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:20.404702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d5dc1701-95aa-49dd-a541-ff3b18abbe52 req-967b64da-cb70-4f93-95f6-6531e7dc3d8e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:20.440425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d5dc1701-95aa-49dd-a541-ff3b18abbe52 req-967b64da-cb70-4f93-95f6-6531e7dc3d8e service nova] Creating event network-vif-plugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:17:20.453531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d5dc1701-95aa-49dd-a541-ff3b18abbe52 req-967b64da-cb70-4f93-95f6-6531e7dc3d8e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091442 Jun 18 22:17:20.457604 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1861/3714] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:20.469780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:20.471197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:20.502568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:20.505487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:20.509921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:20.510400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:20.899097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:20.912431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-49a9607d-ec5c-465f-9a6c-321b66acd3ce tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1533 microversion: 2.1 time: 1.011445 Jun 18 22:17:20.914529 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1854/3715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:19 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1533 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:20.925298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:20.926706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:20.943019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:20.945617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:20.951732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:20.952532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:21.318246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:21.330204 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95b6626a-d860-432a-818d-652317ec45eb tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 0.870714 Jun 18 22:17:21.332567 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1862/3716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:20 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:21.340400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-32f1ebf7-cb99-484a-940d-dfd669e45b73 req-37a73172-8e1d-4364-88e3-87adabf39569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-deleted", "tag": "6f6f5ea1-9aec-43dd-9351-058a6528ebba"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:21.353151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-32f1ebf7-cb99-484a-940d-dfd669e45b73 req-37a73172-8e1d-4364-88e3-87adabf39569 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:21.354846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-32f1ebf7-cb99-484a-940d-dfd669e45b73 req-37a73172-8e1d-4364-88e3-87adabf39569 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:21.368427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-32f1ebf7-cb99-484a-940d-dfd669e45b73 req-37a73172-8e1d-4364-88e3-87adabf39569 service nova] Creating event network-vif-deleted:6f6f5ea1-9aec-43dd-9351-058a6528ebba for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:21.382875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-32f1ebf7-cb99-484a-940d-dfd669e45b73 req-37a73172-8e1d-4364-88e3-87adabf39569 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047969 Jun 18 22:17:21.383484 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1863/3717] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:21.389066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:21.390132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:21.413133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:21.413862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:21.415035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:21.416942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:22.271036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:22.287632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:22.292818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:22.297853 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39d78f93-fbb0-4711-b82d-ac997874e9a6 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2507 microversion: 2.42 time: 1.382068 Jun 18 22:17:22.305861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1855/3718] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:20 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2507 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:22.322965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:22.323608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:22.352113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:22.352568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:22.353396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:22.353904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:23.237181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:23.255428 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5329a969-c73a-44f3-9c96-5a108bcda109 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1533 microversion: 2.1 time: 0.942517 Jun 18 22:17:23.259062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1856/3719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:22 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1533 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:23.265138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:23.266084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:23.273376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:23.274545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:23.275535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:23.276492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:23.375906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:23.396132 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca633fda-25a3-4094-8a72-9755d178f78a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 2.010943 Jun 18 22:17:23.398767 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1864/3720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:21 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:23.403491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-89e53ab2-fbc7-4dfa-9071-d29ecbd2ea39 req-8e4f5da2-398e-46aa-976d-16857a3c94f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88b2790-a5fa-4836-a254-c6ee7f19ab61", "name": "network-vif-plugged", "status": "completed", "tag": "778f525b-c23e-4863-a019-441fd9ed7ba6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:23.438213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-89e53ab2-fbc7-4dfa-9071-d29ecbd2ea39 req-8e4f5da2-398e-46aa-976d-16857a3c94f6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:23.439547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-89e53ab2-fbc7-4dfa-9071-d29ecbd2ea39 req-8e4f5da2-398e-46aa-976d-16857a3c94f6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:23.471664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-89e53ab2-fbc7-4dfa-9071-d29ecbd2ea39 req-8e4f5da2-398e-46aa-976d-16857a3c94f6 service nova] Creating event network-vif-plugged:778f525b-c23e-4863-a019-441fd9ed7ba6 for instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 on nch2-master-1 Jun 18 22:17:23.486250 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-89e53ab2-fbc7-4dfa-9071-d29ecbd2ea39 req-8e4f5da2-398e-46aa-976d-16857a3c94f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085959 Jun 18 22:17:23.495450 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1865/3721] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:23.505162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:23.506594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:23.544204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:23.546628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:23.557505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:23.558350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:24.389467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:24.411119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f8150ef-8801-4386-9a9e-a9477a5ca810 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1318 microversion: 2.1 time: 1.150343 Jun 18 22:17:24.412378 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1857/3722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:23 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1318 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:24.645840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:24.658334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:24.662233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:24.666834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff4a29d2-0b52-4593-a7ca-b7acb325f3c5 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 2347 microversion: 2.42 time: 1.168350 Jun 18 22:17:24.668908 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1866/3723] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:23 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 2347 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:24.683037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:24.684236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:24.692845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2737bbcc-af15-4168-ba5b-856c6d39851c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: .version_select at 0x7fea076228b0>, body: {"keypair": {"name": "tempest-keypair-366293565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFq8JyauhBo8ww3YEb0CMLiLWGRbe9m9Iho9t3baaCfwaAeWQNa4CshdEyJ7G2M1tYmyy2Fjrm7BXNzmXjueQ18pyMfVgZsiJLKc5Zr5WeNljLTz82H/NIJda9nCv9JUw=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:24.696222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:24.696715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:24.698377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:24.698828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:24.759916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2737bbcc-af15-4168-ba5b-856c6d39851c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:17:24.782743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2737bbcc-af15-4168-ba5b-856c6d39851c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:17:24.843702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2737bbcc-af15-4168-ba5b-856c6d39851c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.429968 Jun 18 22:17:24.845889 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1858/3724] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:17:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:24.855047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:24.855696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:24.870223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:24.871074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:24.872070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:24.874827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:25.801526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:25.812255 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1418737-4bda-43eb-882e-3ee101dd1176 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1539 microversion: 2.1 time: 1.141874 Jun 18 22:17:25.812850 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1867/3725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:24 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1539 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:25.817387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c83340a7-cb7d-46f4-8e25-6b85f4526808 req-35a1401f-6329-4c7c-aa64-f15bda06400b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-deleted", "tag": "e82aea74-0ff1-4853-b959-c6713a07c673"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:25.855667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c83340a7-cb7d-46f4-8e25-6b85f4526808 req-35a1401f-6329-4c7c-aa64-f15bda06400b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:25.855822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c83340a7-cb7d-46f4-8e25-6b85f4526808 req-35a1401f-6329-4c7c-aa64-f15bda06400b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:25.868660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:25.880610 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c83340a7-cb7d-46f4-8e25-6b85f4526808 req-35a1401f-6329-4c7c-aa64-f15bda06400b service nova] Creating event network-vif-deleted:e82aea74-0ff1-4853-b959-c6713a07c673 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:25.912730 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c83340a7-cb7d-46f4-8e25-6b85f4526808 req-35a1401f-6329-4c7c-aa64-f15bda06400b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095825 Jun 18 22:17:25.914656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1868/3726] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:25.937138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:25.944595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:25.982330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:25.984823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:25.986772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:25.992265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:26.027318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:26.060974 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc2d20c2-e7ea-43d8-b0ca-f6c7c1bb13fd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 1.213798 Jun 18 22:17:26.102045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1859/3727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:24 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:26.133417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2e611758-1daa-49a9-a5e3-d1ec7fe499b7 req-7048f64a-94c8-4bab-bdab-0f6593956c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d8ead93-21d1-4ed2-8b54-d855890fe754", "name": "network-vif-plugged", "status": "completed", "tag": "3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:26.172085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2e611758-1daa-49a9-a5e3-d1ec7fe499b7 req-7048f64a-94c8-4bab-bdab-0f6593956c07 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:26.176026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2e611758-1daa-49a9-a5e3-d1ec7fe499b7 req-7048f64a-94c8-4bab-bdab-0f6593956c07 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:26.211832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2e611758-1daa-49a9-a5e3-d1ec7fe499b7 req-7048f64a-94c8-4bab-bdab-0f6593956c07 service nova] Creating event network-vif-plugged:3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7 for instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 on nch2-master-1 Jun 18 22:17:26.263179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2e611758-1daa-49a9-a5e3-d1ec7fe499b7 req-7048f64a-94c8-4bab-bdab-0f6593956c07 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124060 Jun 18 22:17:26.267425 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1860/3728] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:26.286167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:26.293004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:26.344237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:26.344717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:26.346988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:26.349571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:26.830599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:26.842936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:26.859103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8eb1a760d644f97bf3aae882e905b85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ddaa6fbcdf4368a8e9be0d07596178', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:26.865614 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b39cc98-66ad-4e40-a64e-c955f8009644 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 200 len: 1603 microversion: 2.42 time: 0.594641 Jun 18 22:17:26.874056 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1861/3729] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:26 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 1603 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:17:26.880032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:26.886924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:26.909354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:26.917655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:26.919310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:26.921298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:27.017533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:27.526627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:27.552329 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6db9c0c1-559b-4f5d-80d4-6536a0a6e65e tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 200 len: 1507 microversion: 2.1 time: 1.635664 Jun 18 22:17:27.557541 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1869/3730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:25 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 1507 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:27.589713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:27.589713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:27.610397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:27.617502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:27.620997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:27.623021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:27.895063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:27.908048 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b954708-6632-4902-8ae7-ee91642978e9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1539 microversion: 2.1 time: 1.029323 Jun 18 22:17:27.908048 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1862/3731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:26 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1539 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:27.956573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:27.970315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:27.997825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:27.998281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:27.999089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:27.999473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:28.704214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:28.723884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73ca6df8-b566-4983-972f-fc884cd0cf15 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 200 len: 1507 microversion: 2.1 time: 0.814845 Jun 18 22:17:28.737683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1863/3732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:27 2022] GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 1507 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:28.771769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:28.774489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:28.799571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:28.804144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:28.811677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:28.815142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:28.863244 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] HTTP exception thrown: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Request method failure captured: Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce HTTP/1.1 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2MvCn_k-djcPIxE_WZJAWKU92pFWR9tCU1kuB3FNBtewqdNFtSno6cRRU_vI2Wc2KIXjJ7sVw8iWvjiwjq4oQxlc1VmSDyMEuAP83dch5cep0vkEf0SIEpMeYfta7mCRbRVa4WFUcb2-DUiYs88NPlmiHoZm6yDe6RCVgmO_60t_Y Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.42 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b8ddaa6fbcdf4368a8e9be0d07596178 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b8ddaa6fbcdf4368a8e9be0d07596178", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b8ddaa6fbcdf4368a8e9be0d07596178 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TaggedBootDevicesTest_v242-1622454662-project Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a8eb1a760d644f97bf3aae882e905b85 Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1622454662-project Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8219ff51-bcac-4dbf-a23d-7a8433e154ce'} Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:28.871067 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:28.876547 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:28.883300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Returning 404 to user: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:28.884892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bfcdd3f4-5796-4e0a-b9d0-82cfb09bf74b tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 404 len: 111 microversion: 2.42 time: 0.144266 Jun 18 22:17:28.887110 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1864/3733] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:28 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:17:28.901743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-74ce3496-c126-4f7f-b86b-74ccf51a0018 req-1cfdc78b-5f7b-40a4-870f-c10e876d059e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8219ff51-bcac-4dbf-a23d-7a8433e154ce", "name": "network-vif-deleted", "tag": "6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:28.941390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-74ce3496-c126-4f7f-b86b-74ccf51a0018 req-1cfdc78b-5f7b-40a4-870f-c10e876d059e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:28.941843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-74ce3496-c126-4f7f-b86b-74ccf51a0018 req-1cfdc78b-5f7b-40a4-870f-c10e876d059e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:28.986775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-74ce3496-c126-4f7f-b86b-74ccf51a0018 req-1cfdc78b-5f7b-40a4-870f-c10e876d059e service nova] Creating event network-vif-deleted:6b6b76c7-2fda-4b5d-b0be-e0aaa9f81960 for instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce on nch1-master-1 Jun 18 22:17:29.018161 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-74ce3496-c126-4f7f-b86b-74ccf51a0018 req-1cfdc78b-5f7b-40a4-870f-c10e876d059e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127167 Jun 18 22:17:29.025351 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1865/3734] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:29.030788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:29.031382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:29.054304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:29.055067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:29.056164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:29.056787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:29.123704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:17:29.299430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a6c503e-394a-44be-90ac-9855a39a1333 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 204 len: 0 microversion: 2.1 time: 0.272363 Jun 18 22:17:29.300881 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1866/3735] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:17:29 2022] DELETE /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:17:29.308743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-42e2bdae-52b2-499f-a936-71258b1dfeef tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '.version_select at 0x7fea07695d30>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:29.374259 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-42e2bdae-52b2-499f-a936-71258b1dfeef tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213769530" status: 204 len: 0 microversion: 2.42 time: 0.071694 Jun 18 22:17:29.378480 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1867/3736] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1213769530 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:17:29.383993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:29.390005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:29.404585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:29.410099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:29.411409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:29.412420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:29.570538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:29.593618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ed2b0ad-f3ec-4e1e-8409-c1f6a24d03ef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 2.021537 Jun 18 22:17:29.602944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1870/3737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:27 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:29.621969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:29.627152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:29.667879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:29.675622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:29.682336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:29.685851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:29.810395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:17:30.107229 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31526a3d-98cb-4622-a954-802ccaa5ceb8 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 204 len: 0 microversion: 2.1 time: 0.500328 Jun 18 22:17:30.107829 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1871/3738] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:17:29 2022] DELETE /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:17:30.138152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-286355c9-f8c8-453a-81e2-b8518cff593f req-33bf2f92-002b-4cfe-a83d-cd6e66d9eeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbf8789-21b7-46a1-9b8f-be1e66d4546c", "name": "network-vif-plugged", "status": "completed", "tag": "b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:30.166483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-286355c9-f8c8-453a-81e2-b8518cff593f req-33bf2f92-002b-4cfe-a83d-cd6e66d9eeaa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:30.166924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-286355c9-f8c8-453a-81e2-b8518cff593f req-33bf2f92-002b-4cfe-a83d-cd6e66d9eeaa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:30.225006 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-286355c9-f8c8-453a-81e2-b8518cff593f req-33bf2f92-002b-4cfe-a83d-cd6e66d9eeaa service nova] Creating event network-vif-plugged:b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa for instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c on nch1-master-1 Jun 18 22:17:30.247842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:30.263605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-621b4a02-8ab5-4268-9df7-b2d76f53f7b8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1521 microversion: 2.1 time: 0.883579 Jun 18 22:17:30.272247 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-286355c9-f8c8-453a-81e2-b8518cff593f req-33bf2f92-002b-4cfe-a83d-cd6e66d9eeaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158327 Jun 18 22:17:30.277380 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1872/3739] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:30.285258 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1868/3740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:29 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1521 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:30.292745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:30.302291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:30.327722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:30.328446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:30.362990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:30.364424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:30.369122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:30.370669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:30.376110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:30.397414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:30.398681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:30.400233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:30.437268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:17:30.683887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b4a386c-8df1-4702-b50f-85a074bfc5d4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 204 len: 0 microversion: 2.1 time: 0.396762 Jun 18 22:17:30.688645 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1869/3741] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:17:30 2022] DELETE /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:17:30.719664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-648873293", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c338c1-54d0-4b94-9891-fcb2729daf72"}], "security_groups": [{"name": "tempest-securitygroup--1125576065"}], "key_name": "tempest-keypair-366293565", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:31.015566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] validate_networks() for [('b8c338c1-54d0-4b94-9891-fcb2729daf72', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:17:31.427188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:31.436657 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff199a7e-b67d-4057-96e2-2e05e3d53cd4 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 200 len: 1513 microversion: 2.1 time: 1.157802 Jun 18 22:17:31.441315 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1873/3742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:30 2022] GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 1513 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:31.712579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-819470283", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "8dfcd2f7-6461-40aa-887b-dd3398c12adc"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:31.843347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] validate_networks() for [('8dfcd2f7-6461-40aa-887b-dd3398c12adc', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:17:32.459112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:17:32.460718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:17:32.461437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:17:32.462110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:17:32.462701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:17:32.486909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:32.487851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:32.488904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:32.490710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:32.567939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:17:32.592498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:17:32.607586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:32.643217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:17:32.649588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:17:32.831275 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b7ae3df5-70e7-456c-a7c0-b5cb0b55362b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.141073 Jun 18 22:17:32.837342 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1870/3743] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:17:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:17:32.852208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:32.867095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:32.901147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:32.903102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:32.906478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:32.911110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:33.521245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:33.537058 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d60c244-5be2-4c78-b750-d3d265ea1f54 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.698222 Jun 18 22:17:33.547129 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1871/3744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:32 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:33.570739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:33.573930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:33.616433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:33.618733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:33.624026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:33.643009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:33.931074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:17:33.931680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:17:33.931990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:17:33.932594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:17:33.933207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:17:33.958069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:33.960275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:33.961573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:33.965978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:34.032222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:34.066707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Getting quotas for project e6e76753152c4fe7881769f5477f65e5. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:17:34.102742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Getting quotas for user 17bce7b531bd49b5a54a2e7eab57834f and project e6e76753152c4fe7881769f5477f65e5. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:17:34.170589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:17:34.178797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:17:34.179251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:34.204032 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c8e997ee-2b98-4940-bc10-6491c1aef3c7 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1527 microversion: 2.1 time: 0.655455 Jun 18 22:17:34.205861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1872/3745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:33 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1527 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:34.210916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:34.211733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:34.220037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:34.220774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:34.222705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:34.223346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:34.323567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d2dd7df-64ff-4407-bb3e-943dc7325eda tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.879176 Jun 18 22:17:34.324533 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1874/3746] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:17:34.358043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:34.358609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:34.378455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:34.379076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:34.380203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:34.383312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:34.801231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:34.810338 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8e111440-cdba-4fd8-9939-93d400829ad6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1244 microversion: 2.1 time: 0.464500 Jun 18 22:17:34.810931 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1875/3747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:34 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1244 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:34.841121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2b33cb71-afa2-4397-89d4-3f32129625f5 req-a2f2b034-a246-4e58-9ffe-d8504275f6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbf8789-21b7-46a1-9b8f-be1e66d4546c", "name": "network-vif-unplugged", "status": "completed", "tag": "b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:34.876217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2b33cb71-afa2-4397-89d4-3f32129625f5 req-a2f2b034-a246-4e58-9ffe-d8504275f6f6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:34.878026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2b33cb71-afa2-4397-89d4-3f32129625f5 req-a2f2b034-a246-4e58-9ffe-d8504275f6f6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:34.919171 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2b33cb71-afa2-4397-89d4-3f32129625f5 req-a2f2b034-a246-4e58-9ffe-d8504275f6f6 service nova] Creating event network-vif-unplugged:b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa for instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c on nch1-master-1 Jun 18 22:17:34.931558 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2b33cb71-afa2-4397-89d4-3f32129625f5 req-a2f2b034-a246-4e58-9ffe-d8504275f6f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109295 Jun 18 22:17:34.933697 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1876/3748] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:34.941496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6db90747-2594-41d9-b4b4-5fe20479ffcb tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:34.943143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6db90747-2594-41d9-b4b4-5fe20479ffcb tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:35.015665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:35.025857 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f8d7893e-dac4-412c-b338-561d8563aefa tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 200 len: 1513 microversion: 2.1 time: 0.818689 Jun 18 22:17:35.035452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1873/3749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:34 2022] GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 1513 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:35.047583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:35.059025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:35.080007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:35.080472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:35.081284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:35.091588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:35.183750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6db90747-2594-41d9-b4b4-5fe20479ffcb tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:35.207665 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6db90747-2594-41d9-b4b4-5fe20479ffcb tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1227 microversion: 2.1 time: 0.272365 Jun 18 22:17:35.208292 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1877/3750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:34 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1227 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:35.224051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:35.225140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:35.245776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:35.249485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:35.253754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:35.254421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:35.621302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:35.638374 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e37ebae4-79a8-4fa6-b9a0-9ae63257ec88 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.594689 Jun 18 22:17:35.640981 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1874/3751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:35 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:35.683061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:35.694907 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d091b61-8965-4984-b834-584c2123592f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1527 microversion: 2.1 time: 0.477555 Jun 18 22:17:35.696429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1878/3752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:35 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1527 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:35.829547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:35.830751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:35.838152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:35.838972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:35.840676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:35.841328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:35.950650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:35.964145 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e2b6570-5a81-48ce-b973-0bf81a884487 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1298 microversion: 2.1 time: 0.139466 Jun 18 22:17:35.976856 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1875/3753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:35 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:36.046091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:36.046721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:36.056804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:36.057294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:36.058091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:36.058528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:36.230942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:36.232575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:36.281288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:36.285428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:36.293692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:36.294674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:36.500389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:36.511145 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-af057cf7-84cd-441e-a9ec-f7369f68c18d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1297 microversion: 2.1 time: 0.290997 Jun 18 22:17:36.511747 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1876/3754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:36 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1297 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:36.656957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:36.657886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:36.670880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:36.672049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:36.673167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:36.675621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:36.944478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:36.965353 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a48f77c-36c5-47a8-9d29-c8e431efc322 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 200 len: 1513 microversion: 2.1 time: 0.920982 Jun 18 22:17:36.967407 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1879/3755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:36 2022] GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 1513 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:36.985540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:36.986247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:37.021562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:37.022595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:37.023464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:37.026569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:37.837423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:37.848118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-79852620-c057-4fcb-b752-2c8426ddbd20 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 1.195119 Jun 18 22:17:37.854060 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1877/3756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:36 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:37.869249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4758eb58-dfc8-476f-9cb5-5e5500e449b7 req-8ade5eb3-7166-4bd0-a286-05276b56a848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88b2790-a5fa-4836-a254-c6ee7f19ab61", "name": "network-vif-deleted", "tag": "778f525b-c23e-4863-a019-441fd9ed7ba6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:37.903121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4758eb58-dfc8-476f-9cb5-5e5500e449b7 req-8ade5eb3-7166-4bd0-a286-05276b56a848 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:37.903890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4758eb58-dfc8-476f-9cb5-5e5500e449b7 req-8ade5eb3-7166-4bd0-a286-05276b56a848 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:37.972637 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4758eb58-dfc8-476f-9cb5-5e5500e449b7 req-8ade5eb3-7166-4bd0-a286-05276b56a848 service nova] Creating event network-vif-deleted:778f525b-c23e-4863-a019-441fd9ed7ba6 for instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 on nch2-master-1 Jun 18 22:17:38.001163 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4758eb58-dfc8-476f-9cb5-5e5500e449b7 req-8ade5eb3-7166-4bd0-a286-05276b56a848 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138923 Jun 18 22:17:38.002281 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1878/3757] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:38.009025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:38.014724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:38.046792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:38.080655 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1a4f7651-5b61-4020-b7d6-d02c8fa3e1c2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 200 len: 1527 microversion: 2.1 time: 1.103086 Jun 18 22:17:38.082595 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1880/3758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:36 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 1527 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:38.101577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6022aeed-62b3-44e2-9e7f-c70983ae2a78 req-1cdc0682-fe0e-4b9b-9e72-91dc76a71518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88b2790-a5fa-4836-a254-c6ee7f19ab61", "name": "network-vif-unplugged", "status": "completed", "tag": "778f525b-c23e-4863-a019-441fd9ed7ba6"}, {"server_uuid": "8d8ead93-21d1-4ed2-8b54-d855890fe754", "name": "network-vif-unplugged", "status": "completed", "tag": "3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:38.114201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.117197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.119570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.127665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.205494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:38.311435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6022aeed-62b3-44e2-9e7f-c70983ae2a78 req-1cdc0682-fe0e-4b9b-9e72-91dc76a71518 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.312506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6022aeed-62b3-44e2-9e7f-c70983ae2a78 req-1cdc0682-fe0e-4b9b-9e72-91dc76a71518 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.055s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.361573 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6022aeed-62b3-44e2-9e7f-c70983ae2a78 req-1cdc0682-fe0e-4b9b-9e72-91dc76a71518 service nova] Creating event network-vif-unplugged:778f525b-c23e-4863-a019-441fd9ed7ba6 for instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 on nch2-master-1 Jun 18 22:17:38.362804 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6022aeed-62b3-44e2-9e7f-c70983ae2a78 req-1cdc0682-fe0e-4b9b-9e72-91dc76a71518 service nova] Creating event network-vif-unplugged:3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7 for instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 on nch2-master-1 Jun 18 22:17:38.383618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6022aeed-62b3-44e2-9e7f-c70983ae2a78 req-1cdc0682-fe0e-4b9b-9e72-91dc76a71518 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.292608 Jun 18 22:17:38.385752 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1881/3759] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:38.397417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:38.398581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:38.408454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.409190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.410153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.410737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.588857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:38.623313 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5da02575-aacc-4764-aafb-2b8ad58ea4f1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1298 microversion: 2.1 time: 0.608088 Jun 18 22:17:38.632933 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1879/3760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:38 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1298 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:38.633091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:38.645674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:38.646607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:38.650877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91812391-7421-4745-ac92-787435a4e0f7 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1285 microversion: 2.1 time: 0.263607 Jun 18 22:17:38.659519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.659983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.660722 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1882/3761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:38 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:38.661099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.661914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.758387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.760464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.760939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lazy-loading 'fault' on Instance uuid 8d8ead93-21d1-4ed2-8b54-d855890fe754 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:17:38.868149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c071daa57f24e9fa1ae5d173a99d2ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851177a639b248a0b4508112a9b6e6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:38.873123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:38.874385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:38.886601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.889767 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e737dfd9-e6ab-4dfd-b06c-a3070603027c tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 200 len: 1308 microversion: 2.1 time: 0.257161 Jun 18 22:17:38.890497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:38.891564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:38.892119 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1880/3762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:38 2022] GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:38.892592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:39.099828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:39.100451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:39.113190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:39.114268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:39.116044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:39.116979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:39.139585 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c HTTP/1.1 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c'} Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:39.142789 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:17:39.149929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:39.150994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:39.152265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e0eef24-8ac5-4202-b7ac-362515c239cf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 404 len: 111 microversion: 2.1 time: 0.056279 Jun 18 22:17:39.153414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1881/3763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:39 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:17:39.173255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d61f99f-bd5b-476a-aaaa-18cd200cb039 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'create', calling method: .version_select at 0x7fea0792d700>, body: {"keypair": {"name": "tempest-keypair-1699663208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdaQi/P+WTsdkny0/35hg9Z361PdTElDLqMAfapYF0Uf9Szhvq5rNXwPo7uJQ63SLSSfsymuMH1TZcUhCEhfQZRyKfWTFhU+K3LpBkTE1RF5DEfjwR1rngI4jqm5w2ABA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:39.200891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8d61f99f-bd5b-476a-aaaa-18cd200cb039 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:17:39.207489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8d61f99f-bd5b-476a-aaaa-18cd200cb039 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for user d5516d85f0ee482facf6a96e2709c41d and project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:17:39.246937 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d61f99f-bd5b-476a-aaaa-18cd200cb039 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.085403 Jun 18 22:17:39.248226 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1882/3764] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:17:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:39.641530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:39.642463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:39.663167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:39.664055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:39.668414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:39.671998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.022545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:40.032411 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ebe9715-9f8c-46c5-810c-bd9328a2ce1c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 1.168979 Jun 18 22:17:40.036417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1883/3765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:38 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:40.045324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:40.051179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:40.066162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.067104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.071068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.072058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.455149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:40.472981 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65bd707f-d303-467a-8342-745b28b06975 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1285 microversion: 2.1 time: 0.428876 Jun 18 22:17:40.474222 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1884/3766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:40 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:40.486471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:40.488357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: 8d8ead93-21d1-4ed2-8b54-d855890fe754] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:40.511890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.515975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.517903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.519386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.557827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] HTTP exception thrown: Instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 could not be found. Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Request method failure captured: Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 HTTP/1.1 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7A8_a8DbBAlKxBkLM6ZnJVTPCoIJxu9G4136UwN1dKBqcJyjDR53YFEerAtyXOZuAUkKj-RH-Xd0Lt0Mi8kViQCW9CA0NPM4Ql1Xl2TvZWyqZZGVshq3APWZpCnHpq8rgb7LEMiiKfVzqMawmAHhdCsEaVT8RKR0eKac6_IM-QHDk Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 851177a639b248a0b4508112a9b6e6bf Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-MultipleCreateTestJSON-1005434132 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/851177a639b248a0b4508112a9b6e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/851177a639b248a0b4508112a9b6e6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/851177a639b248a0b4508112a9b6e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_851177a639b248a0b4508112a9b6e6bf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-MultipleCreateTestJSON-1005434132 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 851177a639b248a0b4508112a9b6e6bf Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1005434132 Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-MultipleCreateTestJSON-1005434132-project Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 4c071daa57f24e9fa1ae5d173a99d2ca Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-MultipleCreateTestJSON-1005434132-project Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 could not be found. Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8d8ead93-21d1-4ed2-8b54-d855890fe754'} Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 could not be found. Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 could not be found. Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:40.565356 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 could not be found. Jun 18 22:17:40.572195 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.573520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:40.581908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Returning 404 to user: Instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:40.583157 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6858ecc4-272b-43dd-af98-991595a9a3f6 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754" status: 404 len: 111 microversion: 2.1 time: 0.105402 Jun 18 22:17:40.587705 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1885/3767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:40 2022] GET /compute/v2.1/servers/8d8ead93-21d1-4ed2-8b54-d855890fe754 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:17:40.590190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2877c0bf-7a08-4cdb-a9a9-2bb90b15de7d req-b7a24dce-8f51-49ce-9d7a-35cb53085858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fbf8789-21b7-46a1-9b8f-be1e66d4546c", "name": "network-vif-deleted", "tag": "b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa"}, {"server_uuid": "8d8ead93-21d1-4ed2-8b54-d855890fe754", "name": "network-vif-deleted", "tag": "3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:40.608335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2877c0bf-7a08-4cdb-a9a9-2bb90b15de7d req-b7a24dce-8f51-49ce-9d7a-35cb53085858 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.610528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2877c0bf-7a08-4cdb-a9a9-2bb90b15de7d req-b7a24dce-8f51-49ce-9d7a-35cb53085858 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.630481 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6ded17d3-e0ed-4b3f-abc3-f83e4a5addce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.986812 Jun 18 22:17:40.631431 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1883/3768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:39 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:40.632579 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2877c0bf-7a08-4cdb-a9a9-2bb90b15de7d req-b7a24dce-8f51-49ce-9d7a-35cb53085858 service nova] Creating event network-vif-deleted:b22f05e6-7d2f-4cea-91cb-c3d29e8f5caa for instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c on nch1-master-1 Jun 18 22:17:40.634134 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2877c0bf-7a08-4cdb-a9a9-2bb90b15de7d req-b7a24dce-8f51-49ce-9d7a-35cb53085858 service nova] Creating event network-vif-deleted:3bf7b0eb-42d4-42f3-a2b2-1892a8d830d7 for instance 8d8ead93-21d1-4ed2-8b54-d855890fe754 on nch2-master-1 Jun 18 22:17:40.648814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:40.653666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] [instance: b88b2790-a5fa-4836-a254-c6ee7f19ab61] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:40.664013 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2877c0bf-7a08-4cdb-a9a9-2bb90b15de7d req-b7a24dce-8f51-49ce-9d7a-35cb53085858 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077597 Jun 18 22:17:40.665304 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1886/3769] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:40.668374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.668841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.703513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:40.705808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:40.795766 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] HTTP exception thrown: Instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 could not be found. Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Request method failure captured: Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 HTTP/1.1 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7A8_a8DbBAlKxBkLM6ZnJVTPCoIJxu9G4136UwN1dKBqcJyjDR53YFEerAtyXOZuAUkKj-RH-Xd0Lt0Mi8kViQCW9CA0NPM4Ql1Xl2TvZWyqZZGVshq3APWZpCnHpq8rgb7LEMiiKfVzqMawmAHhdCsEaVT8RKR0eKac6_IM-QHDk Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 851177a639b248a0b4508112a9b6e6bf Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-MultipleCreateTestJSON-1005434132 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/851177a639b248a0b4508112a9b6e6bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/851177a639b248a0b4508112a9b6e6bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/851177a639b248a0b4508112a9b6e6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_851177a639b248a0b4508112a9b6e6bf", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-MultipleCreateTestJSON-1005434132 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 851177a639b248a0b4508112a9b6e6bf Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1005434132 Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-MultipleCreateTestJSON-1005434132-project Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4c071daa57f24e9fa1ae5d173a99d2ca Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-MultipleCreateTestJSON-1005434132-project Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 could not be found. Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'b88b2790-a5fa-4836-a254-c6ee7f19ab61'} Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 could not be found. Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 could not be found. Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:40.801699 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 could not be found. Jun 18 22:17:40.807177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:40.812472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] Returning 404 to user: Instance b88b2790-a5fa-4836-a254-c6ee7f19ab61 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:40.813642 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db5a7677-ca2d-468f-ac47-7b1a8ccad884 tempest-MultipleCreateTestJSON-1005434132 tempest-MultipleCreateTestJSON-1005434132-project] 10.222.0.30 "GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61" status: 404 len: 111 microversion: 2.1 time: 0.180629 Jun 18 22:17:40.814861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1884/3770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:40 2022] GET /compute/v2.1/servers/b88b2790-a5fa-4836-a254-c6ee7f19ab61 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:17:41.053333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:41.054893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:41.071688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:41.075312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:41.076349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:41.076805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:41.495524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:41.496174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:41.509999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:41.517982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:41.527288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:41.527761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:41.861141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:41.871688 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0b50689-1348-46f9-8bba-dcbe4c62a236 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.823455 Jun 18 22:17:41.878619 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1887/3771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:41 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:41.891794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:41.894373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:41.911253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:41.912405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:41.913721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:41.923599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:42.304828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:42.314409 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39e7b7ef-fbd8-4530-9317-0c287e56978c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.822742 Jun 18 22:17:42.315031 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1885/3772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:41 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:42.761435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:42.772073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:42.778861 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bfc16b85-c388-483c-8e87-677761244179 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.897198 Jun 18 22:17:42.779726 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1888/3773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:41 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:42.896736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:42.897401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:42.900614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:42.912917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:42.915878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:42.917053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:42.919151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:43.334189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:43.335192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:43.352311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:43.355150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:43.356270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:43.357481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:44.004860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:44.707813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:44.716024 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3c1c38b-d677-4d4f-a23d-347272ddae0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 1.823182 Jun 18 22:17:44.716667 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1886/3774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:42 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:44.725793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-efb3a302-f204-4d71-a6f1-9cc72de0594b req-a2757a98-1e85-4216-bb19-6558f32c9fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e5a035-772d-471a-96ab-ce0bfce14d85", "tag": "9746866d-83a7-4cb8-802a-abb7bee91209"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:44.747816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-efb3a302-f204-4d71-a6f1-9cc72de0594b req-a2757a98-1e85-4216-bb19-6558f32c9fb5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:44.748271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-efb3a302-f204-4d71-a6f1-9cc72de0594b req-a2757a98-1e85-4216-bb19-6558f32c9fb5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:44.767767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:44.777251 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73e3b914-45a2-4d43-8a11-6decf25de29d tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 1.448990 Jun 18 22:17:44.789205 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1889/3775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:43 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:44.809496 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-efb3a302-f204-4d71-a6f1-9cc72de0594b req-a2757a98-1e85-4216-bb19-6558f32c9fb5 service nova] Creating event network-changed:9746866d-83a7-4cb8-802a-abb7bee91209 for instance 89e5a035-772d-471a-96ab-ce0bfce14d85 on nch1-master-1 Jun 18 22:17:44.813431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:44.820747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:44.851398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:44.853333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:44.855610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:44.857617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:44.860651 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-efb3a302-f204-4d71-a6f1-9cc72de0594b req-a2757a98-1e85-4216-bb19-6558f32c9fb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130967 Jun 18 22:17:44.864427 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1887/3776] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:45.193358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:45.310364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-12a1fbd6-5559-4657-8f48-ca5d0014c424 req-f344a03c-8b97-4492-b1ed-8c49c9211653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69250039-69f2-4647-bb7d-03033ec4afeb", "tag": "759b9f06-3c1f-4516-8559-55de07216c59"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:45.329398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-12a1fbd6-5559-4657-8f48-ca5d0014c424 req-f344a03c-8b97-4492-b1ed-8c49c9211653 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:45.329935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-12a1fbd6-5559-4657-8f48-ca5d0014c424 req-f344a03c-8b97-4492-b1ed-8c49c9211653 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:45.374371 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-12a1fbd6-5559-4657-8f48-ca5d0014c424 req-f344a03c-8b97-4492-b1ed-8c49c9211653 service nova] Creating event network-changed:759b9f06-3c1f-4516-8559-55de07216c59 for instance 69250039-69f2-4647-bb7d-03033ec4afeb on nch1-master-1 Jun 18 22:17:45.387818 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-12a1fbd6-5559-4657-8f48-ca5d0014c424 req-f344a03c-8b97-4492-b1ed-8c49c9211653 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081040 Jun 18 22:17:45.392692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1888/3777] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:45.738085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:45.739929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:45.757069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:45.757697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:45.758490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:45.758927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:45.889469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:45.926993 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-674f6853-911c-4037-afe3-e17c2a54b8f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 1.135253 Jun 18 22:17:45.944891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1890/3778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:44 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:45.959981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:45.964295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:45.992450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:45.993215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:45.994270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:45.995146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:46.419582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:46.429907 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee4c24bc-729d-4e3b-bec3-2590cdc56acf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.700948 Jun 18 22:17:46.434286 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1889/3779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:45 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:46.442816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:46.446320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:46.452515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:46.462315 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9c768be2-05ad-4e4e-b63b-ab80448c82f6 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.514861 Jun 18 22:17:46.466859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:46.467575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:46.468789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:46.469431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:46.472419 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1891/3780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:45 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:46.479033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1107392635", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:46.510728 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] HTTP exception thrown: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Request method failure captured: Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce HTTP/1.1 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2MvCn_k-djcPIxE_WZJAWKU92pFWR9tCU1kuB3FNBtewqdNFtSno6cRRU_vI2Wc2KIXjJ7sVw8iWvjiwjq4oQxlc1VmSDyMEuAP83dch5cep0vkEf0SIEpMeYfta7mCRbRVa4WFUcb2-DUiYs88NPlmiHoZm6yDe6RCVgmO_60t_Y Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.42 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b8ddaa6fbcdf4368a8e9be0d07596178 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b8ddaa6fbcdf4368a8e9be0d07596178", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b8ddaa6fbcdf4368a8e9be0d07596178 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TaggedBootDevicesTest_v242-1622454662-project Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a8eb1a760d644f97bf3aae882e905b85 Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1622454662-project Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8219ff51-bcac-4dbf-a23d-7a8433e154ce'} Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:46.516784 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Returning 404 to user: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:46.521603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e003a277-0aac-4d70-97b8-d7fa8c68c252 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 404 len: 111 microversion: 2.42 time: 0.084969 Jun 18 22:17:46.522521 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1890/3781] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:17:46 2022] DELETE /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:17:46.543552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:46.544196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] [instance: 8219ff51-bcac-4dbf-a23d-7a8433e154ce] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:46.551909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:46.552432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:46.553323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:46.553920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:46.554562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] validate_networks() for [('cbcb4bc6-4ebe-4797-ba04-d1451a91835b', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:17:46.571142 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] HTTP exception thrown: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Request method failure captured: Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce HTTP/1.1 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk2MvCn_k-djcPIxE_WZJAWKU92pFWR9tCU1kuB3FNBtewqdNFtSno6cRRU_vI2Wc2KIXjJ7sVw8iWvjiwjq4oQxlc1VmSDyMEuAP83dch5cep0vkEf0SIEpMeYfta7mCRbRVa4WFUcb2-DUiYs88NPlmiHoZm6yDe6RCVgmO_60t_Y Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.42 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b8ddaa6fbcdf4368a8e9be0d07596178 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b8ddaa6fbcdf4368a8e9be0d07596178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b8ddaa6fbcdf4368a8e9be0d07596178", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b8ddaa6fbcdf4368a8e9be0d07596178 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1622454662 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TaggedBootDevicesTest_v242-1622454662-project Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a8eb1a760d644f97bf3aae882e905b85 Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1622454662-project Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8219ff51-bcac-4dbf-a23d-7a8433e154ce'} Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.572740 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. Jun 18 22:17:46.577787 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:17:46.596885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] Returning 404 to user: Instance 8219ff51-bcac-4dbf-a23d-7a8433e154ce could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:17:46.599810 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1f13547-38e4-4e5b-9afd-9242c964ef25 tempest-TaggedBootDevicesTest_v242-1622454662 tempest-TaggedBootDevicesTest_v242-1622454662-project] 10.222.0.30 "GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce" status: 404 len: 111 microversion: 2.42 time: 0.064755 Jun 18 22:17:46.601397 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1891/3782] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:17:46 2022] GET /compute/v2.1/servers/8219ff51-bcac-4dbf-a23d-7a8433e154ce => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:17:46.975867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:46.977536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:46.985013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:46.986136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:46.987168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:46.987623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:47.512055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:47.533803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c18b1b0d-bfa5-47ea-98da-083129878426 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.574893 Jun 18 22:17:47.547249 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1892/3783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:46 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:47.558682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:47.562208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:47.586502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:47.588189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:47.589784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:47.592762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:47.828170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:17:47.829243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:17:47.829982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:17:47.830637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:17:47.831303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:17:47.850619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:47.851462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:47.852709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:47.853444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:47.873484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:17:47.881243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for user d5516d85f0ee482facf6a96e2709c41d and project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:17:47.913065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:17:47.920466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:17:48.072298 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b44c4e3-c4f4-4645-a3e2-2a6c70b4de03 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.597956 Jun 18 22:17:48.072956 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1892/3784] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:17:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:17:48.090463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:48.099982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:48.115578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:48.116038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:48.116835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:48.124357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:48.307055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:48.319571 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b3fdaa9-2df4-4afc-8121-7ed6b690fc7e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.770472 Jun 18 22:17:48.320356 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1893/3785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:47 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:48.330624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-beea6e88-2474-4d28-882e-a0d2ed8c5c46 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:48.333571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-beea6e88-2474-4d28-882e-a0d2ed8c5c46 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:48.512149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-beea6e88-2474-4d28-882e-a0d2ed8c5c46 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:48.522045 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-beea6e88-2474-4d28-882e-a0d2ed8c5c46 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1225 microversion: 2.1 time: 0.196078 Jun 18 22:17:48.523052 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1894/3786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:48 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:48.559148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:48.559961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:48.571894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:48.572647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:48.575976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:48.576657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:48.668408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:48.685652 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25784dde-6a19-4e1d-93dc-4f5ef1dfa15c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.611265 Jun 18 22:17:48.686447 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1893/3787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:48 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:48.990194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:49.003179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee9e0d70-8213-4c95-bac5-1ea3a029ff0c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.455225 Jun 18 22:17:49.007549 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1895/3788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:48 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:49.341214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:49.342715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:49.350668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:49.351373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:49.352154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:49.353523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:49.541784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:49.543199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:49.574481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:49.578024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:49.579662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:49.580345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:49.603344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:49.618706 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-193fb916-58b4-4201-a7d4-7c0b69fdcb8a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.282847 Jun 18 22:17:49.620169 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1894/3789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:49 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:49.705358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:49.706292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:49.721512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:49.722463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:49.722690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:49.723994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:49.726456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:49.749431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9bc70c04-0bdf-49e8-96d2-be3cffebe205 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1277 microversion: 2.1 time: 0.211405 Jun 18 22:17:49.750364 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1896/3790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:49 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:50.023393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:50.024182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:50.035672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:50.039703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:50.040171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:50.041075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:50.044271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:50.052699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3a1bcc40-25c4-43b0-8dfa-eadf58db4c8c tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.353456 Jun 18 22:17:50.061498 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1895/3791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:49 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:50.392561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:50.406555 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-36c009d9-3eba-431d-9ff9-fdd38a550ad5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.389051 Jun 18 22:17:50.408733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1897/3792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:50 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:50.636140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:50.637569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:50.644604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:50.645406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:50.646456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:50.647097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:50.774951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:50.780462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:50.800499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:50.801683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:50.808010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:50.809378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:51.138573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:51.151564 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd9e3366-f33a-4ba3-a41b-7768324e4b40 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1679 microversion: 2.1 time: 0.519207 Jun 18 22:17:51.152971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1896/3793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:50 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1679 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:51.159128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:51.170659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:51.178257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:51.178741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:51.179565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:51.180017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:51.382794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:51.398650 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fca79c96-a8a0-4354-9bd1-af83715a768b tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.632051 Jun 18 22:17:51.409555 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1898/3794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:50 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:51.425001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:51.426254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:51.436877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:51.437395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:51.438178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:51.438823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:51.695556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:51.709747 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-522e204e-4897-413c-a15f-220ccb0cfe76 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.552717 Jun 18 22:17:51.713617 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1897/3795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:51 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:51.796412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:51.809579 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4bc25794-2c70-4682-89f2-cc56a9ede174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.388305 Jun 18 22:17:51.826640 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1899/3796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:51 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:52.169662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:52.170271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:52.185876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:52.186324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:52.198663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:52.199172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:52.311767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-bffe48ea-e3f0-4372-bc44-89986cf6fb33 req-1244d5ab-ccbf-4b3e-8961-ee8474a1b224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e5a035-772d-471a-96ab-ce0bfce14d85", "name": "network-vif-plugged", "status": "completed", "tag": "9746866d-83a7-4cb8-802a-abb7bee91209"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:52.348025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-bffe48ea-e3f0-4372-bc44-89986cf6fb33 req-1244d5ab-ccbf-4b3e-8961-ee8474a1b224 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:52.349599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-bffe48ea-e3f0-4372-bc44-89986cf6fb33 req-1244d5ab-ccbf-4b3e-8961-ee8474a1b224 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:52.380738 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-bffe48ea-e3f0-4372-bc44-89986cf6fb33 req-1244d5ab-ccbf-4b3e-8961-ee8474a1b224 service nova] Creating event network-vif-plugged:9746866d-83a7-4cb8-802a-abb7bee91209 for instance 89e5a035-772d-471a-96ab-ce0bfce14d85 on nch1-master-1 Jun 18 22:17:52.398879 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-bffe48ea-e3f0-4372-bc44-89986cf6fb33 req-1244d5ab-ccbf-4b3e-8961-ee8474a1b224 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091111 Jun 18 22:17:52.401168 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1900/3797] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:17:52.423345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:52.427938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:52.454507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:52.457285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:52.459299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:52.460069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:53.965710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:53.975420 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-98f43bb1-f510-47d7-9ed5-51abfc5e760f tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 1.562074 Jun 18 22:17:53.985431 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1901/3798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:52 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:53.998599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:53.999263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:54.015920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:54.017569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:54.018035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:54.018838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:54.019283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:54.078817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:54.091214 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1e1e534-6810-47a5-b982-536523f76060 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 1.920614 Jun 18 22:17:54.093658 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1898/3799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:52 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:54.117720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:54.124283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:54.165572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:54.167522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:54.172785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:54.177455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:54.938454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:54.962299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2611008-f5ad-4d33-a0d1-0afd0fdf8645 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.975389 Jun 18 22:17:54.962877 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1902/3800] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:53 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:54.967825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-77ec5ee1-f81a-4b04-8927-a6017c1f277b req-099d0947-ca9d-41be-87ad-a1d27444f9bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6b3364-316f-4865-bfec-0388e9fbd8c3", "tag": "516cf3a7-d93d-486c-ab4f-3508260eb096"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:54.978146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-77ec5ee1-f81a-4b04-8927-a6017c1f277b req-099d0947-ca9d-41be-87ad-a1d27444f9bd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:54.978601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:54.979042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-77ec5ee1-f81a-4b04-8927-a6017c1f277b req-099d0947-ca9d-41be-87ad-a1d27444f9bd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:54.991389 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be4008fc-2faf-4150-806b-5728f2255cf7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1366 microversion: 2.1 time: 0.893191 Jun 18 22:17:54.992161 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1899/3801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:54 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1366 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:55.001282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:55.001282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:55.002110 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-77ec5ee1-f81a-4b04-8927-a6017c1f277b req-099d0947-ca9d-41be-87ad-a1d27444f9bd service nova] Creating event network-changed:516cf3a7-d93d-486c-ab4f-3508260eb096 for instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 on nch2-master-1 Jun 18 22:17:55.007920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-77ec5ee1-f81a-4b04-8927-a6017c1f277b req-099d0947-ca9d-41be-87ad-a1d27444f9bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043691 Jun 18 22:17:55.008468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.009286 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1903/3802] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:55.015103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-12f0a2f1-659b-41ff-b804-dcccc30b36ba req-12846cb5-baa2-4869-b22c-4969dde68ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-unplugged", "status": "completed", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:55.026391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:55.028601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.030892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:55.063901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-12f0a2f1-659b-41ff-b804-dcccc30b36ba req-12846cb5-baa2-4869-b22c-4969dde68ecb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.064411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-12f0a2f1-659b-41ff-b804-dcccc30b36ba req-12846cb5-baa2-4869-b22c-4969dde68ecb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:55.085162 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-12f0a2f1-659b-41ff-b804-dcccc30b36ba req-12846cb5-baa2-4869-b22c-4969dde68ecb service nova] Creating event network-vif-unplugged:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:17:55.096848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-12f0a2f1-659b-41ff-b804-dcccc30b36ba req-12846cb5-baa2-4869-b22c-4969dde68ecb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085834 Jun 18 22:17:55.103710 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1904/3803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:55.110728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:55.112151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:55.122203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.122821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:55.123913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.125545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:55.513119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:55.528368 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-86b290b9-18ad-4b26-aebc-2ee3d6cef1e7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.534789 Jun 18 22:17:55.549358 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1900/3804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:54 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:55.584295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:55.601536 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47482100-71de-443c-b501-91908a266c42 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.496021 Jun 18 22:17:55.604905 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1905/3805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:55 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:55.979863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:55.980471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:55.990255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.990887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:55.991761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:55.992350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.008180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:56.008811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:56.030628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:56.033679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.034739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:56.035393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.437603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:56.445936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-af4e723c-051b-443e-b856-6f24289f83e0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1556 microversion: 2.1 time: 0.442034 Jun 18 22:17:56.454433 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1906/3806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:56 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1556 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:56.462411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:56.463203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:56.473976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:56.478589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.479652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:56.480273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.670364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:56.685768 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49708a18-7a2b-4268-a712-e71882630261 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.710132 Jun 18 22:17:56.686693 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1901/3807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:55 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:56.699373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:56.700461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:56.707661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:56.708356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.709364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:56.709919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:56.770500 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b0071178-bd15-45a8-8ace-d6c39057f2cd tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.312048 Jun 18 22:17:56.771231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1907/3808] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:17:56 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-interface => generated 284 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:17:57.034310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:57.046130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59090fe9-b350-4f88-9787-9f66700eaf34 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.358092 Jun 18 22:17:57.046757 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1902/3809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:56 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:57.093315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:57.094650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:57.106637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.107113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.107917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.108634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.128095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b3abc2c4-d591-4119-83e0-05bb91b71cf6 req-f66d3625-1fa1-4704-9231-f1575a904386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69250039-69f2-4647-bb7d-03033ec4afeb", "name": "network-vif-plugged", "status": "completed", "tag": "759b9f06-3c1f-4516-8559-55de07216c59"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:57.145353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b3abc2c4-d591-4119-83e0-05bb91b71cf6 req-f66d3625-1fa1-4704-9231-f1575a904386 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.145752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b3abc2c4-d591-4119-83e0-05bb91b71cf6 req-f66d3625-1fa1-4704-9231-f1575a904386 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.167718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b3abc2c4-d591-4119-83e0-05bb91b71cf6 req-f66d3625-1fa1-4704-9231-f1575a904386 service nova] Creating event network-vif-plugged:759b9f06-3c1f-4516-8559-55de07216c59 for instance 69250039-69f2-4647-bb7d-03033ec4afeb on nch1-master-1 Jun 18 22:17:57.189486 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b3abc2c4-d591-4119-83e0-05bb91b71cf6 req-f66d3625-1fa1-4704-9231-f1575a904386 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065842 Jun 18 22:17:57.190172 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1903/3810] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:17:57.703758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:57.704465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:57.716987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.717431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.718193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.718620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.758003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:57.766870 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d5053d1-97f5-45f9-af5f-531d2a002854 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.679324 Jun 18 22:17:57.769718 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1908/3811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:57 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:57.785322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:57.786377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:57.805137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.806129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.807306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:57.807976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:57.864633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:57.897863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:58.166370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:58.178917 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2278c884-d6be-43d8-a378-cdd461393aa1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.397385 Jun 18 22:17:58.190603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1909/3812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:57 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:58.190603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:58.190603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:58.205274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:58.209186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.210113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.217560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.218449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.241895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:58.257923 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-147a3c7c-da4c-47d0-aceb-aaa97bdd3664 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.557062 Jun 18 22:17:58.262197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1904/3813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:57 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:17:58.276804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:58.281571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:58.297786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.298703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.299722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.300346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.521762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:58.605850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:58.625186 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1b1fbd7-cf09-4f2e-b84a-38a763f2c48b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.353034 Jun 18 22:17:58.625866 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1905/3814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:58 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:58.641455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:17:58.642693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:58.656443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:58.658691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.659417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.660437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.661240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.664924 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba74f2fd-babe-4fda-8167-ccf76cee59ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.481772 Jun 18 22:17:58.665564 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1910/3815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:58 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:58.737224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:17:58.835064 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a78dfbe-4a4f-4436-aac5-27c0660dc35d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.197284 Jun 18 22:17:58.835728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1906/3816] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:17:58 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:17:58.844218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:58.844850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:58.857432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.857899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:58.858704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:58.859157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:59.245220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:59.255019 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06f4a8a0-ceed-4296-bbfc-7942cff2541f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1668 microversion: 2.1 time: 0.414928 Jun 18 22:17:59.259904 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1911/3817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:58 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1668 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:17:59.280755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:59.281805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:59.294537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:59.295227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:59.296199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:59.300079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:59.682876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:17:59.683510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:17:59.691743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:59.692204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:59.693103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:17:59.693551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:17:59.963687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:17:59.972470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79451a3a-dc9a-48ab-a8b8-cc2f8f2b9067 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1327 microversion: 2.1 time: 0.697100 Jun 18 22:17:59.989548 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1907/3818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:59 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1327 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:00.033469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:00.050479 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-196963d3-62ff-49d7-9963-20bc97172c17 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.371453 Jun 18 22:18:00.051772 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1912/3819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:17:59 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:00.280015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:00.280990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:00.295577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:00.296920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:00.298002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:00.298815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:00.593082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-559ad384-9938-4e69-9c25-51289c8a455b req-c4213bb3-e5aa-407e-9070-38cb98806951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89e5a035-772d-471a-96ab-ce0bfce14d85", "tag": "9746866d-83a7-4cb8-802a-abb7bee91209"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:00.625680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-559ad384-9938-4e69-9c25-51289c8a455b req-c4213bb3-e5aa-407e-9070-38cb98806951 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:00.628453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-559ad384-9938-4e69-9c25-51289c8a455b req-c4213bb3-e5aa-407e-9070-38cb98806951 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:00.652662 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-559ad384-9938-4e69-9c25-51289c8a455b req-c4213bb3-e5aa-407e-9070-38cb98806951 service nova] Creating event network-changed:9746866d-83a7-4cb8-802a-abb7bee91209 for instance 89e5a035-772d-471a-96ab-ce0bfce14d85 on nch1-master-1 Jun 18 22:18:00.666786 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-559ad384-9938-4e69-9c25-51289c8a455b req-c4213bb3-e5aa-407e-9070-38cb98806951 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078140 Jun 18 22:18:00.667841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1913/3820] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:18:01.009490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:01.010463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:01.027841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:01.031564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:01.033571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:01.035561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:01.678972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:01.692934 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f69e5b0e-6cc4-4f62-9a02-e8133227c557 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1668 microversion: 2.1 time: 1.417545 Jun 18 22:18:01.706947 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1908/3821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:00 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1668 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:01.722994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:01.737017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:01.738094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:01.738883 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22a8dd05-c201-43ac-abd3-cf75d31fcde9 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1527 microversion: 2.1 time: 0.736091 Jun 18 22:18:01.743733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1914/3822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:00 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1527 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:01.754364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:01.763036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:01.765955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:01.766712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:01.767772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:01.771617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:01.791126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:01.791586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:01.792395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:01.804795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:02.183935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:02.200655 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4bac6e7f-836b-478c-b8b2-43867d801e37 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1527 microversion: 2.1 time: 0.440038 Jun 18 22:18:02.214865 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1915/3823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:01 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1527 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:02.352708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:02.378993 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2e0e821f-e9cd-4e2f-af07-14963334f3ab tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.667115 Jun 18 22:18:02.389358 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1909/3824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:01 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:02.680883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:02.690080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:02.704603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:02.706843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:02.709884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:02.710588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:02.718518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:02.719237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:02.737362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:02.737362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:02.738152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:02.738594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:02.745773 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] HTTP exception thrown: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Request method failure captured: Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb HTTP/1.1 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk750R-onJMOWufJey9-JfmRLyY3OFYRZbl3VE9tPxs6VLvm95TdFHzELMw7pY9BMQQ2qm91ecidlmSLyZVhkwSPqXFEWB1-qPVtm2Nlk7agxeyG9K6Y-Gtl5HkCEnyWlME4xFBBKoHC8n5PyH4b8f3Y83215jyL3zFdLBjTzecJpfU Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a23826e63b5c48f2ac201e0929ab5e5b Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1414086381 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a23826e63b5c48f2ac201e0929ab5e5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a23826e63b5c48f2ac201e0929ab5e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a23826e63b5c48f2ac201e0929ab5e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a23826e63b5c48f2ac201e0929ab5e5b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1414086381 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a23826e63b5c48f2ac201e0929ab5e5b Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1414086381 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1414086381-project Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 3755bd71d3cb4e2582ef9ef2f54545a9 Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1414086381-project Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '69250039-69f2-4647-bb7d-03033ec4afeb'} Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:02.752304 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:02.758539 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:02.760095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Returning 404 to user: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:02.760263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-764de04c-9644-4004-8b49-e233e4f930cb tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 404 len: 111 microversion: 2.1 time: 0.542776 Jun 18 22:18:02.760706 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1916/3825] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:02 2022] DELETE /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 111 bytes in 545 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:02.779155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:02.779790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:02.788947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:02.789761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:02.790564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:02.790998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.360355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:03.379163 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ec9dbcc-6030-4c3f-b982-a5ef14359702 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.667885 Jun 18 22:18:03.379843 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1910/3826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:02 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:03.403745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:03.404736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:03.406896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:03.434917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.434917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.440375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.446082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.486222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:03.503615 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64ecc25f-6c9a-4999-a55b-f95eef9db715 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1527 microversion: 2.1 time: 0.729524 Jun 18 22:18:03.514231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1917/3827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:02 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1527 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:03.528952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5bc53eba-1c0b-4a1a-9080-a252ad27a1fc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 200 len: 324 microversion: 2.1 time: 0.135592 Jun 18 22:18:03.534127 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1911/3828] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:18:03 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 324 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:03.536202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:03.539115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:03.547354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Action: 'update', calling method: >, body: {"server": {"name": "69250039-69f2-4647-bb7d-03033ec4afeb_new"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:03.549300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:03.554829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.555535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.556075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.557242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.557706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.558560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.558997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.564503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.580862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] HTTP exception thrown: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Request method failure captured: Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb HTTP/1.1 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 64 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk750R-onJMOWufJey9-JfmRLyY3OFYRZbl3VE9tPxs6VLvm95TdFHzELMw7pY9BMQQ2qm91ecidlmSLyZVhkwSPqXFEWB1-qPVtm2Nlk7agxeyG9K6Y-Gtl5HkCEnyWlME4xFBBKoHC8n5PyH4b8f3Y83215jyL3zFdLBjTzecJpfU Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a23826e63b5c48f2ac201e0929ab5e5b Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1414086381 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a23826e63b5c48f2ac201e0929ab5e5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a23826e63b5c48f2ac201e0929ab5e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a23826e63b5c48f2ac201e0929ab5e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a23826e63b5c48f2ac201e0929ab5e5b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1414086381 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a23826e63b5c48f2ac201e0929ab5e5b Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1414086381 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1414086381-project Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 3755bd71d3cb4e2582ef9ef2f54545a9 Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1414086381-project Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "69250039-69f2-4647-bb7d-03033ec4afeb_new"}} Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '69250039-69f2-4647-bb7d-03033ec4afeb', 'body': {'server': {'name': '69250039-69f2-4647-bb7d-03033ec4afeb_new'}}} Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:18:03.585219 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:03.591730 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:03.597192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] Returning 404 to user: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:03.597192 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae26ea7b-fba0-4190-9cba-3eebf18f3a1d tempest-ServersNegativeTestMultiTenantJSON-1414086381 tempest-ServersNegativeTestMultiTenantJSON-1414086381-project] 10.222.0.30 "PUT /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 404 len: 111 microversion: 2.1 time: 0.061215 Jun 18 22:18:03.597192 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1912/3829] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:18:03 2022] PUT /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:03.605543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:03.607667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:03.616096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.617020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:03.618130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:03.618767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.292795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:04.306610 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a492d44-6911-481e-840f-a2f329a704bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.704602 Jun 18 22:18:04.307679 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1913/3830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:03 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:04.317675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9d1b7928-453b-432a-b8a7-cec66454c55b req-0d75163c-bde1-459a-b950-9c2ba7f3d71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6b3364-316f-4865-bfec-0388e9fbd8c3", "name": "network-vif-plugged", "status": "completed", "tag": "516cf3a7-d93d-486c-ab4f-3508260eb096"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:04.343289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9d1b7928-453b-432a-b8a7-cec66454c55b req-0d75163c-bde1-459a-b950-9c2ba7f3d71b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.343715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9d1b7928-453b-432a-b8a7-cec66454c55b req-0d75163c-bde1-459a-b950-9c2ba7f3d71b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.372160 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9d1b7928-453b-432a-b8a7-cec66454c55b req-0d75163c-bde1-459a-b950-9c2ba7f3d71b service nova] Creating event network-vif-plugged:516cf3a7-d93d-486c-ab4f-3508260eb096 for instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 on nch2-master-1 Jun 18 22:18:04.388033 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9d1b7928-453b-432a-b8a7-cec66454c55b req-0d75163c-bde1-459a-b950-9c2ba7f3d71b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078283 Jun 18 22:18:04.388828 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1914/3831] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:04.402513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:04.408918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:04.427870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.428664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.429716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.433865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.436331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:04.446695 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-07412c23-2f4b-4fc9-9d15-5d573bc30e02 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.923809 Jun 18 22:18:04.450619 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1918/3832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:03 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:04.457252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:04.462162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:04.479207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.479845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.480798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.481263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.497580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:18:04.768380 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88112808-eb7c-4802-8b42-1e8bcc510b96 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "DELETE /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 204 len: 0 microversion: 2.1 time: 0.376847 Jun 18 22:18:04.769257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1915/3833] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:04 2022] DELETE /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:18:04.782618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:04.783352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:04.804872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.805388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:04.806227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:04.808078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:05.025124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:05.047454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-690fa85a-988f-449f-8341-c3ec3d694be0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.595158 Jun 18 22:18:05.055264 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1919/3834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:04 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:05.155079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-256949325", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:05.210135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:05.244716 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-669cb331-ffa6-4a5a-9a83-a9398c466cef tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1533 microversion: 2.1 time: 0.471089 Jun 18 22:18:05.245861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1916/3835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:04 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1533 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:05.252174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:05.252717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:05.257570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:05.271872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:05.272984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:05.274148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:05.274817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:05.799572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:05.812147 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d93478fd-25c3-4e2d-9ebe-da69f459b117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.565024 Jun 18 22:18:05.812751 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1917/3836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:05 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:05.824000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:05.825512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:05.835499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:05.835499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:05.841601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:05.845254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.310917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:06.311408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:06.311813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:06.312231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:06.312646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:06.352319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:06.352746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.353503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:06.369015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.440282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:06.446173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:06.451845 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4639a899-05d4-4c7d-bc5e-62d885f09ba4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1325 microversion: 2.1 time: 0.637960 Jun 18 22:18:06.458619 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1918/3837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:05 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1325 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:06.462053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:06.481280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:06.492133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:06.510591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:06.515481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:06.517197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:06.520032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.524923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:06.528077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.682784 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8bc36403-02e4-4fa7-ac79-c7daf907c998 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.625527 Jun 18 22:18:06.691408 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1920/3838] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:06.701340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:06.702558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:06.735510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:06.735990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.738190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:06.738643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:06.943274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:06.955425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb8e4267-59e5-4f2e-828d-ce99779b2423 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.491757 Jun 18 22:18:06.956423 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1919/3839] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:06 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:06.974997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15ed4d84-5f93-4392-8e34-b7fc8cc8c523 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:06.975772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15ed4d84-5f93-4392-8e34-b7fc8cc8c523 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:07.161172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15ed4d84-5f93-4392-8e34-b7fc8cc8c523 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:07.188045 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15ed4d84-5f93-4392-8e34-b7fc8cc8c523 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1192 microversion: 2.1 time: 0.229522 Jun 18 22:18:07.200892 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1920/3840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:06 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1192 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:07.225341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2055256444", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a4647eff-e46f-4758-90a6-f87dcd82bc48"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:07.238813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17bce7b531bd49b5a54a2e7eab57834f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e76753152c4fe7881769f5477f65e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:07.260601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-10ace508-6f70-4cd5-a68b-8e124e8cad58 tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 200 len: 1533 microversion: 2.1 time: 0.562350 Jun 18 22:18:07.261327 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1921/3841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:06 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 1533 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:07.312995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] validate_networks() for [('a4647eff-e46f-4758-90a6-f87dcd82bc48', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:07.475848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:07.477170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:07.501303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:07.508905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:07.509873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:07.510328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:07.570709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:08.721153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:08.739077 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-628e7bea-3468-4161-bc50-347e504094ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1522 microversion: 2.1 time: 1.267869 Jun 18 22:18:08.740056 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1922/3842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:07 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1522 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:08.749905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1bb02ffd-5287-494e-ac5c-95e79ffc5feb req-f783d421-c79c-4bf1-86f9-069c8299a877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69250039-69f2-4647-bb7d-03033ec4afeb", "name": "network-vif-deleted", "tag": "759b9f06-3c1f-4516-8559-55de07216c59"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:08.784347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1bb02ffd-5287-494e-ac5c-95e79ffc5feb req-f783d421-c79c-4bf1-86f9-069c8299a877 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:08.784924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1bb02ffd-5287-494e-ac5c-95e79ffc5feb req-f783d421-c79c-4bf1-86f9-069c8299a877 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:08.804450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1bb02ffd-5287-494e-ac5c-95e79ffc5feb req-f783d421-c79c-4bf1-86f9-069c8299a877 service nova] Creating event network-vif-deleted:759b9f06-3c1f-4516-8559-55de07216c59 for instance 69250039-69f2-4647-bb7d-03033ec4afeb on nch1-master-1 Jun 18 22:18:08.827565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1bb02ffd-5287-494e-ac5c-95e79ffc5feb req-f783d421-c79c-4bf1-86f9-069c8299a877 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085853 Jun 18 22:18:08.828470 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1923/3843] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:08.848193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:08.849440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:08.857728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:08.858589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:08.859657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:08.860321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.011499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:09.027882 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43470e89-aafd-44fa-9b1c-861ca537a064 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1250 microversion: 2.1 time: 0.192865 Jun 18 22:18:09.031217 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1924/3844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:08 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1250 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:09.042316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:09.046008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] [instance: 69250039-69f2-4647-bb7d-03033ec4afeb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:09.066363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.066824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.067858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.068488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.116581 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] HTTP exception thrown: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Request method failure captured: Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb HTTP/1.1 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7fPz6heQsIXm5Pj8aadKE0_mmAyDLPUPYVoCaeLV180tSQLiIJnFASNVdEMdorsuNta1ArcvhypnCCBJwoTkohyqWbXw0Z4iyDg09h5Cl04sU36HqGM7FqEsvScqeUr7TERNRYOjm52EPpOh78bsSL2UPtMcbWOOGa54xBNCZXnfs Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e6e76753152c4fe7881769f5477f65e5 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-605035846 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e6e76753152c4fe7881769f5477f65e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e6e76753152c4fe7881769f5477f65e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e6e76753152c4fe7881769f5477f65e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e6e76753152c4fe7881769f5477f65e5", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-605035846 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e6e76753152c4fe7881769f5477f65e5 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-605035846 Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestMultiTenantJSON-605035846-project Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 17bce7b531bd49b5a54a2e7eab57834f Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-605035846-project Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '69250039-69f2-4647-bb7d-03033ec4afeb'} Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:09.119529 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. Jun 18 22:18:09.124981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:09.135840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] Returning 404 to user: Instance 69250039-69f2-4647-bb7d-03033ec4afeb could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:09.137210 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9454e7b-c234-4227-b28f-9c26cfa640ff tempest-ServersNegativeTestMultiTenantJSON-605035846 tempest-ServersNegativeTestMultiTenantJSON-605035846-project] 10.222.0.30 "GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb" status: 404 len: 111 microversion: 2.1 time: 0.104676 Jun 18 22:18:09.138417 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1925/3845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:09 2022] GET /compute/v2.1/servers/69250039-69f2-4647-bb7d-03033ec4afeb => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:09.144690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:09.151618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:09.165811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.166593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.167593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.170879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.407107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:09.408689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:09.409504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:09.411450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:09.412593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:09.462593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.463035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.463836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.464273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.520528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:09.538230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:09.541616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for user ab975e8ffd0448939b2105aed58003fe and project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:09.548372 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b2a1dee-4ca4-4231-b572-5a43f074de1c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1522 microversion: 2.1 time: 0.408451 Jun 18 22:18:09.553697 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1926/3846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:09 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:09.573743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1666231408"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:09.575679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:09.581243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:09.585477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.586036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.587098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:09.593286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:09.594229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:09.678605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2988e01b-8fab-47cd-95cc-84825b156490 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.458847 Jun 18 22:18:09.679540 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1921/3847] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:09.695440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-db0c1029-5c38-4b12-9219-fafa4693914d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:09.696286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-db0c1029-5c38-4b12-9219-fafa4693914d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:09.796931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-db0c1029-5c38-4b12-9219-fafa4693914d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:09.807144 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-db0c1029-5c38-4b12-9219-fafa4693914d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1215 microversion: 2.1 time: 0.115834 Jun 18 22:18:09.818638 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1922/3848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:09 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:10.047906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:10.048869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:10.074337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:10.077272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:10.084905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:10.086206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:10.200567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c65f054c-91e9-4aea-aa10-481468e16756 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3/action" status: 202 len: 0 microversion: 2.1 time: 0.634501 Jun 18 22:18:10.215221 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1927/3849] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:18:09 2022] POST /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 18 22:18:10.257986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2e16a1a5-1d31-420c-bbc8-767a353e47db tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '.version_select at 0x7fea19bc5ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:10.304326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:10.314930 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58dca7ae-897f-4968-80aa-8e664ae82ef0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1250 microversion: 2.1 time: 0.271994 Jun 18 22:18:10.318118 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1923/3850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:10 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1250 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:10.600532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-843417502", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "4a91e4e1-7777-4e8e-b900-a0137c5caf91"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:10.615503 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2e16a1a5-1d31-420c-bbc8-767a353e47db tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61" status: 204 len: 0 microversion: 2.1 time: 0.377300 Jun 18 22:18:10.616915 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1928/3851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:10 2022] DELETE /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:18:10.628914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f300c02-9286-49c2-97bc-8fc798310d7a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '.version_select at 0x7fea19bc58b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:10.677386 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0f300c02-9286-49c2-97bc-8fc798310d7a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Image not found. Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f300c02-9286-49c2-97bc-8fc798310d7a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61 HTTP/1.1 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: exception: Image not found. Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '91f72012-1d25-4232-88fb-726c8e11ee61'} Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 91f72012-1d25-4232-88fb-726c8e11ee61 Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 18 22:18:10.687979 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f72012-1d25-4232-88fb-726c8e11ee61 could not be found. Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:18:10.694543 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:10.702036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f300c02-9286-49c2-97bc-8fc798310d7a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Image not found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:10.707814 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f300c02-9286-49c2-97bc-8fc798310d7a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61" status: 404 len: 62 microversion: 2.1 time: 0.078008 Jun 18 22:18:10.711635 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1929/3852] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:18:10 2022] GET /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:18:10.750138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:10.752154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] validate_networks() for [('4a91e4e1-7777-4e8e-b900-a0137c5caf91', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:10.752437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:10.771270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:10.782969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:10.788812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:10.789599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:11.308300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:11.321864 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b0628db-30f8-4029-afdd-bfff952bdfdc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1534 microversion: 2.1 time: 0.608021 Jun 18 22:18:11.337513 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1930/3853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:10 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1534 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:11.346592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:11.348252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:11.367870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:11.368767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:11.369834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:11.370475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:11.650974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:11.661205 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ffb019e2-5b4b-476c-89b8-c4641502ffef tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1267 microversion: 2.1 time: 0.322044 Jun 18 22:18:11.662837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1931/3854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:11 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:11.667741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:11.669309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:11.687656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:11.692100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:11.703597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:11.705592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:12.077437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:12.090905 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef2e0e9f-7b00-4929-a89d-30ac8ca41dac tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.426533 Jun 18 22:18:12.103494 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1932/3855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:11 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:12.162307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:12.162847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:12.164613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:12.165066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:12.165512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:12.184626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:12.186326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:12.188713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:12.190225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:12.231967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Getting quotas for project b2a741fcf70249ecb8c3c727459c84c9. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:12.240973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Getting quotas for user deabdfddc88b4db2bb61ae4da4b4808d and project b2a741fcf70249ecb8c3c727459c84c9. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:12.260050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:12.262908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:12.326275 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea39ec2c-4453-42be-898a-fb37057fd6a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929858 Jun 18 22:18:12.327563 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1924/3856] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:18:12.346184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-524be665-fbb3-4a5a-be79-dee0bc6bcc03 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:12.346821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-524be665-fbb3-4a5a-be79-dee0bc6bcc03 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:12.353135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:12.354693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:12.379355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:12.380152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:12.386511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:12.387175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:13.129411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-524be665-fbb3-4a5a-be79-dee0bc6bcc03 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:13.141271 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-524be665-fbb3-4a5a-be79-dee0bc6bcc03 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1216 microversion: 2.1 time: 0.807307 Jun 18 22:18:13.143432 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1933/3857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:12 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1216 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:13.155724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:13.156361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:13.178466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:13.179081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:13.179886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:13.180935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:13.472722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:13.496650 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ab0a2e0-c8b6-40a3-b440-9b926fe34a86 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1273 microversion: 2.1 time: 0.351871 Jun 18 22:18:13.498407 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1934/3858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:13 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:13.523581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:13.534621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:13.540749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:13.543567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:13.587313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d12655f-72ec-47bc-ba09-933e6595bcbf tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1540 microversion: 2.1 time: 1.243579 Jun 18 22:18:13.590646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1925/3859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:12 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1540 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:13.613141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:13.618225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:13.627569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:13.644645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.175244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:14.176442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:14.222971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:14.223802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.226228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:14.227840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.535417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:14.577649 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06ff287c-ac59-48e5-9d94-ccc4983446f0 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1268 microversion: 2.1 time: 0.412780 Jun 18 22:18:14.578734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1926/3860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:14 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1268 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:14.596220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:14.639319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:14.640294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:14.656710 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d72eef9-94ed-4c9f-a385-462ccd39d150 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 1.154315 Jun 18 22:18:14.657372 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1935/3861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:13 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:14.679048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:14.681301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.686364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:14.687230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:14.687496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:14.688214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.711500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:14.712252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.713715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:14.714421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:14.920348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:14.932230 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3dd622c3-8a97-4be3-9b42-250cf2f9599f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1273 microversion: 2.1 time: 0.350052 Jun 18 22:18:14.934316 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1927/3862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:14 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:15.217228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:15.230273 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ae96717-8f73-4428-b314-b3ca17e1adbc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1522 microversion: 2.1 time: 0.544535 Jun 18 22:18:15.232118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1936/3863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:14 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:15.249920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:15.253477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:15.259749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.260290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.261227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.261662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.294137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:18:15.438383 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c2a3ebd-2ba8-4f12-9244-e98b9b9c9b4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 204 len: 0 microversion: 2.1 time: 0.192488 Jun 18 22:18:15.453476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:15.456014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:15.458866 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1928/3864] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:15 2022] DELETE /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:18:15.463507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.463978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.465010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.465524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.601773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:15.603126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:15.612178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.613135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.614320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.622430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.874368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:15.886474 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-265a7d24-eb40-45b1-bc21-c4f36f751fa3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1274 microversion: 2.1 time: 0.291830 Jun 18 22:18:15.898610 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1929/3865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:15 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1274 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:15.902108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:15.903030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:15.912703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.913694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:15.914396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:15.914806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:16.418933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:16.598751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:16.610417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-afa16cb5-3525-4ade-a16e-55878461b90c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1528 microversion: 2.1 time: 1.162875 Jun 18 22:18:16.614902 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1937/3866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:15 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1528 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:16.632372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4d3731a8-bc75-4781-8813-e51f1af30461 req-47acaef2-127e-487f-9754-b48c940ddec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6fdc5c-0c35-497b-be9c-49a996b93f7f", "tag": "3d9822f1-479a-42ac-ab30-18cb34ad32d0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:16.665647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4d3731a8-bc75-4781-8813-e51f1af30461 req-47acaef2-127e-487f-9754-b48c940ddec5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:16.667091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4d3731a8-bc75-4781-8813-e51f1af30461 req-47acaef2-127e-487f-9754-b48c940ddec5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:16.727655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:16.738796 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ec70165-0e0a-42f0-9912-4b42263ab4e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.850190 Jun 18 22:18:16.745813 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4d3731a8-bc75-4781-8813-e51f1af30461 req-47acaef2-127e-487f-9754-b48c940ddec5 service nova] Creating event network-changed:3d9822f1-479a-42ac-ab30-18cb34ad32d0 for instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f on nch2-master-1 Jun 18 22:18:16.753965 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1930/3867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:15 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:16.763493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:16.764126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:16.764753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4d3731a8-bc75-4781-8813-e51f1af30461 req-47acaef2-127e-487f-9754-b48c940ddec5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148275 Jun 18 22:18:16.767776 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1938/3868] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:16.783427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-68ac3411-6da1-41be-95dd-faaf5ca5511a req-0f38c44d-8da2-41f4-8f81-082e437434ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6b3364-316f-4865-bfec-0388e9fbd8c3", "name": "network-vif-plugged", "status": "completed", "tag": "516cf3a7-d93d-486c-ab4f-3508260eb096"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:16.815622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:16.816069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:16.822937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-68ac3411-6da1-41be-95dd-faaf5ca5511a req-0f38c44d-8da2-41f4-8f81-082e437434ca service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:16.823803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-68ac3411-6da1-41be-95dd-faaf5ca5511a req-0f38c44d-8da2-41f4-8f81-082e437434ca service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:16.826166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:16.826481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:16.855321 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-68ac3411-6da1-41be-95dd-faaf5ca5511a req-0f38c44d-8da2-41f4-8f81-082e437434ca service nova] Creating event network-vif-plugged:516cf3a7-d93d-486c-ab4f-3508260eb096 for instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 on nch2-master-1 Jun 18 22:18:16.868982 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-68ac3411-6da1-41be-95dd-faaf5ca5511a req-0f38c44d-8da2-41f4-8f81-082e437434ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098903 Jun 18 22:18:16.870111 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1939/3869] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:16.908979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:16.910125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:16.923979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:16.926663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:16.930959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:16.931745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:17.191128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:17.206801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c144750-5259-445c-94a1-265ff7b8269e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1274 microversion: 2.1 time: 0.300737 Jun 18 22:18:17.208045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1940/3870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:16 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1274 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:17.632476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:17.633151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:17.641880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:17.642350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:17.643819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:17.644257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:17.659607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:17.670514 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-beb4f0d2-831f-4a50-b581-bcd5280175e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.915272 Jun 18 22:18:17.671107 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1931/3871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:16 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:17.771784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:17.774023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:17.783545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:17.786510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:17.787974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:17.790852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:18.135051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:18.149809 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-609e49d1-478c-41ad-ad64-603f328a4491 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1528 microversion: 2.1 time: 0.521765 Jun 18 22:18:18.151182 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1941/3872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:17 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1528 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:18.208831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:18.217188 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85e63a6b-ce86-4167-b3db-491a46491463 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.456470 Jun 18 22:18:18.217883 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1932/3873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:17 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:18.225358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:18.233251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:18.242713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:18.243167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:18.244045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:18.244663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:18.635939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dc38081a-4fbb-4c99-9bb3-e26b7532ceae req-d055a5d2-fef7-497a-bf88-53f6abaf8016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6b3364-316f-4865-bfec-0388e9fbd8c3", "name": "network-vif-deleted", "tag": "516cf3a7-d93d-486c-ab4f-3508260eb096"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:18.655801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dc38081a-4fbb-4c99-9bb3-e26b7532ceae req-d055a5d2-fef7-497a-bf88-53f6abaf8016 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:18.667589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dc38081a-4fbb-4c99-9bb3-e26b7532ceae req-d055a5d2-fef7-497a-bf88-53f6abaf8016 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:18.700394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:18.711731 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dc38081a-4fbb-4c99-9bb3-e26b7532ceae req-d055a5d2-fef7-497a-bf88-53f6abaf8016 service nova] Creating event network-vif-deleted:516cf3a7-d93d-486c-ab4f-3508260eb096 for instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 on nch2-master-1 Jun 18 22:18:18.722676 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b5d9634-5549-4fec-9745-09d26e43add4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.502496 Jun 18 22:18:18.723560 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1942/3874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:18 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:18.730874 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dc38081a-4fbb-4c99-9bb3-e26b7532ceae req-d055a5d2-fef7-497a-bf88-53f6abaf8016 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102272 Jun 18 22:18:18.733445 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1933/3875] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:18.734858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:18.736464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:18.773059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:18.780929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:18.783073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:18.788060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:18.829676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:19.168182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:19.169936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:19.186112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.187029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.188074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.189069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.285529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.286952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.287951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lazy-loading 'fault' on Instance uuid 6d6b3364-316f-4865-bfec-0388e9fbd8c3 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:18:19.382999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:19.390964 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-132b5357-f44b-4f09-b8ff-1b6cb29e6016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.665852 Jun 18 22:18:19.391911 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1943/3876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:18 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:19.398006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:19.399015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:19.405961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.406704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.407709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.408315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.586967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:19.598243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d49670f-b5f6-4e82-b220-0bd3d4e43699 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 200 len: 1315 microversion: 2.1 time: 0.433771 Jun 18 22:18:19.601961 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1934/3877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:19 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:19.618266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dbc4ba84-a6b7-49be-92c5-e52f710945d1 req-ce4ef4a7-994c-4b28-9d3b-0606a9b29a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dae9ded-d68a-47f1-b2cb-762ba19f91cc", "tag": "f62a3bcb-9abc-4923-8596-cb8240cff0f8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:19.652996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dbc4ba84-a6b7-49be-92c5-e52f710945d1 req-ce4ef4a7-994c-4b28-9d3b-0606a9b29a1f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.654543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dbc4ba84-a6b7-49be-92c5-e52f710945d1 req-ce4ef4a7-994c-4b28-9d3b-0606a9b29a1f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.727737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dbc4ba84-a6b7-49be-92c5-e52f710945d1 req-ce4ef4a7-994c-4b28-9d3b-0606a9b29a1f service nova] Creating event network-changed:f62a3bcb-9abc-4923-8596-cb8240cff0f8 for instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc on nch1-master-1 Jun 18 22:18:19.734006 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dbc4ba84-a6b7-49be-92c5-e52f710945d1 req-ce4ef4a7-994c-4b28-9d3b-0606a9b29a1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130360 Jun 18 22:18:19.738206 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1935/3878] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:19.758267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:19.759319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:19.779816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.785809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:19.788304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:19.789798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:20.095227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:20.108253 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad7ea17d-0f75-4f64-84c8-a673c7b56c5c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.714927 Jun 18 22:18:20.109272 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1944/3879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:19 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:20.408121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:20.408919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:20.417420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:20.418076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:20.419133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:20.419918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:20.817167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:20.845895 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e39b6eb7-c195-4e34-95a8-2b0fc094ac8b tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 1.098047 Jun 18 22:18:20.847317 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1936/3880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:19 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:20.861580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:20.862844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:20.871587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:20.872305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:20.873596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:20.874324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:20.902478 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 HTTP/1.1 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6d6b3364-316f-4865-bfec-0388e9fbd8c3'} Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:20.905585 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:20.915742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:20.916700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:20.918319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:20.919377 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fe76a5f6-9e4b-4cdd-9b12-9ae425abab4a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 404 len: 111 microversion: 2.1 time: 0.070698 Jun 18 22:18:20.920588 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1937/3881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:20 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:20.932894 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f0c2689-ab2f-4e10-bd9b-b78d72d70e0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.528718 Jun 18 22:18:20.935100 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1945/3882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:20 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:21.097203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-14003779", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:21.112161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:21.138673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:21.139570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:21.160528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:21.160528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:21.161811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:21.164432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:21.214352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] validate_networks() for [('cbcb4bc6-4ebe-4797-ba04-d1451a91835b', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:21.793984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:21.802431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc26c8e9-7548-4b13-8f25-7d3721cc6730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.680520 Jun 18 22:18:21.813863 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1946/3883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:21 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:21.818786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f1ea541a-a7bd-4a9e-9a2e-6a1f8e5a5d24 req-8dbe7bf8-5a72-4444-9988-849f80d74192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb89987-1b96-49ac-934c-0eb181958529", "tag": "7935099b-2e45-473c-a197-b38522d9d453"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:21.849476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f1ea541a-a7bd-4a9e-9a2e-6a1f8e5a5d24 req-8dbe7bf8-5a72-4444-9988-849f80d74192 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:21.849862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f1ea541a-a7bd-4a9e-9a2e-6a1f8e5a5d24 req-8dbe7bf8-5a72-4444-9988-849f80d74192 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:21.871597 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f1ea541a-a7bd-4a9e-9a2e-6a1f8e5a5d24 req-8dbe7bf8-5a72-4444-9988-849f80d74192 service nova] Creating event network-changed:7935099b-2e45-473c-a197-b38522d9d453 for instance 7fb89987-1b96-49ac-934c-0eb181958529 on nch2-master-1 Jun 18 22:18:21.876878 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f1ea541a-a7bd-4a9e-9a2e-6a1f8e5a5d24 req-8dbe7bf8-5a72-4444-9988-849f80d74192 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061716 Jun 18 22:18:21.877967 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1947/3884] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:21.883794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:21.884511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:21.893424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:21.894416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:21.895896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:21.896681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:22.212289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:22.254339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:22.287997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:22.302707 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0e6eea43-c60b-44ca-ad1b-b8b27b262116 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.423281 Jun 18 22:18:22.303775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1948/3885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:21 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:22.309233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:22.311316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:22.323286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:22.324070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:22.339841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:22.340535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:22.474358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:22.474876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:22.475648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:22.476160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:22.477183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:22.489606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:22.490201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:22.491356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:22.491794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:22.510961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:22.517008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Getting quotas for user d5516d85f0ee482facf6a96e2709c41d and project 2ed8b40ca3a94586a2363bd22f6de045. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:22.534346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:22.536731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:22.588100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-29d59b8a-567c-4bed-a8cf-7d44fe304d23 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.497857 Jun 18 22:18:22.589134 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1938/3886] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:22.600029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d742bb9d-4932-431d-bc3c-f38ded1932ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:22.600780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d742bb9d-4932-431d-bc3c-f38ded1932ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:22.712389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d742bb9d-4932-431d-bc3c-f38ded1932ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:22.725655 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d742bb9d-4932-431d-bc3c-f38ded1932ac tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1223 microversion: 2.1 time: 0.129978 Jun 18 22:18:22.726910 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1939/3887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:22 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:22.771808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:22.783441 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88719ca2-eeb3-455e-b02d-739999bf4f31 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.478439 Jun 18 22:18:22.784381 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1949/3888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:22 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:22.832074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:22.833148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:22.841208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:22.842434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:22.843554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:22.844300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:23.322603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:23.323230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:23.334844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:23.345930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:23.346413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:23.347229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:23.351568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:23.419111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:23.455022 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a425853-7db0-4caa-bc0a-57d2802b5b23 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.624233 Jun 18 22:18:23.473402 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1940/3889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:22 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:23.743604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:23.748115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:23.761943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:23.762828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:23.763985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:23.774525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:24.120862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:24.125004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:24.133695 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aaa426d4-a88f-4d58-8bb9-27045e4f6571 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1275 microversion: 2.1 time: 0.393834 Jun 18 22:18:24.135314 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9851fb9-3126-4fb4-b6a1-13bd0bb230a4 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.818702 Jun 18 22:18:24.138642 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1941/3890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:23 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1275 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:24.149130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:24.150510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:24.150904 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1950/3891] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:23 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:24.173478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:24.174064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:24.175439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:24.176020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:24.493183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:24.494866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:24.505783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:24.506894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:24.508584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:24.509441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:24.992831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:25.002528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7a9ee5ae-3c4b-44e2-9ecf-110cb30a38bd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.862312 Jun 18 22:18:25.003414 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1942/3892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:24 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:25.133615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:25.152285 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f1846a01-8815-471e-8bae-861459840047 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.666376 Jun 18 22:18:25.155066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:25.155709 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1951/3893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:24 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:25.165113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:25.165941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:25.166399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:25.172492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:25.172492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:25.173412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:25.184802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:25.204988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:25.206077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:25.207452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:25.208173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:25.348746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:25.360105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-665e9ff5-00ca-4b15-a1cb-a81adc4da20d tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1281 microversion: 2.1 time: 0.202545 Jun 18 22:18:25.366026 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1952/3894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:25 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:25.564194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:25.578931 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aee88a2b-c3cd-4770-adaf-0d9923749287 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.424539 Jun 18 22:18:25.582511 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1943/3895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:25 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:26.029292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:26.031324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:26.046594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.048576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.051857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.052586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.172113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:26.172886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:26.182962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.183421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.188697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.189391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.202935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:26.644326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:26.664348 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72afbc8e-9df7-4c56-9929-cf1d68e3fdb7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.647352 Jun 18 22:18:26.670935 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1953/3896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:26 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:26.729371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:26.734405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:26.740846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:26.750113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:26.753650 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3bcd3d6f-88ef-43ba-b874-fad4d23161c1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.584950 Jun 18 22:18:26.753882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.754610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.755581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.756185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.764905 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1944/3897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:26 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:26.770365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:26.771277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:26.777826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.778568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:26.779525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:26.780164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:27.237872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:27.272081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91d45c04-7500-4ae2-bcb0-671e34e7f036 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.504944 Jun 18 22:18:27.273729 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1945/3898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:26 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:27.360899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:27.371739 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-535599e8-06e5-4737-b3a5-f997962c5d93 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.698749 Jun 18 22:18:27.372782 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1954/3899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:26 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:27.598556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-98da90b2-cab8-4c84-897c-d8045f58b4e1 req-09b5e5fa-a490-4fab-a296-f54a21761054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6fdc5c-0c35-497b-be9c-49a996b93f7f", "name": "network-vif-plugged", "status": "completed", "tag": "3d9822f1-479a-42ac-ab30-18cb34ad32d0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:27.615959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-98da90b2-cab8-4c84-897c-d8045f58b4e1 req-09b5e5fa-a490-4fab-a296-f54a21761054 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:27.616768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-98da90b2-cab8-4c84-897c-d8045f58b4e1 req-09b5e5fa-a490-4fab-a296-f54a21761054 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:27.649520 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-98da90b2-cab8-4c84-897c-d8045f58b4e1 req-09b5e5fa-a490-4fab-a296-f54a21761054 service nova] Creating event network-vif-plugged:3d9822f1-479a-42ac-ab30-18cb34ad32d0 for instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f on nch2-master-1 Jun 18 22:18:27.659831 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-98da90b2-cab8-4c84-897c-d8045f58b4e1 req-09b5e5fa-a490-4fab-a296-f54a21761054 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068099 Jun 18 22:18:27.664413 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1946/3900] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:27.687564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:27.688367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:27.695227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:27.696114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:27.697252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:27.698819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:27.772742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:27.773774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:27.782198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:27.782856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:27.783830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:27.784426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:28.532546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:28.563814 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68270f66-1cf7-4396-9bd8-f2c51c647ff6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.880329 Jun 18 22:18:28.566681 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1955/3901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:27 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:28.577625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:28.578870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:28.597863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:28.598675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:28.600821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:28.602822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:28.664128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:28.683021 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51ef2dd6-3ac8-4593-8815-d092ea6479d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1292 microversion: 2.1 time: 0.912270 Jun 18 22:18:28.683635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1947/3902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:27 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1292 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:28.695768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:28.696969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:28.709281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:28.711113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:28.712265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:28.713783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:29.057005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:29.069406 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-083128a0-c68b-4b3a-9ea7-2f236e8e8f2c tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.500560 Jun 18 22:18:29.079518 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1956/3903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:28 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:29.230563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:29.243295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d16c2895-e70d-40dd-bb3d-7024a8541fa2 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.552573 Jun 18 22:18:29.243895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1948/3904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:28 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:29.584747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:29.585323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:29.601528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:29.602183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:29.604494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:29.606264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:29.727284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d3efdeba-681c-4bed-a440-49e09e176374 req-653d5ba7-57d8-417e-9a0e-9295f2d44b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8ce7b3f-9e5b-4640-ad51-7495bc89edc1", "tag": "2e43e4a0-b8de-4b8f-8260-80793befa928"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:29.759877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d3efdeba-681c-4bed-a440-49e09e176374 req-653d5ba7-57d8-417e-9a0e-9295f2d44b0f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:29.760655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d3efdeba-681c-4bed-a440-49e09e176374 req-653d5ba7-57d8-417e-9a0e-9295f2d44b0f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:29.786045 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d3efdeba-681c-4bed-a440-49e09e176374 req-653d5ba7-57d8-417e-9a0e-9295f2d44b0f service nova] Creating event network-changed:2e43e4a0-b8de-4b8f-8260-80793befa928 for instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 on nch1-master-1 Jun 18 22:18:29.794972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d3efdeba-681c-4bed-a440-49e09e176374 req-653d5ba7-57d8-417e-9a0e-9295f2d44b0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490763 Jun 18 22:18:29.795651 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1957/3905] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:29.809479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:29.814675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:29.826073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:29.826805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:29.827804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:29.828421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:30.318086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:30.328911 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4cfd6dc0-b63a-42bf-a0e1-bf642731ab4a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.748785 Jun 18 22:18:30.329545 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1949/3906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:29 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:30.341912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:30.353491 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d218275d-f3f9-462a-81b2-fe1afa52fe3c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1472 microversion: 2.1 time: 0.551595 Jun 18 22:18:30.354120 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1958/3907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:29 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1472 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:30.365981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:30.369661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:30.370543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:30.371461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:30.413670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:30.414128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:30.415386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:30.415854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:30.416655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:30.417140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:30.421385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:30.421846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:31.139161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:31.156695 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09e89830-848e-47c1-97b7-bd1fd5ee103d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.798517 Jun 18 22:18:31.158813 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1950/3908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:30 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:31.172589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1259925478", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:31.206309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:31.215827 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0105a128-086b-46e2-a8a6-00a4cc6a40b4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.860238 Jun 18 22:18:31.221685 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1959/3909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:30 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:31.230676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-972fa3b1-75d9-49c3-849a-dded05a6dccc req-e3d29e76-a619-4e04-b2ad-be686e6d0f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dae9ded-d68a-47f1-b2cb-762ba19f91cc", "name": "network-vif-plugged", "status": "completed", "tag": "f62a3bcb-9abc-4923-8596-cb8240cff0f8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:31.253699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-972fa3b1-75d9-49c3-849a-dded05a6dccc req-e3d29e76-a619-4e04-b2ad-be686e6d0f09 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:31.254645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-972fa3b1-75d9-49c3-849a-dded05a6dccc req-e3d29e76-a619-4e04-b2ad-be686e6d0f09 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:31.267858 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-972fa3b1-75d9-49c3-849a-dded05a6dccc req-e3d29e76-a619-4e04-b2ad-be686e6d0f09 service nova] Creating event network-vif-plugged:f62a3bcb-9abc-4923-8596-cb8240cff0f8 for instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc on nch1-master-1 Jun 18 22:18:31.279457 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-972fa3b1-75d9-49c3-849a-dded05a6dccc req-e3d29e76-a619-4e04-b2ad-be686e6d0f09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052781 Jun 18 22:18:31.286131 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1960/3910] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:31.319624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:31.347784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:31.348821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:31.364580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:31.365026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:31.371906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:31.373094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:31.912744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:31.921179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ad30ff0-a5f2-4afb-84c1-7047444238c6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 0.578042 Jun 18 22:18:31.925793 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1961/3911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:31 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:32.175222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:32.176184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:32.190459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.193647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.197884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.201252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.213317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:32.503458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:32.709089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:32.709926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:32.712005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:32.712582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:32.714981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:32.722071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:32.734424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.736899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.738060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.740286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.796948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:32.805882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:32.843194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:32.851326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:32.891481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:32.905916 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-67ff34a6-2c52-492b-b310-4c77bd52a93e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.734820 Jun 18 22:18:32.908511 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1962/3912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:32 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:32.926348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:32.929817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:32.952181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.961719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.963860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.964679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.967480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e7439ee-e6db-4771-a769-3f4be9b36c24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.805359 Jun 18 22:18:32.968911 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1951/3913] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:32.979520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:32.980523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:32.997254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:32.997962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:32.999328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:33.000556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.305649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:34.321450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:34.334331 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59d73b95-db6a-4c3b-be1f-7436250e93c2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1315 microversion: 2.1 time: 1.363541 Jun 18 22:18:34.337891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1952/3914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:32 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1315 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:34.348661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:34.349516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:34.356646 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-962c2b4e-d198-4459-a2b5-f85c92cfc4f9 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 1.445600 Jun 18 22:18:34.357605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1963/3915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:32 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:34.364469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c60ae091-7a72-4156-9f5c-abc9171de4ef tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'create', calling method: .version_select at 0x7fea077394c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1762680078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP89YE95Nj+0zo3J6yhscQjqLp6ErBeaElk5u96IA8v5AmE7A5R7oTkDyV86d6OJIKWQ2SIhP+3W9oOMFw6OmocslfLEeLdHMCL1h8pwol+lmyW680IivZafYCpSgMa+0A=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:34.373475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.374042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.376265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.377612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.440864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c60ae091-7a72-4156-9f5c-abc9171de4ef tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for project 970d8031a4b149188d5a2bee95524169. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:34.443715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:18:34.488978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c60ae091-7a72-4156-9f5c-abc9171de4ef tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for user caa130c208d44d798cb0a5ba41193976 and project 970d8031a4b149188d5a2bee95524169. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:34.595108 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c60ae091-7a72-4156-9f5c-abc9171de4ef tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.236045 Jun 18 22:18:34.596119 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1964/3916] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:18:34 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:34.618186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-82b7459f-6f22-4a48-8222-ca2d0db1a441 req-d0d23e04-c3ae-418d-a9ac-cc8784b318a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb89987-1b96-49ac-934c-0eb181958529", "name": "network-vif-plugged", "status": "completed", "tag": "7935099b-2e45-473c-a197-b38522d9d453"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:34.641474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-82b7459f-6f22-4a48-8222-ca2d0db1a441 req-d0d23e04-c3ae-418d-a9ac-cc8784b318a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.643551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-82b7459f-6f22-4a48-8222-ca2d0db1a441 req-d0d23e04-c3ae-418d-a9ac-cc8784b318a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.672265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-82b7459f-6f22-4a48-8222-ca2d0db1a441 req-d0d23e04-c3ae-418d-a9ac-cc8784b318a0 service nova] Creating event network-vif-plugged:7935099b-2e45-473c-a197-b38522d9d453 for instance 7fb89987-1b96-49ac-934c-0eb181958529 on nch2-master-1 Jun 18 22:18:34.673737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f68e27f-2d06-46de-8c4f-445215fa3bbf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 204 len: 0 microversion: 2.1 time: 0.333667 Jun 18 22:18:34.674758 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1953/3917] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:34 2022] DELETE /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:18:34.684214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:34.685284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:34.690199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-82b7459f-6f22-4a48-8222-ca2d0db1a441 req-d0d23e04-c3ae-418d-a9ac-cc8784b318a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090764 Jun 18 22:18:34.693304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.693994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.694402 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1965/3918] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:34.695221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.695841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.709547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:34.713555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:34.734185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.745352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.752071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:34.753011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:34.899483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:34.909378 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e9d5489-58c6-45f8-85c6-b7abcb527ddb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 200 len: 1267 microversion: 2.1 time: 0.213599 Jun 18 22:18:34.910504 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1966/3919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:34 2022] GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:35.137169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:35.165690 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-349f6526-3b3e-4124-884d-f54b9f9dade5 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1316 microversion: 2.1 time: 0.483140 Jun 18 22:18:35.166683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1954/3920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:34 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:35.357146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:35.357794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:35.374824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:35.375572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:35.382921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:35.383462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:35.390155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:35.390865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:35.392034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:35.393707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:35.402494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:35.403362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:36.064227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:36.078901 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c59e1c1-0b79-4f9f-871d-8c87cc9cf8af tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1502 microversion: 2.1 time: 0.728772 Jun 18 22:18:36.085023 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1967/3921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:35 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1502 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:36.092834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:36.111353 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35c1404a-42d8-4fa6-b4dc-f545df947a25 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.740292 Jun 18 22:18:36.125473 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1955/3922] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:35 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:36.126396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:36.127487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:36.147336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:36.147792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:36.149273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:36.154317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:36.250196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1492184246", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "7fea0490-51ef-4fce-b315-f07b124a3a96"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:36.342467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] validate_networks() for [('7fea0490-51ef-4fce-b315-f07b124a3a96', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:36.357167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:36.369870 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-04107d3d-eb70-4f64-a111-566332e28a54 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 200 len: 1211 microversion: 2.1 time: 0.253531 Jun 18 22:18:36.371645 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1956/3923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:36 2022] GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 1211 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:36.384755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e576be6c-9365-42ac-a901-04c03ea0d4d4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:36.404165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e576be6c-9365-42ac-a901-04c03ea0d4d4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:36.405540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e576be6c-9365-42ac-a901-04c03ea0d4d4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:36.576568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e576be6c-9365-42ac-a901-04c03ea0d4d4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Going to try to stop instance {{(pid=130903) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:18:36.670927 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e576be6c-9365-42ac-a901-04c03ea0d4d4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc/action" status: 202 len: 0 microversion: 2.1 time: 0.296402 Jun 18 22:18:36.672275 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1957/3924] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:18:36 2022] POST /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:18:36.679492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:36.680513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:36.694696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:36.695741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:36.696770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:36.697443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.106619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:37.129086 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-97a38bcb-3ece-405c-9096-ff2e11051897 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1506 microversion: 2.1 time: 0.454903 Jun 18 22:18:37.130319 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1958/3925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:36 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:37.149897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:37.150986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:37.163056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.165684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.167137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.168614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.220776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:37.392915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:37.394665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:37.395603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:37.396258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:37.396840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:37.423132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.424086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.425750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.427151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.493970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Getting quotas for project 691097edd2ac46af9e83a119b87340e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:37.511560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Getting quotas for user eb2d051325e2465b8eb1fa505770857c and project 691097edd2ac46af9e83a119b87340e8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:37.546449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:37.553062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:37.595730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:37.615636 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d146be75-51fa-4492-9f6b-da2ee0d3eeac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.481092 Jun 18 22:18:37.616732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1959/3926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:37 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:37.625518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:37.628848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:37.645898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.649628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.662410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.663151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.699754 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-34f798df-1e50-4eb4-b69e-e957f7092c3b tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602663 Jun 18 22:18:37.702575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1968/3927] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:37.718958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:37.719969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:37.741653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.742482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.743945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.746001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.806937 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-781d63fe-cc8d-47f6-bd91-505d4121cf07 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529/ips" status: 200 len: 110 microversion: 2.1 time: 0.102982 Jun 18 22:18:37.817292 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1969/3928] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:18:37 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529/ips => generated 110 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:37.835326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:37.836205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:37.855419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.860089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:37.860089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:37.860089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.111112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:38.131251 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db6b143c-007d-49c8-a8dd-b797975825e6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 200 len: 1213 microversion: 2.1 time: 0.305254 Jun 18 22:18:38.132528 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1970/3929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:37 2022] GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 1213 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:38.160293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95c914bc-ebad-4d58-9964-2036acba21d7 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:38.161656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95c914bc-ebad-4d58-9964-2036acba21d7 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:38.206595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:38.221904 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4880f155-39b1-4170-8d49-a4496476030a tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.602946 Jun 18 22:18:38.222571 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1960/3930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:37 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:38.245902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:38.247024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:38.265222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.265677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.302829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.303246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.311977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-95c914bc-ebad-4d58-9964-2036acba21d7 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:38.319821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95c914bc-ebad-4d58-9964-2036acba21d7 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1225 microversion: 2.1 time: 0.185719 Jun 18 22:18:38.320453 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1971/3931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:38 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:38.327901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1023021101", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "0a4d0801-4348-4a8b-af9b-fe54a350a53c"}], "key_name": "tempest-TestNetworkBasicOps-1762680078", "security_groups": [{"name": "tempest-secgroup-smoke-185507910"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:38.396153 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-74666f6f-26d4-4b41-b681-338b270dc599 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529/ips" status: 200 len: 110 microversion: 2.1 time: 0.172513 Jun 18 22:18:38.425458 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1961/3932] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:18:38 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529/ips => generated 110 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:38.437296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:38.439148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:38.465532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.466557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.468574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.469021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.592697 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff68cbd0-e1b0-4126-b3c8-f47bd20f5718 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529/ips/tempest-ServerAddressesTestJSON-1513059975-network" status: 200 len: 95 microversion: 2.1 time: 0.163215 Jun 18 22:18:38.596965 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1962/3933] 10.222.0.30 () {58 vars in 1400 bytes} [Sat Jun 18 22:18:38 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529/ips/tempest-ServerAddressesTestJSON-1513059975-network => generated 95 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:18:38.620772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:38.624003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:38.660850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.666457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.667204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] validate_networks() for [('0a4d0801-4348-4a8b-af9b-fe54a350a53c', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:38.667695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.667695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.723378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:18:38.928673 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81ad8cea-5be6-4047-a8bf-936dcfe888d3 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 204 len: 0 microversion: 2.1 time: 0.319940 Jun 18 22:18:38.940285 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1963/3934] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:38 2022] DELETE /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:18:38.946313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:38.946894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:38.968750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.969234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:38.970016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:38.970448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.344324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:39.357133 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6af2ae65-b0e9-4981-aabb-80c2a621a533 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.415209 Jun 18 22:18:39.368654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1964/3935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:38 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:39.382925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:39.397679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:39.414969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.415476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.416450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.417454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.661480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:39.661911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:39.662393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:39.662802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:39.663217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:39.679529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.680143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.680753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.681292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.705396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for project 970d8031a4b149188d5a2bee95524169. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:39.709624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:39.718893 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0458981-06e4-404b-881f-aa080fea058e tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1512 microversion: 2.1 time: 0.344518 Jun 18 22:18:39.719480 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1965/3936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:39 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:39.722393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for user caa130c208d44d798cb0a5ba41193976 and project 970d8031a4b149188d5a2bee95524169. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:39.724796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:39.725672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:39.732165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.732857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.733777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.734209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.739887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:39.742510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:39.753449 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 HTTP/1.1 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '19271ca1-19b8-483b-8b5c-0362c2f68cc0'} Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:39.755466 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:39.761688 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c2c3f2b8-48fc-4462-9830-72127a92c015 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 404 len: 111 microversion: 2.1 time: 0.038747 Jun 18 22:18:39.772756 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1966/3937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:39 2022] GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:39.772756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:39.776744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:39.780075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:39.786829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.787509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.788405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.788934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.846067 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6589b96-02eb-43c0-b60e-69b0d96d2219 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.523278 Jun 18 22:18:39.854372 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1972/3938] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:39.864400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:39.866175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:39.874762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.875613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:39.876744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:39.877548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:40.005093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:40.030578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa95678c-ba0a-4062-9695-6b04374d9ea6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1277 microversion: 2.1 time: 0.174153 Jun 18 22:18:40.031208 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1973/3939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:39 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:40.041485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61a9aedc-7676-4f82-9836-0095e87b06a5 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:40.044350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61a9aedc-7676-4f82-9836-0095e87b06a5 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:40.154058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61a9aedc-7676-4f82-9836-0095e87b06a5 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:40.155120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:40.166733 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61a9aedc-7676-4f82-9836-0095e87b06a5 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1249 microversion: 2.1 time: 0.134254 Jun 18 22:18:40.171487 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b91375a4-ccba-414b-82cd-20ced72b21bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.406703 Jun 18 22:18:40.172473 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1974/3940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:40 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1249 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:40.185272 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1967/3941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:39 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:40.189406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-596316147", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:40.254584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:40.385459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:40.386079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:40.398186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:40.398602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:40.399443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:40.399889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:40.812391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:40.824216 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3adef365-cdb4-4ac3-9f2a-6bb6f112504f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.442750 Jun 18 22:18:40.827359 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1968/3942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:40 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:40.841844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-60e724ae-99e4-4add-9374-439fd745bc48 req-aeb54654-f78f-406b-a79b-6e132fd6f7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ce7b3f-9e5b-4640-ad51-7495bc89edc1", "name": "network-vif-plugged", "status": "completed", "tag": "2e43e4a0-b8de-4b8f-8260-80793befa928"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:40.855849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-60e724ae-99e4-4add-9374-439fd745bc48 req-aeb54654-f78f-406b-a79b-6e132fd6f7a9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:40.856673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-60e724ae-99e4-4add-9374-439fd745bc48 req-aeb54654-f78f-406b-a79b-6e132fd6f7a9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:40.885502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-60e724ae-99e4-4add-9374-439fd745bc48 req-aeb54654-f78f-406b-a79b-6e132fd6f7a9 service nova] Creating event network-vif-plugged:2e43e4a0-b8de-4b8f-8260-80793befa928 for instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 on nch1-master-1 Jun 18 22:18:40.896095 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-60e724ae-99e4-4add-9374-439fd745bc48 req-aeb54654-f78f-406b-a79b-6e132fd6f7a9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064808 Jun 18 22:18:40.904055 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1969/3943] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:40.913490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:40.914540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:40.922464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:40.923308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:40.924320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:40.924822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.212493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:18:41.213218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:18:41.213797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:18:41.214286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:18:41.214770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:18:41.234503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.235282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.238140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.238720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.241118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:41.249718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7c35170-f241-4bdb-94c3-432afc12fa5d tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1512 microversion: 2.1 time: 0.344527 Jun 18 22:18:41.250401 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1970/3944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:40 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:41.256389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:41.257825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:41.264626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.266055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.268861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.269473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.272840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:41.278754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:41.294059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:18:41.301671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:18:41.323383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:41.343085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:41.352727 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25314846-30f7-4712-bc93-aef75298b48a tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1283 microversion: 2.1 time: 0.101049 Jun 18 22:18:41.354362 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1971/3945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:41 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:41.360335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:41.360954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:41.366527 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-234cb637-0a34-4bed-8704-e6f977b12543 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.192466 Jun 18 22:18:41.369208 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1975/3946] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:18:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:18:41.372661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.373181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.374008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.374453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.377610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:41.378387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:41.387964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.388537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.390116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.390609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.515527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:41.526841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c31139c3-7126-4ded-9617-d8066411d0d3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1301 microversion: 2.1 time: 0.171183 Jun 18 22:18:41.527421 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1972/3947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:41 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1301 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:41.533123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e9644f14-8647-4928-9ec2-165e02d0c946 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:41.533880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e9644f14-8647-4928-9ec2-165e02d0c946 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:41.605112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e9644f14-8647-4928-9ec2-165e02d0c946 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:41.625833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e9644f14-8647-4928-9ec2-165e02d0c946 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1220 microversion: 2.1 time: 0.097108 Jun 18 22:18:41.627425 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1973/3948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:41 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:41.666776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:41.676476 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe818594-4754-4492-88da-603a0d77fd52 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1323 microversion: 2.1 time: 0.305584 Jun 18 22:18:41.677888 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1976/3949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:41 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:41.845163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:41.845783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:41.853803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.854165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:41.854951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:41.855604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.017015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:42.035178 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f8bae8c-9f6b-4239-9b6c-060b20f52eb1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.194786 Jun 18 22:18:42.048511 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1974/3950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:41 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:42.116951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-40a1a868-baa4-4417-a829-63d5ea82fde8 req-a08cdba1-d5d8-44eb-aa75-19eb2286e4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb89987-1b96-49ac-934c-0eb181958529", "name": "network-vif-deleted", "tag": "7935099b-2e45-473c-a197-b38522d9d453"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:42.144368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-40a1a868-baa4-4417-a829-63d5ea82fde8 req-a08cdba1-d5d8-44eb-aa75-19eb2286e4ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.145207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-40a1a868-baa4-4417-a829-63d5ea82fde8 req-a08cdba1-d5d8-44eb-aa75-19eb2286e4ec service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.161284 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-40a1a868-baa4-4417-a829-63d5ea82fde8 req-a08cdba1-d5d8-44eb-aa75-19eb2286e4ec service nova] Creating event network-vif-deleted:7935099b-2e45-473c-a197-b38522d9d453 for instance 7fb89987-1b96-49ac-934c-0eb181958529 on nch2-master-1 Jun 18 22:18:42.168358 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-40a1a868-baa4-4417-a829-63d5ea82fde8 req-a08cdba1-d5d8-44eb-aa75-19eb2286e4ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060073 Jun 18 22:18:42.168972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1977/3951] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:42.268607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:42.269475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:42.279096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.280341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.281427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.282206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.325260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.326090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.327166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lazy-loading 'fault' on Instance uuid 7fb89987-1b96-49ac-934c-0eb181958529 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:18:42.370983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:42.372749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:42.384878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.385371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.386176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.386621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.768231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:42.836795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deabdfddc88b4db2bb61ae4da4b4808d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a741fcf70249ecb8c3c727459c84c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:42.848363 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d376ecb0-5022-4795-890c-d102195f6bef tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 200 len: 1306 microversion: 2.1 time: 0.584379 Jun 18 22:18:42.859867 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1975/3952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:42 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 1306 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:42.865746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:42.866982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:42.876451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.877451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.878500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:42.879443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:42.997238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:43.005091 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ab32cca-f813-4bce-b637-e59529f17a12 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1307 microversion: 2.1 time: 0.143486 Jun 18 22:18:43.015352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1976/3953] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:42 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1307 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:43.020536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:43.021430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:43.028080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.028575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.029579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.030186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.047260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:43.127457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:43.132345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:43.138730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c44f319-959c-405d-b1fb-aabba1f4edf5 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1325 microversion: 2.1 time: 0.772452 Jun 18 22:18:43.140062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1978/3954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:42 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1325 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:43.141633 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ccbe99eb-94fa-4547-9032-35494102d256 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1272 microversion: 2.1 time: 0.124459 Jun 18 22:18:43.142760 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1977/3955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:43 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:43.148348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:43.149292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:43.152244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:43.153657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:43.162054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.162759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.163736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.164364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.186656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.187242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.190378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.192253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.789426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:43.842320 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9324b43-0035-478a-bf1a-aeaa76c2e732 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.695468 Jun 18 22:18:43.844659 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1979/3956] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:43 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:43.847635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:43.861105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-869e6ebe-acd7-4cd2-be47-38a2a01039bc tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1520 microversion: 2.1 time: 0.717038 Jun 18 22:18:43.863364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1978/3957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:43 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1520 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:43.885930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:43.886457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:43.886974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] [instance: 7fb89987-1b96-49ac-934c-0eb181958529] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:43.887633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:43.897951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.898409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.899205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.899565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.899785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.909780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.910732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:43.911604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:43.927119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] HTTP exception thrown: Instance 7fb89987-1b96-49ac-934c-0eb181958529 could not be found. Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Request method failure captured: Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 HTTP/1.1 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8hGA4Dj6ed8fj4rpeukQcVq8p4iAyIFh3EJG0auAF0cQH0IAnd7pmzI4kD-D-UcWXqQGjeY9FQH4B2t67py-ccKC4U9iNXnVDEg0cfggnXEdlFXZP98EZvkEK2e886Ok2fGx2y1Gpqr_WWnOiln_hhpDmt7MARdfWk9FdUVphfzLs Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b2a741fcf70249ecb8c3c727459c84c9 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerAddressesTestJSON-1228458904 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b2a741fcf70249ecb8c3c727459c84c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2a741fcf70249ecb8c3c727459c84c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b2a741fcf70249ecb8c3c727459c84c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b2a741fcf70249ecb8c3c727459c84c9", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerAddressesTestJSON-1228458904 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b2a741fcf70249ecb8c3c727459c84c9 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1228458904 Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerAddressesTestJSON-1228458904-project Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: deabdfddc88b4db2bb61ae4da4b4808d Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerAddressesTestJSON-1228458904-project Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7fb89987-1b96-49ac-934c-0eb181958529 could not be found. Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fb89987-1b96-49ac-934c-0eb181958529'} Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb89987-1b96-49ac-934c-0eb181958529 could not be found. Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb89987-1b96-49ac-934c-0eb181958529 could not be found. Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:43.929124 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb89987-1b96-49ac-934c-0eb181958529 could not be found. Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] Returning 404 to user: Instance 7fb89987-1b96-49ac-934c-0eb181958529 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:43.932988 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08431eb5-9532-4ecf-b54a-827cf8cd2d63 tempest-ServerAddressesTestJSON-1228458904 tempest-ServerAddressesTestJSON-1228458904-project] 10.222.0.30 "GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529" status: 404 len: 111 microversion: 2.1 time: 0.067799 Jun 18 22:18:43.935561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1980/3958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:43 2022] GET /compute/v2.1/servers/7fb89987-1b96-49ac-934c-0eb181958529 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:43.960530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:18:44.031737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:44.041617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:44.048499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.049208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.051300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.052089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.164004 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3f382232-49d0-4946-b8ef-77a2c1fd8b2c tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 204 len: 0 microversion: 2.1 time: 0.286513 Jun 18 22:18:44.170204 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1979/3959] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:43 2022] DELETE /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:18:44.176844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:44.177565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:44.184535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.185555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.186395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.186839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.342619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:44.350808 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83235c3f-1e87-45b5-b5f3-7b48c819e997 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1307 microversion: 2.1 time: 0.331801 Jun 18 22:18:44.351545 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1981/3960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:44 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:44.358848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:44.359523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:44.369507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.369994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.370776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.371227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.526259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:44.543245 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e6a00d2-82c1-4dda-aef0-078709631b90 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1278 microversion: 2.1 time: 0.190548 Jun 18 22:18:44.544395 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1982/3961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:44 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:44.549532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:44.550164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:44.557211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.557683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.558547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.558998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.709666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:44.717492 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-967a3bc9-681d-4c1d-88eb-11d20b7d9b45 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1325 microversion: 2.1 time: 0.545661 Jun 18 22:18:44.718051 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1980/3962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:44 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1325 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:44.723602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e09db9ce-88c5-4f09-b7f6-54ae336dd73b req-a07a984c-7a2d-4104-80c9-1572cdedbc45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bc08db-1348-4301-87c3-f75066fa4af2", "tag": "84f690da-91fc-4030-a00d-25a802028393"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:44.732307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e09db9ce-88c5-4f09-b7f6-54ae336dd73b req-a07a984c-7a2d-4104-80c9-1572cdedbc45 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.733097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e09db9ce-88c5-4f09-b7f6-54ae336dd73b req-a07a984c-7a2d-4104-80c9-1572cdedbc45 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.754634 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e09db9ce-88c5-4f09-b7f6-54ae336dd73b req-a07a984c-7a2d-4104-80c9-1572cdedbc45 service nova] Creating event network-changed:84f690da-91fc-4030-a00d-25a802028393 for instance 42bc08db-1348-4301-87c3-f75066fa4af2 on nch2-master-1 Jun 18 22:18:44.760002 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e09db9ce-88c5-4f09-b7f6-54ae336dd73b req-a07a984c-7a2d-4104-80c9-1572cdedbc45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040396 Jun 18 22:18:44.760720 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1981/3963] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:44.865310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:44.868481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:44.875743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.876393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.878090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:44.878663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:44.924498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:44.934109 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aa9acf36-ed46-4414-950f-2622eeaca1c4 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1526 microversion: 2.1 time: 0.388640 Jun 18 22:18:44.944697 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1983/3964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:44 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1526 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:45.180544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:45.201866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31bf16ef-da7b-40e7-b669-68d63203d600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.343546 Jun 18 22:18:45.213086 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1982/3965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:44 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:45.368852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:45.369490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:45.384859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:45.385561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:45.386511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:45.387084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:45.569612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:45.570552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:45.578920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:45.579583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:45.580809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:45.589486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:45.840041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:45.855608 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ae81e8f1-a260-4680-abe6-d8d50ddaeb15 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.484876 Jun 18 22:18:45.859039 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1984/3966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:45 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:45.868803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:45.869719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:45.877817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:45.878577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:45.879537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:45.880175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:46.116780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:46.127600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-256affdb-17ac-450e-a2a3-f035135f5b9b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.569679 Jun 18 22:18:46.128646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1983/3967] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:45 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:46.135634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:46.136270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:46.153861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:46.154322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:46.155114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:46.155557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:46.483822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:46.506436 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a1ed2f0-393a-44fd-ad0a-06e6ab5d1f54 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1325 microversion: 2.1 time: 0.645903 Jun 18 22:18:46.513774 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1985/3968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:45 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1325 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:46.524219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:46.531023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:46.547484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:46.548089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:46.549622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:46.554648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:46.598113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:47.026841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:47.039205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-69cc738e-0018-4d5b-ae3e-c143b7dd4645 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1526 microversion: 2.1 time: 0.909415 Jun 18 22:18:47.049510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1984/3969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:46 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1526 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:47.055937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:47.056870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:47.064227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.064876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.065733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.066324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.306337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:47.319228 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-155c4b98-9bbc-4954-a3fa-c7d99885ddc7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.799661 Jun 18 22:18:47.319658 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1986/3970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:46 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:47.329772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:47.330395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:47.355465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.365517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.366764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.367643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.473241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:47.501835 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-037c1ad6-32d5-4388-888b-b41144f9a889 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.451172 Jun 18 22:18:47.505077 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1985/3971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:47 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:47.528773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:47.529500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:47.551338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.552215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.553241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.554747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.922717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:47.937815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-442d395e-9387-43eb-a855-3c6d2e40adf2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.611809 Jun 18 22:18:47.939116 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1987/3972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:47 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:47.945324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-36a6e974-8f10-46fc-a077-c98d7fbc6a5f req-eee90c59-17bc-4c41-a19f-d44c05d0fc9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8ce7b3f-9e5b-4640-ad51-7495bc89edc1", "name": "network-vif-deleted", "tag": "2e43e4a0-b8de-4b8f-8260-80793befa928"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:47.968062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-36a6e974-8f10-46fc-a077-c98d7fbc6a5f req-eee90c59-17bc-4c41-a19f-d44c05d0fc9e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:47.968741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-36a6e974-8f10-46fc-a077-c98d7fbc6a5f req-eee90c59-17bc-4c41-a19f-d44c05d0fc9e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:47.982095 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-36a6e974-8f10-46fc-a077-c98d7fbc6a5f req-eee90c59-17bc-4c41-a19f-d44c05d0fc9e service nova] Creating event network-vif-deleted:2e43e4a0-b8de-4b8f-8260-80793befa928 for instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 on nch1-master-1 Jun 18 22:18:47.987687 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-36a6e974-8f10-46fc-a077-c98d7fbc6a5f req-eee90c59-17bc-4c41-a19f-d44c05d0fc9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047035 Jun 18 22:18:47.989491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1988/3973] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:48.058080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:48.059052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:48.082763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.083298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.084363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.084816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.132100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.132738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.133380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lazy-loading 'fault' on Instance uuid f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:18:48.141881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:48.158587 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6666e3cb-6525-4dfe-aaf7-29d1030d62d6 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1325 microversion: 2.1 time: 0.635200 Jun 18 22:18:48.160245 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1986/3974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:47 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1325 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:48.311159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5516d85f0ee482facf6a96e2709c41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed8b40ca3a94586a2363bd22f6de045', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:48.323521 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a2db8e56-a181-42aa-890a-582b1b04b66e tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 200 len: 1313 microversion: 2.1 time: 0.270015 Jun 18 22:18:48.325656 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1989/3975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:48 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:48.342708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:48.343942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:48.351897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.352731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.353862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.355032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.522792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:48.523708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:48.544387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.544856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.545866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.546462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.841230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:48.851301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2e811dbd-5360-484f-bdf4-4fb641287273 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.516253 Jun 18 22:18:48.861631 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1987/3976] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:48 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:48.908171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5528967b-9a17-46f5-bb8c-6c9fb597ff30 req-6afd683d-6de9-4022-8776-5363a20d71fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97e5faa-e61e-4d82-b027-c27ae57421c3", "tag": "eb0fad39-0fa9-473c-bd87-9d42b6bb9d90"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:48.920826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5528967b-9a17-46f5-bb8c-6c9fb597ff30 req-6afd683d-6de9-4022-8776-5363a20d71fa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.921304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5528967b-9a17-46f5-bb8c-6c9fb597ff30 req-6afd683d-6de9-4022-8776-5363a20d71fa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.944243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5528967b-9a17-46f5-bb8c-6c9fb597ff30 req-6afd683d-6de9-4022-8776-5363a20d71fa service nova] Creating event network-changed:eb0fad39-0fa9-473c-bd87-9d42b6bb9d90 for instance f97e5faa-e61e-4d82-b027-c27ae57421c3 on nch1-master-1 Jun 18 22:18:48.952388 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5528967b-9a17-46f5-bb8c-6c9fb597ff30 req-6afd683d-6de9-4022-8776-5363a20d71fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047984 Jun 18 22:18:48.953589 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1988/3977] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:48.959129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:48.960073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:48.967689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.968365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:48.969361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:48.969943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.129500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:49.151628 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b61e887a-9588-4e7c-9224-e1f6d3e17034 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.632729 Jun 18 22:18:49.156311 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1990/3978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:48 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:49.181166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.182018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:49.202204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.202868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.203813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.205142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.556782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:49.566875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-53ec06ce-4a66-4387-9fc4-b1fdcbdbe43d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.611911 Jun 18 22:18:49.567487 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1989/3979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:48 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:49.591198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.596474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: f8ce7b3f-9e5b-4640-ad51-7495bc89edc1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:49.614671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.615145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.620393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.621143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.648635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 could not be found. Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 HTTP/1.1 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 could not be found. Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f8ce7b3f-9e5b-4640-ad51-7495bc89edc1'} Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 could not be found. Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 could not be found. Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.650680 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 could not be found. Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:49.654572 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40f1f51c-53f3-4d34-979e-c615b890cf33 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1" status: 404 len: 111 microversion: 2.1 time: 0.068870 Jun 18 22:18:49.656707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1990/3980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:49 2022] GET /compute/v2.1/servers/f8ce7b3f-9e5b-4640-ad51-7495bc89edc1 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:49.663821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12eacf21-a032-4575-b2c0-35be2e0975de tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '.version_select at 0x7fea07557310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.695676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-12eacf21-a032-4575-b2c0-35be2e0975de tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Image not found. Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12eacf21-a032-4575-b2c0-35be2e0975de tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61 HTTP/1.1 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '91f72012-1d25-4232-88fb-726c8e11ee61'} Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 91f72012-1d25-4232-88fb-726c8e11ee61 to delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91f72012-1d25-4232-88fb-726c8e11ee61 could not be found. Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.697770 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12eacf21-a032-4575-b2c0-35be2e0975de tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12eacf21-a032-4575-b2c0-35be2e0975de tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61" status: 404 len: 62 microversion: 2.1 time: 0.041148 Jun 18 22:18:49.701527 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1991/3981] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:49 2022] DELETE /compute/v2.1/images/91f72012-1d25-4232-88fb-726c8e11ee61 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:18:49.711100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.715156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:49.728800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.731026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.731857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.732303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.753282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:49.757067 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 HTTP/1.1 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6d6b3364-316f-4865-bfec-0388e9fbd8c3'} Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:49.758639 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e611e3a3-a75a-4716-aad2-0a12bde27b79 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 404 len: 111 microversion: 2.1 time: 0.055769 Jun 18 22:18:49.761652 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1992/3982] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:49 2022] DELETE /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:49.768660 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45e013e3-11be-4dd0-ba58-d515a2618641 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1325 microversion: 2.1 time: 0.596731 Jun 18 22:18:49.768884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.777846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1991/3983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:49 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:49.778025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 6d6b3364-316f-4865-bfec-0388e9fbd8c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:49.782221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.782885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.783839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.784503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.800516 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 HTTP/1.1 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '6d6b3364-316f-4865-bfec-0388e9fbd8c3'} Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.802134 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance 6d6b3364-316f-4865-bfec-0388e9fbd8c3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef577906-dfb8-4e24-b29f-bc1b5f1b64e8 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3" status: 404 len: 111 microversion: 2.1 time: 0.038508 Jun 18 22:18:49.805783 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1993/3984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:49 2022] GET /compute/v2.1/servers/6d6b3364-316f-4865-bfec-0388e9fbd8c3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:18:49.813073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6db5da3a-3687-43c0-91be-192decc95868 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '.version_select at 0x7fea076659d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.851644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6db5da3a-3687-43c0-91be-192decc95868 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699663208" status: 202 len: 0 microversion: 2.1 time: 0.042632 Jun 18 22:18:49.851960 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1992/3985] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699663208 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:18:49.868993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:49.869758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:49.886237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.886808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:49.887689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:49.888221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:50.177465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0dd60a10-4d85-4fca-a7ac-ea1ab1659019 req-4930b62b-1b44-47c2-9a41-cb81f6ce15e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82475c63-3cfd-4bf4-9c40-fcc66000d90a", "tag": "a70156e8-cc79-4cb8-b2f0-8043439c8585"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:50.205743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:50.206210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0dd60a10-4d85-4fca-a7ac-ea1ab1659019 req-4930b62b-1b44-47c2-9a41-cb81f6ce15e2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:50.207180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0dd60a10-4d85-4fca-a7ac-ea1ab1659019 req-4930b62b-1b44-47c2-9a41-cb81f6ce15e2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:50.217969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3640c78e-f635-4c78-8fcc-da38acd3eafb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.353041 Jun 18 22:18:50.219031 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1994/3986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:49 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:50.223810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:50.224424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:50.242620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:50.247322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:50.248168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:50.248619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:50.277261 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0dd60a10-4d85-4fca-a7ac-ea1ab1659019 req-4930b62b-1b44-47c2-9a41-cb81f6ce15e2 service nova] Creating event network-changed:a70156e8-cc79-4cb8-b2f0-8043439c8585 for instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a on nch1-master-1 Jun 18 22:18:50.287939 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0dd60a10-4d85-4fca-a7ac-ea1ab1659019 req-4930b62b-1b44-47c2-9a41-cb81f6ce15e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119808 Jun 18 22:18:50.289241 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1993/3987] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:50.588049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:50.588984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:50.617963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:50.618440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:50.620456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:50.622220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:51.102512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:51.115995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d47c117b-99e4-46b3-b71d-a9da2522dbe2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.535110 Jun 18 22:18:51.126002 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1994/3988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:50 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:51.138626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ea0bc34d-05c5-45bc-9771-569a2ac784ac req-32e8e478-27d8-4d5c-97ee-fef9a27477a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bc08db-1348-4301-87c3-f75066fa4af2", "name": "network-vif-plugged", "status": "completed", "tag": "84f690da-91fc-4030-a00d-25a802028393"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:51.170003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea0bc34d-05c5-45bc-9771-569a2ac784ac req-32e8e478-27d8-4d5c-97ee-fef9a27477a8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:51.170729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea0bc34d-05c5-45bc-9771-569a2ac784ac req-32e8e478-27d8-4d5c-97ee-fef9a27477a8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:51.186081 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ea0bc34d-05c5-45bc-9771-569a2ac784ac req-32e8e478-27d8-4d5c-97ee-fef9a27477a8 service nova] Creating event network-vif-plugged:84f690da-91fc-4030-a00d-25a802028393 for instance 42bc08db-1348-4301-87c3-f75066fa4af2 on nch2-master-1 Jun 18 22:18:51.186723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:51.192934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ea0bc34d-05c5-45bc-9771-569a2ac784ac req-32e8e478-27d8-4d5c-97ee-fef9a27477a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065050 Jun 18 22:18:51.194189 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1995/3989] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:51.195859 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1373a0f-09ef-44a7-9e1b-ea63c603aca3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.975747 Jun 18 22:18:51.196449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1995/3990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:50 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:51.212896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:51.214022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:51.221104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:51.221989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:51.223062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:51.223755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:51.240555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:51.241231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:51.251566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:51.255536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:51.258377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:51.258998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:51.263712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:51.287125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=26 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:51.312599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:51.616488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:52.057170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:52.059269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:52.067313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28c86d00-303e-4a42-86cf-2ce15d083ebd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.835138 Jun 18 22:18:52.068288 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1996/3991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:51 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:52.073610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a085f774-9e68-4a03-8a92-4cd79b75e3bd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '.version_select at 0x7fea075d6040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:52.087002 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7addb8c-ea7a-473d-9218-be281e66d07f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1325 microversion: 2.1 time: 0.891272 Jun 18 22:18:52.095953 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1996/3992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:51 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1325 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:52.119611 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a085f774-9e68-4a03-8a92-4cd79b75e3bd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Image not found. Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a085f774-9e68-4a03-8a92-4cd79b75e3bd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/images/4f0bb6f1-512a-4185-9b46-169a22e8770f HTTP/1.1 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: exception: Image not found. Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '4f0bb6f1-512a-4185-9b46-169a22e8770f'} Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4f0bb6f1-512a-4185-9b46-169a22e8770f to delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f0bb6f1-512a-4185-9b46-169a22e8770f could not be found. Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.121021 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a085f774-9e68-4a03-8a92-4cd79b75e3bd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Image not found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a085f774-9e68-4a03-8a92-4cd79b75e3bd tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/images/4f0bb6f1-512a-4185-9b46-169a22e8770f" status: 404 len: 62 microversion: 2.1 time: 0.054156 Jun 18 22:18:52.124303 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1997/3993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:52 2022] DELETE /compute/v2.1/images/4f0bb6f1-512a-4185-9b46-169a22e8770f => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:18:52.135002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:52.135628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:52.136926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:52.141289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:52.143153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.143617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.144703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.145374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.151674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.152127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.152917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.153961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.182939 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c HTTP/1.1 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c'} Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:52.184875 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.188312 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.190410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:52.191550 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb96a01b-e8de-4858-a62d-407a5b37ad32 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 404 len: 111 microversion: 2.1 time: 0.060577 Jun 18 22:18:52.192617 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1997/3994] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:52 2022] DELETE /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:52.204270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:52.205182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] [instance: 7fbf8789-21b7-46a1-9b8f-be1e66d4546c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:52.212864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.213363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.214176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.214618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.231250 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] HTTP exception thrown: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Request method failure captured: Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c HTTP/1.1 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk7Dq-46C0wWzgZ5wrb_HURz6v450-Dvw8LLmgQIXaweKpSjSO-kXJ58YnBuRwsSZI-FrqhM3gFH3US0dn-DlyzzAJmgzO-BTVeNuHxPbr6-SHzKIzXBEDnGGFGYg--cJ0wJ_2VrifYHbp6QqGlVYD_M0c6Bx0z3hEygmxlbYtrBPAQ Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ed8b40ca3a94586a2363bd22f6de045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ed8b40ca3a94586a2363bd22f6de045", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2ed8b40ca3a94586a2363bd22f6de045 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047 Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d5516d85f0ee482facf6a96e2709c41d Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1167275047-project Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fbf8789-21b7-46a1-9b8f-be1e66d4546c'} Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.232942 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] Returning 404 to user: Instance 7fbf8789-21b7-46a1-9b8f-be1e66d4546c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:52.236697 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ccfd7464-ec2f-4c85-b022-fd773f734f14 tempest-ImagesOneServerNegativeTestJSON-1167275047 tempest-ImagesOneServerNegativeTestJSON-1167275047-project] 10.222.0.30 "GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c" status: 404 len: 111 microversion: 2.1 time: 0.034878 Jun 18 22:18:52.238464 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1998/3995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:52 2022] GET /compute/v2.1/servers/7fbf8789-21b7-46a1-9b8f-be1e66d4546c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:52.243454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:52.244076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:52.251210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.251997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.253024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:52.253901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:52.761814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:52.773856 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59383c14-bbcc-4646-bd67-8a05ef3065e1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.642755 Jun 18 22:18:52.775125 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1998/3996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:52 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:52.837966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:52.848864 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab948fe8-2ea6-4948-ae82-e2f82d8a3cee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.609258 Jun 18 22:18:52.849487 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 1999/3997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:52 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:53.087212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.089698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.099332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.100116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.100996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.103961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.108123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.109529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.123618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.125488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.128044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.128848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.580084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:53.590641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe6043ea-753c-4dab-9f13-cba5364d287c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1522 microversion: 2.1 time: 0.489816 Jun 18 22:18:53.591256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:53.604199 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ce56b62-fbfb-4067-b181-bc071fe24065 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.522491 Jun 18 22:18:53.604822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2000/3998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:53 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:53.605274 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 1999/3999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:53 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:53.614303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.615203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.622034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.622727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.623943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.624540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.658566 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] HTTP exception thrown: Action 999 not found Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Request method failure captured: Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2/os-instance-actions/999 HTTP/1.1 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk87W_H5WbGH_YydEfM0nmyPqcZu2YzuvaREtx-2HculbFWNzwGrCSi1x-0lV8QXFJKKc2eVgBWLodGBb12D0G49rdAb5e2Ftuvuy07kqJK4nm7Q8VBr4zMLdBkt7eBniz4ioX_dvleg9rMI7M_FhhiVmWU_n-7LaGtUzB9sZERFFOU Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 691097edd2ac46af9e83a119b87340e8 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_691097edd2ac46af9e83a119b87340e8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 691097edd2ac46af9e83a119b87340e8 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-InstanceActionsNegativeTestJSON-37815190-project Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: eb2d051325e2465b8eb1fa505770857c Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-37815190-project Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: exception: Action 999 not found Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '42bc08db-1348-4301-87c3-f75066fa4af2', 'id': '999'} Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 18 22:18:53.663771 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.667773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Returning 404 to user: Action 999 not found {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:53.668642 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b35f130-af6b-4007-85a9-8c09980a249f tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.062591 Jun 18 22:18:53.669453 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2001/4000] 10.222.0.30 () {58 vars in 1307 bytes} [Sat Jun 18 22:18:53 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2/os-instance-actions/999 => generated 66 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:18:53.680398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd3c27b6-fc2e-45a3-800f-623a950b09cf tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '.version_select at 0x7fea07598ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.681272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fd3c27b6-fc2e-45a3-800f-623a950b09cf tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 34762897-377e-46ec-86cd-78bfd2713cf3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.687379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fd3c27b6-fc2e-45a3-800f-623a950b09cf tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] HTTP exception thrown: Instance 34762897-377e-46ec-86cd-78bfd2713cf3 could not be found. Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd3c27b6-fc2e-45a3-800f-623a950b09cf tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Request method failure captured: Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/34762897-377e-46ec-86cd-78bfd2713cf3/os-instance-actions HTTP/1.1 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk87W_H5WbGH_YydEfM0nmyPqcZu2YzuvaREtx-2HculbFWNzwGrCSi1x-0lV8QXFJKKc2eVgBWLodGBb12D0G49rdAb5e2Ftuvuy07kqJK4nm7Q8VBr4zMLdBkt7eBniz4ioX_dvleg9rMI7M_FhhiVmWU_n-7LaGtUzB9sZERFFOU Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 691097edd2ac46af9e83a119b87340e8 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_691097edd2ac46af9e83a119b87340e8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 691097edd2ac46af9e83a119b87340e8 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-InstanceActionsNegativeTestJSON-37815190-project Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: eb2d051325e2465b8eb1fa505770857c Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-37815190-project Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 34762897-377e-46ec-86cd-78bfd2713cf3 could not be found. Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': '34762897-377e-46ec-86cd-78bfd2713cf3'} Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34762897-377e-46ec-86cd-78bfd2713cf3 could not be found. Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:53.689373 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34762897-377e-46ec-86cd-78bfd2713cf3 could not be found. Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34762897-377e-46ec-86cd-78bfd2713cf3 could not be found. Jun 18 22:18:53.693418 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:53.694184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd3c27b6-fc2e-45a3-800f-623a950b09cf tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Returning 404 to user: Instance 34762897-377e-46ec-86cd-78bfd2713cf3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:53.695141 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fd3c27b6-fc2e-45a3-800f-623a950b09cf tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/34762897-377e-46ec-86cd-78bfd2713cf3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.019117 Jun 18 22:18:53.697092 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2000/4001] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Jun 18 22:18:53 2022] GET /compute/v2.1/servers/34762897-377e-46ec-86cd-78bfd2713cf3/os-instance-actions => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:18:53.706944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.707355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.714157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.714598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.715363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.715795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.745849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:18:53.793623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.794427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.811199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.812505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.814291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.817196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.899918 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c69c45b9-9fd1-415e-956d-c825547266c3 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 204 len: 0 microversion: 2.1 time: 0.196522 Jun 18 22:18:53.900691 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2002/4002] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:18:53 2022] DELETE /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:18:53.912190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:53.915215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:53.931816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.932434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:53.934657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:53.937469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:54.253169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:54.264175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9050c95-d73e-4149-850c-419baa1eec27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.475350 Jun 18 22:18:54.264780 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2001/4003] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:53 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:54.279071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:54.279686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:54.297761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:54.298479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:54.299518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:54.300222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:54.310013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:54.326170 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0891168c-be1e-4405-8a21-af0c5e569359 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.420519 Jun 18 22:18:54.327291 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2003/4004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:53 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:54.526288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:54.534757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36fac1b8-ee37-4553-9c52-b15da1cdaa29 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1528 microversion: 2.1 time: 0.259431 Jun 18 22:18:54.540250 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2002/4005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:54 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1528 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:54.608473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1fa8470-4600-4fdb-9409-e16117b6d4d1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'create', calling method: .version_select at 0x7fea141a55e0>, body: {"keypair": {"name": "tempest-keypair-805130639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWDPOIxm2cdyzAzwKnXj+NHyqVWQ7/WYJXC1XodpKubXexjJTzXzdXAPdm0ZJov5dKhwrg2WswIXrDp+RLJLKzQhz5ZVurc8rEgExuFxmlvZpRnVBuCYROpoU6PnCx6+Q=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:54.626581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:54.627274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:54.640312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:54.644083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:54.648372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:54.649405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:54.654656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c1fa8470-4600-4fdb-9409-e16117b6d4d1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for project b6c1a383333e4e30ace00bcdba714600. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:18:54.669156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c1fa8470-4600-4fdb-9409-e16117b6d4d1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for user 8d81ad22e9434bff9b01fb434231428f and project b6c1a383333e4e30ace00bcdba714600. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:18:54.726425 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1fa8470-4600-4fdb-9409-e16117b6d4d1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.378875 Jun 18 22:18:54.727875 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2004/4006] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:18:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 388 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:18:54.970384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:54.981983 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d361e61-d859-4f01-ac0c-b15631cd6a42 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.363694 Jun 18 22:18:54.986307 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2003/4007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:54 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:55.282328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:55.283255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:55.299664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:55.300436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:55.301433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:55.302043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:55.351447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:55.352980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:55.373829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:55.376486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:55.379516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:55.389652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:56.348220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:56.358727 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a3976cf7-1f47-4c70-8003-bdf482041189 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 1.080327 Jun 18 22:18:56.361340 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2005/4008] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:55 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:56.368806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:56.375208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:56.407218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:56.408147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:56.410805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:56.413413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:56.426830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:18:56.447104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:56.460953 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-143063bf-54af-4a25-988e-5c35abe08d98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 1.119919 Jun 18 22:18:56.465841 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2004/4009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:55 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:18:56.477367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:56.488162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:56.510783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:56.511728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:56.519040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:56.529920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:56.724390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2d051325e2465b8eb1fa505770857c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '691097edd2ac46af9e83a119b87340e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:56.744434 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30e5597e-db6a-42bf-8edc-e27fe612f82c tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 200 len: 1310 microversion: 2.1 time: 0.381815 Jun 18 22:18:56.761375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2006/4010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:56 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 1310 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:56.773665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9edf18a8-75be-4866-92dc-cc80addcf91a req-640e773d-8cbb-4656-8bbc-fb0b64488ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bc08db-1348-4301-87c3-f75066fa4af2", "name": "network-vif-deleted", "tag": "84f690da-91fc-4030-a00d-25a802028393"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:56.802638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9edf18a8-75be-4866-92dc-cc80addcf91a req-640e773d-8cbb-4656-8bbc-fb0b64488ea4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:56.806850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9edf18a8-75be-4866-92dc-cc80addcf91a req-640e773d-8cbb-4656-8bbc-fb0b64488ea4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:56.836780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9edf18a8-75be-4866-92dc-cc80addcf91a req-640e773d-8cbb-4656-8bbc-fb0b64488ea4 service nova] Creating event network-vif-deleted:84f690da-91fc-4030-a00d-25a802028393 for instance 42bc08db-1348-4301-87c3-f75066fa4af2 on nch2-master-1 Jun 18 22:18:56.850384 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9edf18a8-75be-4866-92dc-cc80addcf91a req-640e773d-8cbb-4656-8bbc-fb0b64488ea4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087673 Jun 18 22:18:56.851010 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2007/4011] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:56.982130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:57.004613 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1a30b95c-088e-4add-ae04-1c8638186b61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.536838 Jun 18 22:18:57.005149 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2005/4012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:56 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:57.204550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7909377f-6c2e-4409-afd4-1f8251406f8a req-b33449a2-68ba-4c72-872a-791eb704a232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82475c63-3cfd-4bf4-9c40-fcc66000d90a", "name": "network-vif-plugged", "status": "completed", "tag": "a70156e8-cc79-4cb8-b2f0-8043439c8585"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:57.217988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7909377f-6c2e-4409-afd4-1f8251406f8a req-b33449a2-68ba-4c72-872a-791eb704a232 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.219655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7909377f-6c2e-4409-afd4-1f8251406f8a req-b33449a2-68ba-4c72-872a-791eb704a232 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.256714 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7909377f-6c2e-4409-afd4-1f8251406f8a req-b33449a2-68ba-4c72-872a-791eb704a232 service nova] Creating event network-vif-plugged:a70156e8-cc79-4cb8-b2f0-8043439c8585 for instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a on nch1-master-1 Jun 18 22:18:57.277167 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7909377f-6c2e-4409-afd4-1f8251406f8a req-b33449a2-68ba-4c72-872a-791eb704a232 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085549 Jun 18 22:18:57.278831 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2008/4013] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:18:57.377813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:57.383117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:57.400760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.402361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.406757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.407737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.486693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:57.487631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:57.499143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.502005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.502886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.505830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.907153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:57.917301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e8bdd58-ee6a-42c1-a6fb-a8937fbecb11 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.543351 Jun 18 22:18:57.919810 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2006/4014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:57 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:57.929016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:57.931251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] [instance: 42bc08db-1348-4301-87c3-f75066fa4af2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:57.944548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.945015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.951262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:57.953862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:57.987558 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] HTTP exception thrown: Instance 42bc08db-1348-4301-87c3-f75066fa4af2 could not be found. Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Request method failure captured: Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 HTTP/1.1 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk87W_H5WbGH_YydEfM0nmyPqcZu2YzuvaREtx-2HculbFWNzwGrCSi1x-0lV8QXFJKKc2eVgBWLodGBb12D0G49rdAb5e2Ftuvuy07kqJK4nm7Q8VBr4zMLdBkt7eBniz4ioX_dvleg9rMI7M_FhhiVmWU_n-7LaGtUzB9sZERFFOU Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 691097edd2ac46af9e83a119b87340e8 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/691097edd2ac46af9e83a119b87340e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_691097edd2ac46af9e83a119b87340e8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 691097edd2ac46af9e83a119b87340e8 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-37815190 Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-InstanceActionsNegativeTestJSON-37815190-project Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: eb2d051325e2465b8eb1fa505770857c Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-37815190-project Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 42bc08db-1348-4301-87c3-f75066fa4af2 could not be found. Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '42bc08db-1348-4301-87c3-f75066fa4af2'} Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bc08db-1348-4301-87c3-f75066fa4af2 could not be found. Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bc08db-1348-4301-87c3-f75066fa4af2 could not be found. Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:57.995272 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bc08db-1348-4301-87c3-f75066fa4af2 could not be found. Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] Returning 404 to user: Instance 42bc08db-1348-4301-87c3-f75066fa4af2 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:18:57.998586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-13585483-e845-4a97-8c4d-d379d85cf7f4 tempest-InstanceActionsNegativeTestJSON-37815190 tempest-InstanceActionsNegativeTestJSON-37815190-project] 10.222.0.30 "GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2" status: 404 len: 111 microversion: 2.1 time: 0.076236 Jun 18 22:18:58.000947 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2007/4015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:57 2022] GET /compute/v2.1/servers/42bc08db-1348-4301-87c3-f75066fa4af2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:18:58.004553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:58.015767 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72d3e5ef-0597-474f-96dc-1b1165843841 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.535860 Jun 18 22:18:58.020296 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2009/4016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:57 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:58.029146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:58.030525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:58.040983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:58.044308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:58.045833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:58.047233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:58.518480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:58.532774 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af596f41-40b0-4caa-9e83-7f58128afa83 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.510024 Jun 18 22:18:58.533456 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2008/4017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:58 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:58.739036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1138682179", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e49d21e-43a3-4545-935c-8cce5624bc89"}], "security_groups": [{"name": "tempest-securitygroup--1402376428"}], "key_name": "tempest-keypair-805130639", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:18:58.937514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:58.938458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:58.950055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:58.950508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:58.953518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:58.953978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:59.268240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] validate_networks() for [('9e49d21e-43a3-4545-935c-8cce5624bc89', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:18:59.596863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:18:59.611161 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85572b38-19b2-4024-828b-9b1eedcc7041 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1320 microversion: 2.1 time: 0.678543 Jun 18 22:18:59.611751 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2009/4018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:58 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1320 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:18:59.631399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:18:59.632276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:18:59.657643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:59.658286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:18:59.659659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:18:59.661024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:00.099866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:00.117808 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d11183d-c686-4be5-82ea-90cf0145a291 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.491114 Jun 18 22:19:00.127091 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2010/4019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:18:59 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:00.127091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:00.127091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:00.134749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:00.135283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:00.136254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:00.136694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:00.889218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:00.901434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de73928e-c0cf-4389-8fac-caec6d624143 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.781903 Jun 18 22:19:00.912472 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2011/4020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:00 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:00.918670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:00.919532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:00.926011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:00.926491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:00.927216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:00.927648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.055313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:01.056749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:01.058050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:01.058667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:01.059520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:01.074929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.075851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.079760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.080373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.107994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for project b6c1a383333e4e30ace00bcdba714600. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:01.116037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for user 8d81ad22e9434bff9b01fb434231428f and project b6c1a383333e4e30ace00bcdba714600. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:01.122324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:01.144147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:01.146682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:01.216325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:01.242187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6964856-0625-4b06-b0ae-5105d21b2070 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1500 microversion: 2.1 time: 0.328253 Jun 18 22:19:01.246490 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2012/4021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:00 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1500 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:01.263394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:01.264061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:01.269442 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bed7584-cb00-43c0-a127-e6abb3d79214 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.535602 Jun 18 22:19:01.270414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2010/4022] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:18:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:19:01.281757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:01.282040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.282463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.283087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:01.283293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.283691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.290675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.292033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.293359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.293996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.807008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:01.816332 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-47ac591a-9fd5-441e-9748-dabccd9a408d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.568709 Jun 18 22:19:01.827316 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2013/4023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:01 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:01.849604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec141be2-f719-420f-a34b-59362d14f0fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:01.851358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ec141be2-f719-420f-a34b-59362d14f0fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:01.865783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:01.865969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:01.888445 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe0bf8c4-fa80-46e2-b679-00606de96a2e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1500 microversion: 2.1 time: 0.600454 Jun 18 22:19:01.888445 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2011/4024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:01 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1500 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:01.888445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-70cd1128-1b0e-4c7e-b196-750f82713dac req-038ebacb-faf2-4ba1-b971-cb3dc22d4309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97e5faa-e61e-4d82-b027-c27ae57421c3", "name": "network-vif-plugged", "status": "completed", "tag": "eb0fad39-0fa9-473c-bd87-9d42b6bb9d90"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:01.897017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-70cd1128-1b0e-4c7e-b196-750f82713dac req-038ebacb-faf2-4ba1-b971-cb3dc22d4309 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.897500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-70cd1128-1b0e-4c7e-b196-750f82713dac req-038ebacb-faf2-4ba1-b971-cb3dc22d4309 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.911434 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-70cd1128-1b0e-4c7e-b196-750f82713dac req-038ebacb-faf2-4ba1-b971-cb3dc22d4309 service nova] Creating event network-vif-plugged:eb0fad39-0fa9-473c-bd87-9d42b6bb9d90 for instance f97e5faa-e61e-4d82-b027-c27ae57421c3 on nch1-master-1 Jun 18 22:19:01.931854 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-70cd1128-1b0e-4c7e-b196-750f82713dac req-038ebacb-faf2-4ba1-b971-cb3dc22d4309 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049045 Jun 18 22:19:01.934528 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2012/4025] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:01.939859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:01.940521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:01.966784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.967249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:01.968049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:01.968496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:02.047789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:19:02.092368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec141be2-f719-420f-a34b-59362d14f0fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:02.108969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec141be2-f719-420f-a34b-59362d14f0fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:02.114138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec141be2-f719-420f-a34b-59362d14f0fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:02.116551 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec141be2-f719-420f-a34b-59362d14f0fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1281 microversion: 2.20 time: 0.287802 Jun 18 22:19:02.131188 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2014/4026] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:01 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1281 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:02.153627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:02.155999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:02.175907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:02.176699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:02.178071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:02.178720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:02.239487 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7bd5a9d-2386-4599-b454-c5d1a0b70f92 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 204 len: 0 microversion: 2.1 time: 0.303145 Jun 18 22:19:02.240899 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2013/4027] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:19:01 2022] DELETE /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:19:02.252234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:02.253305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:02.266648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:02.267192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:02.268111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:02.269786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:02.525574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:02.535764 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5054c1bf-d820-4d1b-abc0-6d7347ce2431 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.403188 Jun 18 22:19:02.544150 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2015/4028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:02 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:02.560765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:02.583398 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d2b7699-e523-40e6-8f59-dd12385a27d7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1506 microversion: 2.1 time: 0.336983 Jun 18 22:19:02.584601 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2014/4029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:02 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:02.836902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:02.836902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:02.860508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:02.863776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:02.865052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:02.865715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.113113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c20206c4-fa06-4759-9bed-48d6bb39351a tempest-ListImagesTestJSON-628634221 tempest-ListImagesTestJSON-628634221-project] Calling method '.version_select at 0x7fea0767c940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:03.147166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:03.159236 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3a42dc6-8348-43ad-8b50-d60823cc449b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.326568 Jun 18 22:19:03.159784 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2015/4030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:02 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:03.167760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:03.172563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:03.180731 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c20206c4-fa06-4759-9bed-48d6bb39351a tempest-ListImagesTestJSON-628634221 tempest-ListImagesTestJSON-628634221-project] 10.222.0.30 "GET /compute/v2.1/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad" status: 200 len: 784 microversion: 2.1 time: 0.445844 Jun 18 22:19:03.181574 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2016/4031] 10.222.0.30 () {58 vars in 1232 bytes} [Sat Jun 18 22:19:02 2022] GET /compute/v2.1/images/5a3e12b2-cae5-4235-b8ef-6052c81f2dad => generated 784 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:03.185935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:03.186476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.187351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:03.187857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.195078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d5264d9-76d0-4b3f-9c10-9ab11000535b tempest-ListImagesTestJSON-628634221 tempest-ListImagesTestJSON-628634221-project] Calling method '.version_select at 0x7fea075d6430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:03.286644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:03.302290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:03.304417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:03.306124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61c39630-7942-4764-846f-1acd5aa413a7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1339 microversion: 2.20 time: 0.145109 Jun 18 22:19:03.307012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2016/4032] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:03 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:03.309699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d5264d9-76d0-4b3f-9c10-9ab11000535b tempest-ListImagesTestJSON-628634221 tempest-ListImagesTestJSON-628634221-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.117197 Jun 18 22:19:03.311729 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2017/4033] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:03 2022] GET /compute/v2.1/images => generated 445 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:03.329633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72f8d97d-f61c-4292-9f23-d723540d45e8 tempest-ListImagesTestJSON-628634221 tempest-ListImagesTestJSON-628634221-project] Calling method '.version_select at 0x7fea19c28af0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:03.394825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72f8d97d-f61c-4292-9f23-d723540d45e8 tempest-ListImagesTestJSON-628634221 tempest-ListImagesTestJSON-628634221-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.069726 Jun 18 22:19:03.395943 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2017/4034] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:19:03 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:03.561638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:03.562243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:03.570822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:03.571501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.572888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:03.573515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.603473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:03.604386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:03.617018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:03.619362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.620437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:03.622192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:03.828535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:03.835768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:03.840055 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-358414cf-7e99-4e59-8ae0-00ad1284a38f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.283419 Jun 18 22:19:03.844194 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2018/4035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:03 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:03.858890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:03.868470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-abd55d8a-d022-4d0b-a4aa-638b12d3aed6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1506 microversion: 2.1 time: 0.268877 Jun 18 22:19:03.869986 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2018/4036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:03 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:04.176905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:04.177841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:04.185345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.186062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.187090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.187955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.332009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:04.332673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:04.339818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.340328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.341195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.341620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.469972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:04.479420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:04.481809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:04.483202 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6639b916-50bd-4611-b58b-584ccab4d2c9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1339 microversion: 2.20 time: 0.160024 Jun 18 22:19:04.495163 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2019/4037] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:04 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:04.524507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:04.534321 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1661e927-2881-45cb-a81e-f4292f819079 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1374 microversion: 2.1 time: 0.361999 Jun 18 22:19:04.535350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2019/4038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:04 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1374 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:04.860034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:04.860894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:04.868851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.869658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.871824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.872493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.891134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:04.892605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:04.909605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.912543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:04.913600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:04.914256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:05.368411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:05.379383 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b92856be-578a-4b3a-8c07-56f61fe93c02 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.523280 Jun 18 22:19:05.388746 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2020/4039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:04 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:05.448605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:05.460680 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-94705838-e551-4457-9f50-78dda328bac7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1506 microversion: 2.1 time: 0.576007 Jun 18 22:19:05.472964 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2020/4040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:04 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:05.506710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:05.507348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:05.522691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:05.523375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:05.525308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:05.527248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:05.552305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:05.553086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:05.564247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:05.566345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:05.567536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:05.571263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:05.895906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:05.915883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:05.921512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:05.924198 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3a675d0-a535-4f92-892a-b9797c621c9e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 0.424126 Jun 18 22:19:05.926311 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2021/4041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:05 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:19:05.956595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:05.973107 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b8db239-ba54-4e87-ab4e-740305b98387 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1546 microversion: 2.1 time: 0.424839 Jun 18 22:19:05.974688 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2021/4042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:05 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1546 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:05.995296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:05.995936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:06.006531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.006986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.008912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.010378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.188148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0993532b-ef40-4199-88a7-66394ef87cf1 req-8f555d16-f9cd-4ef3-8b81-4dd146ecdcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82475c63-3cfd-4bf4-9c40-fcc66000d90a", "name": "network-vif-deleted", "tag": "a70156e8-cc79-4cb8-b2f0-8043439c8585"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:06.221845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0993532b-ef40-4199-88a7-66394ef87cf1 req-8f555d16-f9cd-4ef3-8b81-4dd146ecdcd7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.223025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0993532b-ef40-4199-88a7-66394ef87cf1 req-8f555d16-f9cd-4ef3-8b81-4dd146ecdcd7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.255648 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0993532b-ef40-4199-88a7-66394ef87cf1 req-8f555d16-f9cd-4ef3-8b81-4dd146ecdcd7 service nova] Creating event network-vif-deleted:a70156e8-cc79-4cb8-b2f0-8043439c8585 for instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a on nch1-master-1 Jun 18 22:19:06.266343 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0993532b-ef40-4199-88a7-66394ef87cf1 req-8f555d16-f9cd-4ef3-8b81-4dd146ecdcd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089818 Jun 18 22:19:06.267550 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2022/4043] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:06.400874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:06.401973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:06.408465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:06.413559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.416869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.418899 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44651a78-5522-4943-865a-db1d21c3ed72 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1546 microversion: 2.1 time: 0.428811 Jun 18 22:19:06.419385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.420081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.433720 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2022/4044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:05 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1546 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:06.482538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:06.483183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:06.492068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.493252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.494647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.495243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.545929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.546388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.546846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lazy-loading 'fault' on Instance uuid 82475c63-3cfd-4bf4-9c40-fcc66000d90a {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:19:06.623708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:06.649485 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3775b6ce-aaa3-46b5-817d-81f73a676531 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 200 len: 1310 microversion: 2.1 time: 0.170584 Jun 18 22:19:06.650688 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2023/4045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:06 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:06.767713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:06.782724 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dce5cdff-98f9-4207-8998-fd4fbc3963a7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1512 microversion: 2.1 time: 0.382626 Jun 18 22:19:06.785678 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2023/4046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:06 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:06.947075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:06.947706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:06.962209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.962836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:06.964535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:06.964990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:07.174199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f470e8b-14f6-4dfe-a277-85dee020bb40 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Action: 'create', calling method: .version_select at 0x7fea19d1f1f0>, body: {"keypair": {"name": "tempest-keypair-1456019100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Lr/7cB4vWfoJb4w6E04r+heO/TdOFJycFwHQyU9qWUiNsnCMltU2YKu2VY6yE4JeGpn3gYXBUVd2KDQ1SxfbzYSYLePKSU4s+W0kMx1Y1W/NcArsezFGMPszPrfTiyw=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:07.206341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3f470e8b-14f6-4dfe-a277-85dee020bb40 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:07.219581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3f470e8b-14f6-4dfe-a277-85dee020bb40 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for user a709d118d06040129e89deacd3a54c10 and project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:07.240982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:07.270009 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f470e8b-14f6-4dfe-a277-85dee020bb40 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.617290 Jun 18 22:19:07.270524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:07.272740 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2024/4047] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:07.281899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:07.283195 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-156613f4-79a9-40fd-a3ff-ae328325218c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 0.343269 Jun 18 22:19:07.293392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c43c3d51-92ad-48a3-b5a1-c39674c8e8ab tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea19d1ff70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:07.293576 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2024/4048] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:06 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:19:07.302590 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c43c3d51-92ad-48a3-b5a1-c39674c8e8ab tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1456019100" status: 200 len: 498 microversion: 2.1 time: 0.023771 Jun 18 22:19:07.303362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2025/4049] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:19:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1456019100 => generated 498 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:07.316716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e9534a34-473e-4961-8e9b-90bae1d82627 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea075f2790>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:07.346523 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e9534a34-473e-4961-8e9b-90bae1d82627 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456019100" status: 202 len: 0 microversion: 2.1 time: 0.035198 Jun 18 22:19:07.354300 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2025/4050] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1456019100 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:07.360188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a5d4461-16d5-4730-9f61-73db935b6de9 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Action: 'create', calling method: .version_select at 0x7fea19df2160>, body: {"keypair": {"name": "tempest-keypair-23600904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF52wpJLmZek3j60iYav5wHVvlQGrfJ/SNdrtBXiyaf2KqSK54nAtHG94pXAncoVq/UeqZGTbtO2DtLIkpl1OsiHEYv0YtQLKYGTV6clwZlBd5fZHzYU8eqiwTBHI4hF/w=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:07.378338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7a5d4461-16d5-4730-9f61-73db935b6de9 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:07.386472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7a5d4461-16d5-4730-9f61-73db935b6de9 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for user a709d118d06040129e89deacd3a54c10 and project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:07.419297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a5d4461-16d5-4730-9f61-73db935b6de9 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.063060 Jun 18 22:19:07.420842 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2026/4051] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:07.434402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6981df6-ce43-4fe5-8148-0377d14bb202 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea0766ac10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:07.489208 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6981df6-ce43-4fe5-8148-0377d14bb202 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-23600904" status: 202 len: 0 microversion: 2.1 time: 0.060855 Jun 18 22:19:07.511438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-beecdfb1-f77a-47a0-8451-054c5599dc17 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Action: 'create', calling method: .version_select at 0x7fea19dd1700>, body: {"keypair": {"name": "tempest-keypair-2071750297", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:07.514858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2026/4052] 10.222.0.30 () {58 vars in 1214 bytes} [Sat Jun 18 22:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-23600904 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:07.540150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-beecdfb1-f77a-47a0-8451-054c5599dc17 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:07.577302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-beecdfb1-f77a-47a0-8451-054c5599dc17 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for user a709d118d06040129e89deacd3a54c10 and project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:07.638161 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-beecdfb1-f77a-47a0-8451-054c5599dc17 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.142514 Jun 18 22:19:07.644017 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2027/4053] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:07.653420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ead78bb2-e720-44d3-833e-47bc185cbcf7 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea07641ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:07.668680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:07.669659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:07.682924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:07.683878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:07.686625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:07.694670 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ead78bb2-e720-44d3-833e-47bc185cbcf7 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071750297" status: 202 len: 0 microversion: 2.1 time: 0.046232 Jun 18 22:19:07.694948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:07.695490 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2027/4054] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071750297 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:07.716898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb44e291-7d93-46b3-b212-0c7e92dc1b3d tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Action: 'create', calling method: .version_select at 0x7fea07641790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-762669859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq060IgkrOZyo76aLJJojiQCXwV5bhuO7iLFwCTzFKg6ivQhR88T5/f4w29wMMMPQzbmLQ025xSVhJ+16CzUhndhtPwTQX7SqO5tCMsefU/+3ePic0NPugVtoKeNxT3SA=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:07.738909 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a HTTP/1.1 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82475c63-3cfd-4bf4-9c40-fcc66000d90a'} Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:07.746290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:07.749710 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15f4ce50-2ffa-4b97-8f19-b551d40918e8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 404 len: 111 microversion: 2.1 time: 0.084603 Jun 18 22:19:07.751542 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2028/4055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:07 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:07.769819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cb44e291-7d93-46b3-b212-0c7e92dc1b3d tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:07.771499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a42cd02-6c59-4d49-8358-c99e6a9053cb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: .version_select at 0x7fea19df2e50>, body: {"keypair": {"name": "tempest-key-1392816209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVxXQaDHYuSWpveJixdXgp9IxtwVfteB00yN7zryzSw4n1/c/2Uqk/eGWbhqlTT17ybK6EGKGIFOJJMvaUWAlLaNWXqqNcyRZS6mE6lOhf/Mtcx5JPRR7cueXK2zoz0w=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:07.777955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cb44e291-7d93-46b3-b212-0c7e92dc1b3d tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for user a709d118d06040129e89deacd3a54c10 and project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:07.821057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a42cd02-6c59-4d49-8358-c99e6a9053cb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:07.835402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a42cd02-6c59-4d49-8358-c99e6a9053cb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:07.864109 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb44e291-7d93-46b3-b212-0c7e92dc1b3d tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.158111 Jun 18 22:19:07.889760 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2028/4056] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:07.897819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:07.898729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:07.908078 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a42cd02-6c59-4d49-8358-c99e6a9053cb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.147643 Jun 18 22:19:07.913072 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2029/4057] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:07.918141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:07.918605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:07.919683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:07.920458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:07.920574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df9c0954-3ee2-4fae-8627-ba0025dfcc46 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Action: 'create', calling method: .version_select at 0x7fea19dcbf70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1003590030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2CRY3hazxXsuXYmnL0Uco5EGS6A09Us1X3GHsl+TbLWLzRF0m1yCjj8tz+v7Y5rLNfVM6PgaGarRgFQbZl1oRcIVWJqlMx3qcWgGczS+KmpVvdUNrpw3h+H49/v8OEHw=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:07.939078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-df9c0954-3ee2-4fae-8627-ba0025dfcc46 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:07.945958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-df9c0954-3ee2-4fae-8627-ba0025dfcc46 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for user a709d118d06040129e89deacd3a54c10 and project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:07.958595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:07.998603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df9c0954-3ee2-4fae-8627-ba0025dfcc46 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.082548 Jun 18 22:19:07.999850 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2030/4058] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:08.019842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-420da9a6-ec95-4a32-8b2b-6ef6837b4118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '.version_select at 0x7fea19df29d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.033778 ncdv-master-1 devstack@n-api.service[130902]: WARNING oslo_db.sqlalchemy.utils [None req-420da9a6-ec95-4a32-8b2b-6ef6837b4118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 18 22:19:08.046651 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-420da9a6-ec95-4a32-8b2b-6ef6837b4118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.045525 Jun 18 22:19:08.057834 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2031/4059] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:19:07 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:08.063258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a57d890-34e8-49ab-908f-27054aa8da82 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Action: 'create', calling method: .version_select at 0x7fea141aa790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1329172082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmXTpsKQI6LQAMVXvFV/4z8ir8H9NYL4k1OBpPWQTbFjVkmenpPJvk+ioRyz5eqOTRCA5RDFTi07Dpcl2OG8miGJ1TO44wmX7DJy2DejyDwryExvTVqL/4moywfm3iiQw=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:08.081650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2a57d890-34e8-49ab-908f-27054aa8da82 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:08.091680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-2a57d890-34e8-49ab-908f-27054aa8da82 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Getting quotas for user a709d118d06040129e89deacd3a54c10 and project f249362c9ded4f7f80f577091cd7d7aa. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:08.127355 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a57d890-34e8-49ab-908f-27054aa8da82 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.066371 Jun 18 22:19:08.129247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2032/4060] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:08.140023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c7098b87-432f-449c-b24a-8d6e509a94c6 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea19d69670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.145720 ncdv-master-1 devstack@n-api.service[130902]: WARNING oslo_db.sqlalchemy.utils [None req-c7098b87-432f-449c-b24a-8d6e509a94c6 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 18 22:19:08.161543 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c7098b87-432f-449c-b24a-8d6e509a94c6 tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.025779 Jun 18 22:19:08.164859 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2033/4061] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:19:08 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:08.182082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a70afb6b-b99d-46ce-9eed-e84faf0f756a tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea19df2f70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.231806 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a70afb6b-b99d-46ce-9eed-e84faf0f756a tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1329172082" status: 202 len: 0 microversion: 2.1 time: 0.056287 Jun 18 22:19:08.245330 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2034/4062] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Jun 18 22:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1329172082 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:08.259997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:08.269799 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6a1e4b3-eba8-400e-87d4-ac866ff23cb6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1489 microversion: 2.1 time: 0.378042 Jun 18 22:19:08.273429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df14289d-9594-4452-85f2-3a76e0eec8ed tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea16c019d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.277311 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2029/4063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:07 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1489 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:08.287112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1150597009", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "key_name": "tempest-key-1392816209", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:08.314770 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df14289d-9594-4452-85f2-3a76e0eec8ed tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1003590030" status: 202 len: 0 microversion: 2.1 time: 0.067983 Jun 18 22:19:08.315393 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2035/4064] 10.222.0.30 () {58 vars in 1277 bytes} [Sat Jun 18 22:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1003590030 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:08.326102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:08.327134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:08.344232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.344698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:08.345524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.348950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:08.356733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:08.362554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:08.438428 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de3edad5-a001-41af-9f8b-89758e53cca7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 200 len: 132 microversion: 2.1 time: 0.121733 Jun 18 22:19:08.439074 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2036/4065] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:08 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 132 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:08.449466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.451618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:08.469934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.471155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:08.473827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.474532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:08.747998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:08.764064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:08.766812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:08.768602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6dbaec7b-1e8b-4117-a2cf-d587aee389b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 0.327873 Jun 18 22:19:08.769787 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2037/4066] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:08 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:08.775789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f63f10c6-01e9-4e42-8106-3aac28e8a21d tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] Calling method '.version_select at 0x7fea14bc6310>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.807349 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f63f10c6-01e9-4e42-8106-3aac28e8a21d tempest-KeyPairsV2TestJSON-273132497 tempest-KeyPairsV2TestJSON-273132497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-762669859" status: 202 len: 0 microversion: 2.1 time: 0.032394 Jun 18 22:19:08.809691 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2038/4067] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-762669859 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:08.817780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-717b03ac-52de-4955-98e6-7abae7f616ed req-392e9e20-1fb7-4eca-bcee-7c99b0a8c090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:08.838765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-717b03ac-52de-4955-98e6-7abae7f616ed req-392e9e20-1fb7-4eca-bcee-7c99b0a8c090 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.839669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-717b03ac-52de-4955-98e6-7abae7f616ed req-392e9e20-1fb7-4eca-bcee-7c99b0a8c090 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:08.864288 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-717b03ac-52de-4955-98e6-7abae7f616ed req-392e9e20-1fb7-4eca-bcee-7c99b0a8c090 service nova] Creating event network-changed:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:19:08.869977 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-717b03ac-52de-4955-98e6-7abae7f616ed req-392e9e20-1fb7-4eca-bcee-7c99b0a8c090 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058834 Jun 18 22:19:08.871205 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2039/4068] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:08.878374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:08.879334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:08.890042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.890803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:08.892019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:08.892649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.034187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:09.034616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:09.035096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:09.035516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:09.035928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:09.048351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.049180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.050307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.050937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.079786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:09.092562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:09.093307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:09.102620 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2df908cf-8700-43b7-be83-770e2af7a1b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.229614 Jun 18 22:19:09.103231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2040/4069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:08 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:09.114471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:09.117378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:09.123538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:09.124178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:09.131911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.132365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.133202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.133638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.173401 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b6408b4-0633-44a7-9e69-e5b951a0b93b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893511 Jun 18 22:19:09.174397 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2030/4070] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:19:09.186391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56b68d24-241d-46a1-813f-8aa53a83217a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:09.187712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56b68d24-241d-46a1-813f-8aa53a83217a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:09.273938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-56b68d24-241d-46a1-813f-8aa53a83217a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:09.286014 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56b68d24-241d-46a1-813f-8aa53a83217a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1229 microversion: 2.1 time: 0.105213 Jun 18 22:19:09.286613 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2031/4071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:09 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:09.343156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:09.352153 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c769bb2-0629-48a8-8ef3-7e6b3f532b6a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.231721 Jun 18 22:19:09.363557 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2041/4072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:09 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:09.368807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:09.369399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:09.381233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.381974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.382474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.382911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.642097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:09.667017 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3498633-1adc-44b3-b9ad-d37bbd544e6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.300359 Jun 18 22:19:09.667713 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2032/4073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:09 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:09.686732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:09.688262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:09.706797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.709560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.710942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.713106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.791217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:09.791851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:09.810726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.811227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:09.817290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:09.817992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:10.214543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:10.224318 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-936af81d-ddb6-4f48-ac31-63e2039ce3c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.542393 Jun 18 22:19:10.237793 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2042/4074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:09 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:10.304162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:10.305022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:10.317282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:10.317746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:10.318540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:10.318987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:10.824885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:10.837891 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c35151bd-166b-441b-8a6c-234366e97a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1281 microversion: 2.1 time: 0.537546 Jun 18 22:19:10.839849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2043/4075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:10 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1281 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:10.848563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1054174027", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a4647eff-e46f-4758-90a6-f87dcd82bc48"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:10.855869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:10.869118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:10.873071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:10.874197 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4df24a8e-570e-453d-8952-c82a3cbcea7f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 1.087789 Jun 18 22:19:10.874774 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2033/4076] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:09 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:10.903857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7246cfab-a80e-44c8-b972-2e80c9c190af req-aeb46feb-9821-4261-bfcf-bddfe40130c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97e5faa-e61e-4d82-b027-c27ae57421c3", "tag": "eb0fad39-0fa9-473c-bd87-9d42b6bb9d90"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:10.922842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7246cfab-a80e-44c8-b972-2e80c9c190af req-aeb46feb-9821-4261-bfcf-bddfe40130c0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:10.926450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7246cfab-a80e-44c8-b972-2e80c9c190af req-aeb46feb-9821-4261-bfcf-bddfe40130c0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:10.950982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] validate_networks() for [('a4647eff-e46f-4758-90a6-f87dcd82bc48', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:10.954926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7246cfab-a80e-44c8-b972-2e80c9c190af req-aeb46feb-9821-4261-bfcf-bddfe40130c0 service nova] Creating event network-changed:eb0fad39-0fa9-473c-bd87-9d42b6bb9d90 for instance f97e5faa-e61e-4d82-b027-c27ae57421c3 on nch1-master-1 Jun 18 22:19:10.964667 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7246cfab-a80e-44c8-b972-2e80c9c190af req-aeb46feb-9821-4261-bfcf-bddfe40130c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067173 Jun 18 22:19:10.966479 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2034/4077] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:11.095476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:11.535978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:11.538419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:11.539701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:11.540355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:11.541133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:11.553764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:11.554499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:11.556245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:11.556890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:11.580107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:11.587863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for user ab975e8ffd0448939b2105aed58003fe and project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:11.618231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:11.626156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:11.681412 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c406dfb3-2bde-417c-8fd1-5b5c115dc4e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838626 Jun 18 22:19:11.688644 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2044/4078] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:19:11.694548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20f96af0-ea77-4147-94bb-5e0472e9e7b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:11.695259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20f96af0-ea77-4147-94bb-5e0472e9e7b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:11.786318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20f96af0-ea77-4147-94bb-5e0472e9e7b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:11.796819 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20f96af0-ea77-4147-94bb-5e0472e9e7b0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1215 microversion: 2.1 time: 0.107062 Jun 18 22:19:11.800489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2035/4079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:11 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:11.860209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:11.861546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:11.882200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:11.884828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:11.885756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:11.888405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:11.891762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:11.892379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:11.912032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:11.912591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:11.914194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:11.914194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:12.178302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:12.188790 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3ef6f73f-e244-4c0f-a0c5-ddc21f4e9722 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1287 microversion: 2.1 time: 0.334925 Jun 18 22:19:12.199715 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2045/4080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:11 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1287 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:12.341747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:12.359469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:12.361384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:12.362850 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3667d9dc-99dd-4b8f-99c8-a5414e9455e4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 0.475049 Jun 18 22:19:12.363592 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2036/4081] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:11 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:19:12.818180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:12.818808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:12.828475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:12.828934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:12.831849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:12.832293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:12.978712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:12.993961 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ac197afc-6b25-49a6-b713-347fd8f39f90 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1219 microversion: 2.1 time: 0.179971 Jun 18 22:19:13.006676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2046/4082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:12 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:13.206168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:13.207432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:13.221759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:13.222642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:13.223599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:13.227473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:13.800068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:13.813699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15f55328-5fc4-434d-afcd-45885a9a4f47 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.611210 Jun 18 22:19:13.817298 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2037/4083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:13 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:13.818996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce21ae62-93d3-4f8b-a108-9d457ed83d3f tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Calling method '.version_select at 0x7fea141b2430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:13.824319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:13.825316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:13.838306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce21ae62-93d3-4f8b-a108-9d457ed83d3f tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:13.838763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce21ae62-93d3-4f8b-a108-9d457ed83d3f tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:13.839567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce21ae62-93d3-4f8b-a108-9d457ed83d3f tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:13.840015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce21ae62-93d3-4f8b-a108-9d457ed83d3f tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:13.840999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:13.842722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:13.845498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:13.846497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:13.890577 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce21ae62-93d3-4f8b-a108-9d457ed83d3f tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.637737 Jun 18 22:19:13.894213 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2047/4084] 10.222.0.30 () {58 vars in 1121 bytes} [Sat Jun 18 22:19:13 2022] GET /compute/v2.1/limits => generated 511 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:13.957913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1306720309", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:14.057701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:14.372104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:14.419589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:14.422262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:14.424374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-403f36f3-0cb5-4b25-b6e0-4ab1e508741f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 0.604678 Jun 18 22:19:14.436786 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2038/4085] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:13 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:14.626026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Getting quotas for project 03b29ea7dee449169fd9eb341e78d16c. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:14.644941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Getting quotas for user 78f3002bcf404d5eb3543d24a4496630 and project 03b29ea7dee449169fd9eb341e78d16c. Resources: dict_keys(['metadata_items']) {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:14.693664 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Request method failure captured: Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 1752 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9h6ft46pI0rYFwrOahEBGOUZaNc9LUOxZWU_ZOA4yrIvFB1f7P6v_0XLPJqibtt-bU-TIfaMFtUe_vpMRf3FXoR416z3-ouMnoFf5e9NwJqURel0ef5UbhT8TZINi0h6nELpdqZ5m5xT2nYPsv6qgE5HHw7TENtuDzHJc0Riol_vA Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 03b29ea7dee449169fd9eb341e78d16c Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1846161479 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/03b29ea7dee449169fd9eb341e78d16c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/03b29ea7dee449169fd9eb341e78d16c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/03b29ea7dee449169fd9eb341e78d16c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_03b29ea7dee449169fd9eb341e78d16c", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1846161479 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 03b29ea7dee449169fd9eb341e78d16c Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1846161479 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 78f3002bcf404d5eb3543d24a4496630 Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1306720309", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:19:14.710890 ncdv-master-1 devstack@n-api.service[130902]: exception: Maximum number of metadata items exceeds 128 Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1306720309', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:14.713608 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 18 22:19:14.716532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:14.719970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:14.721683 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7e54dd5a-3369-4d38-afc4-84052beb3cff tempest-AbsoluteLimitsNegativeTestJSON-1846161479 tempest-AbsoluteLimitsNegativeTestJSON-1846161479-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.767353 Jun 18 22:19:14.729288 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2048/4086] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Jun 18 22:19:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 776 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:19:14.748608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2f3c2fd2-d78d-4e5b-937f-69d0022481f8 req-05114e70-aca7-495f-9484-a6c214d0fc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "name": "network-vif-plugged", "status": "completed", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:14.807974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2f3c2fd2-d78d-4e5b-937f-69d0022481f8 req-05114e70-aca7-495f-9484-a6c214d0fc18 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:14.809121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2f3c2fd2-d78d-4e5b-937f-69d0022481f8 req-05114e70-aca7-495f-9484-a6c214d0fc18 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:14.843265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2f3c2fd2-d78d-4e5b-937f-69d0022481f8 req-05114e70-aca7-495f-9484-a6c214d0fc18 service nova] Creating event network-vif-plugged:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:19:14.857220 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2f3c2fd2-d78d-4e5b-937f-69d0022481f8 req-05114e70-aca7-495f-9484-a6c214d0fc18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125813 Jun 18 22:19:14.859926 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2049/4087] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:14.874288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:14.876376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:14.892563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:14.895666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:14.896728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:14.898220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:14.901792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:14.903063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:14.918144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:14.920306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:14.922005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:14.923858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:15.114069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:15.125202 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6a30763-601a-4947-a60d-c05ff5676970 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1273 microversion: 2.1 time: 0.680891 Jun 18 22:19:15.126016 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2039/4088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:14 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1273 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:15.188134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:15.189015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:15.204063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:15.204457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:15.205282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:15.205771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:15.265146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-99d0e69c-f0ed-4fa3-814e-4e0a5e27e6b7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/ips" status: 200 len: 150 microversion: 2.1 time: 0.080995 Jun 18 22:19:15.265708 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2040/4089] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:19:15 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:15.448021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:15.450022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:15.466462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:15.467825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:15.470047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:15.473133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:15.847548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:15.857316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27746691-25a1-4a21-b79d-42f5d8069a9d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.992920 Jun 18 22:19:15.861551 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2050/4090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:14 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:15.978962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a19b7e97-f612-49ba-ba09-4b5c08435f56 req-087fe114-e208-4f9a-bb1b-5190b0916051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c62de4-53a8-41b1-a5b6-2f3f9b02565b", "tag": "fdaa97e3-e615-448c-96d8-be1e72f0b056"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:16.005475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a19b7e97-f612-49ba-ba09-4b5c08435f56 req-087fe114-e208-4f9a-bb1b-5190b0916051 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:16.005933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a19b7e97-f612-49ba-ba09-4b5c08435f56 req-087fe114-e208-4f9a-bb1b-5190b0916051 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:16.078690 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a19b7e97-f612-49ba-ba09-4b5c08435f56 req-087fe114-e208-4f9a-bb1b-5190b0916051 service nova] Creating event network-changed:fdaa97e3-e615-448c-96d8-be1e72f0b056 for instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b on nch2-master-1 Jun 18 22:19:16.093009 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a19b7e97-f612-49ba-ba09-4b5c08435f56 req-087fe114-e208-4f9a-bb1b-5190b0916051 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118055 Jun 18 22:19:16.093672 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2051/4091] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:16.153346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:16.154076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:16.170718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:16.171177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:16.171978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:16.172420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:16.320157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:16.333959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:16.340375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:16.341873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09d7e163-b194-48a4-94a7-7edc4ad4443d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1407 microversion: 2.20 time: 0.901075 Jun 18 22:19:16.344225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2041/4092] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:15 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1407 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:16.370670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:16.383528 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61d8b64f-884c-442a-8642-b98f9e7b0600 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1273 microversion: 2.1 time: 0.239125 Jun 18 22:19:16.384374 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2052/4093] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:16 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:16.879181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:16.879813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:16.894463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:16.895487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:16.897273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:16.901848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:17.165928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "333dce02-30ca-476d-b896-3fb4871db3f1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:17.167057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:17.174490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:17.174958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:17.175752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:17.176194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:17.491789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:17.508296 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2483acf-e380-446c-bb14-5d2e1bd85a1d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.634084 Jun 18 22:19:17.512061 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2042/4094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:16 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:17.531885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:17.537826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:17.561798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:17.562409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:17.564415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:17.567172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:17.762987 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-334c6854-48f1-43f5-9808-fdc971debc32 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602615 Jun 18 22:19:17.768676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2053/4095] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:19:17 2022] POST /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:17.811252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:17.812453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:17.834472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:17.835615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:17.844938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:17.846086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:18.866023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:18.872291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:18.884215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:18.885844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:18.887335 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7f8a841-24db-4cbb-a983-182e0e51a9c2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1598 microversion: 2.20 time: 1.371137 Jun 18 22:19:18.895785 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2043/4096] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:17 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1598 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:19:18.906295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:18.910078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:18.927326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:18.928018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:18.930671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:18.932864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:18.977943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:18.986972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-973b9b74-9320-41d7-ba31-333128b7b120 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 1.205555 Jun 18 22:19:19.000893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2054/4097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:17 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:19.013428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:19.013950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:19.046349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:19.046837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:19.053107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:19.053583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:19.061856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:19.382876 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c89283d1-e557-429e-8383-3a6056af0f5c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.380692 Jun 18 22:19:19.383549 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2055/4098] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:19:19 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-interface => generated 284 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:19:19.755745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:19.773067 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b675ec39-524e-475b-af64-b3ac8c35234d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.873190 Jun 18 22:19:19.784905 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2044/4099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:18 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:20.013632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:20.014678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:20.028722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:20.029529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:20.030661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:20.031323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:20.418791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3a7e03e9-8687-4bd2-91d1-281dc4979a1d req-a70ddde1-5d60-41cf-b509-84eecd7391e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b01742a-9619-4cd5-8d4f-01c0364a7355", "tag": "c27d85de-aa63-4273-9105-be49acb3188a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:20.467499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3a7e03e9-8687-4bd2-91d1-281dc4979a1d req-a70ddde1-5d60-41cf-b509-84eecd7391e7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:20.468424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3a7e03e9-8687-4bd2-91d1-281dc4979a1d req-a70ddde1-5d60-41cf-b509-84eecd7391e7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:20.494715 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3a7e03e9-8687-4bd2-91d1-281dc4979a1d req-a70ddde1-5d60-41cf-b509-84eecd7391e7 service nova] Creating event network-changed:c27d85de-aa63-4273-9105-be49acb3188a for instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 on nch1-master-1 Jun 18 22:19:20.506446 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3a7e03e9-8687-4bd2-91d1-281dc4979a1d req-a70ddde1-5d60-41cf-b509-84eecd7391e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091365 Jun 18 22:19:20.511828 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2045/4100] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:20.632599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:20.642836 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-078b3739-4223-4c3d-9985-5eda2ff2ad6f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 0.639345 Jun 18 22:19:20.654247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2056/4101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:20 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:20.791781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:20.793024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:20.812924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:20.813658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:20.814908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:20.815669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:21.432340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73be7891-6381-4be6-85bf-5b829197e34c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: .version_select at 0x7fea19d69040>, body: {"keypair": {"name": "tempest-keypair-1661863151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzStEnSsfJToNvuP4xf6mde1GNmilXhZxeSCFcHV7ZG/cR19M4oMiiRPknloLfrZuFdWLTA8BTOKr2OVZLRvBM5V4GOqJOIZgHzZHjHwWxxgftytdJ/pBo4ht72MgFHsA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:21.449366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:21.486997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=47 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:21.490174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-73be7891-6381-4be6-85bf-5b829197e34c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:21.511853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-73be7891-6381-4be6-85bf-5b829197e34c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:21.565025 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73be7891-6381-4be6-85bf-5b829197e34c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127023 Jun 18 22:19:21.565829 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2057/4102] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:19:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:21.662537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:21.663765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:21.669268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:21.682935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:21.683986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:21.684516 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9b795f52-2c22-4715-bdc3-c78fcaf0dd62 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.896836 Jun 18 22:19:21.685282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:21.686091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:21.686248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2046/4103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:20 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:21.733140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:22.703552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:22.704899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:22.707187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:22.709236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:22.722712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:22.725845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:22.727821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:22.728266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:22.825132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:22.832891 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e0eee5f-ea1a-48ce-b6d2-3bc0e4102208 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 1.176648 Jun 18 22:19:22.843712 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2058/4104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:21 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:23.136316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:23.146130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2abe654-b481-45b8-826d-5509e8eb8958 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.447188 Jun 18 22:19:23.157500 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2047/4105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:22 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:23.428220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e08f897c-d5fd-4eb6-aaff-34c26968a267 req-235e3acc-74be-483c-8acb-6d0c07321f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:23.443566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e08f897c-d5fd-4eb6-aaff-34c26968a267 req-235e3acc-74be-483c-8acb-6d0c07321f9d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:23.444018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e08f897c-d5fd-4eb6-aaff-34c26968a267 req-235e3acc-74be-483c-8acb-6d0c07321f9d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:23.468342 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e08f897c-d5fd-4eb6-aaff-34c26968a267 req-235e3acc-74be-483c-8acb-6d0c07321f9d service nova] Creating event network-changed:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:19:23.491031 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e08f897c-d5fd-4eb6-aaff-34c26968a267 req-235e3acc-74be-483c-8acb-6d0c07321f9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066315 Jun 18 22:19:23.491931 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2059/4106] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:23.850024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:23.850633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:23.865292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:23.866002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:23.868805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:23.870920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:24.160968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:24.166412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:24.167496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:24.182255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:24.183015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:24.184078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:24.187278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:24.888308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:24.906382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b7dfe704-d688-434f-abb6-eeabec331da3 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 1.060337 Jun 18 22:19:24.909613 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2048/4107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:23 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:24.916592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-388874160", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c338c1-54d0-4b94-9891-fcb2729daf72"}], "security_groups": [{"name": "tempest-securitygroup--533751060"}], "key_name": "tempest-keypair-1661863151", "user_data": "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:25.042794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:25.053102 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eea15148-d6eb-4801-a2db-3efced06477b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1329 microversion: 2.1 time: 0.892326 Jun 18 22:19:25.064001 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2060/4108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:24 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1329 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:25.429363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8f72e96c-f370-4a31-ace2-0f4d91b59081 req-d3cfbf79-345e-4fb5-8fcc-2bd0481f19d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c62de4-53a8-41b1-a5b6-2f3f9b02565b", "name": "network-vif-plugged", "status": "completed", "tag": "fdaa97e3-e615-448c-96d8-be1e72f0b056"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:25.465253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8f72e96c-f370-4a31-ace2-0f4d91b59081 req-d3cfbf79-345e-4fb5-8fcc-2bd0481f19d5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:25.466998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8f72e96c-f370-4a31-ace2-0f4d91b59081 req-d3cfbf79-345e-4fb5-8fcc-2bd0481f19d5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:25.508162 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8f72e96c-f370-4a31-ace2-0f4d91b59081 req-d3cfbf79-345e-4fb5-8fcc-2bd0481f19d5 service nova] Creating event network-vif-plugged:fdaa97e3-e615-448c-96d8-be1e72f0b056 for instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b on nch2-master-1 Jun 18 22:19:25.526276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] validate_networks() for [('b8c338c1-54d0-4b94-9891-fcb2729daf72', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:25.530940 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8f72e96c-f370-4a31-ace2-0f4d91b59081 req-d3cfbf79-345e-4fb5-8fcc-2bd0481f19d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107207 Jun 18 22:19:25.531575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2061/4109] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:26.072687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1297394681", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:26.192713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] validate_networks() for [('2d6c9e75-32c3-4096-b802-97b6093af5d2', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:27.799496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:27.800147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:27.800374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:27.801612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:27.802384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:27.825737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:27.826757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:27.827910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:27.828533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:27.877868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Getting quotas for project e844852ee0a54325a07962baa9b8551b. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:27.888510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Getting quotas for user 59876c2e98254d29b51b071f68569602 and project e844852ee0a54325a07962baa9b8551b. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:27.933705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:27.938175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:28.133577 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aebd2605-2e2d-41ff-ae9f-f3106ec6c0e2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.600488 Jun 18 22:19:28.134244 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2062/4110] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:19:28.148375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:28.151367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:28.169628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:28.170102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:28.171428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:28.193009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:28.804229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:28.834877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab0a32e6-d783-4a9a-8386-f1651b967efa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 0.695026 Jun 18 22:19:28.835533 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2063/4111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:28 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:28.848333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:28.848956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:28.867471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:28.870483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:28.873463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:28.874134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.200605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:29.201756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:29.202773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:29.203394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:29.203972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:29.234367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.235051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.235869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.236447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.257561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:29.263830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:29.279417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:29.281998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:29.375227 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-baf6370d-034e-41c8-9a06-29bd0731c551 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.462544 Jun 18 22:19:29.381110 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2049/4112] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 4466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:19:29.387495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:29.388293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:29.398430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:29.410820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.411399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.412954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.413351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-32ef6bd8-c2e8-4f61-a4fa-b99abd5baf14 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1510 microversion: 2.1 time: 0.576616 Jun 18 22:19:29.413660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.417157 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2064/4113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:28 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1510 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:29.447495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7dea4623-e876-4849-b5c8-5e6511f9b0c7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:29.451034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7dea4623-e876-4849-b5c8-5e6511f9b0c7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:29.583642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:29.618078 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ec9c395f-29fb-4e6e-9ad2-cbce4e131a41 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1276 microversion: 2.1 time: 0.238880 Jun 18 22:19:29.620015 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2050/4114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:29 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1276 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:29.627382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:29.628546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:29.638357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7dea4623-e876-4849-b5c8-5e6511f9b0c7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:29.652440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.653750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.656044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.660070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.668011 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7dea4623-e876-4849-b5c8-5e6511f9b0c7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1241 microversion: 2.1 time: 0.249641 Jun 18 22:19:29.668646 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2065/4115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:29 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:29.782423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-276bbf9e-ed53-4a40-9066-d320bb37a41b req-780d96bc-6bc0-4773-9aca-f7052cfc2043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b01742a-9619-4cd5-8d4f-01c0364a7355", "name": "network-vif-plugged", "status": "completed", "tag": "c27d85de-aa63-4273-9105-be49acb3188a"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:29.794740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-276bbf9e-ed53-4a40-9066-d320bb37a41b req-780d96bc-6bc0-4773-9aca-f7052cfc2043 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.796250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-276bbf9e-ed53-4a40-9066-d320bb37a41b req-780d96bc-6bc0-4773-9aca-f7052cfc2043 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.810255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-276bbf9e-ed53-4a40-9066-d320bb37a41b req-780d96bc-6bc0-4773-9aca-f7052cfc2043 service nova] Creating event network-vif-plugged:c27d85de-aa63-4273-9105-be49acb3188a for instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 on nch1-master-1 Jun 18 22:19:29.815752 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-276bbf9e-ed53-4a40-9066-d320bb37a41b req-780d96bc-6bc0-4773-9aca-f7052cfc2043 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045042 Jun 18 22:19:29.816893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2066/4116] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:29.885942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:29.888821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:29.915442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.916308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:29.917668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:29.918337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.107381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:30.120403 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5d247d5a-594a-432e-985d-7f54b3748aa3 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1510 microversion: 2.1 time: 0.498680 Jun 18 22:19:30.122020 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2051/4117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:29 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:30.138932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:30.139908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:30.148735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.149816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.150830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.151517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.184882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:19:30.241212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:30.251043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7bb1e760-281d-4ce9-b315-40a879f15e39 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 0.388362 Jun 18 22:19:30.261531 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2067/4118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:29 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:30.313691 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b571efd3-dad5-4588-bd63-0ddf368639c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 204 len: 0 microversion: 2.1 time: 0.179148 Jun 18 22:19:30.315987 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2052/4119] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:19:30 2022] DELETE /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:19:30.325121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:30.325899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:30.334494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.343506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.345906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.351396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.632046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:30.637678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:30.638207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:30.645277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d42ebeb6-7dd8-4817-b7d1-6c9aa6f88b42 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1516 microversion: 2.1 time: 0.324386 Jun 18 22:19:30.653497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.654445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.655258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.655745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2068/4120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:30 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:30.655979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.688978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:30.690109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:30.703985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.704977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.707455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:30.709000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:30.825925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:30.841715 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-46119ef8-2bf1-41b7-abbc-1318008a59a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1282 microversion: 2.1 time: 0.208991 Jun 18 22:19:30.842580 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2053/4121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:30 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:30.863031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:30.874542 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-689b1909-346a-4866-b1f6-d577a1985959 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1293 microversion: 2.1 time: 0.192296 Jun 18 22:19:30.875164 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2069/4122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:30 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:31.270549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:31.271180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:31.290814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:31.296472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:31.298716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:31.299724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:31.663195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:31.663911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:31.678884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:31.679553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:31.682984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:31.683550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:31.719403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:31.730743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1505a736-7fec-44e7-beae-49062dabab8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1315 microversion: 2.1 time: 0.464892 Jun 18 22:19:31.737847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2054/4123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:31 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:31.859406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:31.860032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:31.870914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:31.872524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:31.876708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:31.877339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:32.041490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:32.058045 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4d239a1-706c-4428-ba3e-aafd5be2dc78 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1516 microversion: 2.1 time: 0.398799 Jun 18 22:19:32.059941 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2070/4124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:31 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:32.070487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:32.075245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:32.092351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:32.095887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:32.097554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:32.098317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:32.234538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:32.244346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:32.245893 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58e37096-b940-4a93-ade5-0776a1f83a6f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1293 microversion: 2.1 time: 0.183044 Jun 18 22:19:32.257736 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95345d7a-fb1f-4e55-8696-92952cad8477 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.401976 Jun 18 22:19:32.270156 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2071/4126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:32 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1293 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:32.270362 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2055/4126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:31 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:32.758037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:32.758936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:32.776927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:32.777710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:32.778788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:32.779478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.009206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3207057f-cd29-4de5-b28e-9ee7d8bfe296 req-d0338a8e-cd33-4b41-bc17-913ad0b4f55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f145f76-4402-4422-894c-6d53de65d705", "tag": "a57bf676-119d-475a-b400-9dd11474368c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:33.040724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3207057f-cd29-4de5-b28e-9ee7d8bfe296 req-d0338a8e-cd33-4b41-bc17-913ad0b4f55f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.041264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3207057f-cd29-4de5-b28e-9ee7d8bfe296 req-d0338a8e-cd33-4b41-bc17-913ad0b4f55f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.060970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3207057f-cd29-4de5-b28e-9ee7d8bfe296 req-d0338a8e-cd33-4b41-bc17-913ad0b4f55f service nova] Creating event network-changed:a57bf676-119d-475a-b400-9dd11474368c for instance 4f145f76-4402-4422-894c-6d53de65d705 on nch1-master-1 Jun 18 22:19:33.105074 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3207057f-cd29-4de5-b28e-9ee7d8bfe296 req-d0338a8e-cd33-4b41-bc17-913ad0b4f55f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100451 Jun 18 22:19:33.110378 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2056/4127] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:19:33.150632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:33.154578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:33.175936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.176483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.177364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.177787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.774260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:33.788563 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e0e2d95-08cc-4c77-a2f1-6f3f3be15324 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 200 len: 1474 microversion: 2.1 time: 0.674698 Jun 18 22:19:33.789656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2057/4128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:33 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 1474 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:33.796874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:33.810709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce963401-82fa-4216-bfcf-0c57b58e3f06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1502 microversion: 2.1 time: 1.058347 Jun 18 22:19:33.814444 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2072/4129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:32 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1502 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:33.819160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:33.821714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:33.828541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:33.835305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:33.846995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.851353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.852438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.853767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.859712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.860565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:33.865589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:33.867774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:34.077284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:34.088324 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12417050-f14c-4a1e-a438-6a674977d118 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1299 microversion: 2.1 time: 0.296718 Jun 18 22:19:34.098166 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2058/4130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:33 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1299 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:34.118573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-301c3ea9-1193-4864-8516-6bcf81d91af5 req-e30dbcb2-1ef1-4f0c-a94a-3493f27ce99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c62de4-53a8-41b1-a5b6-2f3f9b02565b", "name": "network-vif-deleted", "tag": "fdaa97e3-e615-448c-96d8-be1e72f0b056"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:34.130876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-301c3ea9-1193-4864-8516-6bcf81d91af5 req-e30dbcb2-1ef1-4f0c-a94a-3493f27ce99c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:34.131474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-301c3ea9-1193-4864-8516-6bcf81d91af5 req-e30dbcb2-1ef1-4f0c-a94a-3493f27ce99c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:34.159235 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-301c3ea9-1193-4864-8516-6bcf81d91af5 req-e30dbcb2-1ef1-4f0c-a94a-3493f27ce99c service nova] Creating event network-vif-deleted:fdaa97e3-e615-448c-96d8-be1e72f0b056 for instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b on nch2-master-1 Jun 18 22:19:34.167051 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-301c3ea9-1193-4864-8516-6bcf81d91af5 req-e30dbcb2-1ef1-4f0c-a94a-3493f27ce99c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072046 Jun 18 22:19:34.167667 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2059/4131] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:34.177490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:34.178579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:34.204730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:34.205553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:34.207934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:34.209965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:34.271749 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-997aa370-9313-45e2-adb7-628964b90cfe tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 0.102146 Jun 18 22:19:34.273103 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2060/4132] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:34 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:19:34.285280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:34.295597 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-234b9cdc-6876-493c-95db-c4684824bd06 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.477124 Jun 18 22:19:34.299667 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2073/4133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:33 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:34.807519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:34.808268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:34.826377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:34.827165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:34.832711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:34.833344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:34.858320 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b HTTP/1.1 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74c62de4-53a8-41b1-a5b6-2f3f9b02565b'} Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:34.860781 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:34.865023 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:34.865023 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:34.865023 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:34.865023 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:34.865023 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:19:34.865023 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:34.866292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:34.867357 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ccfee85a-428e-4189-b190-851aa1c2fad1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 404 len: 111 microversion: 2.1 time: 0.064126 Jun 18 22:19:34.868241 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2061/4134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:34 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:34.877243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c582156e-974f-4e38-9307-8e545de964bf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '.version_select at 0x7fea19da0160>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:34.905667 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c582156e-974f-4e38-9307-8e545de964bf tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-1392816209" status: 202 len: 0 microversion: 2.1 time: 0.033058 Jun 18 22:19:34.907264 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2074/4135] 10.222.0.30 () {58 vars in 1208 bytes} [Sat Jun 18 22:19:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1392816209 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:35.031600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2006492192", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:35.108194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:35.109915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:35.130445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.133542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.134377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.143314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.151611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:35.414302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:35.426620 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8613a101-b6d6-4d40-9fda-be206c9867bf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.324718 Jun 18 22:19:35.436741 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2075/4136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:35 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:35.443169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:35.444735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:35.460827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.462685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.466268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.466789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.744797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:35.745563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:35.746728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:35.747353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:35.747868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:35.762002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.762002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.766354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.766998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.797297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:35.808705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:35.823441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:35.826553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:35.886051 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7cd6528-af6f-4e6b-a084-47e98032652b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860866 Jun 18 22:19:35.889209 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2062/4137] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:19:35.906376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:35.909680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:35.937573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.938198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.943673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:35.945626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:35.951307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:36.202733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:36.214236 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-19f883b6-c929-4c31-819d-b68966ef27e6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.323520 Jun 18 22:19:36.215371 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2063/4138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:35 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:36.692231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4920151-73dc-4547-91e9-94895dcde616 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea075f2790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-32254573", "description": "tempest-description-181941989"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:36.800923 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06cfe607-f456-461e-a896-b4dd0162923a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 1.362504 Jun 18 22:19:36.804620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2076/4139] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:35 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:19:36.816623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:36.820806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:36.828320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:36.828778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:36.833672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:36.834136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:36.989540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:36.993576 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4920151-73dc-4547-91e9-94895dcde616 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.775566 Jun 18 22:19:36.995020 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2064/4140] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:19:36 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:37.017119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f4471e8-cf3c-43da-b335-177246670347 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1213 microversion: 2.1 time: 0.210600 Jun 18 22:19:37.026908 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2077/4141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:36 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:37.026994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-99e6df69-f117-4a7c-93e6-8ba75b309773 req-ac019ece-b4fc-414b-8e39-669c0569b71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2255804c-8789-4f0c-b90f-d8783df8bdec", "tag": "e5559a6c-070c-49e3-bf02-8fe5b4dd72ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:37.027077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:37.027387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:37.040374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.040836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.041668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.045166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-99e6df69-f117-4a7c-93e6-8ba75b309773 req-ac019ece-b4fc-414b-8e39-669c0569b71c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.045301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.047164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-99e6df69-f117-4a7c-93e6-8ba75b309773 req-ac019ece-b4fc-414b-8e39-669c0569b71c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.070776 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-99e6df69-f117-4a7c-93e6-8ba75b309773 req-ac019ece-b4fc-414b-8e39-669c0569b71c service nova] Creating event network-changed:e5559a6c-070c-49e3-bf02-8fe5b4dd72ab for instance 2255804c-8789-4f0c-b90f-d8783df8bdec on nch2-master-1 Jun 18 22:19:37.084627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-99e6df69-f117-4a7c-93e6-8ba75b309773 req-ac019ece-b4fc-414b-8e39-669c0569b71c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086949 Jun 18 22:19:37.085269 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2065/4142] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:37.096716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6cbf14a-f15c-4c02-ad14-b92618786cb3 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea07686d30>, body: {"security_group_rule": {"parent_group_id": "edf993cc-65dd-4ca3-be18-9f86598bd3ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:37.416637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:37.432409 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed940ef1-f667-476f-b3d2-87f1394e8c1f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.411747 Jun 18 22:19:37.442935 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2078/4143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:37 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:37.442935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:37.445137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:37.467507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.468191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.469439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.470034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.844493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:37.875115 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6cbf14a-f15c-4c02-ad14-b92618786cb3 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.785617 Jun 18 22:19:37.876674 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2066/4144] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:37.882542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:37.884874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:37.896416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.901810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.902905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:37.903570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:37.949788 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2fb977c9-01dc-47c9-a4d4-4998a0ce958e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 0.071373 Jun 18 22:19:37.951059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2067/4145] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:37 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:19:37.958230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e38f3344-2905-4edd-b7a3-a18883f74480 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea076b8040>, body: {"security_group_rule": {"parent_group_id": "edf993cc-65dd-4ca3-be18-9f86598bd3ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:37.959445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:37.972797 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-302bd815-c9fd-4c4a-886b-7a7a821542a0 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.535835 Jun 18 22:19:37.976744 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2079/4146] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:37 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:38.035910 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e38f3344-2905-4edd-b7a3-a18883f74480 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: This rule already exists in group edf993cc-65dd-4ca3-be18-9f86598bd3ce Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e38f3344-2905-4edd-b7a3-a18883f74480 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 138 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: {"security_group_rule": {"parent_group_id": "edf993cc-65dd-4ca3-be18-9f86598bd3ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: exception: This rule already exists in group edf993cc-65dd-4ca3-be18-9f86598bd3ce Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'edf993cc-65dd-4ca3-be18-9f86598bd3ce', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group edf993cc-65dd-4ca3-be18-9f86598bd3ce Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group edf993cc-65dd-4ca3-be18-9f86598bd3ce Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:38.038512 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:38.042706 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:38.042706 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:38.042706 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group edf993cc-65dd-4ca3-be18-9f86598bd3ce Jun 18 22:19:38.042706 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.043102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:38.043102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:38.044835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e38f3344-2905-4edd-b7a3-a18883f74480 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 400 to user: This rule already exists in group edf993cc-65dd-4ca3-be18-9f86598bd3ce {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:38.046435 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e38f3344-2905-4edd-b7a3-a18883f74480 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.093834 Jun 18 22:19:38.048183 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2068/4147] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:37 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:19:38.051803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:38.052345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:38.053473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:38.054034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:38.057955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3eb7c79f-8e25-48b9-8417-4877559a0c82 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea0767c310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:38.061543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:38.152249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:38.175516 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e0d5287-da9a-4429-84aa-d5d0fdad7f04 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1261 microversion: 2.1 time: 0.141336 Jun 18 22:19:38.188981 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2080/4148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:38 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:38.289480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3eb7c79f-8e25-48b9-8417-4877559a0c82 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/cce06542-d687-4dd5-b742-c09cd95c2f8d" status: 202 len: 0 microversion: 2.1 time: 0.236244 Jun 18 22:19:38.290765 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2069/4149] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Jun 18 22:19:38 2022] DELETE /compute/v2.1/os-security-group-rules/cce06542-d687-4dd5-b742-c09cd95c2f8d => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:38.305619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22c8ad70-733f-4cf3-b1c9-57b2a386a20c tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea14911dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-526014442", "description": "tempest-description-1643017291"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:38.456431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:38.457257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:38.504549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:38.514258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:38.519432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:38.520062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:38.686501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22c8ad70-733f-4cf3-b1c9-57b2a386a20c tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.386230 Jun 18 22:19:38.687338 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2081/4150] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:19:38 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:38.704300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3b00ad4-750b-4022-8118-33c7a16546cd tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea145c9af0>, body: {"security_group_rule": {"parent_group_id": "9e8aa788-d715-4257-aa6c-b08a9fb0d3f8", "ip_protocol": "tcp", "from_port": 858361823, "to_port": 22}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:38.840829 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-e3b00ad4-750b-4022-8118-33c7a16546cd tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Invalid port range 858361823:22. Former value cannot be greater than the later Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3b00ad4-750b-4022-8118-33c7a16546cd tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 145 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: {"security_group_rule": {"parent_group_id": "9e8aa788-d715-4257-aa6c-b08a9fb0d3f8", "ip_protocol": "tcp", "from_port": 858361823, "to_port": 22}} Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid port range 858361823:22. Former value cannot be greater than the later Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9e8aa788-d715-4257-aa6c-b08a9fb0d3f8', 'ip_protocol': 'tcp', 'from_port': 858361823, 'to_port': 22}}} Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 858361823:22. Former value cannot be greater than the later Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 858361823:22. Former value cannot be greater than the later Jun 18 22:19:38.842701 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 858361823:22. Former value cannot be greater than the later Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3b00ad4-750b-4022-8118-33c7a16546cd tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 400 to user: Invalid port range 858361823:22. Former value cannot be greater than the later {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3b00ad4-750b-4022-8118-33c7a16546cd tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.149249 Jun 18 22:19:38.847334 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2082/4151] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:38 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:19:38.855631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c9fa6bb-88c7-4e2b-8a8a-6623ceb3df70 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea19dc7f70>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2119842549", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:38.860489 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2c9fa6bb-88c7-4e2b-8a8a-6623ceb3df70 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Security group id should be uuid Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c9fa6bb-88c7-4e2b-8a8a-6623ceb3df70 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 131 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2119842549", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group id should be uuid Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2119842549', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:38.865498 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:38.869798 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 18 22:19:38.869798 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:38.870272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c9fa6bb-88c7-4e2b-8a8a-6623ceb3df70 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 400 to user: Security group id should be uuid {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:38.872068 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c9fa6bb-88c7-4e2b-8a8a-6623ceb3df70 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021255 Jun 18 22:19:38.875313 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2083/4152] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:38 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:38.879810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:38.890770 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7eb15d91-56c0-437c-b0dc-a90882ceff14 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.443758 Jun 18 22:19:38.891496 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2070/4153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:38 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:38.895450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a3c29ef-4721-497f-b9b9-65a314e40607 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea19dc7af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-890353542", "description": "tempest-description-643685045"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:38.968747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:38.969839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:38.980730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:38.981211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:38.981994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:38.984083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:39.098795 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3b2ac523-b73b-43f9-a224-91600c016990 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 0.141219 Jun 18 22:19:39.099813 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2071/4154] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:38 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:19:39.107432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:39.115460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:39.123665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:39.124450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:39.125475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:39.126245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:39.284567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a3c29ef-4721-497f-b9b9-65a314e40607 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.405376 Jun 18 22:19:39.286377 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2084/4155] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:19:38 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:39.297079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:39.297729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:39.307089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:39.309460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:39.314964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:39.315544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:39.410967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:39.423859 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-38f47e54-21c2-403a-9eba-a63ddc4b0622 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1267 microversion: 2.1 time: 0.136221 Jun 18 22:19:39.424362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2085/4156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:39 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:39.437306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:39.448852 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f002817-ef74-4b4f-9eb8-f92115d0d3af tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.347217 Jun 18 22:19:39.453434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7cb2c70-e36e-43cf-ac67-a281f07777a1 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea19dcb0d0>, body: {"security_group_rule": {"parent_group_id": "62a5dafa-c0ae-485e-9314-635ea6ee0a0c", "ip_protocol": "tempest-999-35753322", "from_port": 22, "to_port": 22}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:39.454638 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2072/4157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:39 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:39.529669 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b7cb2c70-e36e-43cf-ac67-a281f07777a1 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Invalid IP protocol tempest-999-35753322. Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7cb2c70-e36e-43cf-ac67-a281f07777a1 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 155 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: {"security_group_rule": {"parent_group_id": "62a5dafa-c0ae-485e-9314-635ea6ee0a0c", "ip_protocol": "tempest-999-35753322", "from_port": 22, "to_port": 22}} Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid IP protocol tempest-999-35753322. Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'security_group_rule': {'parent_group_id': '62a5dafa-c0ae-485e-9314-635ea6ee0a0c', 'ip_protocol': 'tempest-999-35753322', 'from_port': 22, 'to_port': 22}}} Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-35753322. Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-35753322. Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:39.531527 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-35753322. Jun 18 22:19:39.534860 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:39.536767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7cb2c70-e36e-43cf-ac67-a281f07777a1 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 400 to user: Invalid IP protocol tempest-999-35753322. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:39.538006 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b7cb2c70-e36e-43cf-ac67-a281f07777a1 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.095214 Jun 18 22:19:39.539198 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2086/4158] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:39 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:19:39.548847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d18ec1c2-e2a6-4aaa-a44f-2b15a3a1dd2e tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea07654550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1797912228", "description": "tempest-description-853008318"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:39.879785 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d18ec1c2-e2a6-4aaa-a44f-2b15a3a1dd2e tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.335445 Jun 18 22:19:39.881135 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2073/4159] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:19:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:39.888815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=11 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:39.894060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41421728-5f34-48a0-8327-ee1058b22929 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea141ad9d0>, body: {"security_group_rule": {"parent_group_id": "87f4d1d0-25d7-4197-894c-392a191c863f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:39.908935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:39.910046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:39.930015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:39.930464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:39.931261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:39.931690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.054406 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-41421728-5f34-48a0-8327-ee1058b22929 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41421728-5f34-48a0-8327-ee1058b22929 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 138 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: {"security_group_rule": {"parent_group_id": "87f4d1d0-25d7-4197-894c-392a191c863f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'security_group_rule': {'parent_group_id': '87f4d1d0-25d7-4197-894c-392a191c863f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 18 22:19:40.056281 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41421728-5f34-48a0-8327-ee1058b22929 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:40.060541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41421728-5f34-48a0-8327-ee1058b22929 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.170086 Jun 18 22:19:40.064161 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2087/4160] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:39 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:19:40.070163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fa6976ba-4211-4d29-9dea-bc8a45c4b09a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea19d1f040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-930210778", "description": "tempest-description-483696943"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:40.277205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:40.286848 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ddc69920-05ed-475a-b2aa-32db7bfabb98 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.382651 Jun 18 22:19:40.287439 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2074/4161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:39 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:40.322961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:40.324444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:40.349017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.354410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.355496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.356270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.452348 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de53ae09-ad50-42e0-b808-ab0a237b930d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 0.136194 Jun 18 22:19:40.453648 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2075/4162] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:40 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:19:40.476030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:40.477282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:40.495401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.495861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.496658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.497122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.530257 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fa6976ba-4211-4d29-9dea-bc8a45c4b09a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.464815 Jun 18 22:19:40.531202 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2088/4163] 10.222.0.30 () {60 vars in 1179 bytes} [Sat Jun 18 22:19:40 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:40.536614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-789f5e5d-b5b4-411c-8868-1efbac244fc9 req-31bcd948-61e8-4f1f-b725-ecc29afc5856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f145f76-4402-4422-894c-6d53de65d705", "name": "network-vif-plugged", "status": "completed", "tag": "a57bf676-119d-475a-b400-9dd11474368c"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:40.555086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-789f5e5d-b5b4-411c-8868-1efbac244fc9 req-31bcd948-61e8-4f1f-b725-ecc29afc5856 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.558161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-789f5e5d-b5b4-411c-8868-1efbac244fc9 req-31bcd948-61e8-4f1f-b725-ecc29afc5856 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.586809 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-789f5e5d-b5b4-411c-8868-1efbac244fc9 req-31bcd948-61e8-4f1f-b725-ecc29afc5856 service nova] Creating event network-vif-plugged:a57bf676-119d-475a-b400-9dd11474368c for instance 4f145f76-4402-4422-894c-6d53de65d705 on nch1-master-1 Jun 18 22:19:40.599003 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-789f5e5d-b5b4-411c-8868-1efbac244fc9 req-31bcd948-61e8-4f1f-b725-ecc29afc5856 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065529 Jun 18 22:19:40.600690 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2089/4164] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:40.631466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:40.633445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:40.646215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.651827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.653305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:40.654007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:40.887291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:40.899689 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e745eee-19ee-4c2c-8229-2ddc55049293 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.443983 Jun 18 22:19:40.902470 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2076/4165] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:40 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:40.936620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b29027ef-f1ae-477f-af89-e5c8d41a9f72 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea076e4dc0>, body: {"security_group_rule": {"parent_group_id": "afa4baa7-69c6-472e-a803-7c01c6078bbb", "ip_protocol": "tcp", "from_port": 22, "to_port": 278505393}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:41.108076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:41.135024 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80aa3cd0-3516-4853-b213-11c5e78b699d tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.531862 Jun 18 22:19:41.135634 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2090/4166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:40 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:41.167696 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b29027ef-f1ae-477f-af89-e5c8d41a9f72 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Invalid port range 22:278505393. Valid TCP ports should be between 1-65535 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b29027ef-f1ae-477f-af89-e5c8d41a9f72 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 145 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: {"security_group_rule": {"parent_group_id": "afa4baa7-69c6-472e-a803-7c01c6078bbb", "ip_protocol": "tcp", "from_port": 22, "to_port": 278505393}} Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid port range 22:278505393. Valid TCP ports should be between 1-65535 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'afa4baa7-69c6-472e-a803-7c01c6078bbb', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 278505393}}} Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:278505393. Valid TCP ports should be between 1-65535 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:278505393. Valid TCP ports should be between 1-65535 Jun 18 22:19:41.169451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:278505393. Valid TCP ports should be between 1-65535 Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b29027ef-f1ae-477f-af89-e5c8d41a9f72 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 400 to user: Invalid port range 22:278505393. Valid TCP ports should be between 1-65535 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b29027ef-f1ae-477f-af89-e5c8d41a9f72 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.266246 Jun 18 22:19:41.172821 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2077/4167] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:40 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:19:41.182895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Action: 'create', calling method: .version_select at 0x7fea19df2160>, body: {"security_group_rule": {"parent_group_id": "3662bc0a-7751-4768-9cbd-df67f518ce26", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:41.218714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG neutronclient.v2_0.client [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist", "detail": ""}} {{(pid=130902) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:19:41.219377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Neutron security group 3662bc0a-7751-4768-9cbd-df67f518ce26 not found {{(pid=130902) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 18 22:19:41.219869 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.219869 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 138 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: {"security_group_rule": {"parent_group_id": "3662bc0a-7751-4768-9cbd-df67f518ce26", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: exception: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3662bc0a-7751-4768-9cbd-df67f518ce26', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:19:41.222129 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 404 to user: Security group 3662bc0a-7751-4768-9cbd-df67f518ce26 does not exist Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: Neutron server returns request_ids: ['req-9dc528fe-8cad-4342-8570-83840f755e32'] {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6688fb63-44b5-4826-b43e-582e55492f0a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.046006 Jun 18 22:19:41.231027 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2091/4168] 10.222.0.30 () {60 vars in 1194 bytes} [Sat Jun 18 22:19:41 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:41.237271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea14108040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:41.261004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG neutronclient.v2_0.client [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist", "detail": ""}} {{(pid=130903) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 18 22:19:41.261816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.security_group_api [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Neutron security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 not found {{(pid=130903) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 18 22:19:41.262379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] HTTP exception thrown: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.262379 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Request method failure captured: Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-security-group-rules/aeea28e3-2057-42b7-b7a2-fe7c7d571243 HTTP/1.1 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk93hgRr7nPhDSrULQbV0HtCwWbMHaNl0vCWq96-T7vwC-bc5AyCWEQtrhMRiKN8O0mfFR0TR5k_Psqdk2ne80upcabWOH3_DK4ulgYmZ5SYdCcWH3xYwoo_TEsGtbu-4lSwUf2abgc8-wkpZtmZDl-Cn29Kwx5UA3uKNukd-UE5nOA Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b7881662169425eafcad48b5c31f1ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b7881662169425eafcad48b5c31f1ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8b7881662169425eafcad48b5c31f1ee Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ff7a45b8c6c7462ab3e3e1e1caeadf65 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: exception: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'aeea28e3-2057-42b7-b7a2-fe7c7d571243'} Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 18 22:19:41.264243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Returning 404 to user: Security group rule aeea28e3-2057-42b7-b7a2-fe7c7d571243 does not exist Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: Neutron server returns request_ids: ['req-518a742c-f231-49ba-ac7f-05588df97396'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c557216e-0dfc-41bc-af8d-dbdb20af46c9 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/aeea28e3-2057-42b7-b7a2-fe7c7d571243" status: 404 len: 199 microversion: 2.1 time: 0.035051 Jun 18 22:19:41.268047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2078/4169] 10.222.0.30 () {58 vars in 1286 bytes} [Sat Jun 18 22:19:41 2022] DELETE /compute/v2.1/os-security-group-rules/aeea28e3-2057-42b7-b7a2-fe7c7d571243 => generated 199 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:41.275589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f8cb14a7-b4a3-445a-a215-fa7eb818cd1f tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea14c8a0d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:41.305177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:41.306271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:41.323062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.324118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:41.325023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.325739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:41.624070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:41.637616 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dacea85e-b585-453c-8155-2e90d3808619 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.336904 Jun 18 22:19:41.638231 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2079/4170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:41 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:41.658852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-91321deb-a605-4e41-8af1-e3d14715dc6b req-241d276a-9adf-42e8-9fe9-e854616accc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62add9a1-ed28-4e11-b315-4596612cb113", "tag": "2e44566b-6eee-4214-8a15-931c9154bf46"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:41.670301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-91321deb-a605-4e41-8af1-e3d14715dc6b req-241d276a-9adf-42e8-9fe9-e854616accc1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.670954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-91321deb-a605-4e41-8af1-e3d14715dc6b req-241d276a-9adf-42e8-9fe9-e854616accc1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:41.688450 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-91321deb-a605-4e41-8af1-e3d14715dc6b req-241d276a-9adf-42e8-9fe9-e854616accc1 service nova] Creating event network-changed:2e44566b-6eee-4214-8a15-931c9154bf46 for instance 62add9a1-ed28-4e11-b315-4596612cb113 on nch2-master-1 Jun 18 22:19:41.695247 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-91321deb-a605-4e41-8af1-e3d14715dc6b req-241d276a-9adf-42e8-9fe9-e854616accc1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055604 Jun 18 22:19:41.696918 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2080/4171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:41.703863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:41.706255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:41.714143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.715318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:41.716375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.716956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:41.755089 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f8cb14a7-b4a3-445a-a215-fa7eb818cd1f tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/afa4baa7-69c6-472e-a803-7c01c6078bbb" status: 202 len: 0 microversion: 2.1 time: 0.483181 Jun 18 22:19:41.757148 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2092/4172] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:19:41 2022] DELETE /compute/v2.1/os-security-groups/afa4baa7-69c6-472e-a803-7c01c6078bbb => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:41.761123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:41.762289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:41.776765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.777401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:41.784931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:41.785947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.160003 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a80d30b-37fd-40cd-87e9-4ddcabe3b617 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 0.402614 Jun 18 22:19:42.163336 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2093/4173] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:41 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:19:42.165862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-788ad81c-002d-4a71-8ce1-7b5f32776c84 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea19dd1700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:42.189388 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac9fcc70-cde1-449b-ba4c-b2f3f31c9006 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3/action" status: 200 len: 24566 microversion: 2.1 time: 0.490591 Jun 18 22:19:42.196963 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2081/4174] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:41 2022] POST /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3/action => generated 24566 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:19:42.201090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:42.201821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:42.208820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.209871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.210648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.211099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.424898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:42.432986 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65e38a94-8f03-41e5-89cf-ea0146410c09 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.241175 Jun 18 22:19:42.433566 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2082/4175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:42 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:42.438132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:42.438776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:42.448087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.449285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.450028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.450639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.452910 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-788ad81c-002d-4a71-8ce1-7b5f32776c84 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/87f4d1d0-25d7-4197-894c-392a191c863f" status: 202 len: 0 microversion: 2.1 time: 0.290709 Jun 18 22:19:42.454605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2094/4176] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:19:42 2022] DELETE /compute/v2.1/os-security-groups/87f4d1d0-25d7-4197-894c-392a191c863f => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:42.463809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e295b7de-76a8-446b-b5f3-de5a16db6d7a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea141ad9d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:42.667609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:42.681114 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9a95dad-5b9a-4ad6-b205-1b8d80aa2c56 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1324 microversion: 2.1 time: 0.246365 Jun 18 22:19:42.683483 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2083/4177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:42 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:42.689156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:42.689531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:42.699349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.700251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.702192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.702871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.806918 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e295b7de-76a8-446b-b5f3-de5a16db6d7a tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/62a5dafa-c0ae-485e-9314-635ea6ee0a0c" status: 202 len: 0 microversion: 2.1 time: 0.348038 Jun 18 22:19:42.807817 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2095/4178] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:19:42 2022] DELETE /compute/v2.1/os-security-groups/62a5dafa-c0ae-485e-9314-635ea6ee0a0c => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:42.817501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9372d99d-c1c0-4d26-bb28-22ab38800c45 req-1b52bf96-b817-4a1f-bcd5-1b2fcf314b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255804c-8789-4f0c-b90f-d8783df8bdec", "name": "network-vif-plugged", "status": "completed", "tag": "e5559a6c-070c-49e3-bf02-8fe5b4dd72ab"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:42.847046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9372d99d-c1c0-4d26-bb28-22ab38800c45 req-1b52bf96-b817-4a1f-bcd5-1b2fcf314b0b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:42.847627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9372d99d-c1c0-4d26-bb28-22ab38800c45 req-1b52bf96-b817-4a1f-bcd5-1b2fcf314b0b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:42.862643 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9372d99d-c1c0-4d26-bb28-22ab38800c45 req-1b52bf96-b817-4a1f-bcd5-1b2fcf314b0b service nova] Creating event network-vif-plugged:e5559a6c-070c-49e3-bf02-8fe5b4dd72ab for instance 2255804c-8789-4f0c-b90f-d8783df8bdec on nch2-master-1 Jun 18 22:19:42.869216 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9372d99d-c1c0-4d26-bb28-22ab38800c45 req-1b52bf96-b817-4a1f-bcd5-1b2fcf314b0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057838 Jun 18 22:19:42.870449 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2096/4179] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:42.877246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b62303ff-1a45-455c-b1a5-ad1d37645f29 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea19d4b4c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:42.917464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:42.930624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fde55009-c13d-4a20-891f-aa16f0135a82 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.245482 Jun 18 22:19:42.931305 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2084/4180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:42 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:43.141291 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b62303ff-1a45-455c-b1a5-ad1d37645f29 tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/9e8aa788-d715-4257-aa6c-b08a9fb0d3f8" status: 202 len: 0 microversion: 2.1 time: 0.269217 Jun 18 22:19:43.142155 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2097/4181] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:19:42 2022] DELETE /compute/v2.1/os-security-groups/9e8aa788-d715-4257-aa6c-b08a9fb0d3f8 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:43.150632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22123eee-3a54-491e-8f86-0abdaf58fe6f tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] Calling method '.version_select at 0x7fea0764ac10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:43.171654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:43.172830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:43.179470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.179935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.180742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.181220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.221839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a942631b-183a-41ec-9707-fe340bda654a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 14 microversion: 2.1 time: 0.054225 Jun 18 22:19:43.222488 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2098/4182] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:43 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:19:43.423826 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22123eee-3a54-491e-8f86-0abdaf58fe6f tempest-SecurityGroupRulesNegativeTestJSON-1969169054 tempest-SecurityGroupRulesNegativeTestJSON-1969169054-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/edf993cc-65dd-4ca3-be18-9f86598bd3ce" status: 202 len: 0 microversion: 2.1 time: 0.276826 Jun 18 22:19:43.425060 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2085/4183] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:19:43 2022] DELETE /compute/v2.1/os-security-groups/edf993cc-65dd-4ca3-be18-9f86598bd3ce => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:43.451916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:43.453290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:43.462591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.463748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.464647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.465198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.614583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:43.622763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb6059dc-dd4b-46df-b504-6e3fed95701e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.175503 Jun 18 22:19:43.623450 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2099/4184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:43 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:43.699578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:43.700145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:43.706609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.707248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.708255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.708690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.858520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:43.866569 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e99eb6c3-b5aa-483e-8263-5ee7a8fbd785 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1521 microversion: 2.1 time: 0.171839 Jun 18 22:19:43.867172 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2086/4185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:43 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:43.953134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:43.953885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:43.967860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.968407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.969582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:43.970970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:43.994553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c08d17a-f71f-40af-8760-86d93673b461 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-47024356", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c08d17a-f71f-40af-8760-86d93673b461 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 241 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-47024356", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-47024356', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '2d6c9e75-32c3-4096-b802-97b6093af5d2'}]}}} Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:43.999407 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.003478 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.006719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c08d17a-f71f-40af-8760-86d93673b461 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.008213 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c08d17a-f71f-40af-8760-86d93673b461 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.018247 Jun 18 22:19:44.009279 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2087/4186] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:43 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:19:44.021375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee079e9a-cb7c-40be-90ad-1be0fd772e71 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.021979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee079e9a-cb7c-40be-90ad-1be0fd772e71 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 9332a4a7-04d9-4b91-8de8-d99bc2771dd4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.024054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:44.042173 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ee079e9a-cb7c-40be-90ad-1be0fd772e71 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] HTTP exception thrown: Instance 9332a4a7-04d9-4b91-8de8-d99bc2771dd4 could not be found. Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee079e9a-cb7c-40be-90ad-1be0fd772e71 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/9332a4a7-04d9-4b91-8de8-d99bc2771dd4/metadata HTTP/1.1 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 9332a4a7-04d9-4b91-8de8-d99bc2771dd4 could not be found. Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': '9332a4a7-04d9-4b91-8de8-d99bc2771dd4'} Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9332a4a7-04d9-4b91-8de8-d99bc2771dd4 could not be found. Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9332a4a7-04d9-4b91-8de8-d99bc2771dd4 could not be found. Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.049757 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.053502 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:44.053502 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:44.053502 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9332a4a7-04d9-4b91-8de8-d99bc2771dd4 could not be found. Jun 18 22:19:44.053502 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.053502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee079e9a-cb7c-40be-90ad-1be0fd772e71 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 404 to user: Instance 9332a4a7-04d9-4b91-8de8-d99bc2771dd4 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.053502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee079e9a-cb7c-40be-90ad-1be0fd772e71 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/9332a4a7-04d9-4b91-8de8-d99bc2771dd4/metadata" status: 404 len: 111 microversion: 2.1 time: 0.034476 Jun 18 22:19:44.056722 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2088/4187] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:19:44 2022] GET /compute/v2.1/servers/9332a4a7-04d9-4b91-8de8-d99bc2771dd4/metadata => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:44.183842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:44.195722 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-94aad99c-57a3-4cfb-b135-0ceb642724e8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1366 microversion: 2.1 time: 0.250188 Jun 18 22:19:44.200008 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2100/4188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:43 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:44.204949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a89fd727-bd29-42fb-b395-ec8668bf0fb5 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1468806976", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a89fd727-bd29-42fb-b395-ec8668bf0fb5 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 499 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1468806976", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1468806976', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2d6c9e75-32c3-4096-b802-97b6093af5d2'}]}}} Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:19:44.207904 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.211046 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.214179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a89fd727-bd29-42fb-b395-ec8668bf0fb5 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.215111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a89fd727-bd29-42fb-b395-ec8668bf0fb5 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.016309 Jun 18 22:19:44.224577 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2089/4189] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:44 2022] POST /compute/v2.1/servers => generated 687 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:19:44.236042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:44.237257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.247233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.247825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.248866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.249675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.280495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b0b047f-cdaf-4e05-9902-c1e9ffd229ab tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1071961254", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b0b047f-cdaf-4e05-9902-c1e9ffd229ab tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 500 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1071961254", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1071961254', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2d6c9e75-32c3-4096-b802-97b6093af5d2'}]}}} Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:19:44.284941 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.287625 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.291041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b0b047f-cdaf-4e05-9902-c1e9ffd229ab tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.291041 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b0b047f-cdaf-4e05-9902-c1e9ffd229ab tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017561 Jun 18 22:19:44.299680 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2090/4190] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:44 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:19:44.331584 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f4ba019-0a26-4c48-85ab-2f3e06256d13 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action" status: 200 len: 8204 microversion: 2.1 time: 0.101220 Jun 18 22:19:44.332520 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2101/4191] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:44 2022] POST /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355/action => generated 8204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:44.343066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.344098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.356025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.359217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.360627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.361387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.376460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8dc795b3-64bd-4fa6-b4e8-e7893528e52a tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-988554945", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8dc795b3-64bd-4fa6-b4e8-e7893528e52a tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 753 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-988554945", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-988554945', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2d6c9e75-32c3-4096-b802-97b6093af5d2'}]}}} Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:19:44.380541 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:19:44.383147 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:19:44.386015 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.386015 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.386015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8dc795b3-64bd-4fa6-b4e8-e7893528e52a tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.386015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8dc795b3-64bd-4fa6-b4e8-e7893528e52a tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.014029 Jun 18 22:19:44.386015 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2102/4192] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:44 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jun 18 22:19:44.505877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-554948e9-34f5-4bf1-8339-8c55c7a8ce23 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1520608209", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-554948e9-34f5-4bf1-8339-8c55c7a8ce23 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 1266 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1520608209", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2d6c9e75-32c3-4096-b802-97b6093af5d2"}]}} Jun 18 22:19:44.509149 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1520608209', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2d6c9e75-32c3-4096-b802-97b6093af5d2'}]}}} Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.510994 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:19:44.511949 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:19:44.513503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 18 22:19:44.513503 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.515328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-554948e9-34f5-4bf1-8339-8c55c7a8ce23 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.516367 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-554948e9-34f5-4bf1-8339-8c55c7a8ce23 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.014714 Jun 18 22:19:44.517259 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2103/4193] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Jun 18 22:19:44 2022] POST /compute/v2.1/servers => generated 2221 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 18 22:19:44.533811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0f87aa3-28ab-40e0-85fd-b1a3e900d2da tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.535258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0f87aa3-28ab-40e0-85fd-b1a3e900d2da tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 043f6f2a-af8f-4723-b139-a43bb448b7fe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.542118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-e0f87aa3-28ab-40e0-85fd-b1a3e900d2da tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] HTTP exception thrown: Instance 043f6f2a-af8f-4723-b139-a43bb448b7fe could not be found. Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0f87aa3-28ab-40e0-85fd-b1a3e900d2da tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/043f6f2a-af8f-4723-b139-a43bb448b7fe/metadata/test2 HTTP/1.1 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 043f6f2a-af8f-4723-b139-a43bb448b7fe could not be found. Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '043f6f2a-af8f-4723-b139-a43bb448b7fe', 'id': 'test2'} Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 043f6f2a-af8f-4723-b139-a43bb448b7fe could not be found. Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 043f6f2a-af8f-4723-b139-a43bb448b7fe could not be found. Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:44.544333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:44.548072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:44.548072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:44.548072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 043f6f2a-af8f-4723-b139-a43bb448b7fe could not be found. Jun 18 22:19:44.548072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:44.549626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0f87aa3-28ab-40e0-85fd-b1a3e900d2da tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 404 to user: Instance 043f6f2a-af8f-4723-b139-a43bb448b7fe could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:44.550786 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0f87aa3-28ab-40e0-85fd-b1a3e900d2da tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/043f6f2a-af8f-4723-b139-a43bb448b7fe/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022335 Jun 18 22:19:44.551476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2104/4194] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Jun 18 22:19:44 2022] GET /compute/v2.1/servers/043f6f2a-af8f-4723-b139-a43bb448b7fe/metadata/test2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:44.556576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:44.566796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.567313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.567668 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f7bbffe3-7ee6-4519-aeb7-56094e853cbb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.230237 Jun 18 22:19:44.568380 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2091/4195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:44 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:44.576256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.576714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.577707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.579101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.597258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.598017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.606474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.606926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.607797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.608146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.624286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:19:44.727953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:44.742530 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7c72114e-ed3b-4af7-86ca-8187ef3b24a6 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 204 len: 0 microversion: 2.1 time: 0.178581 Jun 18 22:19:44.743620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2105/4196] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:19:44 2022] DELETE /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:19:44.749233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.750794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.758761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.760298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.761391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.762048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.915432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:44.925976 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7192e51e-7eb1-42fa-b33d-b810d12659e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.332743 Jun 18 22:19:44.926591 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2092/4197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:44 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:44.932014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:44.938825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:44.960153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.960970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:44.962007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:44.962604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.016250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:45.025402 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7cd1f74-cc30-4d9c-b226-b3fb8c41ec83 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.280325 Jun 18 22:19:45.026188 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2106/4198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:44 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:45.045099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:45.045826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:45.056948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.057849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.058864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.059870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.204615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:45.213221 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4382f9c-587a-48d7-8379-ea34c3d486ee tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1527 microversion: 2.1 time: 0.284765 Jun 18 22:19:45.223193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2093/4199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:44 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1527 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:45.228049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:45.228673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:45.236024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.236475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.237489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.238100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.258456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:45.265254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:45.275610 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f6630465-faf2-4a1c-b925-02e2f8efd5aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.248228 Jun 18 22:19:45.276588 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2107/4200] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:45 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:45.293065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:45.294020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:45.301512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.302652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.303906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.304599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.519107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:45.529524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7df7af9e-9cf0-42dd-94ca-c355ee7c319b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1557 microversion: 2.1 time: 0.305149 Jun 18 22:19:45.537699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:45.546630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19711a85-dd93-45bb-81e1-5b29102d7b12 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.258146 Jun 18 22:19:45.553109 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2108/4201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:45 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:45.553368 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2094/4202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:45 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1557 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:45.558669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:45.559174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:45.566470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:45.566974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:45.576899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.577378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.578158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.578582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.584582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.585727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.586738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.587398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.646899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Locking {{(pid=130903) lock /opt/stack/nova/nova/compute/api.py:4700}} Jun 18 22:19:45.712108 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-32229ad4-c0c1-4214-8fc0-c1a0a86f9a19 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157175 Jun 18 22:19:45.712719 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2109/4203] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:19:45 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:45.727272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2706eff3-124e-43cb-b3d0-2158d81d6061 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.164289 Jun 18 22:19:45.731946 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2095/4204] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:45 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:45.736777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:45.737437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:45.749277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.749760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:45.750543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:45.750981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.043194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:46.043564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:46.047048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:46.048898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:46.067071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.069365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.070766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.072818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.089090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:46.097830 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-96aa2ac9-e9fc-4028-b345-016b8129a5a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.364917 Jun 18 22:19:46.099061 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2110/4205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:45 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:46.116467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:46.134267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.135331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.166088 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] HTTP exception thrown: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 is locked Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Request method failure captured: Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action HTTP/1.1 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk42EGm5LQCR1sfLFnqveIKswEI9D2bNKgrJ79NnCDSEp3C60cses8yEF_0TpFNS4_J0-KILujwAHrR1O3siwHIDsdmZ3L3DB0dJiOytN29d_92zB4wbEvFqjLmwXmY9a0kwMjOWtzJJFQ1kUvb6r7MfQiXeM0B0x-YdIDo073fProg Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6269e5969c6a4957b3bb1816d93cebd0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ab975e8ffd0448939b2105aed58003fe Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: {"os-stop": {}} Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 is locked Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '37ee6136-56ff-40f6-a614-b941bc50cc88', 'body': {'os-stop': {}}} Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 is locked Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 is locked Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 is locked Jun 18 22:19:46.168017 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:19:46.173427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Returning 409 to user: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 is locked {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:46.174563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5a67dc8-43a7-4b08-8189-accfd089cf30 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 409 len: 107 microversion: 2.1 time: 0.063268 Jun 18 22:19:46.175832 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2111/4206] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:46 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 107 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:19:46.184673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:46.185300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:46.192018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.192810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.193698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.194161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.270146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:46.276662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Unlocking {{(pid=130902) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 18 22:19:46.361024 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41efee94-00fa-4526-bf49-897f5c704dc8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.180255 Jun 18 22:19:46.367551 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2112/4207] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:46 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:46.376792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:46.378523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:46.390772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.392201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.393596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.394232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:46.850066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:46.896806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fe552395-f47c-4657-aca7-34cbb8fa5ee5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.857213 Jun 18 22:19:46.898886 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2096/4208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:46 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:46.912519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd84f5b4-50e7-477d-b88f-04926000af79 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:46.930363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd84f5b4-50e7-477d-b88f-04926000af79 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:46.933687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd84f5b4-50e7-477d-b88f-04926000af79 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:47.009085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd84f5b4-50e7-477d-b88f-04926000af79 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Going to try to stop instance {{(pid=130903) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:19:47.103232 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd84f5b4-50e7-477d-b88f-04926000af79 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.199010 Jun 18 22:19:47.105683 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2097/4209] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:19:46 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:19:47.118967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:47.120254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:47.128226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:47.129650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:47.131725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:47.132589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:47.181700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:47.196494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c6c64c5-9821-4682-9b4e-4a35b51d79b2 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1527 microversion: 2.1 time: 0.822507 Jun 18 22:19:47.197470 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2113/4210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:46 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1527 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:47.717920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:47.727019 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12e21b3c-9a98-4095-8023-cd8464ecbdd6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.616527 Jun 18 22:19:47.728046 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2098/4211] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:47 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:47.915627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:47.916209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:47.928397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:47.929103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:47.930127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:47.931242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:48.215526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:48.216330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:48.222918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:48.223684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:48.224700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:48.225487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:48.367864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59876c2e98254d29b51b071f68569602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e844852ee0a54325a07962baa9b8551b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:48.378535 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d1716ed-076f-415a-b80b-fc7b658bf7a8 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 200 len: 1485 microversion: 2.1 time: 0.167000 Jun 18 22:19:48.381946 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2099/4212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:48 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 1485 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:48.393276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a2f94c81-1013-4221-94df-559646a919ab req-776dc476-5e71-4d4f-89ae-7ccb59dd55ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f145f76-4402-4422-894c-6d53de65d705", "name": "network-vif-deleted", "tag": "a57bf676-119d-475a-b400-9dd11474368c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:48.405697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a2f94c81-1013-4221-94df-559646a919ab req-776dc476-5e71-4d4f-89ae-7ccb59dd55ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:48.406488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a2f94c81-1013-4221-94df-559646a919ab req-776dc476-5e71-4d4f-89ae-7ccb59dd55ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:48.420933 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a2f94c81-1013-4221-94df-559646a919ab req-776dc476-5e71-4d4f-89ae-7ccb59dd55ed service nova] Creating event network-vif-deleted:a57bf676-119d-475a-b400-9dd11474368c for instance 4f145f76-4402-4422-894c-6d53de65d705 on nch1-master-1 Jun 18 22:19:48.426584 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a2f94c81-1013-4221-94df-559646a919ab req-776dc476-5e71-4d4f-89ae-7ccb59dd55ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043089 Jun 18 22:19:48.427911 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2100/4213] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:48.489073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:48.506349 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9feb3d7-c84d-4f6d-9a51-a8e5199cd325 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.594926 Jun 18 22:19:48.507522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2114/4214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:47 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:48.699663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3447e0f7-2428-4a6c-ad3f-f805259a1935 req-36099df2-f3e4-45fd-b298-be55d97eca9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62add9a1-ed28-4e11-b315-4596612cb113", "name": "network-vif-plugged", "status": "completed", "tag": "2e44566b-6eee-4214-8a15-931c9154bf46"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:48.716834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3447e0f7-2428-4a6c-ad3f-f805259a1935 req-36099df2-f3e4-45fd-b298-be55d97eca9b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:48.717475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3447e0f7-2428-4a6c-ad3f-f805259a1935 req-36099df2-f3e4-45fd-b298-be55d97eca9b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:48.740752 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3447e0f7-2428-4a6c-ad3f-f805259a1935 req-36099df2-f3e4-45fd-b298-be55d97eca9b service nova] Creating event network-vif-plugged:2e44566b-6eee-4214-8a15-931c9154bf46 for instance 62add9a1-ed28-4e11-b315-4596612cb113 on nch2-master-1 Jun 18 22:19:48.744507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:48.749977 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3447e0f7-2428-4a6c-ad3f-f805259a1935 req-36099df2-f3e4-45fd-b298-be55d97eca9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057917 Jun 18 22:19:48.752174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2101/4215] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:48.755671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:48.777410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:48.778217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:48.779608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:48.780241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:49.012184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:49.023602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-217e7c9e-9fe7-452e-9888-66b4fd5789ac tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.282724 Jun 18 22:19:49.034481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2115/4216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:48 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:49.397179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:49.400024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] [instance: 4f145f76-4402-4422-894c-6d53de65d705] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:49.414415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:49.415420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:49.416704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:49.418651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:49.439260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] HTTP exception thrown: Instance 4f145f76-4402-4422-894c-6d53de65d705 could not be found. Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Request method failure captured: Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 HTTP/1.1 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9tbnevcrn38x1ItXZ0WnhjA78gXp8DSfBOgOWlbE9BLRnBuc21cE73d93lQ3FPnznDI2qzfl8vbHk-6ocsZCRK7xnyx0Mt8ue85eTwqapSj9PEi0A3sBnCeFLQKF8soVICHrLLH2ZVwVRWbnKdsmlly2xh-uP_DZKlAMbuDG7vsyg Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e844852ee0a54325a07962baa9b8551b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e844852ee0a54325a07962baa9b8551b", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e844852ee0a54325a07962baa9b8551b Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-751747856 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 59876c2e98254d29b51b071f68569602 Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-751747856-project Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 4f145f76-4402-4422-894c-6d53de65d705 could not be found. Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '4f145f76-4402-4422-894c-6d53de65d705'} Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f145f76-4402-4422-894c-6d53de65d705 could not be found. Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f145f76-4402-4422-894c-6d53de65d705 could not be found. Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:49.441729 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f145f76-4402-4422-894c-6d53de65d705 could not be found. Jun 18 22:19:49.446035 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:19:49.447770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] Returning 404 to user: Instance 4f145f76-4402-4422-894c-6d53de65d705 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:19:49.449189 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-959d6e9c-b267-4d1d-b8c3-69c38b7a7d89 tempest-ServerMetadataNegativeTestJSON-751747856 tempest-ServerMetadataNegativeTestJSON-751747856-project] 10.222.0.30 "GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705" status: 404 len: 111 microversion: 2.1 time: 0.058075 Jun 18 22:19:49.460260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2102/4217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:49 2022] GET /compute/v2.1/servers/4f145f76-4402-4422-894c-6d53de65d705 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:19:49.524032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:49.524767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:49.536802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:49.538329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:49.542130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:49.542667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:49.758503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:49.767347 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11ec9912-6516-4cfd-b4ff-b42e4ab43171 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1309 microversion: 2.1 time: 0.247716 Jun 18 22:19:49.778211 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2116/4218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:49 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:50.041442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:50.042070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:50.054967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:50.055556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:50.057574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:50.058200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:50.368761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:50.379337 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e2e79105-91eb-4ac0-92b5-0ca2efe0b32b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.340778 Jun 18 22:19:50.380161 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2103/4219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:50 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:50.481070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-22d21857-c8f5-44b5-a6bf-3433903aec07 req-8adee7f6-15df-4145-9a52-4c41085dd24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2255804c-8789-4f0c-b90f-d8783df8bdec", "tag": "e5559a6c-070c-49e3-bf02-8fe5b4dd72ab"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:50.494006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-22d21857-c8f5-44b5-a6bf-3433903aec07 req-8adee7f6-15df-4145-9a52-4c41085dd24a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:50.494701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-22d21857-c8f5-44b5-a6bf-3433903aec07 req-8adee7f6-15df-4145-9a52-4c41085dd24a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:50.509539 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-22d21857-c8f5-44b5-a6bf-3433903aec07 req-8adee7f6-15df-4145-9a52-4c41085dd24a service nova] Creating event network-changed:e5559a6c-070c-49e3-bf02-8fe5b4dd72ab for instance 2255804c-8789-4f0c-b90f-d8783df8bdec on nch2-master-1 Jun 18 22:19:50.516511 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-22d21857-c8f5-44b5-a6bf-3433903aec07 req-8adee7f6-15df-4145-9a52-4c41085dd24a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039709 Jun 18 22:19:50.517956 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2117/4220] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:50.784586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:50.786072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:50.795035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:50.795793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:50.796872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:50.797752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:50.990540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:51.003004 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be89dd32-40e5-4b14-84b7-e6e748d07cdb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1489 microversion: 2.1 time: 0.222838 Jun 18 22:19:51.004280 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2104/4221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:50 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1489 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:51.245831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2006492192", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:51.327785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:19:51.398571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:51.399453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:51.413830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:51.414875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:51.415981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:51.417737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:51.788057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:51.806076 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da50ea0d-3bc0-47ba-b163-31b7eea03c1b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.413667 Jun 18 22:19:51.806689 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2105/4222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:51 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:52.604644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:19:52.606003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:19:52.608434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:19:52.608884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:19:52.609555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:19:52.626551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:52.627030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:52.627812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:52.628308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:52.648968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:19:52.656335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:19:52.682316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:19:52.690076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:19:52.767523 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f958d4a8-1b42-46c5-8c0c-3f4eeb4ef2c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.526322 Jun 18 22:19:52.772456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2118/4223] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:19:52.782902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5db3934d-c8fe-4e86-8885-2c1c5f4aed4b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:52.783719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5db3934d-c8fe-4e86-8885-2c1c5f4aed4b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:52.825666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:52.826625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:52.843709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:52.849434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:52.853504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:52.857972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:53.019649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5db3934d-c8fe-4e86-8885-2c1c5f4aed4b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:53.034988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5db3934d-c8fe-4e86-8885-2c1c5f4aed4b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1209 microversion: 2.1 time: 0.256474 Jun 18 22:19:53.035717 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2106/4224] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:52 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1209 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:53.496226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:53.516584 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1116b783-3abe-47cb-94e7-3f5016ade94e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.696830 Jun 18 22:19:53.519594 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2119/4225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:52 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:54.055808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:54.056607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:54.084629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:54.087196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:54.089296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:54.089758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:54.546129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:54.547392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:54.570892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:54.577285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:54.581005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:54.585388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:54.597781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:54.617997 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3f8fc92f-2696-485c-bea6-b3870a850558 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1261 microversion: 2.1 time: 0.565765 Jun 18 22:19:54.619066 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2107/4226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:54 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1261 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:55.102345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:55.112543 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee365bc5-e073-4b95-9265-6ab5f5e122fa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.579872 Jun 18 22:19:55.113996 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2120/4227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:54 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:55.318711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:55.319204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:55.332290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:55.332746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:55.333571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:55.334005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:55.391104 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d266896-c2e8-4436-99dd-b40df0a12e6f tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/ips" status: 200 len: 150 microversion: 2.20 time: 0.076431 Jun 18 22:19:55.391775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2108/4228] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Jun 18 22:19:55 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/ips => generated 150 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:19:55.638020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:55.638689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:55.655552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:55.656431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:55.658333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:55.663902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:55.874391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:55.891929 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c721fdd-5518-446c-943c-1075f4d5dbd6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1267 microversion: 2.1 time: 0.257549 Jun 18 22:19:55.894810 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2121/4229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:55 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:56.132540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:56.133840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:56.145414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:56.145882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:56.146691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:56.147132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:56.602002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:56.616294 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9aa11ce3-1485-4584-a3f0-af40017a9b32 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.488540 Jun 18 22:19:56.628323 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2109/4230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:56 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:56.912909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:56.913579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:56.933089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:56.933492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:56.934297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:56.939288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:57.468441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:57.489503 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b22a2c0-ea6e-4905-abc3-8df46591a2a9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 0.581066 Jun 18 22:19:57.491373 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2122/4231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:56 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:57.526730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:57.528257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:57.544982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:57.547914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:57.548775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:57.549264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:57.611367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lazy-loading 'flavor' on Instance uuid 662b2510-85bb-41de-85c9-6b498e04b6b1 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:19:57.636661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:57.637310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:57.647741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:19:57.648094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:57.649784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:57.651343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:57.651807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:57.978511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c179af6a-8194-4226-9900-dc979fa0a750 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/action" status: 202 len: 0 microversion: 2.20 time: 0.458354 Jun 18 22:19:57.982410 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2110/4232] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:19:57 2022] POST /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:19:58.002984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:58.004234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:58.017298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:58.017983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:58.018971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:58.019588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:58.500049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:58.520861 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-373d6184-9a05-4f77-a057-3fe3e6a2c36f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.888187 Jun 18 22:19:58.539785 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2123/4233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:57 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:19:58.561067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:58.561067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:58.579366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:58.592622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:58.596599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:58.598406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:58.598866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:58.601333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:58.603990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:58.608824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da5d0add-65df-4354-bd33-323644cfbf09 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.624879 Jun 18 22:19:58.613743 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2111/4234] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:57 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:19:59.102788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:19:59.111668 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-064b731a-dbe3-458a-88a5-230a6e731be1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 0.570623 Jun 18 22:19:59.112805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2124/4235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:58 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:19:59.290199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-33558540-6c87-4d3a-8a9d-c7a53928a2d7 req-f586715e-a3c5-4135-bdd4-4101d8bb32ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757307a5-1c02-4970-a40a-7084ca46b0c9", "tag": "e9a0039b-8bf2-49fb-b464-f1519a02031b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:19:59.301153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-33558540-6c87-4d3a-8a9d-c7a53928a2d7 req-f586715e-a3c5-4135-bdd4-4101d8bb32ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:59.301623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-33558540-6c87-4d3a-8a9d-c7a53928a2d7 req-f586715e-a3c5-4135-bdd4-4101d8bb32ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:59.313659 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-33558540-6c87-4d3a-8a9d-c7a53928a2d7 req-f586715e-a3c5-4135-bdd4-4101d8bb32ed service nova] Creating event network-changed:e9a0039b-8bf2-49fb-b464-f1519a02031b for instance 757307a5-1c02-4970-a40a-7084ca46b0c9 on nch1-master-1 Jun 18 22:19:59.319384 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-33558540-6c87-4d3a-8a9d-c7a53928a2d7 req-f586715e-a3c5-4135-bdd4-4101d8bb32ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032355 Jun 18 22:19:59.319995 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2112/4236] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:19:59.538624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:59.540079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:59.549785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:59.550238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:59.551018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:59.551510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:59.629660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:19:59.630369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:19:59.643162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:59.643642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:19:59.644378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:19:59.645105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:00.367180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:00.369238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:00.380126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:00.383403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:00.383612 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9dc95360-6f91-4c55-aa52-42c3a646d10f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.848928 Jun 18 22:20:00.384998 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2125/4237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:19:59 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:00.388540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06024f92-4a52-450d-bf59-35a39adf6391 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.764282 Jun 18 22:20:00.391822 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2113/4238] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:19:59 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:20:00.392471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:00.393741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:00.408682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:00.409294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:00.410176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:00.410849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:01.295501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:01.321139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ebe4241-cadc-438c-88ca-283c67b043ec tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 0.934489 Jun 18 22:20:01.334001 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2126/4239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:00 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:01.402546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:01.406098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:01.413003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:01.419192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:01.424582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:01.425172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:01.428169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:01.428687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:01.434032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:01.434751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:01.437843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:01.438351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:01.918493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:01.927282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:01.936149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3e8d4884-aa56-4c69-a425-64e08b4f9240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.538955 Jun 18 22:20:01.941786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:01.944716 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2114/4240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:01 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:01.945496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:01.947083 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b354886d-3bb5-49fb-b53d-9e2f7c94a76d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.542237 Jun 18 22:20:01.947633 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2127/4241] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:01 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:02.344677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:02.345832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:02.363934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:02.370684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:02.383446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:02.384042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:02.865926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:02.883853 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-118477a3-fea2-4ed5-925e-98a6d1240def tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 0.543879 Jun 18 22:20:02.885047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2115/4242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:02 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:02.958210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:02.959912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:02.966253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:02.967385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:02.969853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:02.970509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:02.971694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:02.972333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:02.973821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:02.977746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:02.994985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:02.999101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:03.002256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:03.003165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:03.006421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:03.044779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:03.369061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:03.377085 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c87efefb-5e8f-4650-b7c5-e0b285d8e25b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.427378 Jun 18 22:20:03.388335 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2128/4243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:02 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:03.415679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:03.424998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:03.427300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:03.429121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e91f532c-737d-4ec8-8509-c002c3506553 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.464479 Jun 18 22:20:03.433090 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2116/4244] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:02 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:03.905124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:03.906583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:03.920240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:03.934060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:03.939488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:03.956440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:04.445271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-863726523", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "678f3ac8-4ec2-475f-9617-8e8c74857f1a"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:04.532706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] validate_networks() for [('678f3ac8-4ec2-475f-9617-8e8c74857f1a', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:04.561349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:04.570167 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5238ab0e-46ed-43d8-8fa7-1a9aa33ef5fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 0.670782 Jun 18 22:20:04.578732 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2129/4245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:03 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:04.583764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:04.586832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:04.600412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:04.614193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:04.615750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:04.616677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:05.168732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:05.181693 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a5064b0-dec8-4d11-a87f-7e30f5eedf76 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1653 microversion: 2.1 time: 0.601629 Jun 18 22:20:05.183084 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2130/4246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:04 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1653 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:05.206364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:05.207410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:05.215788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:05.216469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:05.220235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:05.221478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:05.973308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:05.989011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:05.990100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:05.990791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:05.991148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:05.991662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:05.996876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:06.002209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:06.007700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.008150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:06.009010 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0ff3982-fe69-4af8-82d9-6d80867ec218 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.805904 Jun 18 22:20:06.009174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.010793 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2131/4247] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:05 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:06.012541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:06.026870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c00a61f2-cc0a-4bd2-a473-e253b102c50b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:06.037284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c00a61f2-cc0a-4bd2-a473-e253b102c50b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.038009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c00a61f2-cc0a-4bd2-a473-e253b102c50b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:06.058583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Getting quotas for project 73290d4cb44c40ffa3a0a8f1e553f2e6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:06.074164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Getting quotas for user 277319873f994c44831e0840ef111b8f and project 73290d4cb44c40ffa3a0a8f1e553f2e6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:06.097307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:06.100052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:06.103076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c00a61f2-cc0a-4bd2-a473-e253b102c50b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Going to try to start instance {{(pid=130902) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 22:20:06.195396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b84fca6f-256a-4ec8-8390-73d7452dd3a1 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.272767 Jun 18 22:20:06.207019 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2117/4248] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:20:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:20:06.210324 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c00a61f2-cc0a-4bd2-a473-e253b102c50b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.197359 Jun 18 22:20:06.210954 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2132/4249] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:20:06 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:06.219154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e4d11b41-257c-46db-a95b-0ca1f0407c05 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:06.219894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4d11b41-257c-46db-a95b-0ca1f0407c05 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:06.239855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:06.241119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:06.265230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.268768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:06.278665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.279420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:06.687229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4d11b41-257c-46db-a95b-0ca1f0407c05 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:06.707027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4d11b41-257c-46db-a95b-0ca1f0407c05 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:06.709726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4d11b41-257c-46db-a95b-0ca1f0407c05 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:06.714999 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e4d11b41-257c-46db-a95b-0ca1f0407c05 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1258 microversion: 2.21 time: 0.501605 Jun 18 22:20:06.716414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2133/4250] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:06 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1258 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:06.735193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:06.742051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:06.761259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.761806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:06.762665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:06.763722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:07.240504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.273668 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d04a86a-06db-4524-a07e-9a46f5d3f1d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 1.062544 Jun 18 22:20:07.276362 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2118/4251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:06 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:07.302631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:07.304066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:07.311675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:07.312698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:07.315219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:07.315903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:07.611407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.622265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11553c0a-44ed-4598-bdc7-1096fa39e2b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1662 microversion: 2.1 time: 0.902478 Jun 18 22:20:07.626828 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2134/4252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:06 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1662 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:07.640413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cae713a1-8e3d-4ba6-bc67-111d2ca98b56 req-085492c5-534e-47ee-a22b-6f6fd487a7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757307a5-1c02-4970-a40a-7084ca46b0c9", "name": "network-vif-plugged", "status": "completed", "tag": "e9a0039b-8bf2-49fb-b464-f1519a02031b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:07.660839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cae713a1-8e3d-4ba6-bc67-111d2ca98b56 req-085492c5-534e-47ee-a22b-6f6fd487a7df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:07.661622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cae713a1-8e3d-4ba6-bc67-111d2ca98b56 req-085492c5-534e-47ee-a22b-6f6fd487a7df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:07.691494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cae713a1-8e3d-4ba6-bc67-111d2ca98b56 req-085492c5-534e-47ee-a22b-6f6fd487a7df service nova] Creating event network-vif-plugged:e9a0039b-8bf2-49fb-b464-f1519a02031b for instance 757307a5-1c02-4970-a40a-7084ca46b0c9 on nch1-master-1 Jun 18 22:20:07.712517 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cae713a1-8e3d-4ba6-bc67-111d2ca98b56 req-085492c5-534e-47ee-a22b-6f6fd487a7df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078721 Jun 18 22:20:07.716449 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2135/4253] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:07.735594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:07.736505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:07.753257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:07.753940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:07.755198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:07.755780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:07.896543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.933662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.945187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.952627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb64f354-c3b6-4926-bcd7-5cc64965d49f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1310 microversion: 2.21 time: 0.215338 Jun 18 22:20:07.954562 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2136/4254] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:07 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1310 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:07.967657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.979496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.981931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:07.983450 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-187119c8-91b2-4549-8735-dc227c805e68 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.704409 Jun 18 22:20:07.985187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2119/4255] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:07 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:08.292957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:08.293707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:08.318484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:08.319641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:08.324537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:08.325294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:08.645167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:08.646371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:08.674674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:08.675610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:08.684475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:08.691571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:09.001900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.011079 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f6e39c35-479b-4a4f-9b01-0810e938924c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1309 microversion: 2.1 time: 0.722961 Jun 18 22:20:09.012466 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2137/4256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:08 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1309 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:09.028433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:09.029217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:09.045446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:09.047304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:09.048687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:09.049837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:09.088171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.097570 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82a9ae73-3c7b-4dc0-9648-3be4c15566e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1662 microversion: 2.1 time: 0.458257 Jun 18 22:20:09.098150 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2120/4257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:08 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1662 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:09.107188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:09.107804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:09.114470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:09.115271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:09.116376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:09.117664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:09.543076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.569211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.572719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.575683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.578792 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-40f1e9dc-9256-42ab-948c-1b0a84397925 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.564345 Jun 18 22:20:09.589507 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2138/4258] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:09 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:09.595983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.597909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:09.599201 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9da2ea5-00fe-46f4-b3c2-83cff9ec3280 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1743 microversion: 2.20 time: 0.495898 Jun 18 22:20:09.599964 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2121/4259] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:09 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1743 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:10.037905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:10.038283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:10.052209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.056033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.057930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.059331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.116148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:10.117616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:10.130858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.131584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.133145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.133832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.541144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:10.550256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:10.552194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1393bfb6-cd47-47a2-860a-e18a4347acff tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1489 microversion: 2.1 time: 0.527442 Jun 18 22:20:10.560805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6325b45b-b962-4582-9b51-3a96022800f6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1662 microversion: 2.1 time: 0.449500 Jun 18 22:20:10.568011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2139/4260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:10 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1489 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:10.570458 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2122/4261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:10 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1662 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:10.582478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5fcb55b4-c866-43be-b969-78446de8b623 req-8186f92b-6e6c-472b-a14b-6792f26b3474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efa9aa8-8770-4309-ae40-106e83046a07", "tag": "10d21a0f-f660-4120-8618-a9ecba44cc66"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:10.597774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5fcb55b4-c866-43be-b969-78446de8b623 req-8186f92b-6e6c-472b-a14b-6792f26b3474 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.598567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5fcb55b4-c866-43be-b969-78446de8b623 req-8186f92b-6e6c-472b-a14b-6792f26b3474 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.632309 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5fcb55b4-c866-43be-b969-78446de8b623 req-8186f92b-6e6c-472b-a14b-6792f26b3474 service nova] Creating event network-changed:10d21a0f-f660-4120-8618-a9ecba44cc66 for instance 7efa9aa8-8770-4309-ae40-106e83046a07 on nch1-master-1 Jun 18 22:20:10.644084 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5fcb55b4-c866-43be-b969-78446de8b623 req-8186f92b-6e6c-472b-a14b-6792f26b3474 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072944 Jun 18 22:20:10.646784 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2140/4262] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:10.659713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:10.662344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:10.676488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.677241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.678235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.678921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.850603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:10.872130 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9ab6222b-6266-4643-a781-a6fe9ab0ae4c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1489 microversion: 2.1 time: 0.218082 Jun 18 22:20:10.882674 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2141/4263] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:10 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1489 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:10.890349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:10.891029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:10.899311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.899765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.903959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:10.904510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:10.966591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1267214663", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "34b3dfd9-af8c-4b6b-9d29-ab8ba4dee2bc"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:11.041891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] validate_networks() for [('34b3dfd9-af8c-4b6b-9d29-ab8ba4dee2bc', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:11.225594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.264268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.268169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.269816 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e998fc6a-f71c-469b-b27a-496df89724ee tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.385155 Jun 18 22:20:11.270562 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2142/4264] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:10 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:11.281867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:11.282767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:11.293440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.294163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.295156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.295789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.531077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.542791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.544644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.546163 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e2df206a-0ac3-4175-aed3-3c8104ac966b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1743 microversion: 2.20 time: 0.274435 Jun 18 22:20:11.548695 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2143/4265] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:11 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1743 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:11.556314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:11.557239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:11.581770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.582541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.583639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.584326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.718415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:11.719016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:11.719283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:11.719966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:11.721123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:11.741496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.743507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.752100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.754632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.794483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Getting quotas for project 113eb5bc0323404bb64b87dbff50b96d. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:11.801008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Getting quotas for user 5a1fc3fc3ccf40fb89b17836ee1a29d9 and project 113eb5bc0323404bb64b87dbff50b96d. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:11.813266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:11.823529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7566ac0-29d4-46cc-9bc7-074b1e42fb9f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1489 microversion: 2.1 time: 0.271900 Jun 18 22:20:11.828104 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2144/4266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:11 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1489 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:11.833958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:11.834584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:11.840313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:11.841338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.841794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.842573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.843010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.849996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:11.923527 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de4ffc6f-cfae-402d-b091-3e7ae8c06a87 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345177 Jun 18 22:20:11.924207 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2123/4267] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:20:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:20:11.929635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:11.930349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:11.939135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.939595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.940549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:11.941177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:11.973863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:12.097173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:12.119873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b5e9c8d6-29be-44cd-8878-223049c5ee24 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 204 len: 0 microversion: 2.1 time: 0.193969 Jun 18 22:20:12.124148 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2124/4268] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:20:11 2022] DELETE /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:12.133004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6ce7e10-de35-4075-8a8a-e003765514b1 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:12.133794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6ce7e10-de35-4075-8a8a-e003765514b1 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:12.216389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:12.228644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e487f21b-3da0-4bb9-b7a0-d636cd2b2047 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.398070 Jun 18 22:20:12.231682 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2145/4269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:11 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:12.244614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:12.245372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:12.263011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.263489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.267187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.268600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.305002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e6ce7e10-de35-4075-8a8a-e003765514b1 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:12.316493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6ce7e10-de35-4075-8a8a-e003765514b1 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1216 microversion: 2.1 time: 0.188872 Jun 18 22:20:12.330518 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2125/4270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:12 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:12.343838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:12.346242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:12.366992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.369676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.370782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.371595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:12.372240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.695548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:12.707035 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83c131ae-a0d1-46de-bf31-7d4813bec18a tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.375269 Jun 18 22:20:12.710417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2126/4271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:12 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:12.725634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:12.727338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:12.740684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.743700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.744715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.746163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.783350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:12.793662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:12.797172 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52b29a80-f07b-4c9e-b445-1af77b0f93b9 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1495 microversion: 2.1 time: 0.559201 Jun 18 22:20:12.807643 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2146/4272] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:12 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1495 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:12.825549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:12.826247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:12.839312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:12.859125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.859678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:12.869982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:12.871820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.019922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.048589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.051711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.054463 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31d40171-567d-45c2-a6fa-e5897c112d2e tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.342618 Jun 18 22:20:13.055882 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2127/4273] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:12 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:13.080456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:13.082740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:13.104638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.105749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.106847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.109672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.181626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.193073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.196489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.199316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08c84a01-e560-4cfe-8f54-71ee247aa3a3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.389189 Jun 18 22:20:13.201111 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2147/4274] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:12 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:13.238393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Unlocking {{(pid=130903) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 18 22:20:13.259447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0531a323-723d-4c02-aef1-3ea6ccbf2438 req-fd7320db-2c57-4cf9-9cbc-85a53e3be6b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "name": "network-vif-plugged", "status": "completed", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:13.276201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0531a323-723d-4c02-aef1-3ea6ccbf2438 req-fd7320db-2c57-4cf9-9cbc-85a53e3be6b3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.277573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0531a323-723d-4c02-aef1-3ea6ccbf2438 req-fd7320db-2c57-4cf9-9cbc-85a53e3be6b3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.312188 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0531a323-723d-4c02-aef1-3ea6ccbf2438 req-fd7320db-2c57-4cf9-9cbc-85a53e3be6b3 service nova] Creating event network-vif-plugged:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:20:13.324187 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0531a323-723d-4c02-aef1-3ea6ccbf2438 req-fd7320db-2c57-4cf9-9cbc-85a53e3be6b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069931 Jun 18 22:20:13.329141 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2148/4275] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:20:13.345213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:13.346404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:13.352488 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90389fea-de82-4d80-804d-a8752a7aafe4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.291907 Jun 18 22:20:13.356052 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2128/4276] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:20:13 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:13.370053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.373915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.374954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.375830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:13.376718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.377206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:13.392370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.393106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.394071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.398080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.582743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.636521 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce400757-369d-4439-8f5e-40ee6c355898 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1268 microversion: 2.1 time: 0.294986 Jun 18 22:20:13.636521 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2149/4277] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:13 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1268 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:13.714497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:13.722675 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b506382-0a4b-4c69-9d93-51208aa30275 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.358509 Jun 18 22:20:13.724501 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2129/4278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:13 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:13.746939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:13.748383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:13.760285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.761055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.762007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.762584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.830106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:13.835121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:13.845426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.849269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:13.850683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:13.856526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.146755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:14.165134 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6c47bfa-9f78-4ce2-8103-a3221c31c27c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.423723 Jun 18 22:20:14.168872 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2150/4279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:13 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:14.179267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:14.183977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:14.204828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.205301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.206097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.220010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.355005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:14.366657 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2fb9b3e0-5d57-4cc7-b713-b057d478c2a1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1495 microversion: 2.1 time: 0.546084 Jun 18 22:20:14.367261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2130/4280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:13 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1495 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:14.397180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:14.400318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:14.426824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.427666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.428822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.429481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.663794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:14.682029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:14.686055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:14.688575 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-249b7fe3-5181-4cff-98ae-f189e7685fab tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.518358 Jun 18 22:20:14.692293 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2151/4281] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:14 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:14.700283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:14.701410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:14.734011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.735872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.738270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.740903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.844098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:14.860391 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d095aa8-7569-4842-8fc6-5f753dcbfe61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.492046 Jun 18 22:20:14.861000 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2131/4282] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:14 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:14.879953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:14.880581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:14.898667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.900450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:14.902439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:14.903072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:15.105656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:15.117621 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a91d5496-6611-49c0-bea5-27666abb48b0 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1274 microversion: 2.1 time: 0.255348 Jun 18 22:20:15.118124 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2132/4283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:14 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:15.136699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:15.140080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:15.157233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:15.157687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:15.158477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:15.158920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:15.204431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:15.220667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:15.222578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:15.224880 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8c2064f3-4d14-471d-a35b-4a40cd33bc64 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.530961 Jun 18 22:20:15.225669 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2152/4284] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:14 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:15.370759 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-adda7224-5099-43fd-a4b0-5ae7b3cbf66e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.248264 Jun 18 22:20:15.375488 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2133/4285] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:20:15 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:15.387008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:15.388057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:15.409935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:15.414288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:15.414745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:15.415527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:15.415959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:15.425969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:15.448590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:15.451803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:15.452981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:15.454827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.035700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:16.053959 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23c0f290-82a4-4be0-bfb8-5f8511fa3f4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1671 microversion: 2.1 time: 0.677306 Jun 18 22:20:16.054594 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2153/4286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:15 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1671 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:16.087765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:16.097604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:16.123036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:16.125165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.127216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:16.132223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:16.132708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.139655 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d3333f19-9bc2-42fa-9833-a2061316fe0b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1495 microversion: 2.1 time: 0.756194 Jun 18 22:20:16.161102 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2134/4287] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:15 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1495 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:16.166439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:16.181199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:16.197066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:16.197519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.198678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:16.199118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.696275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:16.709919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:16.720103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:16.722416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:16.723850 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7b5a000-996f-4872-b515-e16a2dd39d34 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.664919 Jun 18 22:20:16.725009 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2154/4288] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:16 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:16.729979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:16.730854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:16.737597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:16.738365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.739372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:16.740025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:16.855913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:16.899323 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-683ef0a0-b287-437e-82ba-5e995e2c2b5d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.732695 Jun 18 22:20:16.915892 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2135/4289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:16 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:17.078030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:17.079064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:17.093228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.094103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.095076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.095706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.227173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:17.251084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:17.253119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:17.262812 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6789f62-d481-48a9-9138-0df21c0d88ac tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.536379 Jun 18 22:20:17.274387 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2155/4290] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:16 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:17.287376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:17.288277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:17.316862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.322447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.324018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.330024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.480766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:17.491783 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f00d0b2e-c184-4fba-8983-8306bd2cbc45 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1453 microversion: 2.1 time: 0.215899 Jun 18 22:20:17.497608 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2156/4291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:17 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:17.508598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-59b97e45-9bdc-40d3-9390-28b254d4d7dd req-2277e5b1-bcf8-4fc5-99d0-42d094b32f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757307a5-1c02-4970-a40a-7084ca46b0c9", "name": "network-vif-deleted", "tag": "e9a0039b-8bf2-49fb-b464-f1519a02031b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:17.525362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-59b97e45-9bdc-40d3-9390-28b254d4d7dd req-2277e5b1-bcf8-4fc5-99d0-42d094b32f90 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.526044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-59b97e45-9bdc-40d3-9390-28b254d4d7dd req-2277e5b1-bcf8-4fc5-99d0-42d094b32f90 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.527720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:17.552914 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-59b97e45-9bdc-40d3-9390-28b254d4d7dd req-2277e5b1-bcf8-4fc5-99d0-42d094b32f90 service nova] Creating event network-vif-deleted:e9a0039b-8bf2-49fb-b464-f1519a02031b for instance 757307a5-1c02-4970-a40a-7084ca46b0c9 on nch1-master-1 Jun 18 22:20:17.556330 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d975764-ecbb-4c00-b3e6-4af1e59ab278 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1651 microversion: 2.1 time: 0.479089 Jun 18 22:20:17.559647 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2136/4292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:17 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1651 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:17.561720 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-59b97e45-9bdc-40d3-9390-28b254d4d7dd req-2277e5b1-bcf8-4fc5-99d0-42d094b32f90 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062193 Jun 18 22:20:17.562708 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2157/4293] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:17.571570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6d493f3b-f2f8-4652-b466-98750cf6b20c req-99466773-7c33-4389-99ff-4d94b51da27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efa9aa8-8770-4309-ae40-106e83046a07", "name": "network-vif-plugged", "status": "completed", "tag": "10d21a0f-f660-4120-8618-a9ecba44cc66"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:17.595121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6d493f3b-f2f8-4652-b466-98750cf6b20c req-99466773-7c33-4389-99ff-4d94b51da27a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.598883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6d493f3b-f2f8-4652-b466-98750cf6b20c req-99466773-7c33-4389-99ff-4d94b51da27a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.600511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:17.602597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:17.622083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.624332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.625472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.626680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.637533 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6d493f3b-f2f8-4652-b466-98750cf6b20c req-99466773-7c33-4389-99ff-4d94b51da27a service nova] Creating event network-vif-plugged:10d21a0f-f660-4120-8618-a9ecba44cc66 for instance 7efa9aa8-8770-4309-ae40-106e83046a07 on nch1-master-1 Jun 18 22:20:17.652207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6d493f3b-f2f8-4652-b466-98750cf6b20c req-99466773-7c33-4389-99ff-4d94b51da27a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087129 Jun 18 22:20:17.656170 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2137/4294] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:17.744455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:17.745790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:17.753526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f9d07b8-3305-43a2-8e53-82382ddf8712 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.171768 Jun 18 22:20:17.754709 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2158/4295] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:20:17 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:17.760343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.767004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.768310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:17.769162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.769479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:17.782520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.794976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.797240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:17.798559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:17.801954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.107353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.125153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.126848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.128805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-335b334f-ebc1-4997-95c1-abe66eac77d5 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.389228 Jun 18 22:20:18.141077 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2138/4296] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:17 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:18.146352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:18.147125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:18.155963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.156613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.157552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.158228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.158914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.171744 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-089100b1-f49d-4b25-8e15-a24f508a3a61 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1658 microversion: 2.1 time: 0.408221 Jun 18 22:20:18.181842 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2159/4297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:17 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1658 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:18.293700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:18.300384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:18.313630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.327714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.328793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.329734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.396681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.412193 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c6cda50e-4f05-45e9-8392-857461bec028 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.269534 Jun 18 22:20:18.412999 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2139/4298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:18 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:18.519986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:18.521859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:18.530018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.543825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.547623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.550006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.629831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:18.630540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:18.631067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lazy-loading 'fault' on Instance uuid 757307a5-1c02-4970-a40a-7084ca46b0c9 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:20:18.631200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.638459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:18.640922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.642605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.645986 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-881affe3-ad3a-46f5-a1df-e581baa24d25 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.358078 Jun 18 22:20:18.646696 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2160/4299] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:18 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:18.697563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:18.717837 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7a371eea-372b-4edf-9cb9-a70a9afe456e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 200 len: 1299 microversion: 2.1 time: 0.203243 Jun 18 22:20:18.719448 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2140/4300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:18 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:19.152129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:19.153123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:19.170833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:19.171301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:19.172176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:19.172609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:19.174834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b6c3134f-eaa4-4db2-91f8-d8630aab31c7 req-07fd33dc-285d-4999-a371-d119d520beae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af26acff-9bcf-4cd6-ad99-6ea1c8a12acd", "tag": "f387afac-8184-446b-9301-c63c7975998b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:19.197790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b6c3134f-eaa4-4db2-91f8-d8630aab31c7 req-07fd33dc-285d-4999-a371-d119d520beae service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:19.198623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b6c3134f-eaa4-4db2-91f8-d8630aab31c7 req-07fd33dc-285d-4999-a371-d119d520beae service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:19.246360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b6c3134f-eaa4-4db2-91f8-d8630aab31c7 req-07fd33dc-285d-4999-a371-d119d520beae service nova] Creating event network-changed:f387afac-8184-446b-9301-c63c7975998b for instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd on nch2-master-1 Jun 18 22:20:19.257271 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b6c3134f-eaa4-4db2-91f8-d8630aab31c7 req-07fd33dc-285d-4999-a371-d119d520beae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091997 Jun 18 22:20:19.258820 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2141/4301] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 18 22:20:19.266291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:19.267010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:19.277882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:19.279825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:19.280648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:19.281471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.054913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.082489 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a688a545-8f8e-4b11-9774-424c6382ae4d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.821893 Jun 18 22:20:20.095984 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2142/4302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:19 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:20.101078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.101849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.102205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.110280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.110991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.112541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.112994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.113412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.114944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.121452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b88ade1c-bebb-45a4-a0f7-ab8212cb7b69 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1358 microversion: 2.21 time: 0.975437 Jun 18 22:20:20.137141 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2161/4303] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:19 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1358 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:20.142503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.143595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.150240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.150803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.151601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.152217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.375811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.387694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a11dbda-2a38-42c2-ac07-85521c3a7b46 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.287973 Jun 18 22:20:20.388352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2143/4304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:20 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:20.401521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.402264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.421670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.422318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.423262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.428040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.451097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.460429 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:20:20.471858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.474156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 HTTP/1.1 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '757307a5-1c02-4970-a40a-7084ca46b0c9'} Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:20.476626 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:20.481779 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:20.481779 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:20.481779 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:20.481779 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:20.481779 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:20:20.481779 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:20.484895 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-349c0c90-c9e5-4dd1-8890-872b956aba0a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.346292 Jun 18 22:20:20.487702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:20.489698 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-100cbbb7-3017-4bfa-9ab8-09d2eca18421 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 404 len: 111 microversion: 2.1 time: 0.098249 Jun 18 22:20:20.490133 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2162/4305] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:20 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:20.493425 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2144/4306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:20 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:20:20.499154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.504516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.505168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.508706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.517692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.518856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.519886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.520761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.523993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.524464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.528618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.529240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.552224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:20.560069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:20.680379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2adc6bbb-a218-4682-8591-6062f191cf27 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 204 len: 0 microversion: 2.1 time: 0.181489 Jun 18 22:20:20.682240 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2145/4307] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:20:20 2022] DELETE /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:20:20.698952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.699207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.704606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.706291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.706756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.707707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.708157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.714593 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9445d12-8410-4c31-b8ac-b53e6f80c56d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.223059 Jun 18 22:20:20.715385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2163/4308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:20 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:20.737960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:20.739558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:20.751227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.751855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.752998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:20.753694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:20.980469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:20.991757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1485cbdf-fd65-47b8-9b2e-9824568a7b10 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1495 microversion: 2.1 time: 0.303137 Jun 18 22:20:20.996743 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2146/4309] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:20 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1495 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:21.044286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.063888 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3ceded2-1f6a-466f-93ef-8378c18ee2e8 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.330109 Jun 18 22:20:21.067274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2164/4310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:20 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:21.086624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:21.087260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:21.094248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.094713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.095513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.095960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.143000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:21.144269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:21.155270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.156007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.157063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.158192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.429624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.449233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.454214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.455835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.457548 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e4f39828-c012-46d5-a5f6-4d1a0bf988be tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1550 microversion: 2.21 time: 0.321740 Jun 18 22:20:21.458674 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2165/4311] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:21 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1550 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:20:21.458810 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6bfaf0b-1b1a-45d1-9a0b-4bf16df63327 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.377147 Jun 18 22:20:21.469914 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2147/4312] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:21 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:21.478505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:21.478717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:21.479348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:21.480134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:21.489858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.490637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.492078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.492985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.504713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.505220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.506041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.506490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.777753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:21.842822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.875128 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c20e1265-70da-4b22-b573-2272db53f9e9 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.414626 Jun 18 22:20:21.875736 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2166/4313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:21 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:21.887143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:21.889780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:21.914774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.915709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.916738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.917357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.933248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:21.944510 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5654835e-e974-4706-be15-47f8d8e5216b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.467723 Jun 18 22:20:21.947096 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2148/4314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:21 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:21.959477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:21.963190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:21.965816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:21.976298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.976765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:21.977586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:21.978021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.128934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b91dac6e-ce6c-4362-b4f4-c698808a68e6 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 204 len: 0 microversion: 2.21 time: 0.250696 Jun 18 22:20:22.133673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2167/4315] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:20:21 2022] DELETE /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:20:22.146613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:22.147341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:22.163435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.163900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.164694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.165186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.316569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:22.344603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.363850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.375267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.377624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fed8ba1c-47ec-407f-99d8-63ec6455938a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.426862 Jun 18 22:20:22.378960 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2149/4316] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:21 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:22.398393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:22.399626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:22.418181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.419799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.420684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.424362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.432414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.440344 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22f2aa86-545f-42c6-bbca-09ce69597024 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.306153 Jun 18 22:20:22.440950 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2168/4317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:22 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:22.455669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:22.456306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:22.472474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.472845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.482195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.482715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.589236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.597512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e1dd79fa-790e-4519-9f1a-6f2d5e34d22c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1495 microversion: 2.1 time: 0.203454 Jun 18 22:20:22.602027 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2150/4318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:22 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1495 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:22.768404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.778023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.780206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:22.784280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35cfdedf-df07-4ac5-bc5e-3a46b7ae2e92 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1556 microversion: 2.21 time: 0.341033 Jun 18 22:20:22.785545 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2169/4319] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:22 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1556 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:22.892410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:22.893556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:22.902751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.903682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:22.904566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:22.905164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:23.128180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:23.137500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-668ee244-54eb-40bb-8f8a-ae7a350dbb8a tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.249369 Jun 18 22:20:23.138363 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2151/4320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:22 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:23.397411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:23.398205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:23.406046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:23.406534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:23.412958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:23.414975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:23.618521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:23.619094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:23.631716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:23.633929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:23.634157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:23.634612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:23.843436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:23.854473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:23.856452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:23.858319 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fa74727-f7da-4c2c-ba16-e019fc2a5621 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.465099 Jun 18 22:20:23.875012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2170/4321] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:23 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:23.880388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:23.881401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:23.890128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:23.890904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:23.891841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:23.892424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:24.174777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:24.188242 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03207011-f0c1-4b8f-91e4-66b3d6569422 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1495 microversion: 2.1 time: 0.573770 Jun 18 22:20:24.194284 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2152/4322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:23 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1495 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:24.204330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:24.207027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:24.216039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:24.216548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:24.217505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:24.217939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:24.575580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:24.591213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:24.595961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:24.598580 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b1c24a8-2883-485c-8213-3826647fe779 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1556 microversion: 2.21 time: 0.721917 Jun 18 22:20:24.599362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2171/4323] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:23 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1556 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:24.745853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-67aad7d7-5c13-4985-aa3f-b0b14a7b7720 req-28c9b36e-6ba2-4006-9337-03717e7f1957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62add9a1-ed28-4e11-b315-4596612cb113", "name": "network-vif-deleted", "tag": "2e44566b-6eee-4214-8a15-931c9154bf46"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:24.761270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:24.773256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-67aad7d7-5c13-4985-aa3f-b0b14a7b7720 req-28c9b36e-6ba2-4006-9337-03717e7f1957 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:24.773862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-67aad7d7-5c13-4985-aa3f-b0b14a7b7720 req-28c9b36e-6ba2-4006-9337-03717e7f1957 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:24.783388 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d6001a7-57e7-4d5c-9612-9ec1484ffa73 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.587753 Jun 18 22:20:24.796110 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2153/4324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:24 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:24.818961 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-67aad7d7-5c13-4985-aa3f-b0b14a7b7720 req-28c9b36e-6ba2-4006-9337-03717e7f1957 service nova] Creating event network-vif-deleted:2e44566b-6eee-4214-8a15-931c9154bf46 for instance 62add9a1-ed28-4e11-b315-4596612cb113 on nch2-master-1 Jun 18 22:20:24.837313 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-67aad7d7-5c13-4985-aa3f-b0b14a7b7720 req-28c9b36e-6ba2-4006-9337-03717e7f1957 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097603 Jun 18 22:20:24.839046 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2172/4325] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:20:24.878244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:24.878860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:24.891257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:24.891663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:24.892541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:24.892958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.080977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-65876fe0-3d3e-48ce-bd07-e9b9d73bdba9 req-7468cb04-5a70-4228-aa1f-e6a11aca2493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af26acff-9bcf-4cd6-ad99-6ea1c8a12acd", "name": "network-vif-plugged", "status": "completed", "tag": "f387afac-8184-446b-9301-c63c7975998b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:25.100233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-65876fe0-3d3e-48ce-bd07-e9b9d73bdba9 req-7468cb04-5a70-4228-aa1f-e6a11aca2493 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.105258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-65876fe0-3d3e-48ce-bd07-e9b9d73bdba9 req-7468cb04-5a70-4228-aa1f-e6a11aca2493 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.155088 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-65876fe0-3d3e-48ce-bd07-e9b9d73bdba9 req-7468cb04-5a70-4228-aa1f-e6a11aca2493 service nova] Creating event network-vif-plugged:f387afac-8184-446b-9301-c63c7975998b for instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd on nch2-master-1 Jun 18 22:20:25.174374 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-65876fe0-3d3e-48ce-bd07-e9b9d73bdba9 req-7468cb04-5a70-4228-aa1f-e6a11aca2493 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100261 Jun 18 22:20:25.180239 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2173/4326] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:25.211263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:25.212342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:25.227425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.228237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.230328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.231241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.327388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:25.334101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.337277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.337277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lazy-loading 'fault' on Instance uuid 62add9a1-ed28-4e11-b315-4596612cb113 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:20:25.338774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:25.343337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:25.347218 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1885c9a-03b7-4836-87cc-cd2db3670267 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.473846 Jun 18 22:20:25.361592 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2154/4327] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:24 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:25.416551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:25.435604 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06d62dc7-3c76-4ee2-9f09-e0c38917034b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 200 len: 1299 microversion: 2.1 time: 0.229598 Jun 18 22:20:25.446608 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2174/4328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:25 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:25.552404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:25.553315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:25.571463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.572106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.574512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.576064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.620803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:25.622034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:25.635462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.641421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fd95c94-6fd5-4450-85b1-613acb9b5360 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/ips" status: 200 len: 150 microversion: 2.1 time: 0.094170 Jun 18 22:20:25.645173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.647955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.649465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.657477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2155/4329] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:20:25 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/ips => generated 150 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:25.672690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "333dce02-30ca-476d-b896-3fb4871db3f1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:25.674298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:25.690118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.692067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.695332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.695954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.823354 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Invalid volume: volume 333dce02-30ca-476d-b896-3fb4871db3f1 is already attached to instances: 89e5a035-772d-471a-96ab-ce0bfce14d85 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/os-volume_attachments HTTP/1.1 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 74 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: {"volumeAttachment": {"volumeId": "333dce02-30ca-476d-b896-3fb4871db3f1"}} Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid volume: volume 333dce02-30ca-476d-b896-3fb4871db3f1 is already attached to instances: 89e5a035-772d-471a-96ab-ce0bfce14d85 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': '2255804c-8789-4f0c-b90f-d8783df8bdec', 'body': {'volumeAttachment': {'volumeId': '333dce02-30ca-476d-b896-3fb4871db3f1'}}} Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 333dce02-30ca-476d-b896-3fb4871db3f1 is already attached to instances: 89e5a035-772d-471a-96ab-ce0bfce14d85 Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:20:25.825952 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 333dce02-30ca-476d-b896-3fb4871db3f1 is already attached to instances: 89e5a035-772d-471a-96ab-ce0bfce14d85 Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 333dce02-30ca-476d-b896-3fb4871db3f1 is already attached to instances: 89e5a035-772d-471a-96ab-ce0bfce14d85 Jun 18 22:20:25.830586 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:25.832959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 400 to user: Invalid volume: volume 333dce02-30ca-476d-b896-3fb4871db3f1 is already attached to instances: 89e5a035-772d-471a-96ab-ce0bfce14d85 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:25.834737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-76c9c72f-bdd4-439f-9605-52e5fd71bee7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.169616 Jun 18 22:20:25.835858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2156/4330] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:20:25 2022] POST /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:20:25.840963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:25.841662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:25.850868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.851898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.853218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:25.853931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:25.879033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:26.063535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:26.074273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:26.090094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '277319873f994c44831e0840ef111b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73290d4cb44c40ffa3a0a8f1e553f2e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:26.091504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-acfb2201-e8bb-4ede-9d37-d69912567055 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 200 len: 1514 microversion: 2.21 time: 0.474717 Jun 18 22:20:26.092191 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2175/4331] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:25 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 1514 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:26.096971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:26.097624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:26.108206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:26.113654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:26.114718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:26.115513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:26.163175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:26.188455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:26.200398 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b3bc417a-4d84-4bef-a1c5-36c368077805 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1316 microversion: 2.1 time: 0.363238 Jun 18 22:20:26.200974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2157/4332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:25 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:26.321838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-db04c427-c247-4b6f-a7fb-0303fa6b9e46 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'create', calling method: .version_select at 0x7fea14775430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-869093146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8v1EJFgtQeUuYefRhoUqYCT/ylcfMJXHthqv33DEWd0SXn2rIpShX+IU+APQBRRL8VOYb3ipV+8siw/uiepccMzwnBDb6hA1pJn7A7AktTL+fZpE1cpmXOplS87l+oBA=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:26.329001 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da69bc15-2155-4ca7-ae51-694b3719a90e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 204 len: 0 microversion: 2.1 time: 0.235406 Jun 18 22:20:26.329778 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2176/4333] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:20:26 2022] DELETE /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:26.342319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:26.353545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:26.360483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:26.360949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:26.361772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:26.362213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:26.387386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-db04c427-c247-4b6f-a7fb-0303fa6b9e46 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for project 970d8031a4b149188d5a2bee95524169. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:26.412757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-db04c427-c247-4b6f-a7fb-0303fa6b9e46 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for user caa130c208d44d798cb0a5ba41193976 and project 970d8031a4b149188d5a2bee95524169. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:26.479202 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-db04c427-c247-4b6f-a7fb-0303fa6b9e46 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.161730 Jun 18 22:20:26.480285 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2158/4334] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:20:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:20:26.485669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:26.489699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:26.502340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:26.503011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:26.503951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:26.504533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:27.795321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:27.803840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:27.812104 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9356af7d-fbce-4e7c-b43e-a4bc71b8c8a2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1681 microversion: 2.1 time: 1.473871 Jun 18 22:20:27.816919 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2177/4335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:26 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1681 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:27.829800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:27.844299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:27.869449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:27.870129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:27.870754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:27.871371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:27.910791 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:20:27.912867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 HTTP/1.1 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '62add9a1-ed28-4e11-b315-4596612cb113'} Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:27.913627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:27.917602 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:27.917602 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:27.917602 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:27.917602 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:27.917602 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:20:27.917602 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:27.920602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:27.923537 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f5d56f5-a20e-4977-9b01-9a4b39760790 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 404 len: 111 microversion: 2.1 time: 0.105149 Jun 18 22:20:27.928753 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2178/4336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:27 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:20:27.930155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:27.946803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:27.957118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7db37d6a-e819-458c-84dd-b5c8d41d4cba req-fc9744de-6a5a-4635-90b2-949dfecfd3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efa9aa8-8770-4309-ae40-106e83046a07", "name": "network-vif-deleted", "tag": "10d21a0f-f660-4120-8618-a9ecba44cc66"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:27.972543 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9fe44b32-d27b-4aa9-bd27-29c8fc25d7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 1.490884 Jun 18 22:20:27.973182 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2159/4337] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:26 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:28.003030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:28.003658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:28.004432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7db37d6a-e819-458c-84dd-b5c8d41d4cba req-fc9744de-6a5a-4635-90b2-949dfecfd3e0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.005229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7db37d6a-e819-458c-84dd-b5c8d41d4cba req-fc9744de-6a5a-4635-90b2-949dfecfd3e0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.019717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.020169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.027791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.028458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.051648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7db37d6a-e819-458c-84dd-b5c8d41d4cba req-fc9744de-6a5a-4635-90b2-949dfecfd3e0 service nova] Creating event network-vif-deleted:10d21a0f-f660-4120-8618-a9ecba44cc66 for instance 7efa9aa8-8770-4309-ae40-106e83046a07 on nch1-master-1 Jun 18 22:20:28.064081 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7db37d6a-e819-458c-84dd-b5c8d41d4cba req-fc9744de-6a5a-4635-90b2-949dfecfd3e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131373 Jun 18 22:20:28.064997 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2179/4338] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:28.067260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] HTTP exception thrown: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Request method failure captured: Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 HTTP/1.1 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk-ThMZ83aLHf6DFbmzoTdzCu-MLwBb52sVet9LZ211jPwYopoI8eMwRiyTu8_Ci0EmQDWyeZkWB_wqPyaEXCNT7Z4EdQgf56MW2fIKRgMiSEWQvP8rfE1jq64jN8xcRQ5jKy1kfXDOqPUYpd8IQMGHPuSphx7I5uJnbBJYLR-T27yY Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.21 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 73290d4cb44c40ffa3a0a8f1e553f2e6 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73290d4cb44c40ffa3a0a8f1e553f2e6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 73290d4cb44c40ffa3a0a8f1e553f2e6 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-InstanceActionsV221TestJSON-84128052-project Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 277319873f994c44831e0840ef111b8f Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-InstanceActionsV221TestJSON-84128052-project Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '7efa9aa8-8770-4309-ae40-106e83046a07'} Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:28.068789 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Returning 404 to user: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5eb5380c-7a6d-413d-a078-17d892a16da2 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 404 len: 111 microversion: 2.21 time: 0.077657 Jun 18 22:20:28.073662 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2160/4339] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:27 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:20:28.088435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:28.089589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '.version_select at 0x7fea0767c310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:28.090759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:28.091557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:28.108278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.110217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.110419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.113502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.114143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.114456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.116078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:28.116951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:28.300442 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb618458-d0c7-484a-b163-4672a421e817 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.218772 Jun 18 22:20:28.311161 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2161/4340] 10.222.0.30 () {60 vars in 1336 bytes} [Sat Jun 18 22:20:28 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07/os-instance-actions => generated 611 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:20:28.322725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2059133373", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:28.366663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:28.463878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:28.967658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:28.977335 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b005e51d-19f7-452a-be89-b80243d1cfc3 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1504 microversion: 2.1 time: 0.908617 Jun 18 22:20:28.977929 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2180/4341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:28 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1504 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:28.994565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:28.995608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:29.018954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:29.019425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:29.020253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:29.020673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:29.041297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] HTTP exception thrown: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Request method failure captured: Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 HTTP/1.1 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk-ThMZ83aLHf6DFbmzoTdzCu-MLwBb52sVet9LZ211jPwYopoI8eMwRiyTu8_Ci0EmQDWyeZkWB_wqPyaEXCNT7Z4EdQgf56MW2fIKRgMiSEWQvP8rfE1jq64jN8xcRQ5jKy1kfXDOqPUYpd8IQMGHPuSphx7I5uJnbBJYLR-T27yY Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.21 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 73290d4cb44c40ffa3a0a8f1e553f2e6 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73290d4cb44c40ffa3a0a8f1e553f2e6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 73290d4cb44c40ffa3a0a8f1e553f2e6 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-InstanceActionsV221TestJSON-84128052-project Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 277319873f994c44831e0840ef111b8f Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-InstanceActionsV221TestJSON-84128052-project Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7efa9aa8-8770-4309-ae40-106e83046a07'} Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:29.048433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:29.051889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Returning 404 to user: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:29.053918 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1820acbc-dfe9-4f9e-b410-102b6a1b9a2f tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 404 len: 111 microversion: 2.21 time: 0.074524 Jun 18 22:20:29.060180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2181/4342] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:20:28 2022] DELETE /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:20:29.065234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:29.068830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:29.083075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:29.083529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:29.090291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:29.091143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:29.804329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:29.816861 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2af8a9a6-24f1-4785-a71d-2236a3662312 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 200 len: 1681 microversion: 2.1 time: 0.755342 Jun 18 22:20:29.817586 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2182/4343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:29 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 1681 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:29.846464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:29.851949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:29.862685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:29.870143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:29.871299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:29.871897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:30.276864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:30.293519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:30.295418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:30.296928 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-832695e7-cc69-48a6-b74b-36da90e4f3db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.463042 Jun 18 22:20:30.308369 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2183/4344] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:29 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:30.315265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:30.321870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:30.336878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:30.337618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:30.338751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:30.340773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:30.509416 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d2895804-7d0b-48a4-8446-9b83879db72d tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.195498 Jun 18 22:20:30.510196 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2184/4345] 10.222.0.30 () {58 vars in 1295 bytes} [Sat Jun 18 22:20:30 2022] DELETE /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd/os-server-password => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:30.517327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:30.517954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] [instance: 7efa9aa8-8770-4309-ae40-106e83046a07] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:30.535048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:30.535517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:30.537480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:30.537952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:30.571842 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] HTTP exception thrown: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Request method failure captured: Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 HTTP/1.1 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk-ThMZ83aLHf6DFbmzoTdzCu-MLwBb52sVet9LZ211jPwYopoI8eMwRiyTu8_Ci0EmQDWyeZkWB_wqPyaEXCNT7Z4EdQgf56MW2fIKRgMiSEWQvP8rfE1jq64jN8xcRQ5jKy1kfXDOqPUYpd8IQMGHPuSphx7I5uJnbBJYLR-T27yY Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.21 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 73290d4cb44c40ffa3a0a8f1e553f2e6 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73290d4cb44c40ffa3a0a8f1e553f2e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73290d4cb44c40ffa3a0a8f1e553f2e6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 73290d4cb44c40ffa3a0a8f1e553f2e6 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-84128052 Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-InstanceActionsV221TestJSON-84128052-project Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 277319873f994c44831e0840ef111b8f Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-InstanceActionsV221TestJSON-84128052-project Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7efa9aa8-8770-4309-ae40-106e83046a07'} Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:30.580211 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] Returning 404 to user: Instance 7efa9aa8-8770-4309-ae40-106e83046a07 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05ea38bd-e0e4-47bd-bb3a-fbd7af6fb199 tempest-InstanceActionsV221TestJSON-84128052 tempest-InstanceActionsV221TestJSON-84128052-project] 10.222.0.30 "GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07" status: 404 len: 111 microversion: 2.21 time: 0.070885 Jun 18 22:20:30.588016 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2185/4346] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:30 2022] GET /compute/v2.1/servers/7efa9aa8-8770-4309-ae40-106e83046a07 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:20:30.594436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1726081713", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "6bf42627-cec6-4411-91a6-2ffb246bf8e8"}], "key_name": "tempest-TestNetworkBasicOps-869093146", "security_groups": [{"name": "tempest-secgroup-smoke-169144704"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:31.309493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] validate_networks() for [('6bf42627-cec6-4411-91a6-2ffb246bf8e8', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:31.471576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:31.472065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:31.472543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:31.473242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:31.473891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:31.500034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.500748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:31.505725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.506824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:31.571299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:31.587536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:31.610341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:31.613079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:31.706641 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b31c33b6-68b9-4b94-ab0e-113d435dd06e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.394048 Jun 18 22:20:31.707920 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2162/4347] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:20:31.713130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:31.713904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:31.724493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.725362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:31.726354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.726992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:31.786328 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5146dd4d-4caa-4b2c-becb-30529ce1d933 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.077063 Jun 18 22:20:31.788806 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2163/4348] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:20:31 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd/os-server-password => generated 16 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:20:31.799822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:31.800788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:31.853519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.855838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:31.856855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.858236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:31.927789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec HTTP/1.1 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2255804c-8789-4f0c-b90f-d8783df8bdec'} Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:31.929684 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:20:31.933228 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:31.935195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:31.936331 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c32a38c-2ce8-4072-814f-017770c7a006 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 404 len: 111 microversion: 2.1 time: 0.143074 Jun 18 22:20:31.948825 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2164/4349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:31 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:20:31.954195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-76ee7183-f02f-4680-86ad-8454e679c096 req-9d9b7d44-44b2-4e96-af5c-b215f2310202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2255804c-8789-4f0c-b90f-d8783df8bdec", "name": "network-vif-deleted", "tag": "e5559a6c-070c-49e3-bf02-8fe5b4dd72ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:31.983353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-76ee7183-f02f-4680-86ad-8454e679c096 req-9d9b7d44-44b2-4e96-af5c-b215f2310202 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:31.983975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-76ee7183-f02f-4680-86ad-8454e679c096 req-9d9b7d44-44b2-4e96-af5c-b215f2310202 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.008379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-76ee7183-f02f-4680-86ad-8454e679c096 req-9d9b7d44-44b2-4e96-af5c-b215f2310202 service nova] Creating event network-vif-deleted:e5559a6c-070c-49e3-bf02-8fe5b4dd72ab for instance 2255804c-8789-4f0c-b90f-d8783df8bdec on nch2-master-1 Jun 18 22:20:32.017581 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-76ee7183-f02f-4680-86ad-8454e679c096 req-9d9b7d44-44b2-4e96-af5c-b215f2310202 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066929 Jun 18 22:20:32.023196 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2165/4350] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:32.030071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:32.034005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:32.064640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:32.066776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.069216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:32.073653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.707362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:32.725347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:32.726844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:32.740106 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f84b5c7c-4eee-4d21-8f15-1e2071aa1138 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 0.715302 Jun 18 22:20:32.753849 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2166/4351] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:32 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:32.762134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:32.763395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:32.784339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:32.784816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.786099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:32.789695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.867675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:32.869145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:32.869807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:32.870415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:32.870989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:32.907985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:32.908711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.909797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:32.910537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:32.943098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for project 970d8031a4b149188d5a2bee95524169. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:32.960372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:32.962112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for user caa130c208d44d798cb0a5ba41193976 and project 970d8031a4b149188d5a2bee95524169. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:32.972707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:32.982806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7bdc12b-bca5-4d82-8b6e-dba2a31312fb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1205 microversion: 2.1 time: 0.226768 Jun 18 22:20:32.986912 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2167/4352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:32 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1205 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:32.989409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:32.991962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:32.995241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:32.995811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:33.029519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:33.030229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:33.032035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:33.033524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:33.090073 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7589314e-0f39-4355-be75-ce9af6cc35f1 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.502975 Jun 18 22:20:33.093761 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2186/4353] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:20:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:20:33.107002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:33.113442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-559bd705-fb09-40ce-bbe0-e2967e825a33 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '.version_select at 0x7fea14d61d30>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:33.146919 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-559bd705-fb09-40ce-bbe0-e2967e825a33 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661863151" status: 202 len: 0 microversion: 2.1 time: 0.048735 Jun 18 22:20:33.148808 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2187/4354] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661863151 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:33.153950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d62b940c-2057-4839-8c6d-3b0a47554a76 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:33.155461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d62b940c-2057-4839-8c6d-3b0a47554a76 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:33.323303 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95fbf59f-b361-458c-9b94-0c440d2bf827 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 204 len: 0 microversion: 2.1 time: 0.331829 Jun 18 22:20:33.324261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2168/4355] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:20:32 2022] DELETE /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:33.333023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d62b940c-2057-4839-8c6d-3b0a47554a76 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:33.339678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:33.340484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:33.341231 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d62b940c-2057-4839-8c6d-3b0a47554a76 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1248 microversion: 2.1 time: 0.191095 Jun 18 22:20:33.341805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2188/4356] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:33 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1248 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:33.348632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:33.349586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:33.350942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:33.351450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:33.771405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:33.772018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:33.786006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:33.786450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:33.787241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:33.787682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:34.301634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:34.316432 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a383c49c-2c60-49fd-be03-e9b5d430f5e4 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1510 microversion: 2.1 time: 0.981745 Jun 18 22:20:34.317427 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2169/4357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:33 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1510 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:34.328185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:34.330868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:34.350025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:34.358285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:34.361388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:34.365410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:34.904293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:34.917753 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3633c6a-4af8-40f8-a1ae-d6081a66b595 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1267 microversion: 2.1 time: 0.599006 Jun 18 22:20:34.927486 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2170/4358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:34 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1267 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:34.927486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:34.927486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:34.929825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:34.930267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:34.931035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:34.931651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:34.940898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:34.954978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:34.958013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:34.959849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a539802-8298-4c13-8de1-79714083658c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1738 microversion: 2.20 time: 1.192323 Jun 18 22:20:34.973277 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2189/4359] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:33 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1738 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:35.041859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:35.051851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9dc1a2ab-2401-48e6-ad37-f037dc3a0989 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1300 microversion: 2.1 time: 0.131178 Jun 18 22:20:35.052775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2171/4360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:34 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1300 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:35.333986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:35.334683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:35.344839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:35.345867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:35.347155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:35.347928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:35.729323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:35.745010 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21b8bbbf-a4c3-424c-9d4c-052f27cbfd22 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1510 microversion: 2.1 time: 0.412727 Jun 18 22:20:35.746968 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2190/4361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:35 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:35.936157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:35.937539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:35.965350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:35.966304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:35.967223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:35.968390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:35.988250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:35.993333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:36.007060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.010304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.012110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.014488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.399799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:36.414556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85061130-f41c-4a51-9ddc-fbb280e4677d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.482181 Jun 18 22:20:36.415937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2172/4362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:35 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:36.422309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:36.423772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:36.432338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.433712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.434773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.435433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.528735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:36.533801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:36.541969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-861e500c-b06b-4d87-a882-3336b9efa5f4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1306 microversion: 2.1 time: 0.123945 Jun 18 22:20:36.546859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:36.548813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:36.550095 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9c4eccc-ee77-4300-8523-946f428cd7b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1720 microversion: 2.20 time: 0.569321 Jun 18 22:20:36.550666 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2191/4363] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:35 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1720 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:36.554716 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2173/4364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:36 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:36.561248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:36.561818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:36.571265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.571864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.573080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.573538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.735961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lazy-loading 'services' on Instance uuid 89e5a035-772d-471a-96ab-ce0bfce14d85 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:20:36.762223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:36.769952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:36.783023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.783865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.785428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.786220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.901985 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a427e9f-75f3-48f4-b34b-4e184970cd21 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments/333dce02-30ca-476d-b896-3fb4871db3f1" status: 202 len: 0 microversion: 2.1 time: 0.345360 Jun 18 22:20:36.905703 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2174/4365] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:20:36 2022] DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments/333dce02-30ca-476d-b896-3fb4871db3f1 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:36.918937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:36.926434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:36.928472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:36.947470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.949184 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9ce5bad9-c4fe-4e7a-983d-df1534d8eb5e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1468 microversion: 2.1 time: 0.190381 Jun 18 22:20:36.950419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.951328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:36.953964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:36.965374 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2192/4366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:36 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1468 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:36.990419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:37.016114 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc0ae117-5696-4b92-b5a4-238d0555314f tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102200 Jun 18 22:20:37.017568 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2175/4367] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:20:36 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:37.223832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0d4e2e18-b1d4-4580-addd-644e23cad91a req-7940a509-1fda-4fc0-9805-c191dba74c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af26acff-9bcf-4cd6-ad99-6ea1c8a12acd", "name": "network-vif-deleted", "tag": "f387afac-8184-446b-9301-c63c7975998b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:37.239711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0d4e2e18-b1d4-4580-addd-644e23cad91a req-7940a509-1fda-4fc0-9805-c191dba74c75 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.240475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0d4e2e18-b1d4-4580-addd-644e23cad91a req-7940a509-1fda-4fc0-9805-c191dba74c75 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:37.269798 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0d4e2e18-b1d4-4580-addd-644e23cad91a req-7940a509-1fda-4fc0-9805-c191dba74c75 service nova] Creating event network-vif-deleted:f387afac-8184-446b-9301-c63c7975998b for instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd on nch2-master-1 Jun 18 22:20:37.282032 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0d4e2e18-b1d4-4580-addd-644e23cad91a req-7940a509-1fda-4fc0-9805-c191dba74c75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063684 Jun 18 22:20:37.290586 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2193/4368] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:37.434017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:37.435328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:37.470689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.471178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:37.472029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.472537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:37.561808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:37.563277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:37.579956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.580654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:37.584191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.584919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:37.895552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:37.909820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2359323e-0deb-44f5-b6b0-3e538a22784a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.480131 Jun 18 22:20:37.912377 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2176/4369] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:37 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:37.922175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:37.923678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:37.935139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.936727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:37.937903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:37.938503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.494044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:38.504099 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cdcdba36-db3b-4cc8-9b6b-65d41ffc2cc4 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 0.947671 Jun 18 22:20:38.504810 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2194/4370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:37 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:38.509733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:38.510612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:38.523822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.525323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.528171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.528692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.595188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:38.608472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:38.610464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:38.615380 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-484e96c8-4676-4819-9c45-d19a16aaf6df tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1720 microversion: 2.20 time: 0.700384 Jun 18 22:20:38.616715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2177/4371] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:37 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1720 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:38.623183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:38.624311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:38.631010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1fc3fc3ccf40fb89b17836ee1a29d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113eb5bc0323404bb64b87dbff50b96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:38.663569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.664372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.668199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b0ec372a-0a6b-45be-9cb4-368582b1bc1e tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 200 len: 1301 microversion: 2.1 time: 0.160686 Jun 18 22:20:38.668542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.669231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.689155 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2195/4372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:38 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:38.769443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c2fdaa5-acb3-443f-b4cc-489e7073a1ed tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150839 Jun 18 22:20:38.770043 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2178/4373] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:20:38 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:20:38.896436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:38.896966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:38.904778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.909777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.910778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.911362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.942292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:38.946868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:38.973444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:38.981104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.982913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:38.985310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:38.991970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.122248 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-afe0e26a-5f2b-4142-813c-477f363fdcdb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 204 len: 0 microversion: 2.1 time: 0.230001 Jun 18 22:20:39.123590 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2196/4374] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:20:38 2022] DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:39.132553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d8a4176b-4291-4cd8-b29c-b00dc1f047e1 req-fbd05a99-607f-4aff-94d1-d01e12a78bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "name": "network-vif-unplugged", "status": "completed", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:39.144205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d8a4176b-4291-4cd8-b29c-b00dc1f047e1 req-fbd05a99-607f-4aff-94d1-d01e12a78bc3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.144818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d8a4176b-4291-4cd8-b29c-b00dc1f047e1 req-fbd05a99-607f-4aff-94d1-d01e12a78bc3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.167926 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d8a4176b-4291-4cd8-b29c-b00dc1f047e1 req-fbd05a99-607f-4aff-94d1-d01e12a78bc3 service nova] Creating event network-vif-unplugged:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:20:39.186844 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d8a4176b-4291-4cd8-b29c-b00dc1f047e1 req-fbd05a99-607f-4aff-94d1-d01e12a78bc3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058500 Jun 18 22:20:39.188876 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2197/4375] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:39.198580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:39.200193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:39.214029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.215400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.219642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.221910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.239663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:39.404343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:39.420651 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-99723ce9-169a-41ad-ab5e-5e7048f42711 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.489905 Jun 18 22:20:39.421640 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2179/4376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:38 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:39.427830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-452d6c64-5706-4b86-ac9f-3235c2eeafd7 req-68001c56-0d7f-4ca3-bec6-d4b0e8b8b19c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a983d93d-70e3-4f93-bcf7-2d241c8b983e", "tag": "399e5f37-2ddf-4da4-9c1d-12f839a8b7b9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:39.438159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-452d6c64-5706-4b86-ac9f-3235c2eeafd7 req-68001c56-0d7f-4ca3-bec6-d4b0e8b8b19c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.439035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-452d6c64-5706-4b86-ac9f-3235c2eeafd7 req-68001c56-0d7f-4ca3-bec6-d4b0e8b8b19c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.481841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-452d6c64-5706-4b86-ac9f-3235c2eeafd7 req-68001c56-0d7f-4ca3-bec6-d4b0e8b8b19c service nova] Creating event network-changed:399e5f37-2ddf-4da4-9c1d-12f839a8b7b9 for instance a983d93d-70e3-4f93-bcf7-2d241c8b983e on nch1-master-1 Jun 18 22:20:39.491058 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-452d6c64-5706-4b86-ac9f-3235c2eeafd7 req-68001c56-0d7f-4ca3-bec6-d4b0e8b8b19c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067815 Jun 18 22:20:39.492497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2180/4377] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:39.530054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:39.537143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:39.545211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.546644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.547274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.547717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.865490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:39.887202 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ce9b5525-d106-4b1f-a9be-22546a280ece tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1681 microversion: 2.1 time: 0.696142 Jun 18 22:20:39.897837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2198/4378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:39 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1681 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:39.904853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:39.905844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:39.913875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.914567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.915559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:39.916240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:39.990715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:39.999081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b345c41b-082b-4bec-abaf-60dc7015d7b0 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 0.479995 Jun 18 22:20:40.009186 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2181/4379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:39 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:40.009186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:40.009186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] [instance: af26acff-9bcf-4cd6-ad99-6ea1c8a12acd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:40.013560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.014154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.015399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.015907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.033401 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] HTTP exception thrown: Instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd could not be found. Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Request method failure captured: Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd HTTP/1.1 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk-az_iL8Uj3LM6XzZXg9vYQ4LfAOvpPudr9gd_WT0qPaaHRvmzkYsr83WSaakjjdCxU3b-7opgEHkrMMRM7CdwbmmLeQBS51BAbadFSXeWetOQJJIi8B_XGjPa_CnYpRSsddpvl8tY1l8n_uAzrzbbbXy3f0XTSaQK9JJULjgif4vs Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 113eb5bc0323404bb64b87dbff50b96d Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerPasswordTestJSON-828307492 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/113eb5bc0323404bb64b87dbff50b96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/113eb5bc0323404bb64b87dbff50b96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/113eb5bc0323404bb64b87dbff50b96d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_113eb5bc0323404bb64b87dbff50b96d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerPasswordTestJSON-828307492 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 113eb5bc0323404bb64b87dbff50b96d Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerPasswordTestJSON-828307492 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerPasswordTestJSON-828307492-project Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 5a1fc3fc3ccf40fb89b17836ee1a29d9 Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerPasswordTestJSON-828307492-project Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd could not be found. Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'af26acff-9bcf-4cd6-ad99-6ea1c8a12acd'} Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd could not be found. Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd could not be found. Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:40.035128 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd could not be found. Jun 18 22:20:40.040075 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:40.043349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] Returning 404 to user: Instance af26acff-9bcf-4cd6-ad99-6ea1c8a12acd could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:40.043349 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-47bb0c5a-320a-424d-8d9e-d7a959433013 tempest-ServerPasswordTestJSON-828307492 tempest-ServerPasswordTestJSON-828307492-project] 10.222.0.30 "GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd" status: 404 len: 111 microversion: 2.1 time: 0.040882 Jun 18 22:20:40.048049 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2182/4380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:40 2022] GET /compute/v2.1/servers/af26acff-9bcf-4cd6-ad99-6ea1c8a12acd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:20:40.271627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:40.281785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:40.283354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:40.284694 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-56a4e298-86c1-4a44-8f4a-c969a4f5f569 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1663 microversion: 2.20 time: 0.393869 Jun 18 22:20:40.285350 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2199/4381] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:39 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1663 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:40.302502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ad3ba56-1c0d-49cd-9990-41fcf14a30b3"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:40.303587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:40.309717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.310165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.310939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.311362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.437517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:40.438866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:40.448123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.449183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.457638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.458556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.759642 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3429c0d4-c6cf-4925-8fa3-6e815f71b17e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.460936 Jun 18 22:20:40.761933 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2183/4382] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Jun 18 22:20:40 2022] POST /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments => generated 188 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:20:40.767676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-160426ea-85d0-4fbc-abba-8e2069c67b99 req-52cce589-09f3-48e1-8591-53712bd2fbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8775380-a72b-4162-b589-4ac43d347cbd", "tag": "3daba290-d1f9-436d-8923-d16a165428a9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:40.786098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-160426ea-85d0-4fbc-abba-8e2069c67b99 req-52cce589-09f3-48e1-8591-53712bd2fbe0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.793338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-160426ea-85d0-4fbc-abba-8e2069c67b99 req-52cce589-09f3-48e1-8591-53712bd2fbe0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.806794 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-160426ea-85d0-4fbc-abba-8e2069c67b99 req-52cce589-09f3-48e1-8591-53712bd2fbe0 service nova] Creating event network-changed:3daba290-d1f9-436d-8923-d16a165428a9 for instance b8775380-a72b-4162-b589-4ac43d347cbd on nch2-master-1 Jun 18 22:20:40.812916 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-160426ea-85d0-4fbc-abba-8e2069c67b99 req-52cce589-09f3-48e1-8591-53712bd2fbe0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049651 Jun 18 22:20:40.814112 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2184/4383] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:40.910754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:40.912028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:40.920075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.921187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:40.922368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:40.923044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:41.083174 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-57504285-b83a-4637-89d8-5796fd6df463 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/action" status: 202 len: 0 microversion: 2.20 time: 0.181775 Jun 18 22:20:41.087916 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2185/4384] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:20:40 2022] POST /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:41.094448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:41.095246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:41.099124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:41.104388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:41.105158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:41.106265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:41.106861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:41.113971 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5d4ed34d-d77a-4001-a86c-145ceaffcd3e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.678223 Jun 18 22:20:41.117521 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2200/4385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:40 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:41.135164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:41.137284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:41.145720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:41.145720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:41.147185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:41.147714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:41.545081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:41.599285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:42.074765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:42.083590 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d70fa87-0ed5-4759-91b4-1907da36622c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1681 microversion: 2.1 time: 0.994114 Jun 18 22:20:42.086971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2186/4386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:41 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1681 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:42.092746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:42.099471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:42.112078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:42.114953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:42.115939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:42.116381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:42.131257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:42.148506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-811ce028-7016-4a01-9e65-39fb79ccb943 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 1.027585 Jun 18 22:20:42.149643 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2201/4387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:41 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:42.156384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:42.157003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:42.164686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:42.165187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:42.165972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:42.166408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:42.682102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:42.700605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:42.702586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:42.704548 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9dcdbf44-d261-4bd0-80fd-ad4ec1385c55 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1749 microversion: 2.20 time: 0.615542 Jun 18 22:20:42.705590 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2187/4388] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:42 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1749 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:42.718888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:42.733552 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a041774-9884-4f20-b63d-5507fc6d2303 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.580766 Jun 18 22:20:42.734467 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2202/4389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:42 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:42.832802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-654063676", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "876179d9-270f-4170-9bad-15593aac43e1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:42.898081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] validate_networks() for [('876179d9-270f-4170-9bad-15593aac43e1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:43.104037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:43.104647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:43.107529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:43.114885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:43.115603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:43.116922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:43.117984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:43.341128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:43.655510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:43.670355 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0f35d85-4184-4a36-99b6-62910d51f5ab tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1681 microversion: 2.1 time: 0.570168 Jun 18 22:20:43.671635 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2203/4390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:43 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1681 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:43.676495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:43.681908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:43.692757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:43.693247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:43.694034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:43.701624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:44.376240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:44.395510 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d363886-92fb-47f3-aa08-91ee1f7e6e3c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 0.722310 Jun 18 22:20:44.403950 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2204/4391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:43 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:44.419765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:44.422715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:44.436937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:44.438129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:44.439206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:44.439853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:44.881953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:44.882690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:44.883638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:44.884248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:44.884912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:44.902224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:44.903226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:44.904240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:44.904885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:44.947876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Getting quotas for project 5cc2ac33206d4b3499ce139b0ecdf356. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:44.965139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Getting quotas for user 21a7cd29a3044c0d8eb886d1e3ea3bbb and project 5cc2ac33206d4b3499ce139b0ecdf356. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:45.001755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:45.005206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:45.150159 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9ca72e10-3bf4-42e8-af88-918143128555 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.396662 Jun 18 22:20:45.151452 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2188/4392] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:20:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:20:45.156417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:45.160372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:45.175337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:45.182072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:45.189500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:45.190394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:45.614982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:45.624039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:45.625610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:45.638063 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-386628b7-fbd6-4b88-9371-700616224958 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1751 microversion: 2.20 time: 1.232240 Jun 18 22:20:45.639053 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2205/4393] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:44 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1751 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:45.643995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:45.644792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:45.653095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:45.655051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:45.656144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:45.656777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:45.982241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:45.993693 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0d472849-f064-43cf-942c-8501e33559aa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.841002 Jun 18 22:20:45.994894 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2189/4394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:45 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:46.010059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1639437588", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "876179d9-270f-4170-9bad-15593aac43e1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:46.111649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] validate_networks() for [('876179d9-270f-4170-9bad-15593aac43e1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:46.470686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:46.480290 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-506be17c-b718-46ff-8d7f-9e4469e94746 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1681 microversion: 2.1 time: 0.839995 Jun 18 22:20:46.481235 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2206/4395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:45 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1681 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:46.495990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:46.496627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:46.509695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:46.510142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:46.510940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:46.511543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:47.076327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:47.091792 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7373b596-e7f2-4f31-b09e-a30f752d31ee tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 0.599658 Jun 18 22:20:47.092385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2207/4396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:46 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:47.097368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-146fe7f0-e304-46b8-83e7-7447a8a57ca3 req-03d03a6a-7aee-4485-a690-d6d71c9ea400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a983d93d-70e3-4f93-bcf7-2d241c8b983e", "name": "network-vif-plugged", "status": "completed", "tag": "399e5f37-2ddf-4da4-9c1d-12f839a8b7b9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:47.122421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-146fe7f0-e304-46b8-83e7-7447a8a57ca3 req-03d03a6a-7aee-4485-a690-d6d71c9ea400 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:47.122874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-146fe7f0-e304-46b8-83e7-7447a8a57ca3 req-03d03a6a-7aee-4485-a690-d6d71c9ea400 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:47.147303 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-146fe7f0-e304-46b8-83e7-7447a8a57ca3 req-03d03a6a-7aee-4485-a690-d6d71c9ea400 service nova] Creating event network-vif-plugged:399e5f37-2ddf-4da4-9c1d-12f839a8b7b9 for instance a983d93d-70e3-4f93-bcf7-2d241c8b983e on nch1-master-1 Jun 18 22:20:47.158934 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-146fe7f0-e304-46b8-83e7-7447a8a57ca3 req-03d03a6a-7aee-4485-a690-d6d71c9ea400 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065225 Jun 18 22:20:47.160621 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2208/4397] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:47.175780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:47.178554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:47.213498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:47.214393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:47.215353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:47.216081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:48.803733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:48.831128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:48.834207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:48.836473 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ac31d43-29aa-417e-91a6-4a48b1f5b43e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 1.673700 Jun 18 22:20:48.839215 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2209/4398] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:47 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:48.864284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:48.866022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:48.881794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:48.882684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:48.883896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:48.884841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.420212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:49.459734 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05afc636-86e7-4f0a-8015-63201ee23352 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1309 microversion: 2.1 time: 0.583826 Jun 18 22:20:49.460713 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2210/4399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:48 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:49.466145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:49.467320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:49.474949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.475767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.477137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.477979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.582903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:49.583571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:49.584138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:49.585143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:49.585596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:49.623650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.624501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.625594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.626353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.657125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Getting quotas for project 5cc2ac33206d4b3499ce139b0ecdf356. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:49.663702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Getting quotas for user 21a7cd29a3044c0d8eb886d1e3ea3bbb and project 5cc2ac33206d4b3499ce139b0ecdf356. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:49.668890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:49.682301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:49.684980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:49.699718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:49.716450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a01c251d-4c54-4d39-8450-7a7a2270375a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 200 len: 1613 microversion: 2.1 time: 0.253687 Jun 18 22:20:49.727263 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2211/4400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:49 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 1613 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:49.737957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:49.748239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:49.757324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.757844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.769340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.770173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.792412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80e18296-4737-4b51-bce5-9c884decb9dd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.795694 Jun 18 22:20:49.793734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2190/4401] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:20:49.802372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1c625e05-b602-49fd-bbb2-cc03cc7bc48a req-bce901a3-00da-4b68-ab2a-fbc408124f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e5a035-772d-471a-96ab-ce0bfce14d85", "name": "network-vif-unplugged", "status": "completed", "tag": "9746866d-83a7-4cb8-802a-abb7bee91209"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:49.823696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1c625e05-b602-49fd-bbb2-cc03cc7bc48a req-bce901a3-00da-4b68-ab2a-fbc408124f3b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.824153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1c625e05-b602-49fd-bbb2-cc03cc7bc48a req-bce901a3-00da-4b68-ab2a-fbc408124f3b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.846630 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1c625e05-b602-49fd-bbb2-cc03cc7bc48a req-bce901a3-00da-4b68-ab2a-fbc408124f3b service nova] Creating event network-vif-unplugged:9746866d-83a7-4cb8-802a-abb7bee91209 for instance 89e5a035-772d-471a-96ab-ce0bfce14d85 on nch1-master-1 Jun 18 22:20:49.852765 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1c625e05-b602-49fd-bbb2-cc03cc7bc48a req-bce901a3-00da-4b68-ab2a-fbc408124f3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057597 Jun 18 22:20:49.853949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2191/4402] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:49.859745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:49.860622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:49.867683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.868317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.869300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:49.869883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:49.899715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:50.353284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:50.365528 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f39a55c-66f8-41ad-a115-0c3c3a13ea89 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 0.632112 Jun 18 22:20:50.366995 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2212/4403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:49 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:50.383968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-237687793", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "451", "networks": [{"uuid": "876179d9-270f-4170-9bad-15593aac43e1"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:50.533611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] validate_networks() for [('876179d9-270f-4170-9bad-15593aac43e1', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:20:50.541944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:50.560079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:50.564601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:50.576539 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e81ec085-1aa4-419f-8c06-2509ad0969ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.715070 Jun 18 22:20:50.578106 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2192/4404] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:49 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:20:50.587498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9af66d17-9d9c-4416-a895-8d9829508492 req-528def43-fbbd-4398-957a-cb189821a09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89e5a035-772d-471a-96ab-ce0bfce14d85", "name": "network-vif-deleted", "tag": "9746866d-83a7-4cb8-802a-abb7bee91209"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:50.611543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9af66d17-9d9c-4416-a895-8d9829508492 req-528def43-fbbd-4398-957a-cb189821a09e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:50.613470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9af66d17-9d9c-4416-a895-8d9829508492 req-528def43-fbbd-4398-957a-cb189821a09e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:50.661291 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9af66d17-9d9c-4416-a895-8d9829508492 req-528def43-fbbd-4398-957a-cb189821a09e service nova] Creating event network-vif-deleted:9746866d-83a7-4cb8-802a-abb7bee91209 for instance 89e5a035-772d-471a-96ab-ce0bfce14d85 on nch1-master-1 Jun 18 22:20:50.677148 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9af66d17-9d9c-4416-a895-8d9829508492 req-528def43-fbbd-4398-957a-cb189821a09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096661 Jun 18 22:20:50.684344 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2193/4405] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:50.709123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:50.715244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:50.744200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:50.747899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:50.748881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:50.753328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:51.322342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:51.332341 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58a5a3aa-77fd-40a1-9544-1e365e96ad4e tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1490 microversion: 2.1 time: 0.646482 Jun 18 22:20:51.337389 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2194/4406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:50 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1490 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:51.351596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:51.352059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:51.366529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:51.366983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:51.367766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:51.368705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:51.416981 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 HTTP/1.1 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '89e5a035-772d-471a-96ab-ce0bfce14d85'} Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:20:51.422617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:20:51.427304 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e80a982c-4111-4932-82eb-1ff02512d046 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 404 len: 111 microversion: 2.1 time: 0.086086 Jun 18 22:20:51.438950 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2195/4407] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:51 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:20:51.440336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:51.442873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:51.466194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:51.466643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:51.467453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:51.467919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:51.673404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56712b63-4fed-4030-8a24-3d5b1a08d39f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "PUT /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1085 microversion: 2.1 time: 0.243291 Jun 18 22:20:51.674990 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2196/4408] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:20:51 2022] PUT /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1085 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:51.688179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:51.701538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:51.740216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:51.740786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:51.741666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:51.742117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:52.633262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:20:52.634421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:20:52.635183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:20:52.635764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:20:52.636334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:20:52.657515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:52.658062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:52.658807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:52.659193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:52.710767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Getting quotas for project 5cc2ac33206d4b3499ce139b0ecdf356. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:52.727425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Getting quotas for user 21a7cd29a3044c0d8eb886d1e3ea3bbb and project 5cc2ac33206d4b3499ce139b0ecdf356. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:52.747844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:20:52.750501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:20:52.844386 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f5f6197f-6e2c-4a8f-b5d0-97749ec58937 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.474277 Jun 18 22:20:52.846634 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2213/4409] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:20:52.853269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2efbc0fd-e00b-486b-a4ec-cb66b71cc598 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '.version_select at 0x7fea144bd5e0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:52.902707 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2efbc0fd-e00b-486b-a4ec-cb66b71cc598 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366293565" status: 202 len: 0 microversion: 2.1 time: 0.054751 Jun 18 22:20:52.903325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2214/4410] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366293565 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:20:52.919909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:52.920972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:52.936125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:52.938456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:52.942149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:52.942778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:53.951474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:53.980913 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4e5d2579-168c-4ccd-9e84-d8701c2a53b6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 2.296568 Jun 18 22:20:53.984454 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2197/4411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:51 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:54.000572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:54.006190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:54.023881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:54.024710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:54.025861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:54.029883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:54.466008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:54.492529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:54.494692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:54.501856 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21eb946c-eaba-4796-a751-a62cfeee0ea4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 1.594035 Jun 18 22:20:54.506493 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2215/4412] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:52 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:54.536018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6ad3a736-7c67-41e1-90bf-b7637265c373 req-d1215418-41d6-466c-8e0b-49516a17ba18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8775380-a72b-4162-b589-4ac43d347cbd", "name": "network-vif-plugged", "status": "completed", "tag": "3daba290-d1f9-436d-8923-d16a165428a9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:54.556418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6ad3a736-7c67-41e1-90bf-b7637265c373 req-d1215418-41d6-466c-8e0b-49516a17ba18 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:54.557295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6ad3a736-7c67-41e1-90bf-b7637265c373 req-d1215418-41d6-466c-8e0b-49516a17ba18 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:54.606230 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6ad3a736-7c67-41e1-90bf-b7637265c373 req-d1215418-41d6-466c-8e0b-49516a17ba18 service nova] Creating event network-vif-plugged:3daba290-d1f9-436d-8923-d16a165428a9 for instance b8775380-a72b-4162-b589-4ac43d347cbd on nch2-master-1 Jun 18 22:20:54.615718 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6ad3a736-7c67-41e1-90bf-b7637265c373 req-d1215418-41d6-466c-8e0b-49516a17ba18 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092647 Jun 18 22:20:54.616826 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2216/4413] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:54.632058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:54.634140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:54.649021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:54.649662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:54.650512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:54.651027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:55.042064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:55.046134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:55.056821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b5c3259-1169-4b53-b95a-a8f4aca91ec8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1272 microversion: 2.1 time: 0.435880 Jun 18 22:20:55.058000 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2217/4414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:54 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:55.086694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9f03cf71-d141-4043-acd2-3497113e8a42 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: .version_select at 0x7fea19d0e9d0>, body: {"keypair": {"name": "tempest-keypair-404588194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmliDkzcvkIcnDV+ISViKiftfbDtneBGVd1jEXZV9DJATiLQq3eDXLVRP4Lo8xPCeCdeoUbrwYYurtTAZ5KGSo/bA2QMWh0CZm2lkpsEYrplJDZTUEIF8vwiBKs0btPVw=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:55.110597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:55.129900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9f03cf71-d141-4043-acd2-3497113e8a42 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:20:55.139113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:55.140845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9f03cf71-d141-4043-acd2-3497113e8a42 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:20:55.167894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-332683f3-a3d8-4da2-88f6-1422f75d31d1 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1511 microversion: 2.1 time: 1.174083 Jun 18 22:20:55.170111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2198/4415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:53 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1511 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:55.189089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:55.191439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:55.223501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9f03cf71-d141-4043-acd2-3497113e8a42 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152718 Jun 18 22:20:55.224247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2218/4416] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:20:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:20:55.228261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:55.229386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:55.230197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:55.230649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:55.245469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:55.246510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:55.264935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:55.265743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:55.266766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:55.267370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:56.419479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:56.431200 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-61ad0a7c-3c6d-43d2-b0ef-27d80043eecd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 1.257632 Jun 18 22:20:56.431877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2199/4417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:55 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:56.437334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:56.438594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:56.471264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:56.473491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:56.475666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:56.478812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.111232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:57.122299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27b96fb2-c4fa-472e-87a3-3c898196f103 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1511 microversion: 2.1 time: 1.892687 Jun 18 22:20:57.123839 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2219/4418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:55 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1511 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:57.131033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:57.132053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:57.139941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.141896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.144106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.144967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.281779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:57.294532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:57.296459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:57.297922 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f33a8aa-d4b9-4e58-8110-8644328c8284 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.864738 Jun 18 22:20:57.299067 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2200/4419] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:56 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:57.303926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:57.304686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:57.313363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.314106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.315109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.315736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.361335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:20:57.364049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:57.382682 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9c818571-937e-4bf8-b38c-1d5ad19e6315 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1278 microversion: 2.1 time: 0.249506 Jun 18 22:20:57.383558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2220/4420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:57 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:57.449499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:57.450576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:57.463386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.465502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.466892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.471808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.528230 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6077948a-1a5f-4ee6-8c61-b9d629dd2971 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 204 len: 0 microversion: 2.1 time: 0.226289 Jun 18 22:20:57.531628 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2201/4421] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:20:57 2022] DELETE /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:20:57.546538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:57.547603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:57.562399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.562854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:57.563838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:57.564435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:58.543540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:58.552709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52002172-eeff-4f41-bcfc-32c718809a14 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1373 microversion: 2.1 time: 1.108453 Jun 18 22:20:58.553600 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2221/4422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:57 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1373 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:58.559591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:58.560503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:58.573861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:58.574671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:58.575427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:58.576072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:58.653717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:58.667333 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a6d046b4-b23d-4a88-ad39-997262253423 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1517 microversion: 2.1 time: 1.128705 Jun 18 22:20:58.668594 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2202/4423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:57 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1517 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:20:58.674892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:58.676004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:58.685922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:58.686429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:58.687283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:58.687733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:59.033417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:59.068336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:59.070319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:59.078377 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-baefffec-d300-40c4-b78f-c88ba9cdfb28 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.521608 Jun 18 22:20:59.081742 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2222/4424] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:20:58 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:20:59.325877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:20:59.342313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b2ac8f2-df4e-4a3a-b0a3-ddb3951f065b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.670400 Jun 18 22:20:59.344201 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2203/4425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:58 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:20:59.570446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:59.571079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:59.576709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3f83bdc6-8a48-443a-a1d6-6c936ef4571c req-419c51bf-4066-4fa0-9500-1512a20d8c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28d4572-3bd6-4ddb-8542-b17869c57da5", "tag": "823b3203-5977-4ff8-be98-8591bbb9bef2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:20:59.588408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3f83bdc6-8a48-443a-a1d6-6c936ef4571c req-419c51bf-4066-4fa0-9500-1512a20d8c17 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:59.588962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:59.589394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3f83bdc6-8a48-443a-a1d6-6c936ef4571c req-419c51bf-4066-4fa0-9500-1512a20d8c17 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:59.589534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:59.590247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:59.590700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:59.636474 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3f83bdc6-8a48-443a-a1d6-6c936ef4571c req-419c51bf-4066-4fa0-9500-1512a20d8c17 service nova] Creating event network-changed:823b3203-5977-4ff8-be98-8591bbb9bef2 for instance a28d4572-3bd6-4ddb-8542-b17869c57da5 on nch2-master-1 Jun 18 22:20:59.652801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:59.658446 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3f83bdc6-8a48-443a-a1d6-6c936ef4571c req-419c51bf-4066-4fa0-9500-1512a20d8c17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086422 Jun 18 22:20:59.660968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2204/4426] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:20:59.683364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:20:59.700073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:20:59.701816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:20:59.731564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:59.732695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:20:59.736564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:20:59.738377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:00.060803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:00.073330 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da894354-3e16-417a-a97b-c5ddb0ab2125 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1546 microversion: 2.1 time: 0.505798 Jun 18 22:21:00.073945 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2223/4427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:59 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1546 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:00.090323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:00.090941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:00.098619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:00.099066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:00.100103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:00.100738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:00.205120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:00.221936 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7797f4f7-7071-47db-a095-02a2b8e883a6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 200 len: 1517 microversion: 2.1 time: 0.539627 Jun 18 22:21:00.222758 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2205/4428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:20:59 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 1517 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:00.227983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:00.228604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:00.250455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:00.256091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:00.257365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:00.257817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:01.061362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:01.077503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:01.086122 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc098e91-0ad8-44d0-993b-6cc85ed14e9a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1546 microversion: 2.1 time: 0.999559 Jun 18 22:21:01.087144 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2224/4429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:00 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1546 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:01.100316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:01.103469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:01.106381 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8b910d96-6cf1-47ce-922f-5833067ced5e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.882417 Jun 18 22:21:01.107511 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2206/4430] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:00 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:01.117248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:01.121793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:01.145959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:01.160039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:01.166912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:01.168335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:01.367302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b2d67e7f-16cc-4911-a739-3544cb72f212 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Action: 'create', calling method: .version_select at 0x7fea0797b4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-907351783"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:01.739164 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b2d67e7f-16cc-4911-a739-3544cb72f212 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.650174 Jun 18 22:21:01.740183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2225/4431] 10.222.0.30 () {60 vars in 1154 bytes} [Sat Jun 18 22:21:01 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 652 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 18 22:21:01.752049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-689072764", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c338c1-54d0-4b94-9891-fcb2729daf72"}], "security_groups": [{"name": "tempest-securitygroup--222563401"}], "key_name": "tempest-keypair-404588194", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:01.888061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:01.917169 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-715da00b-3766-4ae9-a945-31f866464be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.805849 Jun 18 22:21:01.918393 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2207/4432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:01 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:01.923274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-888800d7-56dc-450b-989a-985a73f44dbb req-27ca3b73-ce43-4de1-8640-befa58f0433e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636d790b-ebcf-4e9c-98c4-1f631cbd88c0", "tag": "4fccbd21-0045-4ff3-a73f-8b715b5b472d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:01.934457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-888800d7-56dc-450b-989a-985a73f44dbb req-27ca3b73-ce43-4de1-8640-befa58f0433e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:01.934915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-888800d7-56dc-450b-989a-985a73f44dbb req-27ca3b73-ce43-4de1-8640-befa58f0433e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:01.953265 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-888800d7-56dc-450b-989a-985a73f44dbb req-27ca3b73-ce43-4de1-8640-befa58f0433e service nova] Creating event network-changed:4fccbd21-0045-4ff3-a73f-8b715b5b472d for instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 on nch2-master-1 Jun 18 22:21:01.960385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-888800d7-56dc-450b-989a-985a73f44dbb req-27ca3b73-ce43-4de1-8640-befa58f0433e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040520 Jun 18 22:21:01.961687 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2208/4433] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:01.967830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:01.968712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:01.975445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:01.975911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:01.976929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:01.977688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:01.999624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e HTTP/1.1 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'a983d93d-70e3-4f93-bcf7-2d241c8b983e'} Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:02.001394 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:02.006062 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:02.006062 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:02.006062 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:02.006062 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:02.006062 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:21:02.006062 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:02.007453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:02.008821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b7dec228-c809-4e9d-a4d2-ae0d6a3a885b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 404 len: 111 microversion: 2.1 time: 0.045547 Jun 18 22:21:02.019942 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2209/4434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:01 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:02.024216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b5e0bb3-ccdd-491d-bd0b-a59d91dc9e28 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea14278c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:02.060677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] validate_networks() for [('b8c338c1-54d0-4b94-9891-fcb2729daf72', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:21:02.120660 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b5e0bb3-ccdd-491d-bd0b-a59d91dc9e28 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 200 len: 337 microversion: 2.1 time: 0.099578 Jun 18 22:21:02.121949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2210/4435] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:02 2022] GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:02.127063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-24aa28b0-6723-4daa-ba88-edcaae2b401e req-ac37459c-ede9-4767-9565-cc1e7a3c7ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55610324-3c5b-4d74-bd72-d0b8419a2464", "tag": "a42d07e7-1972-4323-9996-1fbbc03f8092"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:02.138180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-24aa28b0-6723-4daa-ba88-edcaae2b401e req-ac37459c-ede9-4767-9565-cc1e7a3c7ec9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:02.139057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-24aa28b0-6723-4daa-ba88-edcaae2b401e req-ac37459c-ede9-4767-9565-cc1e7a3c7ec9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:02.143804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:02.153303 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-24aa28b0-6723-4daa-ba88-edcaae2b401e req-ac37459c-ede9-4767-9565-cc1e7a3c7ec9 service nova] Creating event network-changed:a42d07e7-1972-4323-9996-1fbbc03f8092 for instance 55610324-3c5b-4d74-bd72-d0b8419a2464 on nch1-master-1 Jun 18 22:21:02.158847 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-24aa28b0-6723-4daa-ba88-edcaae2b401e req-ac37459c-ede9-4767-9565-cc1e7a3c7ec9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035455 Jun 18 22:21:02.159809 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2211/4436] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:02.165852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:02.166703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:02.175685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:02.176246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:02.177380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:02.178155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:02.626493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:02.636220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:02.637809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:02.639029 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06a17661-20e5-4c54-a5bd-e66991fca13c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.477819 Jun 18 22:21:02.640274 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2212/4437] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:02 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:02.670731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1403895247", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "7a2fabf6-7223-4939-9ce8-43290924a94f"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:02.704828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:02.773851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] validate_networks() for [('7a2fabf6-7223-4939-9ce8-43290924a94f', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:21:03.571737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:21:03.572841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:21:03.573532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:21:03.573946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:21:03.575107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:21:03.588189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:03.589087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:03.589903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:03.590340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:03.613889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:21:03.620829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:21:03.660568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:21:03.663332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:21:03.764518 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0dee751e-ae79-4879-99dd-e2fd0f2c64f5 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.022555 Jun 18 22:21:03.766865 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2226/4438] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:21:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:21:03.772597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:03.773836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:03.782857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:03.784184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:03.785185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:03.786317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.260232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:04.268764 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18d9f1be-804a-4ab8-9acf-30b4356e21e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.500294 Jun 18 22:21:04.278267 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2227/4439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:03 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:04.283794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7fffe75-ea70-40d4-b7e9-cad60c26505c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea19bccaf0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:04.335844 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7fffe75-ea70-40d4-b7e9-cad60c26505c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 200 len: 338 microversion: 2.1 time: 0.056055 Jun 18 22:21:04.344926 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2228/4440] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:04 2022] GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 338 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:04.350676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:04.351571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:04.360544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.362289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.363509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.364320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.385532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:21:04.386551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:21:04.387220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:21:04.387862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:21:04.388354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:21:04.415907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.416363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.417198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.417869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.436294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:21:04.441940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Getting quotas for user 20c4f7872035427d9bfb6a6ecfb7a0da and project 28c54796fc944347a190465d4c0732a8. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:21:04.455726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:21:04.458079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:21:04.507034 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59656983-2a1d-4d85-ad8e-ff293cdae1f2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.865393 Jun 18 22:21:04.507766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2213/4441] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:21:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:21:04.512320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:04.513477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:04.520210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.520980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.522118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.522743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.631573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:04.642777 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c90d2a1f-63a9-4913-9259-b8cf6b2701f3 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1244 microversion: 2.1 time: 0.133884 Jun 18 22:21:04.653960 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2214/4442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:04 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1244 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:04.660815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-92d49fac-55da-437f-bf08-cc53e399cd83 req-686361cb-4a0f-4411-85d1-49448a28b2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a983d93d-70e3-4f93-bcf7-2d241c8b983e", "name": "network-vif-deleted", "tag": "399e5f37-2ddf-4da4-9c1d-12f839a8b7b9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:04.670185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-92d49fac-55da-437f-bf08-cc53e399cd83 req-686361cb-4a0f-4411-85d1-49448a28b2bb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:04.670639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-92d49fac-55da-437f-bf08-cc53e399cd83 req-686361cb-4a0f-4411-85d1-49448a28b2bb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:04.700081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-92d49fac-55da-437f-bf08-cc53e399cd83 req-686361cb-4a0f-4411-85d1-49448a28b2bb service nova] Creating event network-vif-deleted:399e5f37-2ddf-4da4-9c1d-12f839a8b7b9 for instance a983d93d-70e3-4f93-bcf7-2d241c8b983e on nch1-master-1 Jun 18 22:21:04.710550 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-92d49fac-55da-437f-bf08-cc53e399cd83 req-686361cb-4a0f-4411-85d1-49448a28b2bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051399 Jun 18 22:21:04.715961 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2215/4443] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:04.731289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-28622f41-1a95-4918-895c-1e74c5161c52 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Action: 'create', calling method: .version_select at 0x7fea14acadc0>, body: {"snapshot": {"volume_id": "8d98f64f-6de5-4ca6-9da0-237fd3ad8387", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-253252264"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:04.783090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:04.798023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:04.799554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:04.800789 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-427623ae-558c-4811-910b-c2c31f5d57fe tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.454375 Jun 18 22:21:04.813229 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2229/4444] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:04 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:04.836664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9ea10fd0-9d07-47a0-a442-f18733d2a001 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:04.846022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9ea10fd0-9d07-47a0-a442-f18733d2a001 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:05.100887 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-28622f41-1a95-4918-895c-1e74c5161c52 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.381284 Jun 18 22:21:05.113236 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2216/4445] 10.222.0.30 () {60 vars in 1161 bytes} [Sat Jun 18 22:21:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:05.122033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9ea10fd0-9d07-47a0-a442-f18733d2a001 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:05.130775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ec4fb95-a1cc-4538-aa6b-167cb303543c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea145a1940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:05.130991 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9ea10fd0-9d07-47a0-a442-f18733d2a001 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1209 microversion: 2.1 time: 0.313858 Jun 18 22:21:05.131729 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2230/4446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:04 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1209 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:05.222353 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ec4fb95-a1cc-4538-aa6b-167cb303543c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569" status: 200 len: 286 microversion: 2.1 time: 0.101117 Jun 18 22:21:05.223111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2217/4447] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:21:05 2022] GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:05.236672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab06ac17-d577-48e2-89a0-186d1dcd5a05 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea1423ba60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:05.291884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab06ac17-d577-48e2-89a0-186d1dcd5a05 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.062310 Jun 18 22:21:05.292585 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2231/4448] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Jun 18 22:21:05 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:05.295413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:05.296204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:05.307142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-91d32274-3309-4ee5-bf83-fb7aed372d39 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea07929790>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:05.333937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.335467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.339932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.353087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.398337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-91d32274-3309-4ee5-bf83-fb7aed372d39 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569" status: 200 len: 286 microversion: 2.1 time: 0.098964 Jun 18 22:21:05.399558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2232/4449] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:21:05 2022] GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:05.473024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d1711be4-6b60-46ae-9f7f-2951c6087f59 req-fbff9329-ae47-4d49-8348-cc46f665a9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "name": "network-vif-plugged", "status": "completed", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:05.496808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d1711be4-6b60-46ae-9f7f-2951c6087f59 req-fbff9329-ae47-4d49-8348-cc46f665a9f0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.497701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d1711be4-6b60-46ae-9f7f-2951c6087f59 req-fbff9329-ae47-4d49-8348-cc46f665a9f0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.516298 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d1711be4-6b60-46ae-9f7f-2951c6087f59 req-fbff9329-ae47-4d49-8348-cc46f665a9f0 service nova] Creating event network-vif-plugged:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:21:05.522470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d1711be4-6b60-46ae-9f7f-2951c6087f59 req-fbff9329-ae47-4d49-8348-cc46f665a9f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053727 Jun 18 22:21:05.523151 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2233/4450] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:21:05.660866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:05.662060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:05.676283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.676742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.677565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.678005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.759647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:05.775635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb6001ab-fdca-4a2e-81b4-27593028bf4a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.493880 Jun 18 22:21:05.777656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2218/4451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:05 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:05.832440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:05.833750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:05.845082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.846238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.847352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:05.848128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:05.940627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:05.955204 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8f13fd9-f7e4-41a1-92c0-34430ea49f9e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1292 microversion: 2.1 time: 0.298257 Jun 18 22:21:05.969171 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2234/4452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:05 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1292 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:06.149441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:06.150237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:06.159056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:06.162818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:06.164945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:06.165430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:06.724371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:06.735612 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30648123-2d57-4127-bebc-ba292e8807ce tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1269 microversion: 2.1 time: 0.589382 Jun 18 22:21:06.737799 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2235/4453] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:06 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1269 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:06.744115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b07afe7f-0655-4545-92b6-6a6a94b8555d tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea1423b040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:06.806329 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b07afe7f-0655-4545-92b6-6a6a94b8555d tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569" status: 200 len: 287 microversion: 2.1 time: 0.066927 Jun 18 22:21:06.809522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2236/4454] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:21:06 2022] GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:06.817568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:06.820724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:06.837748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:06.838534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:06.842251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:06.842925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:07.056997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:07.071549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:07.074323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:07.074882 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5fb4659a-bb2e-44b4-aeef-80ed0e3d50fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 1.247107 Jun 18 22:21:07.087194 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2219/4455] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:05 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:21:07.095958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73e1b745-8b95-4397-846f-fecd43aadf7f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea14c378b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:07.170579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:07.179676 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9629b6a9-513c-4ce8-8815-147ae6421f55 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.368639 Jun 18 22:21:07.181869 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2237/4456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:06 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:07.187216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:07.188095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:07.196575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:07.197697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:07.198832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:07.199474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:07.208778 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73e1b745-8b95-4397-846f-fecd43aadf7f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569" status: 202 len: 0 microversion: 2.1 time: 0.118485 Jun 18 22:21:07.209750 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2220/4457] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:21:07 2022] DELETE /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:07.218753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15a854c8-0506-4e47-901e-859945676ea7 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea140c7040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:07.264825 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15a854c8-0506-4e47-901e-859945676ea7 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569" status: 200 len: 286 microversion: 2.1 time: 0.050887 Jun 18 22:21:07.265530 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2221/4458] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:21:07 2022] GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:21:07.290866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:07.299785 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a2cec00-e249-46cb-84ea-8acead39bca1 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1298 microversion: 2.1 time: 0.116442 Jun 18 22:21:07.306586 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2238/4459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:07 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:07.756194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:07.756815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:07.773261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:07.773765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:07.776235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:07.776870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:07.885888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:07.906099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6ef43a0a-e86c-4280-a944-417e9bdf15ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1267 microversion: 2.1 time: 0.153085 Jun 18 22:21:07.908409 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2222/4460] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:07 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:08.081511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cbe0da6b-d5a0-4e2b-bb29-4948e5bf99ef req-ce56b5b8-059b-4560-b39e-d0d2735c0394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d4572-3bd6-4ddb-8542-b17869c57da5", "name": "network-vif-plugged", "status": "completed", "tag": "823b3203-5977-4ff8-be98-8591bbb9bef2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:08.108014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:08.110160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:08.115676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cbe0da6b-d5a0-4e2b-bb29-4948e5bf99ef req-ce56b5b8-059b-4560-b39e-d0d2735c0394 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:08.116085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cbe0da6b-d5a0-4e2b-bb29-4948e5bf99ef req-ce56b5b8-059b-4560-b39e-d0d2735c0394 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:08.139445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:08.147057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:08.150499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:08.151040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:08.158913 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cbe0da6b-d5a0-4e2b-bb29-4948e5bf99ef req-ce56b5b8-059b-4560-b39e-d0d2735c0394 service nova] Creating event network-vif-plugged:823b3203-5977-4ff8-be98-8591bbb9bef2 for instance a28d4572-3bd6-4ddb-8542-b17869c57da5 on nch2-master-1 Jun 18 22:21:08.183409 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cbe0da6b-d5a0-4e2b-bb29-4948e5bf99ef req-ce56b5b8-059b-4560-b39e-d0d2735c0394 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090596 Jun 18 22:21:08.184111 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2239/4461] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:08.209871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:08.210600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:08.235326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:08.251963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:08.252864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:08.253349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:08.845132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:08.867822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:08.873631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:08.878367 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d34904e-8186-4280-83b4-b6a3671193f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1807 microversion: 2.20 time: 0.777740 Jun 18 22:21:08.880786 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2223/4462] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:08 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1807 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:08.888361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10c16edc-74ea-4cc1-b116-a61616ac7f8c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea077ff8b0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:08.942995 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-10c16edc-74ea-4cc1-b116-a61616ac7f8c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] HTTP exception thrown: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. Jun 18 22:21:08.956674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:08.965331 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba048b07-75a9-42d6-af0f-dcf6301ef878 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.770679 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10c16edc-74ea-4cc1-b116-a61616ac7f8c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Request method failure captured: Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 HTTP/1.1 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk_MyRgCKGZV28fZehL-fkCeIBeK7XpxyGoaoQZGxEP8IfwmBw50dH6Y9AWCln4njowFTG-tcJ75BSIJZRMXbcC4eU4wgBtd_JtLk6PKycUqEtZ6u8XOlemEGe-a4dE95USIza5rsZLt14b8A-34ZFQnXEVRELkXyNWFtfQfEv1aVJ4 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66c346c784cb4027a7c412b200d749ab", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7780fd767b13484cb1a536802ad3c168 Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: exception: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '5aace7c3-f463-49ca-b8ff-1687f8875569'} Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. (HTTP 404) (Request-ID: req-b2d64b4b-6d1a-4f7a-8edf-00fb2c03bdfb) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:21:08.967747 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10c16edc-74ea-4cc1-b116-a61616ac7f8c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Returning 404 to user: Snapshot 5aace7c3-f463-49ca-b8ff-1687f8875569 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:08.972606 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10c16edc-74ea-4cc1-b116-a61616ac7f8c tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569" status: 404 len: 111 microversion: 2.1 time: 0.090374 Jun 18 22:21:08.978030 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2224/4463] 10.222.0.30 () {58 vars in 1250 bytes} [Sat Jun 18 22:21:08 2022] GET /compute/v2.1/os-snapshots/5aace7c3-f463-49ca-b8ff-1687f8875569 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:08.981386 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2240/4464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:08 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:08.986711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:08.990362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:08.994861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:09.005925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:09.015796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:09.016597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:09.019884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:09.020605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:09.020825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:09.021334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:09.025961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:09.026603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:09.642128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:09.665633 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ffb56cb7-f7af-4387-9eb3-5931f4ba165f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.669873 Jun 18 22:21:09.683351 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2241/4465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:08 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:09.690827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:09.691634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7927c4f0-6860-4371-8c76-965dd76c7e0e tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea079bb310>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:09.700181 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39e2a236-75ce-46dd-afed-1df697846235 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.720755 Jun 18 22:21:09.710272 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2225/4466] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:08 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:09.829749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7927c4f0-6860-4371-8c76-965dd76c7e0e tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 202 len: 0 microversion: 2.1 time: 0.144511 Jun 18 22:21:09.833221 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2242/4467] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:21:09 2022] DELETE /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:09.840360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a2f3eea-081d-48be-8098-8bb4593f2ea8 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea1414d280>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:09.895861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:09.896491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:09.911967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:09.912422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:09.913340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:09.913703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:09.921471 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a2f3eea-081d-48be-8098-8bb4593f2ea8 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 200 len: 337 microversion: 2.1 time: 0.086729 Jun 18 22:21:09.923227 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2226/4468] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:09 2022] GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:10.001583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:10.003935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:10.036981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.039920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.040625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.043159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.283148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:10.299315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:10.301643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:10.303529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d998e9d-55fe-4d5f-b2b8-5cd8e53d8c07 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1794 microversion: 2.20 time: 0.411697 Jun 18 22:21:10.304596 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2243/4469] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:09 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1794 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:10.311893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2d6f11d1-9e68-4325-ac1a-a02c94566302 req-5bd3080d-783e-4370-bc27-442933ba01c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636d790b-ebcf-4e9c-98c4-1f631cbd88c0", "name": "network-vif-plugged", "status": "completed", "tag": "4fccbd21-0045-4ff3-a73f-8b715b5b472d"}, {"server_uuid": "55610324-3c5b-4d74-bd72-d0b8419a2464", "name": "network-vif-plugged", "status": "completed", "tag": "a42d07e7-1972-4323-9996-1fbbc03f8092"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:10.332661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2d6f11d1-9e68-4325-ac1a-a02c94566302 req-5bd3080d-783e-4370-bc27-442933ba01c3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.333628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2d6f11d1-9e68-4325-ac1a-a02c94566302 req-5bd3080d-783e-4370-bc27-442933ba01c3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.352719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:10.364597 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d661945-0a67-4025-8386-3cf5410ee993 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.370858 Jun 18 22:21:10.364863 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2d6f11d1-9e68-4325-ac1a-a02c94566302 req-5bd3080d-783e-4370-bc27-442933ba01c3 service nova] Creating event network-vif-plugged:4fccbd21-0045-4ff3-a73f-8b715b5b472d for instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 on nch2-master-1 Jun 18 22:21:10.365631 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2d6f11d1-9e68-4325-ac1a-a02c94566302 req-5bd3080d-783e-4370-bc27-442933ba01c3 service nova] Creating event network-vif-plugged:a42d07e7-1972-4323-9996-1fbbc03f8092 for instance 55610324-3c5b-4d74-bd72-d0b8419a2464 on nch1-master-1 Jun 18 22:21:10.365768 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2227/4470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:09 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:10.379279 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2d6f11d1-9e68-4325-ac1a-a02c94566302 req-5bd3080d-783e-4370-bc27-442933ba01c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072601 Jun 18 22:21:10.380412 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2244/4471] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:10.683173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:10.684461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:10.708605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.709284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.710167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.710611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.717606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:10.718314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:10.727655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.729079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.729892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:10.730332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:10.739546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:10.975246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:10.992872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4c0cf66-f73a-4ed7-884f-3c576535428f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.313563 Jun 18 22:21:10.994895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2228/4472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:10 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:11.007259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fd7ac4c-5d28-44f8-b541-ec7d70efab73 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea140bc700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:11.018585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:11.028229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c21fe16e-eed2-4bad-8144-669b0098f4ff tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.314778 Jun 18 22:21:11.039536 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2245/4473] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:10 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:11.042589 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-7fd7ac4c-5d28-44f8-b541-ec7d70efab73 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] HTTP exception thrown: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fd7ac4c-5d28-44f8-b541-ec7d70efab73 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Request method failure captured: Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 HTTP/1.1 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk_MyRgCKGZV28fZehL-fkCeIBeK7XpxyGoaoQZGxEP8IfwmBw50dH6Y9AWCln4njowFTG-tcJ75BSIJZRMXbcC4eU4wgBtd_JtLk6PKycUqEtZ6u8XOlemEGe-a4dE95USIza5rsZLt14b8A-34ZFQnXEVRELkXyNWFtfQfEv1aVJ4 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66c346c784cb4027a7c412b200d749ab", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7780fd767b13484cb1a536802ad3c168 Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: exception: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8d98f64f-6de5-4ca6-9da0-237fd3ad8387'} Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. (HTTP 404) (Request-ID: req-3efd64fc-5251-4203-99e2-be7fee23bb0c) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:21:11.045122 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fd7ac4c-5d28-44f8-b541-ec7d70efab73 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Returning 404 to user: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:11.049243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fd7ac4c-5d28-44f8-b541-ec7d70efab73 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 404 len: 109 microversion: 2.1 time: 0.050505 Jun 18 22:21:11.051611 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2229/4474] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:10 2022] GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:11.058164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccf95173-a25d-49d7-947a-d9343b64450f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea1438c280>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:11.089892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ccf95173-a25d-49d7-947a-d9343b64450f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] HTTP exception thrown: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccf95173-a25d-49d7-947a-d9343b64450f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Request method failure captured: Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 HTTP/1.1 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk_MyRgCKGZV28fZehL-fkCeIBeK7XpxyGoaoQZGxEP8IfwmBw50dH6Y9AWCln4njowFTG-tcJ75BSIJZRMXbcC4eU4wgBtd_JtLk6PKycUqEtZ6u8XOlemEGe-a4dE95USIza5rsZLt14b8A-34ZFQnXEVRELkXyNWFtfQfEv1aVJ4 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66c346c784cb4027a7c412b200d749ab", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 7780fd767b13484cb1a536802ad3c168 Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: exception: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8d98f64f-6de5-4ca6-9da0-237fd3ad8387'} Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. (HTTP 404) (Request-ID: req-2a00b81a-d897-43db-af95-0775478ea8a7) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:21:11.092024 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccf95173-a25d-49d7-947a-d9343b64450f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Returning 404 to user: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:11.096606 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ccf95173-a25d-49d7-947a-d9343b64450f tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 404 len: 109 microversion: 2.1 time: 0.039685 Jun 18 22:21:11.099550 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2246/4475] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:21:11 2022] DELETE /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:11.102689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ddd0435c-81a1-4c64-8dce-3baca6c01964 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Calling method '.version_select at 0x7fea143770d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:11.134425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ddd0435c-81a1-4c64-8dce-3baca6c01964 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] HTTP exception thrown: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ddd0435c-81a1-4c64-8dce-3baca6c01964 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Request method failure captured: Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 HTTP/1.1 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk_MyRgCKGZV28fZehL-fkCeIBeK7XpxyGoaoQZGxEP8IfwmBw50dH6Y9AWCln4njowFTG-tcJ75BSIJZRMXbcC4eU4wgBtd_JtLk6PKycUqEtZ6u8XOlemEGe-a4dE95USIza5rsZLt14b8A-34ZFQnXEVRELkXyNWFtfQfEv1aVJ4 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/66c346c784cb4027a7c412b200d749ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_66c346c784cb4027a7c412b200d749ab", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 66c346c784cb4027a7c412b200d749ab Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-377884937 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7780fd767b13484cb1a536802ad3c168 Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesSnapshotsTestJSON-377884937-project Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: exception: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8d98f64f-6de5-4ca6-9da0-237fd3ad8387'} Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. (HTTP 404) (Request-ID: req-0caa3096-ba13-40a5-b25e-72b9f54a379e) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:21:11.136949 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ddd0435c-81a1-4c64-8dce-3baca6c01964 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] Returning 404 to user: Volume 8d98f64f-6de5-4ca6-9da0-237fd3ad8387 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:11.141306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ddd0435c-81a1-4c64-8dce-3baca6c01964 tempest-VolumesSnapshotsTestJSON-377884937 tempest-VolumesSnapshotsTestJSON-377884937-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387" status: 404 len: 109 microversion: 2.1 time: 0.040477 Jun 18 22:21:11.146374 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2230/4476] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:11 2022] GET /compute/v2.1/os-volumes/8d98f64f-6de5-4ca6-9da0-237fd3ad8387 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:11.385022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:11.386105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:11.395457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:11.396118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:11.397286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:11.397733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:11.553004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:11.564172 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8c058b97-6b73-4162-9dda-753107c5fe12 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1320 microversion: 2.1 time: 0.185293 Jun 18 22:21:11.564833 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2247/4477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:11 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:11.839644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2fc16370-9887-41d7-8924-c108167aade7 req-8d18e457-1e52-4457-8b21-995cacd33459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "242f9f7c-b889-43f2-bc08-39e9b7c6e606", "tag": "69c6e34b-14be-45d0-87e9-e40df503c4f5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:11.880914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2fc16370-9887-41d7-8924-c108167aade7 req-8d18e457-1e52-4457-8b21-995cacd33459 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:11.881655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2fc16370-9887-41d7-8924-c108167aade7 req-8d18e457-1e52-4457-8b21-995cacd33459 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:11.928302 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2fc16370-9887-41d7-8924-c108167aade7 req-8d18e457-1e52-4457-8b21-995cacd33459 service nova] Creating event network-changed:69c6e34b-14be-45d0-87e9-e40df503c4f5 for instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 on nch1-master-1 Jun 18 22:21:11.938947 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2fc16370-9887-41d7-8924-c108167aade7 req-8d18e457-1e52-4457-8b21-995cacd33459 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102645 Jun 18 22:21:11.940508 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2231/4478] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:12.014528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:12.015900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:12.035809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.036692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.039017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.040131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.050966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:12.056145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:12.115742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.118052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.120853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.122337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.399236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:12.408039 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4672195c-0872-4796-bb8e-1d9364380f8a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.399739 Jun 18 22:21:12.408925 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2248/4479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:12 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:12.426820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:12.436902 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5227a354-4bf1-4653-b71a-272ef868d84d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.391455 Jun 18 22:21:12.437709 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2232/4480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:12 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:12.582007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:12.582431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:12.594094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.594549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.595363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.595986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.906589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:12.923238 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bba71757-de3d-42ab-b2bb-8a5670f2a955 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1512 microversion: 2.1 time: 0.344165 Jun 18 22:21:12.927309 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2249/4481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:12 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1512 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:12.958167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:12.960841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:12.973622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.974426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:12.975648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:12.976257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.217287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:13.226061 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ecbee197-2671-4d0e-a2cf-60f6db7c5292 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1511 microversion: 2.1 time: 0.276403 Jun 18 22:21:13.226891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2233/4482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:12 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:13.242999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:13.243622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:13.250083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.250643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.251305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.251749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.427321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:13.433060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:13.444652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.445362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.449171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.450114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.483231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:13.492494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7168e42f-f9a2-416f-b79e-1ad0a9962279 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 200 len: 1512 microversion: 2.1 time: 0.253581 Jun 18 22:21:13.502791 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2250/4483] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:13 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:13.507996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:13.508621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:13.517872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.518419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.519318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.519971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.603827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:13.781571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:13.789782 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c25af93a-b47e-4e41-828a-bc11e9c72dbb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.368500 Jun 18 22:21:13.790352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2234/4484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:13 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:13.795655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:13.801138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:13.802075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:13.813804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:13.814651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:13.818037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.818503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.819303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.819742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.823624 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cb6b9f67-8358-4d17-8d38-df9daaafb36d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.319423 Jun 18 22:21:13.824445 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2251/4485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:13 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:13.911866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:13.958428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-73f25dd8-4624-4205-87be-bfa85c37ce5b req-1ba1d322-d4a1-467d-b412-c8dafb5b5510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc927fb6-524d-4101-bc72-5939b8505361", "tag": "e5c36ec9-9ac0-4532-ba55-3eb65c2272af"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:13.971289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-73f25dd8-4624-4205-87be-bfa85c37ce5b req-1ba1d322-d4a1-467d-b412-c8dafb5b5510 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:13.972015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-73f25dd8-4624-4205-87be-bfa85c37ce5b req-1ba1d322-d4a1-467d-b412-c8dafb5b5510 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:13.985758 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-73f25dd8-4624-4205-87be-bfa85c37ce5b req-1ba1d322-d4a1-467d-b412-c8dafb5b5510 service nova] Creating event network-changed:e5c36ec9-9ac0-4532-ba55-3eb65c2272af for instance bc927fb6-524d-4101-bc72-5939b8505361 on nch1-master-1 Jun 18 22:21:13.991202 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-73f25dd8-4624-4205-87be-bfa85c37ce5b req-1ba1d322-d4a1-467d-b412-c8dafb5b5510 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036321 Jun 18 22:21:13.991793 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2252/4486] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:13.996682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:14.003123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.003601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.135653 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ebd48898-07a5-4ecc-bee5-0e71616cb54a tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.344216 Jun 18 22:21:14.136328 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2235/4487] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:21:13 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:14.154595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:14.158494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:14.159412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-654063676', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:14.165247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.165879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.166833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.167552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.265750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:14.330203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=19 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:14.334450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:14.340895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.341392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.462385 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a8b498f-9c34-4cd8-8c92-166b681733d7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-654063676" status: 200 len: 1514 microversion: 2.1 time: 0.312031 Jun 18 22:21:14.463021 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2253/4488] 10.222.0.30 () {58 vars in 1260 bytes} [Sat Jun 18 22:21:14 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-654063676 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:14.479905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:14.483326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:14.484179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:14.489976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.490621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.491425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.492033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.541944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-07b61b07-e169-455c-b565-c224f6481b04 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea14526310>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:14.595371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:14.597612 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-07b61b07-e169-455c-b565-c224f6481b04 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/75820544-c433-4f43-a9ca-ce14d20468bc" status: 200 len: 343 microversion: 2.1 time: 0.059564 Jun 18 22:21:14.598161 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2254/4489] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:14 2022] GET /compute/v2.1/os-volumes/75820544-c433-4f43-a9ca-ce14d20468bc => generated 343 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:14.673870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:14.680954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.681453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.808145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:14.809026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:14.820174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.820893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.821904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.822885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.838983 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c452116e-5fd7-4e66-821c-11f2502dfd33 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.362941 Jun 18 22:21:14.839881 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2236/4490] 10.222.0.30 () {58 vars in 1172 bytes} [Sat Jun 18 22:21:14 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:14.845157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:14.845995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:14.856888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.857497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.858460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:14.858946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:14.863653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:15.064303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.077626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-495b213b-8c90-495a-a489-235fcd6a80d8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.273359 Jun 18 22:21:15.078579 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2255/4491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:14 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:15.094263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.100457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.101917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.compute.servers [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Removing options 'limit' from query {{(pid=130902) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 18 22:21:15.103908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.111093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.111714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.112671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.113325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.119295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.140869 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8f9f269d-ef69-4fb7-a2b0-d56dfc00e61e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.299355 Jun 18 22:21:15.142049 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2237/4492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:14 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:15.160410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.167306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.167873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.297200 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5fca01b7-7b4a-4b95-9a84-ad9d5e840bb2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.206852 Jun 18 22:21:15.301068 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2256/4493] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:15.314901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.318310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.319082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.328523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.328523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.328523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.328523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.355707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:15.388379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f0ec1b9-7498-4216-b2e7-317b1b0243c7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.077387 Jun 18 22:21:15.388992 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2238/4494] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:15.401743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.405509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.406004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.compute.servers [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Removing options 'limit' from query {{(pid=130902) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 18 22:21:15.406735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.412393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.412837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.413656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.414089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.440552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:15.469067 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52b77e82-ab43-404d-83c6-3bda24cccc91 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.072321 Jun 18 22:21:15.469654 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2257/4495] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:15.480291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.483760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.484553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.490172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.490736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.491549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.491989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.518856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:15.546372 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-717624c3-7951-439d-9d44-618bbee63876 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.069973 Jun 18 22:21:15.546967 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2239/4496] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers => generated 1010 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:15.558537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.562191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.562945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.575403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.575936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.576861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.577551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.661811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:15.723593 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41dbd5c5-41cc-4cae-ac25-cc3c671d153d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.168915 Jun 18 22:21:15.724193 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2258/4497] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:15.735869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.739197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.739650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.servers [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Removing options 'limit' from query {{(pid=130903) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 18 22:21:15.740306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.746144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.746610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.747393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.748076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.773190 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-415e9e9c-d9f5-4f07-a612-7cf93a1e9acd tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.040983 Jun 18 22:21:15.773990 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2240/4498] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:15.785341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:15.788671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:15.789351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-654063676', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:15.794646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.795197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.795977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.796636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.878490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:15.936218 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-987f9e57-7f27-4719-8ee8-cfe3496ed4d0 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-654063676" status: 200 len: 345 microversion: 2.1 time: 0.154773 Jun 18 22:21:15.936814 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2259/4499] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-654063676 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:15.949594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e5fffcea-cee0-4004-8195-b8080e597405 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:15.956528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5fffcea-cee0-4004-8195-b8080e597405 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:15.956988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e5fffcea-cee0-4004-8195-b8080e597405 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:15.981934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e5fffcea-cee0-4004-8195-b8080e597405 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Going to try to stop instance {{(pid=130903) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:21:16.000931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab893496-7cfa-4523-b90f-9d7dcc7bc34e tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea079bb430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:16.041837 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e5fffcea-cee0-4004-8195-b8080e597405 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "POST /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5/action" status: 202 len: 0 microversion: 2.1 time: 0.096982 Jun 18 22:21:16.042849 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2241/4500] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:21:15 2022] POST /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:16.051417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:16.052190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:16.059403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.059942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.061178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.062199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.073475 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab893496-7cfa-4523-b90f-9d7dcc7bc34e tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/504cf1d0-bff8-4f44-b1a3-43b28acf5c5f" status: 200 len: 344 microversion: 2.1 time: 0.076625 Jun 18 22:21:16.074142 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2260/4501] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:15 2022] GET /compute/v2.1/os-volumes/504cf1d0-bff8-4f44-b1a3-43b28acf5c5f => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:16.081324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:16.083898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:16.089620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:16.092615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.093298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.094104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.094548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.221670 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5de8842a-8187-4f06-9aa5-1b1b54319e74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.144958 Jun 18 22:21:16.222841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2261/4502] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:21:16 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:16.230439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:16.232010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:16.240942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.241654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.242594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.244000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.245607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:16.254098 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bbc0e716-3adb-4beb-b87d-c0cb546a8492 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.207015 Jun 18 22:21:16.255324 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2242/4503] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:16 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:16.260516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:16.261501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:16.269363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.270158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.271309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.272021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.839343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:16.845961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:16.848674 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf20c1b0-d46d-4936-9a57-ac8c5e70ded5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.624125 Jun 18 22:21:16.849493 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2262/4504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:16 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:16.854182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:16.854958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:16.861647 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2076482b-c7c6-4864-b054-885f27e05b68 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.605081 Jun 18 22:21:16.862550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.862740 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2243/4505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:16 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:16.863348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.864135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:16.864576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:16.867872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:17.005580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:17.013172 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d6ae4d19-aa88-4fd2-9eae-4f0b8c83a8a6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1668 microversion: 2.1 time: 0.162502 Jun 18 22:21:17.014323 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2263/4506] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:16 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:17.272189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:17.272972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:17.280419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:17.280862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:17.281790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:17.282223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:17.566843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-863a4e3e-6eec-4643-9a73-f486ff0755e8 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea074bbb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:17.660105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-863a4e3e-6eec-4643-9a73-f486ff0755e8 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/661a0d7d-b4a9-4432-af16-c25e983dbedc" status: 200 len: 343 microversion: 2.1 time: 0.097089 Jun 18 22:21:17.660359 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2264/4507] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:21:17 2022] GET /compute/v2.1/os-volumes/661a0d7d-b4a9-4432-af16-c25e983dbedc => generated 343 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:17.672979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-49b4a180-3a1c-4cda-839e-e26297061ad7 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea14b84700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:17.780952 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-49b4a180-3a1c-4cda-839e-e26297061ad7 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.112816 Jun 18 22:21:17.781941 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2265/4508] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:21:17 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:17.794944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9559f05a-3a0c-458c-8ef5-fb54ac588079 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea0744c5e0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:17.893506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9559f05a-3a0c-458c-8ef5-fb54ac588079 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.103287 Jun 18 22:21:17.894683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2266/4509] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:21:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:21:17.900522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:17.901528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:17.909232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:17.910144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:17.911203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:17.911622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:17.978588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:17.986970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0d49d41f-af65-4eaf-b0de-680a493a23ce tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.718828 Jun 18 22:21:17.987849 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2244/4510] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:17 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:18.001989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.004898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:18.015042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:18.015490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:18.016401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:18.016992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:18.360717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:18.369361 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a33039c5-39fe-4982-86ff-9d5171750c9c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.473311 Jun 18 22:21:18.370109 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2267/4511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:17 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:18.375572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3e9e519-579f-4c4f-b6fd-bfd741b2e997 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea079bb430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.449364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:18.459311 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-71070b5d-e933-4926-93b2-47203719d9b6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.460525 Jun 18 22:21:18.460709 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2245/4512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:17 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:18.482583 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3e9e519-579f-4c4f-b6fd-bfd741b2e997 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.110618 Jun 18 22:21:18.482963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.483768 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2268/4513] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:18.484137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:18.493056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:18.493559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:18.494565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:18.495006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:18.496278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f2c7962-853d-487e-957a-4af506090e19 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea0744cd30>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.586468 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4f2c7962-853d-487e-957a-4af506090e19 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.095222 Jun 18 22:21:18.587042 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2269/4514] 10.222.0.30 () {58 vars in 1166 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:21:18.599092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9197dd5-8b4d-4c99-b299-2a4714fdabf2 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea079bb4c0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.683145 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9197dd5-8b4d-4c99-b299-2a4714fdabf2 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.088243 Jun 18 22:21:18.685435 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2270/4515] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:18.696786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f3d55558-19c6-4596-b062-d5e9ca36c380 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea0744c3a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.792504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f3d55558-19c6-4596-b062-d5e9ca36c380 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.099365 Jun 18 22:21:18.793118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2271/4516] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:18.799444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:18.804435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc8be2ea-c089-4bbb-9705-0cc87611533f tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea074653a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:18.807175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e375b4c0-93fb-4b1d-8f97-a665eb9ce647 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1668 microversion: 2.1 time: 0.329739 Jun 18 22:21:18.808991 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2246/4517] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1668 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:18.907599 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc8be2ea-c089-4bbb-9705-0cc87611533f tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.106783 Jun 18 22:21:18.908274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2272/4518] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:18.921600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18846766-7dae-4e05-aa69-7b3372b49b61 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] Calling method '.version_select at 0x7fea078e61f0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:19.004568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:19.005344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:19.006040 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-18846766-7dae-4e05-aa69-7b3372b49b61 tempest-VolumesTestJSON-1272162193 tempest-VolumesTestJSON-1272162193-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.089010 Jun 18 22:21:19.006829 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2247/4519] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:19.019353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.020592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.021430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.021956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.333242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:19.343221 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f46f339-dead-4c6a-a18c-21d2e731dd54 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.342994 Jun 18 22:21:19.354123 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2273/4520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:18 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:19.390887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:19.392496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:19.405446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.406256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.407582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.408231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.476610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:19.477411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:19.486992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.487813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.488784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.489413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.817589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:19.827374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7d7d68d-c55d-494a-8677-702bd428644d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.444140 Jun 18 22:21:19.828476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2248/4521] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:19 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:19.834131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8a307d22-d496-4f42-a7f0-e6eccc48c6d6 req-5a7c98c9-6764-4f07-b80b-38b59543c9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc927fb6-524d-4101-bc72-5939b8505361", "name": "network-vif-plugged", "status": "completed", "tag": "e5c36ec9-9ac0-4532-ba55-3eb65c2272af"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:19.846582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8a307d22-d496-4f42-a7f0-e6eccc48c6d6 req-5a7c98c9-6764-4f07-b80b-38b59543c9f2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.847293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8a307d22-d496-4f42-a7f0-e6eccc48c6d6 req-5a7c98c9-6764-4f07-b80b-38b59543c9f2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.862886 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8a307d22-d496-4f42-a7f0-e6eccc48c6d6 req-5a7c98c9-6764-4f07-b80b-38b59543c9f2 service nova] Creating event network-vif-plugged:e5c36ec9-9ac0-4532-ba55-3eb65c2272af for instance bc927fb6-524d-4101-bc72-5939b8505361 on nch1-master-1 Jun 18 22:21:19.868377 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8a307d22-d496-4f42-a7f0-e6eccc48c6d6 req-5a7c98c9-6764-4f07-b80b-38b59543c9f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038444 Jun 18 22:21:19.868974 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2249/4522] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:19.874863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:19.875935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:19.882745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.883400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:19.884370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:19.884959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:20.089979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:20.097724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-333a2a94-d6e3-43ee-af7e-211748cbeb1c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.625598 Jun 18 22:21:20.098302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2274/4523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:19 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:20.208582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:20.235728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8fc8898f-a6ff-4dbd-b439-ded7307bf8ed tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.365514 Jun 18 22:21:20.236326 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2250/4524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:19 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:20.362796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:20.364874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:20.372725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:20.373467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:20.374420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:20.375084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:20.524092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:20.532991 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de722b40-c1df-4c51-8228-4d93deb0ea14 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.175562 Jun 18 22:21:20.533733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2275/4525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:20 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:20.848632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:20.849518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:20.857453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:20.857890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:20.858658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:20.859100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:21.005701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:21.018850 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-43eee9fe-36fe-477e-a726-93feb386f57b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.175178 Jun 18 22:21:21.019443 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2251/4526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:20 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:21.114784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:21.115393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:21.122543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:21.122962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:21.123747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:21.124191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:21.260754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:21.269119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-53510183-df87-4786-a96b-33138d3e5660 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1365 microversion: 2.1 time: 0.158171 Jun 18 22:21:21.269751 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2276/4527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:21 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:21.551187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:21.551801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:21.558248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:21.558706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:21.559457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:21.559881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:21.756065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:21.765095 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09a97ed2-48e8-44c5-b467-64667c541bac tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.217725 Jun 18 22:21:21.774944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2252/4528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:21 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:21.888359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b721d146-4ea1-4242-bc66-fbc232ece3df req-e5e29da8-8a34-4d2d-9bb8-fbf3ba256581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242f9f7c-b889-43f2-bc08-39e9b7c6e606", "name": "network-vif-plugged", "status": "completed", "tag": "69c6e34b-14be-45d0-87e9-e40df503c4f5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:21.898139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b721d146-4ea1-4242-bc66-fbc232ece3df req-e5e29da8-8a34-4d2d-9bb8-fbf3ba256581 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:21.898913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b721d146-4ea1-4242-bc66-fbc232ece3df req-e5e29da8-8a34-4d2d-9bb8-fbf3ba256581 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:21.936016 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b721d146-4ea1-4242-bc66-fbc232ece3df req-e5e29da8-8a34-4d2d-9bb8-fbf3ba256581 service nova] Creating event network-vif-plugged:69c6e34b-14be-45d0-87e9-e40df503c4f5 for instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 on nch1-master-1 Jun 18 22:21:21.942143 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b721d146-4ea1-4242-bc66-fbc232ece3df req-e5e29da8-8a34-4d2d-9bb8-fbf3ba256581 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058903 Jun 18 22:21:21.942772 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2277/4529] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:22.036041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:22.037350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:22.045611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.046135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.047016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.047515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.226236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:22.235888 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-178098f2-1a95-4456-b069-923fa74a5e8b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.203936 Jun 18 22:21:22.236462 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2253/4530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:22 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:22.287764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:22.288512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:22.298713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.299172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.299958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.300414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.558655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:22.566775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b62250e1-1e7b-43ce-8535-d0ffb59800f0 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1556 microversion: 2.1 time: 0.284149 Jun 18 22:21:22.579194 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2278/4531] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:22 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1556 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:22.583558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:22.584197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:22.590660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.591121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.591940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.592596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.612231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:22.734486 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d46d300-2485-45e9-84a4-b2b081634e0d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154816 Jun 18 22:21:22.736310 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2254/4532] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:21:22 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:22.782651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:22.783279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:22.797169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.797631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:22.798429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:22.798863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:23.255547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:23.256910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:23.263924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:23.264470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:23.265353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:23.265879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:23.389064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:23.398837 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c37a61dc-19e0-4752-86e7-3dbb5af0bfed tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.620043 Jun 18 22:21:23.399605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2279/4533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:22 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:23.507597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:23.516086 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03cf8176-3ceb-4e42-9281-6ef6931d7f86 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1309 microversion: 2.1 time: 0.266777 Jun 18 22:21:23.516781 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2255/4534] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:23 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:24.112384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c47e3083-f751-4137-80f6-da72d3c50b83 req-c61d1258-89a1-4f15-b095-7855392530a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc927fb6-524d-4101-bc72-5939b8505361", "tag": "e5c36ec9-9ac0-4532-ba55-3eb65c2272af"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:24.128668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c47e3083-f751-4137-80f6-da72d3c50b83 req-c61d1258-89a1-4f15-b095-7855392530a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.141108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c47e3083-f751-4137-80f6-da72d3c50b83 req-c61d1258-89a1-4f15-b095-7855392530a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.158002 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c47e3083-f751-4137-80f6-da72d3c50b83 req-c61d1258-89a1-4f15-b095-7855392530a0 service nova] Creating event network-changed:e5c36ec9-9ac0-4532-ba55-3eb65c2272af for instance bc927fb6-524d-4101-bc72-5939b8505361 on nch1-master-1 Jun 18 22:21:24.163154 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c47e3083-f751-4137-80f6-da72d3c50b83 req-c61d1258-89a1-4f15-b095-7855392530a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057052 Jun 18 22:21:24.164924 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2280/4535] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:24.418528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:24.419143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:24.431805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.432271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.435079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.435505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.536051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:24.537633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:24.547861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.548581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.549737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.550322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.672355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:24.809405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:24.819061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:24.826246 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49d52993-503b-49b1-9b07-8bf1af31c4da tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.414436 Jun 18 22:21:24.832316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8c511373-f974-46ce-9e02-bd7c2aef2daa tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1490 microversion: 2.1 time: 0.302049 Jun 18 22:21:24.838224 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2256/4536] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:24 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:24.851159 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2281/4537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:24 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1490 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:24.855913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1726021199"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:24.857658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:24.864657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.865467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.866513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.867336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.952095 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-69424049-3a34-44ec-bdcd-e95197a61feb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "PUT /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1075 microversion: 2.1 time: 0.099953 Jun 18 22:21:24.961807 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2257/4538] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:21:24 2022] PUT /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1075 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:24.968150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:24.969251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:24.981435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.982220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:24.983892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:24.984711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.157855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:25.196757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:25.207124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bcf883e2-4b41-47e0-9293-cb1cf579e6c2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1501 microversion: 2.1 time: 0.243378 Jun 18 22:21:25.220574 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2282/4539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:24 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:25.226533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:25.227233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:25.233880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.234458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.235595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.236097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.453423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:25.467527 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d1d9269-e5a0-4d82-be32-0a9d679ed74b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1501 microversion: 2.1 time: 0.245327 Jun 18 22:21:25.468165 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2258/4540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:25 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:25.491407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cfbb9750-68c2-4440-89c0-6275d9dac609 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:25.498944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cfbb9750-68c2-4440-89c0-6275d9dac609 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.499753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cfbb9750-68c2-4440-89c0-6275d9dac609 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.527456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cfbb9750-68c2-4440-89c0-6275d9dac609 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Going to try to stop instance {{(pid=130902) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:21:25.595578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cfbb9750-68c2-4440-89c0-6275d9dac609 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "POST /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606/action" status: 202 len: 0 microversion: 2.1 time: 0.108589 Jun 18 22:21:25.597180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2283/4541] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:21:25 2022] POST /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:25.605604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:25.606245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:25.612702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.613429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.614667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.615298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.753192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:25.804583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:25.819823 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36b02f66-777a-4142-9cf1-b700b67f28cc tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.218934 Jun 18 22:21:25.820798 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2259/4542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:25 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:25.851829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=10 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:25.857146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:25.857865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:25.864899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.865389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:25.866175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:25.866617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:26.012313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:26.023546 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf8e2b5d-2245-4ba4-a8cc-ad093989c331 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.169923 Jun 18 22:21:26.024362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2284/4543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:25 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:26.844080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:26.846778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:26.858744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:26.859935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:26.861442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:26.862398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:27.045545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:27.046920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:27.055171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:27.056093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:27.057181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:27.057836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:27.304455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:27.318219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cb517fd-5278-42ea-9d90-a75cb9f10815 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.481532 Jun 18 22:21:27.318959 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2260/4544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:26 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:27.454328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:27.467979 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b059f032-4be1-49ce-a9bc-74fe8a1fed00 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.426483 Jun 18 22:21:27.469181 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2285/4545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:27 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:28.015867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:28.017563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:28.026900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.027876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.028787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.029267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.058606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:21:28.168913 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2c9c16e-e174-44ae-9ce1-27f3484c7427 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 204 len: 0 microversion: 2.1 time: 0.156480 Jun 18 22:21:28.169938 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2261/4546] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:21:28 2022] DELETE /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:21:28.187571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:28.189511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:28.201702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.202438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.203484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.204051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.342082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:28.343550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:28.363148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.363840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.364927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.365674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.732554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:28.755462 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e5ab44db-3dbb-4208-9559-1735a3ff5e29 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1552 microversion: 2.1 time: 0.580845 Jun 18 22:21:28.760080 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2286/4547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:28 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1552 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:28.766720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:28.772951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:28.782699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.783324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.784284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:28.785526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:28.925687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:28.943156 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af1286e6-c0f3-4c85-8c10-b41a3741a730 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.608663 Jun 18 22:21:28.944355 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2262/4548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:28 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:29.117899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:29.128079 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3199d5f-6151-444f-8ed3-72b31de16a6b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.366145 Jun 18 22:21:29.129169 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2287/4549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:28 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:29.775587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:29.777818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:29.785179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:29.785729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:29.786608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:29.787795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:29.963144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:29.964468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:29.973858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:29.974485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:29.975556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:29.976284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:29.981273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:30.573308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:30.582047 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3b518be-b4db-4354-addd-c7c5b1a9bbf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1552 microversion: 2.1 time: 0.810259 Jun 18 22:21:30.582770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2263/4550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:29 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1552 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:30.593372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:30.594811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:30.602362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:30.603391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:30.604200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:30.604642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:30.809857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:30.818884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f43b78b9-9e1c-4905-b065-1973717ca8fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.861824 Jun 18 22:21:30.819472 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2288/4551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:29 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:30.986937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:30.996215 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e900b96-ed48-402f-9da5-4e7ba90633aa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.411858 Jun 18 22:21:30.996781 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2264/4552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:30 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:31.338788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-74fa33fd-3943-4633-ac3f-596f1160ad61 req-a1d955b6-066f-4bfd-8118-8b4393f7758f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8775380-a72b-4162-b589-4ac43d347cbd", "name": "network-vif-deleted", "tag": "3daba290-d1f9-436d-8923-d16a165428a9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:31.349506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-74fa33fd-3943-4633-ac3f-596f1160ad61 req-a1d955b6-066f-4bfd-8118-8b4393f7758f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:31.350274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-74fa33fd-3943-4633-ac3f-596f1160ad61 req-a1d955b6-066f-4bfd-8118-8b4393f7758f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:31.366456 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-74fa33fd-3943-4633-ac3f-596f1160ad61 req-a1d955b6-066f-4bfd-8118-8b4393f7758f service nova] Creating event network-vif-deleted:3daba290-d1f9-436d-8923-d16a165428a9 for instance b8775380-a72b-4162-b589-4ac43d347cbd on nch2-master-1 Jun 18 22:21:31.371920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-74fa33fd-3943-4633-ac3f-596f1160ad61 req-a1d955b6-066f-4bfd-8118-8b4393f7758f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037356 Jun 18 22:21:31.372918 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2289/4553] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:21:31.599907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:31.600821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:31.610582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:31.612512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:31.613550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:31.615604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:31.683780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:31.684502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:31.685252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lazy-loading 'fault' on Instance uuid b8775380-a72b-4162-b589-4ac43d347cbd {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:21:31.768508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:31.781256 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1ba2bb2-9927-4f1d-8295-ce35d7bc4c0c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 200 len: 1338 microversion: 2.1 time: 0.185161 Jun 18 22:21:31.788569 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2265/4554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:31 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 1338 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:31.848045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:31.851003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:31.861175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:31.861643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:31.862576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:31.863280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:32.013154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:32.013804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:32.034457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:32.034918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:32.040378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:32.040905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:32.079642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:32.090195 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61b7b7f6-724f-4fe1-a10e-8682e7a5717f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.257503 Jun 18 22:21:32.091566 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2290/4555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:31 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:32.302539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:32.312768 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d591a2cc-d85b-4e8b-aa98-17810a218fa7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.303343 Jun 18 22:21:32.313777 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2266/4556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:32 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:32.797528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:32.798141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: b8775380-a72b-4162-b589-4ac43d347cbd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:32.805362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:32.805971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:32.806963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:32.808109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:32.824417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] HTTP exception thrown: Instance b8775380-a72b-4162-b589-4ac43d347cbd could not be found. Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Request method failure captured: Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd HTTP/1.1 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8pf6lXk9rS5ppzqJrGEIlBUsvNlMkvvZc_OSJiyrUUthdGMtG7CJLO0K702KDlaqxMdnaJJayBbUcWELzDkmaDzjPlbSA7XenKQiHK_MpCVgknZXt9YZvS7s_UF-nAzr_jLpkpXUiCpq4NzyK8zp447xWeWyTRmCXQzmdz0u_HIjk Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 970d8031a4b149188d5a2bee95524169 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkBasicOps-665639190 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/970d8031a4b149188d5a2bee95524169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/970d8031a4b149188d5a2bee95524169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/970d8031a4b149188d5a2bee95524169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_970d8031a4b149188d5a2bee95524169", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkBasicOps-665639190 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 970d8031a4b149188d5a2bee95524169 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkBasicOps-665639190 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkBasicOps-665639190-project Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: caa130c208d44d798cb0a5ba41193976 Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkBasicOps-665639190-project Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance b8775380-a72b-4162-b589-4ac43d347cbd could not be found. Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'b8775380-a72b-4162-b589-4ac43d347cbd'} Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8775380-a72b-4162-b589-4ac43d347cbd could not be found. Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8775380-a72b-4162-b589-4ac43d347cbd could not be found. Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:32.826361 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8775380-a72b-4162-b589-4ac43d347cbd could not be found. Jun 18 22:21:32.831096 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:32.832219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Returning 404 to user: Instance b8775380-a72b-4162-b589-4ac43d347cbd could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:32.833254 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d65c1ea-f96c-45a0-81cb-c2b16cabbef8 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd" status: 404 len: 111 microversion: 2.1 time: 0.039657 Jun 18 22:21:32.833840 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2291/4557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:32 2022] GET /compute/v2.1/servers/b8775380-a72b-4162-b589-4ac43d347cbd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:33.088958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-579f2eb0-b157-407e-86ac-8ac9bfa90e6d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '.version_select at 0x7fea140b51f0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:33.108415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:33.109137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:33.114835 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-579f2eb0-b157-407e-86ac-8ac9bfa90e6d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-869093146" status: 202 len: 0 microversion: 2.1 time: 0.034162 Jun 18 22:21:33.115732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2267/4558] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:21:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-869093146 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:33.117380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:33.119628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:33.121652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:33.123156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:33.332118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:33.332720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:33.340386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:33.340749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:33.342244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:33.343231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:34.056895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:34.060987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:34.068886 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-164d6e71-c8c8-4fa3-92b6-25574d0ba1d4 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.964582 Jun 18 22:21:34.069261 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c399fc1e-3706-4855-aaf5-ea04a5180bf2 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.741551 Jun 18 22:21:34.079299 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2292/4559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:33 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:34.080669 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2268/4560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:33 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:35.089278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:35.091291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:35.100382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:35.102311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:35.126026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.127392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.128084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.128702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.129671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.130571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.131173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.131994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.487350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:35.489901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:35.500968 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11316e6d-b1de-49aa-9a5d-c73874846d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.403964 Jun 18 22:21:35.501139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:35.502955 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2269/4561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:35 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:35.511324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:35.512190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:35.523470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.524479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.526096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.526622 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bfd2595-27ce-4cc0-ab4e-bdef324f68fd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.439066 Jun 18 22:21:35.526886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.528550 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2293/4562] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:35 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:35.541057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-51ce0d1e-3c9a-4c51-ac7f-2217130260fd req-624ba1e1-2412-4e4f-9cb7-1020b7075a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97e5faa-e61e-4d82-b027-c27ae57421c3", "tag": "eb0fad39-0fa9-473c-bd87-9d42b6bb9d90"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:35.558682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-51ce0d1e-3c9a-4c51-ac7f-2217130260fd req-624ba1e1-2412-4e4f-9cb7-1020b7075a91 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.561376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-51ce0d1e-3c9a-4c51-ac7f-2217130260fd req-624ba1e1-2412-4e4f-9cb7-1020b7075a91 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.564490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:21:35.587896 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-51ce0d1e-3c9a-4c51-ac7f-2217130260fd req-624ba1e1-2412-4e4f-9cb7-1020b7075a91 service nova] Creating event network-changed:eb0fad39-0fa9-473c-bd87-9d42b6bb9d90 for instance f97e5faa-e61e-4d82-b027-c27ae57421c3 on nch1-master-1 Jun 18 22:21:35.593355 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-51ce0d1e-3c9a-4c51-ac7f-2217130260fd req-624ba1e1-2412-4e4f-9cb7-1020b7075a91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061364 Jun 18 22:21:35.594886 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2294/4563] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:35.710540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5933f787-b2a7-4732-8d85-fbde54a74ffe tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 204 len: 0 microversion: 2.1 time: 0.205992 Jun 18 22:21:35.720692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:35.721602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:35.724609 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2270/4564] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:21:35 2022] DELETE /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:21:35.728145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.728607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.729534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:35.729983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:35.909061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:35.918180 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee9f1b6e-af42-4c17-bc73-0e309a4e5e71 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1671 microversion: 2.1 time: 0.201696 Jun 18 22:21:35.920453 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2295/4565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:35 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:36.520408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:36.521329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:36.536193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:36.536885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:36.537785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:36.540207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:36.545960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:36.547162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:36.555677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:36.556182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:36.557254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:36.557757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:36.807828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:36.814642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:36.818478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-94333cdb-26d5-42e4-980f-65b48d2e22ca tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.277500 Jun 18 22:21:36.829271 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2296/4566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:36 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:36.836959 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a66fafad-a5ec-4dce-bd1b-e2d2a5692d21 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.321166 Jun 18 22:21:36.847419 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2271/4567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:36 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:36.936617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:36.937475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:36.944743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:36.945700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:36.946529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:36.947327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:37.094026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:37.102487 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64885560-d50d-40ed-9d11-453f91d34743 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1671 microversion: 2.1 time: 0.170237 Jun 18 22:21:37.103542 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2297/4568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:36 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:37.836609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:37.837292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:37.846159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:37.846820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:37.847619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:37.849443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:37.856157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:37.857405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:37.865396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:37.866034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:37.866963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:37.867399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:38.115112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:38.126357 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6cc43d7b-497a-434f-9451-2b648e23ba3d tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.292983 Jun 18 22:21:38.126357 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2272/4569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:37 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:38.140796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:38.141750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:38.142471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:38.149391 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-164f31a8-4255-4dd1-b94e-5f332de4b0e6 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.298493 Jun 18 22:21:38.150025 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2298/4570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:37 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:38.162426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:38.163145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:38.164273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:38.165359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:38.474567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:38.483965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67bbfb01-bc18-470e-ab59-056db34f2353 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 200 len: 1552 microversion: 2.1 time: 0.356993 Jun 18 22:21:38.485049 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2273/4571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:38 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 1552 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:38.614247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e954a1eb-c1a6-4f75-836a-94b1fcf27f7f req-500d0241-d3ab-4d8c-9e5d-b903fce224a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97e5faa-e61e-4d82-b027-c27ae57421c3", "name": "network-vif-deleted", "tag": "eb0fad39-0fa9-473c-bd87-9d42b6bb9d90"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:38.625991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e954a1eb-c1a6-4f75-836a-94b1fcf27f7f req-500d0241-d3ab-4d8c-9e5d-b903fce224a3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:38.626736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e954a1eb-c1a6-4f75-836a-94b1fcf27f7f req-500d0241-d3ab-4d8c-9e5d-b903fce224a3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:38.639347 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e954a1eb-c1a6-4f75-836a-94b1fcf27f7f req-500d0241-d3ab-4d8c-9e5d-b903fce224a3 service nova] Creating event network-vif-deleted:eb0fad39-0fa9-473c-bd87-9d42b6bb9d90 for instance f97e5faa-e61e-4d82-b027-c27ae57421c3 on nch1-master-1 Jun 18 22:21:38.644634 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e954a1eb-c1a6-4f75-836a-94b1fcf27f7f req-500d0241-d3ab-4d8c-9e5d-b903fce224a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034340 Jun 18 22:21:38.645718 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2299/4572] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:21:39.142004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:39.142699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:39.174784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:39.175526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:39.179389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:39.179989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:39.183520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:39.188086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:39.194798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:39.197334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:39.198141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:39.198586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:39.510381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:39.513944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:39.520155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4256523-fa5b-452b-92ab-28c6756e3d5c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.356095 Jun 18 22:21:39.530277 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2300/4573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:39 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:39.530497 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ea45e45-4e73-4c64-bd60-7f332204adb2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.385896 Jun 18 22:21:39.530497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2274/4574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:39 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:39.536353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:39.538916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: f97e5faa-e61e-4d82-b027-c27ae57421c3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:39.555507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:39.555507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:39.560371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:39.561063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:39.582966 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] HTTP exception thrown: Instance f97e5faa-e61e-4d82-b027-c27ae57421c3 could not be found. Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Request method failure captured: Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 HTTP/1.1 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8pf6lXk9rS5ppzqJrGEIlBUsvNlMkvvZc_OSJiyrUUthdGMtG7CJLO0K702KDlaqxMdnaJJayBbUcWELzDkmaDzjPlbSA7XenKQiHK_MpCVgknZXt9YZvS7s_UF-nAzr_jLpkpXUiCpq4NzyK8zp447xWeWyTRmCXQzmdz0u_HIjk Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 970d8031a4b149188d5a2bee95524169 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkBasicOps-665639190 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/970d8031a4b149188d5a2bee95524169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/970d8031a4b149188d5a2bee95524169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/970d8031a4b149188d5a2bee95524169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_970d8031a4b149188d5a2bee95524169", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkBasicOps-665639190 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 970d8031a4b149188d5a2bee95524169 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkBasicOps-665639190 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkBasicOps-665639190-project Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: caa130c208d44d798cb0a5ba41193976 Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkBasicOps-665639190-project Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance f97e5faa-e61e-4d82-b027-c27ae57421c3 could not be found. Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f97e5faa-e61e-4d82-b027-c27ae57421c3'} Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97e5faa-e61e-4d82-b027-c27ae57421c3 could not be found. Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97e5faa-e61e-4d82-b027-c27ae57421c3 could not be found. Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:39.584631 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97e5faa-e61e-4d82-b027-c27ae57421c3 could not be found. Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Returning 404 to user: Instance f97e5faa-e61e-4d82-b027-c27ae57421c3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-57215434-bd66-44bc-9486-d4ef9f52a190 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3" status: 404 len: 111 microversion: 2.1 time: 0.063346 Jun 18 22:21:39.589262 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2301/4575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:39 2022] GET /compute/v2.1/servers/f97e5faa-e61e-4d82-b027-c27ae57421c3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:21:39.789640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-27ba143d-c85e-417c-89bf-f00cdbd3d5a2 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '.version_select at 0x7fea078d74c0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:39.805619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:39.824539 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-27ba143d-c85e-417c-89bf-f00cdbd3d5a2 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1762680078" status: 202 len: 0 microversion: 2.1 time: 0.039088 Jun 18 22:21:39.824539 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2275/4576] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1762680078 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:21:40.539160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:40.540302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:40.542363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:40.543196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:40.551444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:40.551871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:40.553410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:40.554005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:40.560182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:40.561777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:40.562880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:40.564650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:41.001146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:41.009436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:41.011359 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-af59425a-978a-4cd8-9c8f-2cb8b1c4eb26 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.477013 Jun 18 22:21:41.012285 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2302/4577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:40 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:41.021271 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5125084d-5a14-4c49-9619-c1a49d4f50cd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.479837 Jun 18 22:21:41.021271 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2276/4578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:40 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:42.030716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:42.031462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:42.041174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:42.041673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:42.042727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:42.042817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:42.044066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:42.044736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:42.053380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:42.055195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:42.056316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:42.056944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:42.380722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:42.386087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:42.400149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09b9fdaa-1218-49e6-abe7-f72384b81aaa tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.373814 Jun 18 22:21:42.401332 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2277/4579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:42 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:42.402845 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-09fdbcd1-dbe7-437f-aaad-362181e18826 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.372626 Jun 18 22:21:42.403648 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2303/4580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:42 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:43.431563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:43.432781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:43.433196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:43.434727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:43.455380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:43.455840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:43.456629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:43.457337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:43.462749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:43.465778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:43.466767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:43.467211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:43.893819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:43.904771 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-363aba02-54c7-4bff-bc68-52f64c98b6bd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.488698 Jun 18 22:21:43.917852 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2304/4581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:43 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:43.982538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:43.990721 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c66d0ac4-7140-48ae-9570-e96fccb5107d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.575542 Jun 18 22:21:44.000924 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2278/4582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:43 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:44.923507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:44.925110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:44.933917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:44.934716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:44.935845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:44.936443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:45.008954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:45.010567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:45.019990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:45.020693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:45.022111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:45.023838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:45.314745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:45.327289 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d37f1953-77ad-44b5-adcb-ea067b3fa26f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.407748 Jun 18 22:21:45.328336 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2305/4583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:44 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:45.343412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:45.354892 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae1ea2db-59d8-47ea-a822-be8f944bfe47 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.349989 Jun 18 22:21:45.356160 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2279/4584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:45 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:46.361302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:46.376123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:46.379038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:46.387669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:46.405458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=74 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:46.420508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:46.421319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:46.426039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:46.430945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:46.434422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:46.437951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:46.441613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:46.445174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:46.773386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:46.785827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c736455-b2cf-4c67-bd7c-19dd667da431 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1521 microversion: 2.1 time: 0.416961 Jun 18 22:21:46.797129 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2280/4585] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:46 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:46.850562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:46.863217 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-998243dc-4a82-40b4-ac16-a329c2a0f59f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.519680 Jun 18 22:21:46.863970 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2306/4586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:46 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:47.806609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:47.807249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:47.833149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:47.833633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:47.834500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:47.834966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:47.880218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:47.880837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:47.891122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:47.905506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:47.907207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:47.908004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.336222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:48.353724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b0d62e0b-ae1f-4a94-b3cb-f5ec6b8dbcd5 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.477742 Jun 18 22:21:48.358044 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2307/4587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:47 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:48.463673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:48.482304 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-712c7ded-3dc9-4cdb-92b1-04691248ffc9 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1498 microversion: 2.1 time: 0.677053 Jun 18 22:21:48.483862 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2281/4588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:47 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1498 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:48.498654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:48.499500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:48.499859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:48.503274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:48.504882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:48.511237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.511800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.512713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.513530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.514074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.519511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.520465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.520916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.522746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:48.585897 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-af2eb7e0-04f1-4574-915a-b02b5cd24d45 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments/0ad3ba56-1c0d-49cd-9990-41fcf14a30b3" status: 200 len: 194 microversion: 2.20 time: 0.091597 Jun 18 22:21:48.586652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:48.590521 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2308/4589] 10.222.0.30 () {60 vars in 1453 bytes} [Sat Jun 18 22:21:48 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments/0ad3ba56-1c0d-49cd-9990-41fcf14a30b3 => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:21:48.654563 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03814e9f-2ef9-4176-b9fd-aa3df10936a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.158863 Jun 18 22:21:48.660847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2282/4590] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Jun 18 22:21:48 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:48.665890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2f8b79e-e5e8-47dc-98ad-d59125eab8b5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:48.672725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:48.673382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:48.677890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2f8b79e-e5e8-47dc-98ad-d59125eab8b5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.678483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2f8b79e-e5e8-47dc-98ad-d59125eab8b5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.687130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.687873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.689852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.692274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.732763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2f8b79e-e5e8-47dc-98ad-d59125eab8b5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Going to try to start instance {{(pid=130902) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 22:21:48.815280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2f8b79e-e5e8-47dc-98ad-d59125eab8b5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "POST /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5/action" status: 202 len: 0 microversion: 2.1 time: 0.153167 Jun 18 22:21:48.816694 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2309/4591] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:21:48 2022] POST /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:21:48.829965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:48.831351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:48.852110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.852636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.856252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:48.858507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:48.877125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lazy-loading 'services' on Instance uuid 662b2510-85bb-41de-85c9-6b498e04b6b1 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:21:49.010898 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c6470126-e8ad-4709-8406-227619bc94f8 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments/0ad3ba56-1c0d-49cd-9990-41fcf14a30b3" status: 202 len: 0 microversion: 2.20 time: 0.341847 Jun 18 22:21:49.012160 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2283/4592] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Jun 18 22:21:48 2022] DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments/0ad3ba56-1c0d-49cd-9990-41fcf14a30b3 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:21:49.024735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:49.026098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:49.043200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:49.043893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:49.045966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:49.046939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:49.081864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:49.088093 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2631415-d62d-4636-aa77-5d83f96252a4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.069672 Jun 18 22:21:49.089188 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2284/4593] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Jun 18 22:21:49 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:21:49.374344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:49.375091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:49.385133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:49.386914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:49.387601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:49.388399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:49.388839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:49.402718 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14b425d8-ab79-427e-b4f9-09a3ca12ec03 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1507 microversion: 2.1 time: 0.581333 Jun 18 22:21:49.407201 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2310/4594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:48 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1507 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:50.006862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:50.014952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5703d3fc-5569-4b5b-9ea6-00b0b520d64b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.644671 Jun 18 22:21:50.015558 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2285/4595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:49 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:50.101509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:50.103477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:50.115267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.115936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.116937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.117707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.170954 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-67eab3ff-98cb-4805-9a32-d5f847c77a1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065182 Jun 18 22:21:50.177329 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2311/4596] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Jun 18 22:21:50 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:50.245415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:50.246265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:50.252991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.253851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.254781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.255362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.290815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:21:50.428837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:50.431635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:50.462722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.466390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.469001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.470234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.500984 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79204b55-d7e4-4f94-9d0e-cb5a78b38fa5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 204 len: 0 microversion: 2.20 time: 0.259699 Jun 18 22:21:50.504927 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2286/4597] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:21:50 2022] DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:21:50.511801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:50.512030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:50.522703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.523156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.523946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:50.524383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:50.972812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:50.986771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:50.988353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:50.989631 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-00135411-a1d9-44b1-ad79-512cbfe579f2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 0.483314 Jun 18 22:21:50.990189 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2287/4598] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:50 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:21:50.995160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:51.007970 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6c9221e-7bf5-4949-99fc-e944b68a6e16 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1507 microversion: 2.1 time: 0.587743 Jun 18 22:21:51.008871 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2312/4599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:50 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1507 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:51.032103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:51.032613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:51.041791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:51.042261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:51.043074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:51.047569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:51.380832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:51.409560 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4d30db0-2cf8-499b-940a-3c1ca87d9da6 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.381415 Jun 18 22:21:51.411243 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2288/4600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:51 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:52.008596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:52.009260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:52.028303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:52.028757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:52.029581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:52.029847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:52.030019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:52.030858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:52.049686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:52.050320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:52.050910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:52.051342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:53.052429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:53.064055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:53.072595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:53.076247 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a3d0c42-2742-49f2-b7e2-579ad852c215 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1722 microversion: 2.20 time: 1.071986 Jun 18 22:21:53.077091 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2313/4601] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:52 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1722 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:53.092664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:53.093408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:53.110674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:53.111294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:53.112303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:53.112766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:53.134805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:53.149203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9b28577d-1a6d-4499-9ec4-54dc2deb5534 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1507 microversion: 2.1 time: 1.121369 Jun 18 22:21:53.150634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2289/4602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:52 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1507 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:53.160442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4476b32e-42e3-434c-af5d-df28e356b17a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'create', calling method: .version_select at 0x7fea0786ef70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1010574615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0ODF7czkTTGpmVg5BP/fQO3yVo7MlWd49NxksgF3zHdkTxgKcRz6ZJ09YeuQIv/eJvKzu5P6+5hcp5+hvrczCZ2Sj3B5YChmZcgQPGZ7l57Ix5vIRYwW8PG84l9sAA8Q=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:53.184402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4476b32e-42e3-434c-af5d-df28e356b17a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for project 970d8031a4b149188d5a2bee95524169. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:21:53.191485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4476b32e-42e3-434c-af5d-df28e356b17a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for user caa130c208d44d798cb0a5ba41193976 and project 970d8031a4b149188d5a2bee95524169. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:21:53.231517 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4476b32e-42e3-434c-af5d-df28e356b17a tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.076789 Jun 18 22:21:53.232336 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2290/4603] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:21:53 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:53.455271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:53.469077 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1f6310a-6ed2-47a7-bec5-b614c418603f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.390066 Jun 18 22:21:53.473075 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2314/4604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:53 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:54.099360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:54.101321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:54.119238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.122647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.125751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.127387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.178755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:54.179428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:54.208053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.210997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.213769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.216013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.235458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:54.244211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:54.245734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:54.247038 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c4c539c0-6911-4d22-a2d6-4cecfae2f74a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 200 len: 1654 microversion: 2.20 time: 0.154012 Jun 18 22:21:54.247628 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2291/4605] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:54 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:21:54.487538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:54.488449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:54.525967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.527097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.529175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.529634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.785298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:54.815597 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a9706ddc-3044-4418-9e08-e78bc33f0118 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1511 microversion: 2.1 time: 0.649789 Jun 18 22:21:54.818312 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2315/4606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:54 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:54.831655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5401b543-d0cd-49f5-9143-b45a94f696a2 req-e76879f6-e1ae-42a2-a8b1-cb1301e55bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662b2510-85bb-41de-85c9-6b498e04b6b1", "name": "network-vif-deleted", "tag": "99726bbf-0cb5-4dc9-8218-5f38c23981c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:54.858864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5401b543-d0cd-49f5-9143-b45a94f696a2 req-e76879f6-e1ae-42a2-a8b1-cb1301e55bae service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.859607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5401b543-d0cd-49f5-9143-b45a94f696a2 req-e76879f6-e1ae-42a2-a8b1-cb1301e55bae service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.903604 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5401b543-d0cd-49f5-9143-b45a94f696a2 req-e76879f6-e1ae-42a2-a8b1-cb1301e55bae service nova] Creating event network-vif-deleted:99726bbf-0cb5-4dc9-8218-5f38c23981c6 for instance 662b2510-85bb-41de-85c9-6b498e04b6b1 on nch2-master-1 Jun 18 22:21:54.916146 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5401b543-d0cd-49f5-9143-b45a94f696a2 req-e76879f6-e1ae-42a2-a8b1-cb1301e55bae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094626 Jun 18 22:21:54.918954 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2316/4607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:54.935673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:54.947395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:54.952142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.compute.servers [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Removing options 'limit' from query {{(pid=130902) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 18 22:21:54.954426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:54.955963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.958184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.962483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:54.963870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:54.966768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2dbecf11-0c4a-400e-a8a3-289bdbf48e3c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.044969 Jun 18 22:21:54.970311 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2317/4608] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Jun 18 22:21:54 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:21:55.004465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:55.006342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:55.030398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:55.039865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:55.041965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2673877a-c9de-49c3-8df1-0b0d4f15c897 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.558840 Jun 18 22:21:55.053255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:55.054005 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2292/4609] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:54 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:55.055346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:55.056136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:55.315274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:55.324736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:55.355757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:55.356828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:55.359003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:55.368218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:55.429568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] HTTP exception thrown: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Request method failure captured: Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 HTTP/1.1 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9N6pJ0MfiJVZQsIRmPpiXe3LyMytLJseAgzJ8zWOn2vVh4vjwlsUvCUyg6Yh8SAEA02KbXgBGfd018xkWy-aiaFdpbdr5XKZEaEGtHGMxVR2kmnqk9TWwsut9BffYKszcrKNAd1q7BRQn4IiYj64J_JnUMZYn_yj2wOTLK0Qo1Zwg Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6c1a383333e4e30ace00bcdba714600", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d81ad22e9434bff9b01fb434231428f Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '662b2510-85bb-41de-85c9-6b498e04b6b1'} Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:55.431453 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:21:55.436069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:21:55.437984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Returning 404 to user: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:21:55.439648 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64d09874-8f32-4a4d-99be-4cbef141b70d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 404 len: 111 microversion: 2.20 time: 0.163419 Jun 18 22:21:55.441023 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2293/4610] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:21:55 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:21:55.454740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80070721-9bfd-4e00-87c4-26447048471e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '.version_select at 0x7fea14039af0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:55.516898 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80070721-9bfd-4e00-87c4-26447048471e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805130639" status: 204 len: 0 microversion: 2.20 time: 0.070430 Jun 18 22:21:55.516898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2294/4611] 10.222.0.30 () {60 vars in 1258 bytes} [Sat Jun 18 22:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805130639 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:21:55.525601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:55.536985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ebbefdd9-3973-4de0-8c3f-ea6f39c9c759 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1511 microversion: 2.1 time: 0.558812 Jun 18 22:21:55.548140 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2318/4612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:54 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:55.558291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:55.559303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:55.596763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:55.600601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:55.602234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:55.605289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:56.019190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:56.037516 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f13239cd-52f2-4f7a-a48d-01d39bef7727 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 200 len: 1512 microversion: 2.1 time: 0.478220 Jun 18 22:21:56.050708 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2295/4613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:55 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 1512 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:56.055105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:56.055649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:56.064377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:56.065016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:56.072171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:56.072649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:56.073166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:56.073637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:56.073784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:56.074124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:56.074507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:56.074968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:56.425820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:56.444518 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fbea7680-1d13-4ddf-9ca0-6f4f234c62da tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1511 microversion: 2.1 time: 0.383784 Jun 18 22:21:56.447409 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2296/4614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:56 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:56.511616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:56.526096 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0bb3c82f-12f3-4dec-8dd2-4db643c872ef tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1512 microversion: 2.1 time: 0.475609 Jun 18 22:21:56.529354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2319/4615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:56 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:21:56.544766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:56.564289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:56.569803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:21:56.804981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:56.805483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:56.806291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:56.806731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:57.007223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:21:57.116731 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6adfb39f-e327-4c30-a231-66083734d1ca tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.576544 Jun 18 22:21:57.130121 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2297/4616] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Jun 18 22:21:56 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:21:57.143916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-595564748", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "fafa5ccd-7941-4f64-82dc-6eec419111fe"}], "key_name": "tempest-TestNetworkBasicOps-1010574615", "security_groups": [{"name": "tempest-secgroup-smoke-1843690447"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:57.149918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:57.163681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:57.180707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:57.181203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:57.182005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:57.182449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:57.587402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] validate_networks() for [('fafa5ccd-7941-4f64-82dc-6eec419111fe', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:21:57.608743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:57.622640 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d84718b5-165f-4e27-a99a-7bc01e134b35 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1511 microversion: 2.1 time: 0.478139 Jun 18 22:21:57.623502 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2298/4617] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:57 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:57.637168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ad364c6-fdce-4ae2-a2e3-fe9f9790b85a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'create', calling method: .version_select at 0x7fea0784a160>, body: {"keypair": {"name": "tempest-keypair-1375239381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZXMxCzz+tpnyJro1Vo91EciE9L+sQA9kgMPsWCP5rmog8hl9X6hkgMYzg3L3kcpcq+w2T3XYGTOGFdjLDwX7RlRebWA35BbAZ0nwJOIVv+ocfZPNQL5wIwV2abch8wJQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:57.659647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2ad364c6-fdce-4ae2-a2e3-fe9f9790b85a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for project b6c1a383333e4e30ace00bcdba714600. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:21:57.667005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2ad364c6-fdce-4ae2-a2e3-fe9f9790b85a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for user 8d81ad22e9434bff9b01fb434231428f and project b6c1a383333e4e30ace00bcdba714600. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:21:57.701437 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ad364c6-fdce-4ae2-a2e3-fe9f9790b85a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.075676 Jun 18 22:21:57.702432 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2299/4618] 10.222.0.30 () {62 vars in 1199 bytes} [Sat Jun 18 22:21:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 18 22:21:57.707858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:57.709232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:57.716765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:57.717641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:57.718705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:57.719322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.053668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:58.069596 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-565e38fc-89df-4142-8688-4ce9a3abb231 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1488 microversion: 2.1 time: 0.360877 Jun 18 22:21:58.078620 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2300/4619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:57 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:58.104882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:58.105848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:58.122714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.123570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.124484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.124914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.579784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:58.591091 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5d51be2-8379-49b8-9b1d-a04b4336d9c4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 200 len: 1512 microversion: 2.1 time: 0.509885 Jun 18 22:21:58.592341 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2301/4620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:58 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 1512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:58.608976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-880982558"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:58.613102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:58.629835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.630360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.631531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.632038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.685760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:21:58.686831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:21:58.687547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:21:58.687896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:21:58.688322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:21:58.690474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:21:58.703623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.704622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.708138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.709808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.723034 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-76c73e08-3b6e-4fc3-8e62-2f3b25884923 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "PUT /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1060 microversion: 2.1 time: 0.129419 Jun 18 22:21:58.734635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2302/4621] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:21:58 2022] PUT /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1060 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:58.742049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:58.743154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:58.752016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for project 970d8031a4b149188d5a2bee95524169. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:21:58.758339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.759040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.760142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.761318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.765736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Getting quotas for user caa130c208d44d798cb0a5ba41193976 and project 970d8031a4b149188d5a2bee95524169. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:21:58.803806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:21:58.816940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:21:58.914215 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bd901a5-0fe8-455a-b040-ce409d8d8afa tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.783123 Jun 18 22:21:58.922575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2320/4622] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:21:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:21:58.928054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:58.928679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:58.944357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.949895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:58.956405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:21:58.957073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:21:59.824175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:59.844073 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2561ed3c-e279-4fef-af7d-154fc4dc207d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1512 microversion: 2.1 time: 1.106903 Jun 18 22:21:59.844631 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2303/4623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:58 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1512 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:59.849634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2d2c3b8-660a-4fa4-a8ce-7a71c84cc87d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:21:59.850281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2d2c3b8-660a-4fa4-a8ce-7a71c84cc87d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:21:59.867399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:59.875730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2222c87e-fc35-43ec-80e8-1801aafda3dd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1487 microversion: 2.1 time: 0.951622 Jun 18 22:21:59.876895 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2321/4624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:58 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1487 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:21:59.882604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-474416795", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e49d21e-43a3-4545-935c-8cce5624bc89"}], "security_groups": [{"name": "tempest-securitygroup--776261163"}], "key_name": "tempest-keypair-1375239381", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:21:59.970879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2d2c3b8-660a-4fa4-a8ce-7a71c84cc87d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:21:59.978560 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2d2c3b8-660a-4fa4-a8ce-7a71c84cc87d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1248 microversion: 2.1 time: 0.133004 Jun 18 22:21:59.989788 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2304/4625] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:21:59 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:00.016527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:00.024677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:00.025851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:00.035125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:00.036404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:00.038181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:00.039014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:00.101432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:00.142059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] validate_networks() for [('9e49d21e-43a3-4545-935c-8cce5624bc89', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:22:00.160131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:00.168625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:00.169385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:00.616824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac659a60-6fad-4c6a-b67a-0f4fe712066d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.625350 Jun 18 22:22:00.618051 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2305/4626] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:21:59 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:00.626037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:00.626967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:00.661153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:00.661705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:00.662562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:00.663018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.384995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:01.401872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d4dabc4-bfa9-453d-9ed3-1eaa3ed6b30a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1487 microversion: 2.1 time: 0.782246 Jun 18 22:22:01.402942 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2306/4627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:00 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1487 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:01.407816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:01.411391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:01.412060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:01.653279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.656370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.657596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.658372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.702489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:01.733702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:22:01.735366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:22:01.736335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:22:01.736920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:22:01.737212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e572f5a9-324c-4253-b0ec-f1de7e1bd6b8 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.333003 Jun 18 22:22:01.737588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:22:01.738871 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2307/4628] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Jun 18 22:22:01 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:01.747719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:01.748666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:01.756131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.756987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.758062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.758710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.762164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.763910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.765517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.767724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.804636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for project b6c1a383333e4e30ace00bcdba714600. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:22:01.812613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Getting quotas for user 8d81ad22e9434bff9b01fb434231428f and project b6c1a383333e4e30ace00bcdba714600. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:22:01.836220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:22:01.838800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:22:01.887722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:01.897426 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51d9703e-217b-454e-b36b-f16dfa10f853 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1306 microversion: 2.1 time: 0.157132 Jun 18 22:22:01.898464 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2308/4629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:01 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1306 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:01.904194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65de2c02-4608-4a4d-a323-d2efdc602d23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.025839 Jun 18 22:22:01.905558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2322/4630] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:21:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:22:01.914672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:01.926470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:01.927047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:01.927689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:01.928531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130902) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:01.938015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.938884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.944213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.944516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.945894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.947365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:01.953094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:01.957226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.009514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:02.111864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.multi_cell_list [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130902) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:02.186967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:02.213809 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e9f52de-e3ad-4bfc-ab88-057541a57fd3 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.306993 Jun 18 22:22:02.215361 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2323/4631] 10.222.0.30 () {58 vars in 1211 bytes} [Sat Jun 18 22:22:01 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:02.221257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3524c106-2302-4823-8707-ee913977b2f1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:02.223038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3524c106-2302-4823-8707-ee913977b2f1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:02.229727 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3db2ffd1-a5d8-48a2-b348-8621e21663b0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 204 len: 0 microversion: 2.1 time: 0.329611 Jun 18 22:22:02.230407 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2309/4632] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:01 2022] DELETE /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:22:02.235727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:02.239530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:02.250665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:02.262992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.263632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.264590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.265224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.342581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3524c106-2302-4823-8707-ee913977b2f1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:02.353588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3524c106-2302-4823-8707-ee913977b2f1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:02.357327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3524c106-2302-4823-8707-ee913977b2f1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:02.358755 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3524c106-2302-4823-8707-ee913977b2f1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1281 microversion: 2.20 time: 0.141768 Jun 18 22:22:02.372588 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2324/4633] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:02 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:02.379631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:02.418433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:02.456088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:02.538946 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-76f4ad98-a0b2-4b4f-a2f5-460740e2f2f4 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.307128 Jun 18 22:22:02.545635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2310/4634] 10.222.0.30 () {58 vars in 1195 bytes} [Sat Jun 18 22:22:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:02.551298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:02.556193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:02.557317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': '-654063676', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:02.563681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.564487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.565749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.566402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.727228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:02.825349 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-779a74be-6e45-4f2f-a867-fcb8387bfa23 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-654063676" status: 200 len: 345 microversion: 2.1 time: 0.278266 Jun 18 22:22:02.827688 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2311/4635] 10.222.0.30 () {58 vars in 1155 bytes} [Sat Jun 18 22:22:02 2022] GET /compute/v2.1/servers?name=-654063676 => generated 345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:02.844095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:02.851908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:02.852988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:02.869144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.869598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.871074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.871517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.906879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.908149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.909410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:02.910200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:02.994442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:03.064696 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2bac1e93-0693-46c1-af85-610d767ac1cc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.229673 Jun 18 22:22:03.072126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2312/4636] 10.222.0.30 () {58 vars in 1153 bytes} [Sat Jun 18 22:22:02 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:03.079122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:03.080054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:03.088289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.088939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.090151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.090594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.212557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:03.221503 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc184097-20cf-44eb-913f-36b328a4251b tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1306 microversion: 2.1 time: 0.147538 Jun 18 22:22:03.222345 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2313/4637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:03 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1306 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:03.227227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:03.231180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:03.231846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-65406367', 'deleted': False, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:22:03.240912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.241402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.242202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.242639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.273204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:03.285894 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75ec396b-81ce-419d-a1ab-29511abe97c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1493 microversion: 2.1 time: 0.911471 Jun 18 22:22:03.286704 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2325/4638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:02 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1493 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:03.379066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:03.379711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:03.386677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.387693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.388862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.389499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.708079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:22:03.774575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8caa253a-ca00-4536-a5f5-fd5c5fadad6e tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-65406367" status: 200 len: 345 microversion: 2.1 time: 0.550928 Jun 18 22:22:03.775769 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2314/4639] 10.222.0.30 () {58 vars in 1225 bytes} [Sat Jun 18 22:22:03 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-65406367 => generated 345 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:03.787447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:03.788053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:03.794586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.795053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.796188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:03.796694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:03.814133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:03.832621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:03.835560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:03.838290 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c85227f2-d264-4f9a-85bc-0c6df4691515 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1333 microversion: 2.20 time: 0.463658 Jun 18 22:22:03.840707 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2326/4640] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:03 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1333 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:22:03.846524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:03.861365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:04.013598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36cf8d28-65dc-4179-8cd7-101a0a8c2532 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "DELETE /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 204 len: 0 microversion: 2.1 time: 0.229842 Jun 18 22:22:04.014250 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2315/4641] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:03 2022] DELETE /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:22:04.022749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:04.024009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:04.039814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.041200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.042323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.044686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.067612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:04.242653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:04.243859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:04.252270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.253245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.255551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.256470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.325796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:04.333694 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-33419dff-ba47-407c-9932-d4704766c081 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1518 microversion: 2.1 time: 0.314924 Jun 18 22:22:04.334284 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2327/4642] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:04 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1518 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:04.348910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:04.349890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:04.356473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.356934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.357762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.358369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.578799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:04.599525 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-457685ea-8b3b-4200-85d7-9559c5adde98 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.363817 Jun 18 22:22:04.601795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2316/4643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:04 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:04.688346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:04.698682 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aede478d-cd07-4eb5-9d9a-d1cced585211 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 200 len: 1493 microversion: 2.1 time: 0.353561 Jun 18 22:22:04.709120 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2328/4644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:04 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 1493 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:04.861902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:04.874494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:04.890698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.891308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:04.898208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:04.898760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.130871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-387003d1-1067-4ee0-8275-8a30e5adf6cd req-1fdb68b0-1d21-490f-813b-11ebb645acbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "242f9f7c-b889-43f2-bc08-39e9b7c6e606", "name": "network-vif-deleted", "tag": "69c6e34b-14be-45d0-87e9-e40df503c4f5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:05.153295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-387003d1-1067-4ee0-8275-8a30e5adf6cd req-1fdb68b0-1d21-490f-813b-11ebb645acbc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.153750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-387003d1-1067-4ee0-8275-8a30e5adf6cd req-1fdb68b0-1d21-490f-813b-11ebb645acbc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.154762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:05.169182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:05.171194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:05.172813 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16aa6b18-80ef-48a7-b22c-d95883d7921d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1339 microversion: 2.20 time: 0.314930 Jun 18 22:22:05.173569 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2329/4645] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:04 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1339 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:22:05.197263 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-387003d1-1067-4ee0-8275-8a30e5adf6cd req-1fdb68b0-1d21-490f-813b-11ebb645acbc service nova] Creating event network-vif-deleted:69c6e34b-14be-45d0-87e9-e40df503c4f5 for instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 on nch1-master-1 Jun 18 22:22:05.204236 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-387003d1-1067-4ee0-8275-8a30e5adf6cd req-1fdb68b0-1d21-490f-813b-11ebb645acbc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387897 Jun 18 22:22:05.205749 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2317/4646] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:05.352360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:05.353247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:05.364619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.371220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.372525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.373081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.618549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:05.619258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:05.627918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.628631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.630160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.632826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.793378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:05.801991 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f56b8d53-cf52-4724-b579-de517a11772c tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1518 microversion: 2.1 time: 0.454446 Jun 18 22:22:05.813020 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2330/4647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:05 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1518 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:05.818895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:05.819791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:05.830827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.831536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.833320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.834072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.855541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 HTTP/1.1 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '242f9f7c-b889-43f2-bc08-39e9b7c6e606'} Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.858090 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.862459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:05.862459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:05.862459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:05.862459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:05.862459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.862459 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.865892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:05.867105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f974584e-77c3-4943-a5a1-7cdc18ff8f07 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 404 len: 111 microversion: 2.1 time: 0.052586 Jun 18 22:22:05.871975 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2331/4648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:05 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:05.893638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:05.894302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:05.901157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.901696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.902616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.903123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.919507 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 HTTP/1.1 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '242f9f7c-b889-43f2-bc08-39e9b7c6e606'} Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:05.922395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.926686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:05.928081 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0add4b22-4340-40df-93a1-06f151e95dbe tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 404 len: 111 microversion: 2.1 time: 0.043508 Jun 18 22:22:05.929570 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2332/4649] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:05 2022] DELETE /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:22:05.939067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:05.941270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 242f9f7c-b889-43f2-bc08-39e9b7c6e606] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:05.949288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.949820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.950676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:05.951413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:05.979565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 HTTP/1.1 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '242f9f7c-b889-43f2-bc08-39e9b7c6e606'} Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.982467 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 242f9f7c-b889-43f2-bc08-39e9b7c6e606 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-defd2a01-64e0-4d1f-8198-ef37c5fc5d2b tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606" status: 404 len: 111 microversion: 2.1 time: 0.050452 Jun 18 22:22:05.987078 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2333/4650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:05 2022] GET /compute/v2.1/servers/242f9f7c-b889-43f2-bc08-39e9b7c6e606 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:05.998471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:05.999486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.009654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.010329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.011276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.011792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.028993 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e HTTP/1.1 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a983d93d-70e3-4f93-bcf7-2d241c8b983e'} Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.030700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b4d511e-275c-41e7-aa34-14ee75a06472 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 404 len: 111 microversion: 2.1 time: 0.043358 Jun 18 22:22:06.034957 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2334/4651] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:05 2022] DELETE /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:22:06.045572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.046356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: a983d93d-70e3-4f93-bcf7-2d241c8b983e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.057473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.058036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.059121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.059639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.078305 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e HTTP/1.1 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a983d93d-70e3-4f93-bcf7-2d241c8b983e'} Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.080152 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance a983d93d-70e3-4f93-bcf7-2d241c8b983e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ade2f341-5e14-4fd5-9c01-3f6eb438940f tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e" status: 404 len: 111 microversion: 2.1 time: 0.042990 Jun 18 22:22:06.084664 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2335/4652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/a983d93d-70e3-4f93-bcf7-2d241c8b983e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.091200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.091998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.112825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.113320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.114788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.115399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.117794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:06.125567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4eb854ec-45f1-4e04-abaf-2956adb66350 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.511476 Jun 18 22:22:06.131120 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.131953 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2318/4653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:05 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 HTTP/1.1 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '757307a5-1c02-4970-a40a-7084ca46b0c9'} Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.133189 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a038c7f-73bb-4be1-aebc-0194ca415035 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 404 len: 111 microversion: 2.1 time: 0.047638 Jun 18 22:22:06.137373 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2336/4654] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:06 2022] DELETE /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.143829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.144629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 757307a5-1c02-4970-a40a-7084ca46b0c9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.159096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.159655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.160447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.160900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.192765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.193468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.195260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 HTTP/1.1 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '757307a5-1c02-4970-a40a-7084ca46b0c9'} Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.206913 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 757307a5-1c02-4970-a40a-7084ca46b0c9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59fe915d-6f09-4c38-8804-14417882abe7 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9" status: 404 len: 111 microversion: 2.1 time: 0.068721 Jun 18 22:22:06.215109 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2319/4655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/757307a5-1c02-4970-a40a-7084ca46b0c9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.215802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.216055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.217963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-fa1a530a-9727-4ddd-be20-6773f76a08cd req-7b5cabb2-f474-49bb-bd48-e7870c92ec88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b9d81e-5b35-4bd1-bb60-f227804e41f1", "tag": "251edfcf-1c82-45d5-9965-7e832dbf289d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:06.218365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.222388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.227928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fa1a530a-9727-4ddd-be20-6773f76a08cd req-7b5cabb2-f474-49bb-bd48-e7870c92ec88 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.228376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fa1a530a-9727-4ddd-be20-6773f76a08cd req-7b5cabb2-f474-49bb-bd48-e7870c92ec88 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.241559 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-fa1a530a-9727-4ddd-be20-6773f76a08cd req-7b5cabb2-f474-49bb-bd48-e7870c92ec88 service nova] Creating event network-changed:251edfcf-1c82-45d5-9965-7e832dbf289d for instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 on nch2-master-1 Jun 18 22:22:06.247694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-fa1a530a-9727-4ddd-be20-6773f76a08cd req-7b5cabb2-f474-49bb-bd48-e7870c92ec88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036469 Jun 18 22:22:06.248318 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2320/4656] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:06.255494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.256091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.268528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.269209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.270186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.271837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.294529 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 HTTP/1.1 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '62add9a1-ed28-4e11-b315-4596612cb113'} Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.296589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.301144 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.302625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.303653 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-94018fd9-9be5-4a12-a2e1-5d85129c9cfd tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 404 len: 111 microversion: 2.1 time: 0.054259 Jun 18 22:22:06.304408 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2321/4657] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:06 2022] DELETE /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.312770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.313662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 62add9a1-ed28-4e11-b315-4596612cb113] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.320718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.321834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.322784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.323404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.339854 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 HTTP/1.1 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '62add9a1-ed28-4e11-b315-4596612cb113'} Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.341827 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.346584 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.346584 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.346584 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.346584 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.346584 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. Jun 18 22:22:06.346584 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.347929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 62add9a1-ed28-4e11-b315-4596612cb113 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.348960 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3afcdb22-4367-41d8-88bb-4e21d622711a tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113" status: 404 len: 111 microversion: 2.1 time: 0.040151 Jun 18 22:22:06.352969 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2322/4658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/62add9a1-ed28-4e11-b315-4596612cb113 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:22:06.358638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.359452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.366235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.366979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.368013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.368607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.374596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:06.383412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:06.384332 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b HTTP/1.1 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74c62de4-53a8-41b1-a5b6-2f3f9b02565b'} Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.386237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.390886 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.392030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:06.392654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.393784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36b0054a-2077-443c-b4f5-8fa86d54fad8 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 404 len: 111 microversion: 2.1 time: 0.039468 Jun 18 22:22:06.397563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e158ed83-e082-41a4-857f-df914f6f85ba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1339 microversion: 2.20 time: 0.206313 Jun 18 22:22:06.397996 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2323/4659] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:06 2022] DELETE /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.398806 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2337/4660] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:06.403498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.404285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 74c62de4-53a8-41b1-a5b6-2f3f9b02565b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.415768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.416316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.417496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.419249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.439466 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b HTTP/1.1 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '74c62de4-53a8-41b1-a5b6-2f3f9b02565b'} Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.441367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 74c62de4-53a8-41b1-a5b6-2f3f9b02565b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39f923c0-4fa4-47e6-b4ff-b4ed4f124072 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b" status: 404 len: 111 microversion: 2.1 time: 0.044251 Jun 18 22:22:06.446114 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2324/4661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/74c62de4-53a8-41b1-a5b6-2f3f9b02565b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.453817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.454573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.461874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.462622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.463467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.463991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.478887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a HTTP/1.1 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82475c63-3cfd-4bf4-9c40-fcc66000d90a'} Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.480647 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.484844 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.486534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.487468 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d02c9f08-eaad-4a69-8d9f-1cd56fb0c8af tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 404 len: 111 microversion: 2.1 time: 0.037910 Jun 18 22:22:06.488252 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2338/4662] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:06 2022] DELETE /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.498179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.498179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 82475c63-3cfd-4bf4-9c40-fcc66000d90a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.506170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.506621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.507663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.508173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.540052 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a HTTP/1.1 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82475c63-3cfd-4bf4-9c40-fcc66000d90a'} Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.543726 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.547731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.547731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.547731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.547731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.547731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. Jun 18 22:22:06.547731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.550965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 82475c63-3cfd-4bf4-9c40-fcc66000d90a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.552111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f8e9f98e-8978-4010-8eb5-d14ea3c499bb tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a" status: 404 len: 111 microversion: 2.1 time: 0.059172 Jun 18 22:22:06.553274 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2325/4663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/82475c63-3cfd-4bf4-9c40-fcc66000d90a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.561554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.562021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.571669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.571972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.572757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.573249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.594131 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 HTTP/1.1 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '19271ca1-19b8-483b-8b5c-0362c2f68cc0'} Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.600219 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.604106 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.611849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.613148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bfa74887-53c7-49b2-a291-b6814ed6a032 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 404 len: 111 microversion: 2.1 time: 0.055938 Jun 18 22:22:06.618689 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2339/4664] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:06 2022] DELETE /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.626755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.627693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 19271ca1-19b8-483b-8b5c-0362c2f68cc0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.643567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.644404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.647533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.648426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.665460 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 HTTP/1.1 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '19271ca1-19b8-483b-8b5c-0362c2f68cc0'} Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.667412 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:06.671406 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:06.671406 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:06.671406 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:06.671406 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:06.671406 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. Jun 18 22:22:06.671406 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:06.673604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 19271ca1-19b8-483b-8b5c-0362c2f68cc0 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:06.674699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fcf7b42b-26ed-4985-aacf-950b172446c0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0" status: 404 len: 111 microversion: 2.1 time: 0.051775 Jun 18 22:22:06.675784 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2326/4665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/19271ca1-19b8-483b-8b5c-0362c2f68cc0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:06.684492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.685091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.687228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:06.713513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.714136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.714998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.715435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.771987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:06.819790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.822499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.837324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.838168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.839278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.839994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.936829 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-150c230d-86f2-4a49-b5c6-d4de0d0b3118 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 204 len: 0 microversion: 2.1 time: 0.256260 Jun 18 22:22:06.937614 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2340/4666] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:06 2022] DELETE /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:22:06.958160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:06.960862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:06.977075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.977542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:06.978377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:06.978833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:07.064484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:07.077866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c2316ae5-ab3b-4384-8166-df9483573573 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1476 microversion: 2.1 time: 0.262564 Jun 18 22:22:07.089950 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2327/4667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:07.150452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:07.152572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:07.167195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:07.170787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:07.173658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:07.176127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:07.276522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:07.288593 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aa155df7-da2d-4a6e-8608-ff855d698df2 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1478 microversion: 2.1 time: 0.345447 Jun 18 22:22:07.292617 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2341/4668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:06 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1478 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:07.308045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e67915a1-b033-48c0-816c-35c02ae80eca req-e2175d93-7bb2-416a-975c-68cba7dd6a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636d790b-ebcf-4e9c-98c4-1f631cbd88c0", "name": "network-vif-deleted", "tag": "4fccbd21-0045-4ff3-a73f-8b715b5b472d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:07.318279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e67915a1-b033-48c0-816c-35c02ae80eca req-e2175d93-7bb2-416a-975c-68cba7dd6a9b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:07.318734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e67915a1-b033-48c0-816c-35c02ae80eca req-e2175d93-7bb2-416a-975c-68cba7dd6a9b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:07.333950 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e67915a1-b033-48c0-816c-35c02ae80eca req-e2175d93-7bb2-416a-975c-68cba7dd6a9b service nova] Creating event network-vif-deleted:4fccbd21-0045-4ff3-a73f-8b715b5b472d for instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 on nch2-master-1 Jun 18 22:22:07.339409 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e67915a1-b033-48c0-816c-35c02ae80eca req-e2175d93-7bb2-416a-975c-68cba7dd6a9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035143 Jun 18 22:22:07.340039 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2342/4669] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:07.418122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:07.419099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:07.427045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:07.427733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:07.429411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:07.429854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:07.852677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:07.861387 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b86025e8-adb7-4711-b15c-d0e5a61412e7 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.715554 Jun 18 22:22:07.874717 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2328/4670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:07 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:07.989302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:08.000396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:08.002668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:08.004038 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c030df80-29bf-4185-a216-0a06efdfb6b3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.591830 Jun 18 22:22:08.025180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2343/4671] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:07 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:22:08.097534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:08.098506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:08.107739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.112173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:08.113083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.113545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:08.151724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.152972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:08.153651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lazy-loading 'fault' on Instance uuid 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:22:08.215729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:08.226512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff69532d-52d1-4f53-917c-083f0a90f45b tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 200 len: 1310 microversion: 2.1 time: 0.133157 Jun 18 22:22:08.227779 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2329/4672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:08 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 1310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:08.329565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:08.332964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:08.356734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.357560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:08.359240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.360411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:08.705441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:08.717820 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8ef046a-e6e9-4810-bd56-134114ccf6f0 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1478 microversion: 2.1 time: 0.411692 Jun 18 22:22:08.718710 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2344/4673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:08 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1478 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:08.893715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:08.894401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:08.907831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.907831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:08.907831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:08.908241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.028349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:09.029369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:09.050256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.050730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.051598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.052036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.583249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:09.591382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:09.600252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:09.602194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:09.603828 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-107ac1a7-7b39-4fc2-9faf-6acf32f9b3f9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.580163 Jun 18 22:22:09.607091 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2345/4674] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:09 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:09.610803 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-27e31a79-cab6-4390-a615-e54e84d93537 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.718133 Jun 18 22:22:09.612134 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2330/4675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:08 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:09.616901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:09.617608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 636d790b-ebcf-4e9c-98c4-1f631cbd88c0] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:09.628850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e25655f5-e555-49f1-9ceb-4f569fb90225 req-1f7cf2ef-0ee8-4550-8ad4-fb418f2f4d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:09.637057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.639674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.641267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.644252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e25655f5-e555-49f1-9ceb-4f569fb90225 req-1f7cf2ef-0ee8-4550-8ad4-fb418f2f4d5a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.644607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.646141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e25655f5-e555-49f1-9ceb-4f569fb90225 req-1f7cf2ef-0ee8-4550-8ad4-fb418f2f4d5a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.666869 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e25655f5-e555-49f1-9ceb-4f569fb90225 req-1f7cf2ef-0ee8-4550-8ad4-fb418f2f4d5a service nova] Creating event network-changed:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch2-master-1 Jun 18 22:22:09.681825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] HTTP exception thrown: Instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 could not be found. Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Request method failure captured: Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 HTTP/1.1 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk-6kX6yIpe8LtBS7FLbzS8l0vz-n2G7k-mcTokPW-A4esE8u0pEQbfafNGT0N1ubR6pYwijPEmwD7BWZUj1lkhCEAaEB_SMjVhh9RV60wJmStegwJavO5eDZmJ4bcc4Rgr3OAtJHnz4cskPraz3rArNd077Rs5KP4Nr2fI5FwQKQQQ Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 5cc2ac33206d4b3499ce139b0ecdf356 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5cc2ac33206d4b3499ce139b0ecdf356", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 5cc2ac33206d4b3499ce139b0ecdf356 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServerFiltersTestJSON-768595223-project Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 21a7cd29a3044c0d8eb886d1e3ea3bbb Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServerFiltersTestJSON-768595223-project Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 could not be found. Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '636d790b-ebcf-4e9c-98c4-1f631cbd88c0'} Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 could not be found. Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 could not be found. Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:09.685516 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 could not be found. Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Returning 404 to user: Instance 636d790b-ebcf-4e9c-98c4-1f631cbd88c0 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:09.690775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-459dde49-45f5-4f63-9ccc-7103f160e49d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0" status: 404 len: 111 microversion: 2.1 time: 0.081761 Jun 18 22:22:09.691546 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2346/4676] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:09 2022] GET /compute/v2.1/servers/636d790b-ebcf-4e9c-98c4-1f631cbd88c0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:09.691807 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e25655f5-e555-49f1-9ceb-4f569fb90225 req-1f7cf2ef-0ee8-4550-8ad4-fb418f2f4d5a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075390 Jun 18 22:22:09.692770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2331/4677] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:09.702460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:09.702993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:09.717079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.722087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.723107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.723569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.741299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:09.747275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:09.751323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.751981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.752944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.753819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.801776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:09.815376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:09.815909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:09.816491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lazy-loading 'fault' on Instance uuid 5b6fdc5c-0c35-497b-be9c-49a996b93f7f {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:22:09.879471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c4f7872035427d9bfb6a6ecfb7a0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28c54796fc944347a190465d4c0732a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:09.882007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:09.889907 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a3d8783-ccea-4b9b-9b9d-7eb0fc8dfb2c tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 200 len: 1282 microversion: 2.1 time: 0.157290 Jun 18 22:22:09.890971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2332/4678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:09 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:09.938983 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7964caca-e684-44dd-aa4c-98638eb73f87 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "DELETE /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 204 len: 0 microversion: 2.1 time: 0.243437 Jun 18 22:22:09.945213 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2347/4679] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:09 2022] DELETE /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:22:09.950352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:09.951301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:09.995911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:10.000498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:10.001756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:10.003733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:10.155992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:10.444955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:10.460598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d18aad7e-c9b8-4d0b-a4ff-0dd58af3a839 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 200 len: 1518 microversion: 2.1 time: 0.515347 Jun 18 22:22:10.463136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2333/4680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:09 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:10.638507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:10.639189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:10.641287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:10.642011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:10.660699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:10.662671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:10.664882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:10.666635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:10.669216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:10.671210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:10.675296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:10.680551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:11.082477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:11.088625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:11.092225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:11.094370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:11.096625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b26d824-1b9a-41d2-8430-c5549d0cf85e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.469535 Jun 18 22:22:11.097346 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58bfb776-3de2-46f4-8df6-d116ce397c4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.473379 Jun 18 22:22:11.097682 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2348/4681] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:10 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:11.097968 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2334/4682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:10 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:11.102867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:11.103642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] [instance: 5b6fdc5c-0c35-497b-be9c-49a996b93f7f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:11.111148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:11.111989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:11.113129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:11.113732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:11.134782 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] HTTP exception thrown: Instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f could not be found. Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Request method failure captured: Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f HTTP/1.1 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk8c2d_Th0ZnU09kNwydJZ7Ohihz6giQUxABILuIrzbiMOwTyh8zjcuQSLBpyWvK6BQovWWpkALiPbqfX8Vc5F7swDijj9Nlde2lfcLfGwaqXxQujObON6e3YrU28fkYgal0jRh0jUwD7riUyF6uw-oyMhvX4iKp9e9q84_RazGmBgc Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/28c54796fc944347a190465d4c0732a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/28c54796fc944347a190465d4c0732a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_28c54796fc944347a190465d4c0732a8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersTestJSON-297260301 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 28c54796fc944347a190465d4c0732a8 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersTestJSON-297260301 Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersTestJSON-297260301-project Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 20c4f7872035427d9bfb6a6ecfb7a0da Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersTestJSON-297260301-project Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f could not be found. Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '5b6fdc5c-0c35-497b-be9c-49a996b93f7f'} Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f could not be found. Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f could not be found. Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:11.140700 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f could not be found. Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] Returning 404 to user: Instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eae00ca1-2a69-4448-8c96-3c388a9d9834 tempest-ServersTestJSON-297260301 tempest-ServersTestJSON-297260301-project] 10.222.0.30 "GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f" status: 404 len: 111 microversion: 2.1 time: 0.039160 Jun 18 22:22:11.144801 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2349/4683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:11 2022] GET /compute/v2.1/servers/5b6fdc5c-0c35-497b-be9c-49a996b93f7f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:11.484905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:11.485950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:11.500081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:11.503136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:11.506884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:11.506884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:11.736589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0bf48875-1994-4524-ab5b-cdc50ef0802c req-e468351d-dacc-41f6-9782-c8407d1e8f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6fdc5c-0c35-497b-be9c-49a996b93f7f", "name": "network-vif-deleted", "tag": "3d9822f1-479a-42ac-ab30-18cb34ad32d0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:11.757151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0bf48875-1994-4524-ab5b-cdc50ef0802c req-e468351d-dacc-41f6-9782-c8407d1e8f7a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:11.758201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0bf48875-1994-4524-ab5b-cdc50ef0802c req-e468351d-dacc-41f6-9782-c8407d1e8f7a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:11.774698 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0bf48875-1994-4524-ab5b-cdc50ef0802c req-e468351d-dacc-41f6-9782-c8407d1e8f7a service nova] Creating event network-vif-deleted:3d9822f1-479a-42ac-ab30-18cb34ad32d0 for instance 5b6fdc5c-0c35-497b-be9c-49a996b93f7f on nch2-master-1 Jun 18 22:22:11.781320 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0bf48875-1994-4524-ab5b-cdc50ef0802c req-e468351d-dacc-41f6-9782-c8407d1e8f7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048676 Jun 18 22:22:11.782536 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2350/4684] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:11.806579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:11.816110 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb1c5cc5-8bd4-4b05-99e9-df71e3e49bbc tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 200 len: 1518 microversion: 2.1 time: 0.339095 Jun 18 22:22:11.824382 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2335/4685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:11 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 1518 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:12.118028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:12.127685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:12.128659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:12.141406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:12.141858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:12.142651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:12.143085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:12.145937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:12.146949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:12.156634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:12.160867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:12.162098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:12.164723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:12.348723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=14 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:12.598926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:12.611438 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e91c9387-24d2-43b3-9945-bf7107f2e90c tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.487784 Jun 18 22:22:12.621956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:12.623128 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2336/4686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:12 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:12.628134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:12.630420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:12.632293 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9a5568f-8d94-46b9-bb68-f2c5796bd97e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.519275 Jun 18 22:22:12.635472 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2351/4687] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:12 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:12.843178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:12.844650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:12.867216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:12.872101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:12.874813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:12.875336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:12.900153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:13.281499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:13.413572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:13.426041 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f8e2b74-eb4d-4a44-9af9-ccef1d12925f tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 200 len: 1518 microversion: 2.1 time: 0.587654 Jun 18 22:22:13.427638 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2337/4688] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:12 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 1518 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:13.629258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:13.630613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:13.649746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:13.652041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:13.652689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:13.653703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:13.654919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:13.656238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:13.665684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:13.668324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:13.669460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:13.670149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.265305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:14.288348 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cdf8508b-7a4e-43ea-b6cd-a004d9068b18 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.663617 Jun 18 22:22:14.294583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2352/4689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:13 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:14.310131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9c4bf652-f18c-4d8d-9f53-f659a05fcf9b req-bcc371e5-0652-4f6f-8621-f6172fd1d84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55610324-3c5b-4d74-bd72-d0b8419a2464", "name": "network-vif-deleted", "tag": "a42d07e7-1972-4323-9996-1fbbc03f8092"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:14.337638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9c4bf652-f18c-4d8d-9f53-f659a05fcf9b req-bcc371e5-0652-4f6f-8621-f6172fd1d84a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.339882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9c4bf652-f18c-4d8d-9f53-f659a05fcf9b req-bcc371e5-0652-4f6f-8621-f6172fd1d84a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.364536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:14.385439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:14.392193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:14.395580 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9c4bf652-f18c-4d8d-9f53-f659a05fcf9b req-bcc371e5-0652-4f6f-8621-f6172fd1d84a service nova] Creating event network-vif-deleted:a42d07e7-1972-4323-9996-1fbbc03f8092 for instance 55610324-3c5b-4d74-bd72-d0b8419a2464 on nch1-master-1 Jun 18 22:22:14.397685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-045ac6f8-dc5d-4ada-869e-8051f0d048fb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.747478 Jun 18 22:22:14.404179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2338/4690] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:13 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:14.415921 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9c4bf652-f18c-4d8d-9f53-f659a05fcf9b req-bcc371e5-0652-4f6f-8621-f6172fd1d84a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119746 Jun 18 22:22:14.416540 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2353/4691] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:14.445023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:14.447654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: 55610324-3c5b-4d74-bd72-d0b8419a2464] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:14.456062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.457067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.458636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.459432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.478849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] HTTP exception thrown: Instance 55610324-3c5b-4d74-bd72-d0b8419a2464 could not be found. Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Request method failure captured: Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 HTTP/1.1 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk-6kX6yIpe8LtBS7FLbzS8l0vz-n2G7k-mcTokPW-A4esE8u0pEQbfafNGT0N1ubR6pYwijPEmwD7BWZUj1lkhCEAaEB_SMjVhh9RV60wJmStegwJavO5eDZmJ4bcc4Rgr3OAtJHnz4cskPraz3rArNd077Rs5KP4Nr2fI5FwQKQQQ Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 5cc2ac33206d4b3499ce139b0ecdf356 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5cc2ac33206d4b3499ce139b0ecdf356", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 5cc2ac33206d4b3499ce139b0ecdf356 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServerFiltersTestJSON-768595223-project Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 21a7cd29a3044c0d8eb886d1e3ea3bbb Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServerFiltersTestJSON-768595223-project Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 55610324-3c5b-4d74-bd72-d0b8419a2464 could not be found. Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '55610324-3c5b-4d74-bd72-d0b8419a2464'} Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55610324-3c5b-4d74-bd72-d0b8419a2464 could not be found. Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55610324-3c5b-4d74-bd72-d0b8419a2464 could not be found. Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:14.481285 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55610324-3c5b-4d74-bd72-d0b8419a2464 could not be found. Jun 18 22:22:14.485142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:14.487136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Returning 404 to user: Instance 55610324-3c5b-4d74-bd72-d0b8419a2464 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:14.488732 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8c010ca8-e2e8-48e7-92ac-44b3acf85c93 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464" status: 404 len: 111 microversion: 2.1 time: 0.047573 Jun 18 22:22:14.490194 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2354/4692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:14 2022] GET /compute/v2.1/servers/55610324-3c5b-4d74-bd72-d0b8419a2464 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:22:14.499753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:14.500674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:14.510291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.511771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.512911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.513917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.555992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:14.697901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d9ce8d0f-980d-4712-b36d-db348339edca req-1fff29c0-4df9-4dea-849f-e9c0f756cca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b9d81e-5b35-4bd1-bb60-f227804e41f1", "name": "network-vif-plugged", "status": "completed", "tag": "251edfcf-1c82-45d5-9965-7e832dbf289d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:14.717363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d9ce8d0f-980d-4712-b36d-db348339edca req-1fff29c0-4df9-4dea-849f-e9c0f756cca9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.718101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d9ce8d0f-980d-4712-b36d-db348339edca req-1fff29c0-4df9-4dea-849f-e9c0f756cca9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.722783 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ab000db6-09aa-424d-b518-74bf3daf8653 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 204 len: 0 microversion: 2.1 time: 0.227818 Jun 18 22:22:14.727312 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2355/4693] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:14 2022] DELETE /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:22:14.735593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:14.736423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:14.744849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.745804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.747545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:14.748609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:14.755758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d9ce8d0f-980d-4712-b36d-db348339edca req-1fff29c0-4df9-4dea-849f-e9c0f756cca9 service nova] Creating event network-vif-plugged:251edfcf-1c82-45d5-9965-7e832dbf289d for instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 on nch2-master-1 Jun 18 22:22:14.768757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d9ce8d0f-980d-4712-b36d-db348339edca req-1fff29c0-4df9-4dea-849f-e9c0f756cca9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.362636 Jun 18 22:22:14.773734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2339/4694] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:14.963278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:14.972913 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-732f7940-bdba-4837-8bc8-1f035cd9f24d tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1517 microversion: 2.1 time: 0.242945 Jun 18 22:22:14.973848 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2356/4695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:14 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:15.312182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:15.313519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:15.321629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:15.322394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:15.323643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:15.324317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:15.419517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:15.420461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:15.438251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:15.439431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:15.440463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:15.442679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:15.561569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:15.578049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de3be8ae-c755-46a5-a211-046520d070de tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.270160 Jun 18 22:22:15.579056 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2340/4696] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:15 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:15.731963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:15.741695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:15.749387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:15.750625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e7be0b95-e136-494f-b547-53e2e7f29bba tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.338760 Jun 18 22:22:15.751213 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2357/4697] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:15 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:22:15.991084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:15.992109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:16.000910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.001743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.002869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.003528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.413419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:16.423462 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-834acfdb-99b7-4e31-a9e4-4fbbd42c2be5 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1517 microversion: 2.1 time: 0.435629 Jun 18 22:22:16.424767 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2341/4698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:15 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1517 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:16.595540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:16.596493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:16.603785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.604256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.605160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.605612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.769236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:16.770642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:16.778709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.779710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.780923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.781471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.822108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:16.839879 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f543d9f-5cb9-4e65-a6e3-d8b300e010a3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.247699 Jun 18 22:22:16.842509 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2358/4699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:16 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:16.849147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8392224c-f1c0-4f68-b1b6-4748b5e11b30 req-603fa43a-5cb8-4745-9074-f80c91765522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "name": "network-vif-plugged", "status": "completed", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:16.864218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8392224c-f1c0-4f68-b1b6-4748b5e11b30 req-603fa43a-5cb8-4745-9074-f80c91765522 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:16.865154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8392224c-f1c0-4f68-b1b6-4748b5e11b30 req-603fa43a-5cb8-4745-9074-f80c91765522 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:16.886796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8392224c-f1c0-4f68-b1b6-4748b5e11b30 req-603fa43a-5cb8-4745-9074-f80c91765522 service nova] Creating event network-vif-plugged:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch2-master-1 Jun 18 22:22:16.901529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8392224c-f1c0-4f68-b1b6-4748b5e11b30 req-603fa43a-5cb8-4745-9074-f80c91765522 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057337 Jun 18 22:22:16.902621 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2359/4700] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:17.132517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:17.143295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:17.145581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:17.147681 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83732471-e107-4b21-9872-af0cd91395b4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.382581 Jun 18 22:22:17.148918 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2342/4701] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:16 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:17.155804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7fa801f4-5682-48cc-bc12-5afe63ac8efc req-6f0f1694-7b15-4e12-bc7b-d0b1675d7dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28d4572-3bd6-4ddb-8542-b17869c57da5", "name": "network-vif-deleted", "tag": "823b3203-5977-4ff8-be98-8591bbb9bef2"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:17.165367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7fa801f4-5682-48cc-bc12-5afe63ac8efc req-6f0f1694-7b15-4e12-bc7b-d0b1675d7dfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:17.165939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7fa801f4-5682-48cc-bc12-5afe63ac8efc req-6f0f1694-7b15-4e12-bc7b-d0b1675d7dfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:17.184248 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7fa801f4-5682-48cc-bc12-5afe63ac8efc req-6f0f1694-7b15-4e12-bc7b-d0b1675d7dfd service nova] Creating event network-vif-deleted:823b3203-5977-4ff8-be98-8591bbb9bef2 for instance a28d4572-3bd6-4ddb-8542-b17869c57da5 on nch2-master-1 Jun 18 22:22:17.191181 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7fa801f4-5682-48cc-bc12-5afe63ac8efc req-6f0f1694-7b15-4e12-bc7b-d0b1675d7dfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046190 Jun 18 22:22:17.192192 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2360/4702] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:22:17.448739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:17.452722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:17.463271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:17.463845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:17.464774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:17.465503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:17.569906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:17.581627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cbfe80ec-de68-4f6f-b30e-76b64734ee63 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1305 microversion: 2.1 time: 0.142195 Jun 18 22:22:17.582740 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2343/4703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:17 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1305 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:17.861974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:17.863324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:17.870176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:17.870902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:17.871878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:17.872475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:18.173225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:18.175202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:18.184052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:18.185647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:18.187037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:18.187689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:18.627708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:18.635366 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6361c2b3-9843-46d2-a897-905aeb857b64 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1374 microversion: 2.1 time: 0.780540 Jun 18 22:22:18.636337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2361/4704] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:17 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1374 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:18.641603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:18.642460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:18.649427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:18.650097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:18.651077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:18.651712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:18.718611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:18.722304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:18.723952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lazy-loading 'fault' on Instance uuid a28d4572-3bd6-4ddb-8542-b17869c57da5 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:22:18.876105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a7cd29a3044c0d8eb886d1e3ea3bbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2ac33206d4b3499ce139b0ecdf356', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:18.892844 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47c5ed98-9498-49b9-b9e3-107fc52695e7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 200 len: 1310 microversion: 2.1 time: 0.254236 Jun 18 22:22:18.893801 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2362/4705] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:18 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:18.909815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:18.921939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:18.924778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:18.927729 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-61cad767-6e05-4009-905a-7a76547bae1c tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1406 microversion: 2.20 time: 0.763330 Jun 18 22:22:18.928865 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2344/4706] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:18 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1406 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:19.661501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:19.662141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:19.672384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.673669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.674676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.675286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.862133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:19.888258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fc0e87b-5a25-4e1d-9faf-9da60c1e94c3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1545 microversion: 2.1 time: 0.238915 Jun 18 22:22:19.901985 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2363/4707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:19 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1545 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:19.907027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:19.908570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:19.916963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.918126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.918953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:19.919715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] [instance: a28d4572-3bd6-4ddb-8542-b17869c57da5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:19.924202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.925050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.927850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.928497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.930159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.930777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.957890 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] HTTP exception thrown: Instance a28d4572-3bd6-4ddb-8542-b17869c57da5 could not be found. Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Request method failure captured: Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 HTTP/1.1 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk-6kX6yIpe8LtBS7FLbzS8l0vz-n2G7k-mcTokPW-A4esE8u0pEQbfafNGT0N1ubR6pYwijPEmwD7BWZUj1lkhCEAaEB_SMjVhh9RV60wJmStegwJavO5eDZmJ4bcc4Rgr3OAtJHnz4cskPraz3rArNd077Rs5KP4Nr2fI5FwQKQQQ Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 5cc2ac33206d4b3499ce139b0ecdf356 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5cc2ac33206d4b3499ce139b0ecdf356"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5cc2ac33206d4b3499ce139b0ecdf356", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 5cc2ac33206d4b3499ce139b0ecdf356 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-768595223 Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ListServerFiltersTestJSON-768595223-project Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 21a7cd29a3044c0d8eb886d1e3ea3bbb Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ListServerFiltersTestJSON-768595223-project Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a28d4572-3bd6-4ddb-8542-b17869c57da5 could not be found. Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a28d4572-3bd6-4ddb-8542-b17869c57da5'} Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28d4572-3bd6-4ddb-8542-b17869c57da5 could not be found. Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28d4572-3bd6-4ddb-8542-b17869c57da5 could not be found. Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:19.960748 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28d4572-3bd6-4ddb-8542-b17869c57da5 could not be found. Jun 18 22:22:19.965570 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:22:19.968398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] Returning 404 to user: Instance a28d4572-3bd6-4ddb-8542-b17869c57da5 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:19.969531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4f1cda40-5c13-49bd-94e0-7804d167a4a7 tempest-ListServerFiltersTestJSON-768595223 tempest-ListServerFiltersTestJSON-768595223-project] 10.222.0.30 "GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5" status: 404 len: 111 microversion: 2.1 time: 0.056105 Jun 18 22:22:19.970506 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2364/4708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:19 2022] GET /compute/v2.1/servers/a28d4572-3bd6-4ddb-8542-b17869c57da5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:22:19.977135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:19.978237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:19.989307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.990689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:19.992172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:19.993262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:20.401970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:20.418007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:20.420646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:20.424808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:20.437747 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5da9833-bd7f-4920-a3e0-fa8a43e89421 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1598 microversion: 2.20 time: 0.465542 Jun 18 22:22:20.441723 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2365/4709] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:22:19 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1598 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:22:20.446403 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f26c17f3-7d93-41e8-81e4-8f7e8569999f tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1545 microversion: 2.1 time: 0.543879 Jun 18 22:22:20.447213 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2345/4710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:19 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1545 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:20.476893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:20.480662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:20.492418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:20.495445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:20.497116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:20.499448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:20.809337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50a2e4eb-3475-408a-a4aa-df9fb595bed7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.338316 Jun 18 22:22:20.810154 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2366/4711] 10.222.0.30 () {60 vars in 1315 bytes} [Sat Jun 18 22:22:20 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-interface => generated 285 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:22:23.763380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-417fa8aa-c69a-4cbb-9eb7-f254a167acc0 req-eec28a0d-2185-485f-ae67-73e2dac90517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:23.809719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-417fa8aa-c69a-4cbb-9eb7-f254a167acc0 req-eec28a0d-2185-485f-ae67-73e2dac90517 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:23.810319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-417fa8aa-c69a-4cbb-9eb7-f254a167acc0 req-eec28a0d-2185-485f-ae67-73e2dac90517 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:23.828741 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-417fa8aa-c69a-4cbb-9eb7-f254a167acc0 req-eec28a0d-2185-485f-ae67-73e2dac90517 service nova] Creating event network-changed:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch2-master-1 Jun 18 22:22:23.835512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-417fa8aa-c69a-4cbb-9eb7-f254a167acc0 req-eec28a0d-2185-485f-ae67-73e2dac90517 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101252 Jun 18 22:22:23.842028 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2346/4712] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:24.075850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:24.077671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:24.095531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:24.121281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:24.123693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:24.124625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:24.129665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:24.871704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:24.880887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a61c3e3-dafb-46ed-b1b1-094ee6cd4621 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.811432 Jun 18 22:22:24.887656 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2367/4713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:24 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:24.902783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:24.903599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:24.922753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:24.923208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:24.924012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:24.929641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:26.075285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:26.101901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a9b4190-af3c-4605-b7f2-0cc6af444f28 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 1.198737 Jun 18 22:22:26.104233 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2347/4714] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:24 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:26.122408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:26.123177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:26.136889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:26.137471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:26.147063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:26.149397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:26.492793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:26.502190 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9064ff31-49eb-415d-8255-1d223a11d056 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.384128 Jun 18 22:22:26.508932 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2368/4715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:26 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:26.525702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:26.526721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:26.536900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:26.544561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:26.544924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:26.545412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:27.229898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:27.243523 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-06c05012-a0b6-40cc-aa9e-bbbefdc9d7a9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.721990 Jun 18 22:22:27.244750 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2348/4716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:26 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:27.426281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-709941939", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a4647eff-e46f-4758-90a6-f87dcd82bc48"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:27.490547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] validate_networks() for [('a4647eff-e46f-4758-90a6-f87dcd82bc48', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:22:29.177517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-48dd3512-13cd-4747-867c-a0bb180b2793 req-2af64293-d5f9-4357-ad6a-1e744fdbfbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b9d81e-5b35-4bd1-bb60-f227804e41f1", "tag": "251edfcf-1c82-45d5-9965-7e832dbf289d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:29.197216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-48dd3512-13cd-4747-867c-a0bb180b2793 req-2af64293-d5f9-4357-ad6a-1e744fdbfbfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:29.197568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-48dd3512-13cd-4747-867c-a0bb180b2793 req-2af64293-d5f9-4357-ad6a-1e744fdbfbfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:29.222520 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-48dd3512-13cd-4747-867c-a0bb180b2793 req-2af64293-d5f9-4357-ad6a-1e744fdbfbfd service nova] Creating event network-changed:251edfcf-1c82-45d5-9965-7e832dbf289d for instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 on nch2-master-1 Jun 18 22:22:29.237606 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-48dd3512-13cd-4747-867c-a0bb180b2793 req-2af64293-d5f9-4357-ad6a-1e744fdbfbfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054307 Jun 18 22:22:29.240572 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2349/4717] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:22:29.689954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:22:29.691306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:22:29.692617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:22:29.694554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:22:29.694554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:22:29.712138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:29.716796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:29.720163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:29.721708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:29.763930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:22:29.784971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for user ab975e8ffd0448939b2105aed58003fe and project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:22:29.804277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:22:29.807724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:22:29.951925 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f7e81b2-b30b-4e44-93a3-11deba7a5128 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.529659 Jun 18 22:22:29.953349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2369/4718] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:22:29.968928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-213c0e45-b57e-4984-ac35-0db8750650a1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:29.970650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-213c0e45-b57e-4984-ac35-0db8750650a1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:30.215229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-213c0e45-b57e-4984-ac35-0db8750650a1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:30.225575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-213c0e45-b57e-4984-ac35-0db8750650a1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1214 microversion: 2.1 time: 0.263565 Jun 18 22:22:30.226191 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2350/4719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:29 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:31.245791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:31.246423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:31.261282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:31.262794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:31.266910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:31.267672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:31.573821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:31.586311 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e043586a-4230-4d3e-bcac-7428206478e6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1266 microversion: 2.1 time: 0.347196 Jun 18 22:22:31.589202 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2370/4720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:31 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:32.605633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:32.606276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:32.614588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:32.617727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:32.618637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:32.620125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:32.620835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:32.760552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:32.773610 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4962604d-43b2-40b4-8639-0af015abfe65 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1272 microversion: 2.1 time: 0.171779 Jun 18 22:22:32.778841 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2351/4721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:32 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:33.794960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:33.795645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:33.808400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:33.808858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:33.819671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:33.820300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:34.316188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:34.325315 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dd94ffb4-b43d-4fa2-9db9-f39068446cd7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.535017 Jun 18 22:22:34.326611 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2371/4722] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:33 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:35.342557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:35.343790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:35.360842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:35.361318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:35.362112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:35.362549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:36.300020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6c6c8743-c153-4ddc-8759-567d2d120036 req-03000135-b3d9-477c-9058-272e1205f6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aacbb16-218a-4c65-8f79-5c5b2c4d5f79", "tag": "e803796e-dec2-4bf1-862b-d9088b0c5b59"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:36.321286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6c6c8743-c153-4ddc-8759-567d2d120036 req-03000135-b3d9-477c-9058-272e1205f6fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:36.324152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6c6c8743-c153-4ddc-8759-567d2d120036 req-03000135-b3d9-477c-9058-272e1205f6fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:36.349703 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6c6c8743-c153-4ddc-8759-567d2d120036 req-03000135-b3d9-477c-9058-272e1205f6fe service nova] Creating event network-changed:e803796e-dec2-4bf1-862b-d9088b0c5b59 for instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 on nch1-master-1 Jun 18 22:22:36.362701 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6c6c8743-c153-4ddc-8759-567d2d120036 req-03000135-b3d9-477c-9058-272e1205f6fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066169 Jun 18 22:22:36.363824 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2372/4723] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:36.669682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:36.680130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6280b8c5-8b21-429d-99e2-33ec94593595 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 1.342008 Jun 18 22:22:36.684810 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2352/4724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:35 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:37.702574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:37.703392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:37.734730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:37.740565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:37.742249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:37.745234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:37.749324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:38.170918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:38.183047 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2d7ebe1-d76e-412f-ba93-38d01d2d05a2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.485696 Jun 18 22:22:38.193114 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2373/4725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:37 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:39.200236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:39.208225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:39.220335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:39.221260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:39.224797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:39.225598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:39.292982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-833457140", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:39.359834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] validate_networks() for [('9b042883-87aa-470b-a375-8fa5157a8e61', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:22:39.745867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:39.771924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:39.796686 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02994e3a-3648-413f-a781-213672864d3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.598991 Jun 18 22:22:39.816584 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2374/4726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:39 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:39.837186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:40.098961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:40.100111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:40.109528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:40.110792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:40.111920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:40.112563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:40.170773 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e19835b-ff9d-416f-a9a9-228e9cd007cc tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/ips" status: 200 len: 150 microversion: 2.1 time: 0.350578 Jun 18 22:22:40.185764 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2375/4727] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:22:39 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/ips => generated 150 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:40.219751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:40.323638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:22:40.324222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:22:40.324536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:22:40.324947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:22:40.326171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:22:40.346500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:40.346961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:40.347750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:40.348187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:40.422868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Getting quotas for project a88cba0e44af4875b05d6c3546cf0543. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:22:40.439089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Getting quotas for user 719d3fb4f7f44c239e03b5f7076edcc8 and project a88cba0e44af4875b05d6c3546cf0543. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:22:40.476457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:22:40.482217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:22:40.568107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1137351239", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "8f47bd8b-f871-4dee-8dc1-18d7f62a7765"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:40.604334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-66d7099f-262d-435a-b0c6-f7b656f2a9cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490838 Jun 18 22:22:40.612732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2353/4728] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:22:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:22:40.624359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-664ef665-12d1-489b-a722-8a76472fb1d1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:40.624912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-664ef665-12d1-489b-a722-8a76472fb1d1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:40.643003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] validate_networks() for [('8f47bd8b-f871-4dee-8dc1-18d7f62a7765', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:22:41.607246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-664ef665-12d1-489b-a722-8a76472fb1d1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:41.620664 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-664ef665-12d1-489b-a722-8a76472fb1d1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1216 microversion: 2.1 time: 1.006298 Jun 18 22:22:41.638866 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2354/4729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:40 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1216 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:41.646809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:41.650261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:41.668799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:41.670334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:41.671685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:41.672366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:42.175086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:42.185541 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3638ae8c-272b-45ae-806b-6370147d7f81 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.545075 Jun 18 22:22:42.186161 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2355/4730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:41 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:42.204184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "794f4393-bb2e-4407-bcd1-975dd142d8d4"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:42.207585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:42.225197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:42.226146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:42.229601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:42.230446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:42.535169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:22:42.536105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:22:42.536715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:22:42.537273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:22:42.537992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:22:42.572432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:42.572876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:42.574052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:42.576699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:42.662022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Getting quotas for project 7dc17b4ab1a149728470cc0d7d1ff38f. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:22:42.684465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Getting quotas for user 247bbe467782453385f5d7b687597fee and project 7dc17b4ab1a149728470cc0d7d1ff38f. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:22:42.728328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:22:42.740232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:22:42.811477 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2635b4f1-2510-4009-a4ba-a03f9e16989c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613267 Jun 18 22:22:42.814996 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b808e107-0323-4fbb-8b54-d12cb541f353 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.329101 Jun 18 22:22:42.816746 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2376/4731] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:22:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:22:42.825079 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2356/4732] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:22:42 2022] POST /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:42.840505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:42.842707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:42.846841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae4d7dfc-86d5-4b27-b83b-3d5db27b9421 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:42.849567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae4d7dfc-86d5-4b27-b83b-3d5db27b9421 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:42.877380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:42.879203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:42.880303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:42.882055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:43.037252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae4d7dfc-86d5-4b27-b83b-3d5db27b9421 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:43.046142 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae4d7dfc-86d5-4b27-b83b-3d5db27b9421 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1225 microversion: 2.1 time: 0.214875 Jun 18 22:22:43.048263 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2357/4733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:42 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:43.050384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:43.116818 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ac9a12b-a58e-41ad-8e26-7924e05c8d76 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1274 microversion: 2.1 time: 0.270198 Jun 18 22:22:43.123028 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2377/4734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:42 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:43.203078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:43.203776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:43.225407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:43.229663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:43.231030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:43.231797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:43.248174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:43.527941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:43.538989 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1be51db-e706-4211-963e-5df168a99f8c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.340554 Jun 18 22:22:43.540255 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2358/4735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:43 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:44.015124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:44.019060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:44.046651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.047316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.048956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.049574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.068648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:44.069314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:44.082198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.082689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.083451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.083891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.250358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:44.262045 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-27c5c248-3f6d-44d6-b9ca-c63dfb199990 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1277 microversion: 2.1 time: 0.196580 Jun 18 22:22:44.262636 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2359/4736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:44 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:44.274648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:44.276380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:44.299027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.299678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.300622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.301196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.331584 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b15e63d-3c69-41cb-b5ad-937f9c0dbc4d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1/action" status: 200 len: 24560 microversion: 2.1 time: 0.319675 Jun 18 22:22:44.338160 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2378/4737] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:22:44 2022] POST /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1/action => generated 24560 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:22:44.395289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:44.404833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-551ebdc4-d433-4f94-95e0-d0d1076a14d5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1274 microversion: 2.1 time: 0.138779 Jun 18 22:22:44.417844 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2360/4738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:44 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:44.564134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:44.565864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:44.596368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.600780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:44.601955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:44.604957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:45.169501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:45.183841 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-49b3131c-f347-4a2d-83ae-71a3e35b16e1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.625272 Jun 18 22:22:45.185374 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2379/4739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:44 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:45.282903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:45.283469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:45.317683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:45.318665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:45.320918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:45.321395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:45.424963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:45.425925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:45.450452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:45.451159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:45.452153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:45.452748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:45.544307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:45.552212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20bd5f33-a7d4-435b-b8c4-7a89d0f80b8a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1283 microversion: 2.1 time: 0.276928 Jun 18 22:22:45.562441 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2361/4740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:45 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1283 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:45.604207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:45.613288 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-072646ea-cb58-44a2-9fda-9bdbc43a48cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1274 microversion: 2.1 time: 0.192994 Jun 18 22:22:45.614441 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2380/4741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:45 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1274 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:46.204540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:46.206186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:46.216968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.221074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.229262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.229963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.359369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e2bf97c4-e8f8-4a78-8e19-62b08d1fd1d1 req-544c4ad2-a577-4ba3-b90c-2edbfd353d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aacbb16-218a-4c65-8f79-5c5b2c4d5f79", "name": "network-vif-plugged", "status": "completed", "tag": "e803796e-dec2-4bf1-862b-d9088b0c5b59"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:46.377737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e2bf97c4-e8f8-4a78-8e19-62b08d1fd1d1 req-544c4ad2-a577-4ba3-b90c-2edbfd353d31 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.378186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e2bf97c4-e8f8-4a78-8e19-62b08d1fd1d1 req-544c4ad2-a577-4ba3-b90c-2edbfd353d31 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.400704 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e2bf97c4-e8f8-4a78-8e19-62b08d1fd1d1 req-544c4ad2-a577-4ba3-b90c-2edbfd353d31 service nova] Creating event network-vif-plugged:e803796e-dec2-4bf1-862b-d9088b0c5b59 for instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 on nch1-master-1 Jun 18 22:22:46.413144 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e2bf97c4-e8f8-4a78-8e19-62b08d1fd1d1 req-544c4ad2-a577-4ba3-b90c-2edbfd353d31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058249 Jun 18 22:22:46.414803 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2381/4742] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:22:46.496705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:46.514055 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65e0d49c-547a-486e-82b3-2d9c49c727e9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.310645 Jun 18 22:22:46.515848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2362/4743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:46 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:46.584075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:46.585015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:46.595922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.601964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.603021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.603617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.636138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:46.637398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:46.645912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.646618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.648259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:46.648860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:46.969954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:46.997745 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d200f432-f413-4b66-9e69-6a7a7674b40c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.362590 Jun 18 22:22:47.000670 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2363/4744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:46 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:47.088696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:47.100432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe0bab05-5973-4d75-9353-099a4bd95e93 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.524032 Jun 18 22:22:47.114043 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2382/4745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:46 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:47.429871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "794f4393-bb2e-4407-bcd1-975dd142d8d4"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:47.432111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:47.440244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.441141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.442183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.442859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.535440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:47.537520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:47.550942 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Invalid volume: volume 794f4393-bb2e-4407-bcd1-975dd142d8d4 is already attached to instances: bc927fb6-524d-4101-bc72-5939b8505361 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments HTTP/1.1 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 74 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: {"volumeAttachment": {"volumeId": "794f4393-bb2e-4407-bcd1-975dd142d8d4"}} Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid volume: volume 794f4393-bb2e-4407-bcd1-975dd142d8d4 is already attached to instances: bc927fb6-524d-4101-bc72-5939b8505361 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': 'bc927fb6-524d-4101-bc72-5939b8505361', 'body': {'volumeAttachment': {'volumeId': '794f4393-bb2e-4407-bcd1-975dd142d8d4'}}} Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 794f4393-bb2e-4407-bcd1-975dd142d8d4 is already attached to instances: bc927fb6-524d-4101-bc72-5939b8505361 Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:22:47.554983 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 794f4393-bb2e-4407-bcd1-975dd142d8d4 is already attached to instances: bc927fb6-524d-4101-bc72-5939b8505361 Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 794f4393-bb2e-4407-bcd1-975dd142d8d4 is already attached to instances: bc927fb6-524d-4101-bc72-5939b8505361 Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 400 to user: Invalid volume: volume 794f4393-bb2e-4407-bcd1-975dd142d8d4 is already attached to instances: bc927fb6-524d-4101-bc72-5939b8505361 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6057189-39c2-4ade-a147-69b3a38f37af tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134102 Jun 18 22:22:47.561197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2364/4746] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:22:47 2022] POST /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:22:47.564041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.566420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.567769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.570213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.628404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:47.628963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:47.636972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.637796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.638959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.639431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.761481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lazy-loading 'services' on Instance uuid bc927fb6-524d-4101-bc72-5939b8505361 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:22:47.861713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ad5eed59-9cf3-40a5-95e6-18e4fb332cb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments/794f4393-bb2e-4407-bcd1-975dd142d8d4" status: 202 len: 0 microversion: 2.1 time: 0.237509 Jun 18 22:22:47.862531 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2365/4747] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:22:47 2022] DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments/794f4393-bb2e-4407-bcd1-975dd142d8d4 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:22:47.873074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:47.874842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:47.882792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.883384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.884422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:47.885253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:47.908830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:47.923835 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46dba351-ecee-4bc3-bce5-ce81df64f240 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1314 microversion: 2.1 time: 0.395708 Jun 18 22:22:47.924972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2383/4748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:47 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:47.925230 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85169210-6938-4c81-bf0a-87aed0ea5fc6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053693 Jun 18 22:22:47.926063 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2366/4749] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:22:47 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:48.018342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:48.019184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:48.069209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:48.073781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:48.076080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:48.076979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:48.122199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:48.123348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:48.131207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:48.132009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:48.133062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:48.133940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:48.973112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:48.981283 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16f8da46-fe82-4b56-899e-116455d7d43d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.866197 Jun 18 22:22:48.981891 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2367/4750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:48 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:48.994114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c4a8cb26-b4d4-4540-b2e5-3e066fe2b978 req-f1b3b860-128e-4094-ac33-78fabef30484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82678d7b-d3bf-4ed3-b8f9-945d2279172e", "tag": "c53d5f7e-99ad-4718-b288-9c6b747e1b74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:49.014865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c4a8cb26-b4d4-4540-b2e5-3e066fe2b978 req-f1b3b860-128e-4094-ac33-78fabef30484 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.015326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c4a8cb26-b4d4-4540-b2e5-3e066fe2b978 req-f1b3b860-128e-4094-ac33-78fabef30484 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.039600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c4a8cb26-b4d4-4540-b2e5-3e066fe2b978 req-f1b3b860-128e-4094-ac33-78fabef30484 service nova] Creating event network-changed:c53d5f7e-99ad-4718-b288-9c6b747e1b74 for instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e on nch1-master-1 Jun 18 22:22:49.055203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c4a8cb26-b4d4-4540-b2e5-3e066fe2b978 req-f1b3b860-128e-4094-ac33-78fabef30484 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064664 Jun 18 22:22:49.056187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2368/4751] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:49.080192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:49.082288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:49.089086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:49.097967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.098919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.099996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.100700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.111377 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7593ffa4-7bea-4f8b-9ad6-acd165985a2a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 1.098985 Jun 18 22:22:49.112164 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2384/4752] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:48 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:49.138160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:49.141265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:49.157137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.158101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.159743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.160431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.167614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea173b8c-1352-47e6-94a4-d1c34cfbe6ce tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109908 Jun 18 22:22:49.168967 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2369/4753] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:22:49 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:22:49.259642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:49.260457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:49.268259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.268721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.270331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.272007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.305597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:49.401223 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b143ced5-4f4b-4b11-af11-69ac755eca58 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 204 len: 0 microversion: 2.1 time: 0.145414 Jun 18 22:22:49.402193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2370/4754] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:49 2022] DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:22:49.414210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:49.414920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:49.422024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.422741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.423696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.424307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.436901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:49.468823 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e69945a1-abe7-4ccf-8af7-7b5f09a4f646 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1501 microversion: 2.1 time: 0.345165 Jun 18 22:22:49.469477 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2385/4755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:49 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:49.485344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:49.486248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:49.492914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.493658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.494502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:49.494947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:49.717520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:49.730909 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1ae13e3a-4d39-4ba6-a5a0-548d4981ecb2 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1680 microversion: 2.1 time: 0.323186 Jun 18 22:22:49.732151 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2371/4756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:49 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1680 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:49.770636 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.security_group_api [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Removing security group 3dc55f30-9e9a-419a-8a71-b4aa3cc31c43 from port e803796e-dec2-4bf1-862b-d9088b0c5b59 Jun 18 22:22:50.001550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:50.002708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:50.015294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.015764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.018631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.019516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.257814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:50.269243 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d4ca6a7-6fbb-41f2-aef7-794cc16f533f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.272558 Jun 18 22:22:50.270527 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2372/4757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:49 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:50.276566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:50.277363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:50.286301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.287052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.288542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.289263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.315175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:50.341672 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8886c0e8-3d5d-437f-8228-7023ef10044e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79/action" status: 202 len: 0 microversion: 2.1 time: 0.859668 Jun 18 22:22:50.346289 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2386/4758] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:22:49 2022] POST /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:22:50.351662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:50.352307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:50.362396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.363322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.364972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.365609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.391039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:50.392249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:50.480824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:50.489903 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6063f5e2-04f8-4836-a07b-92130c0e635d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1459 microversion: 2.1 time: 0.142630 Jun 18 22:22:50.494318 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2387/4759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:50 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1459 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:50.511878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3e94afb2-75bc-436a-8293-b44eb62c1705 req-360a2b12-c78d-480a-926c-3874041a2057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aacbb16-218a-4c65-8f79-5c5b2c4d5f79", "tag": "e803796e-dec2-4bf1-862b-d9088b0c5b59"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:50.531182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3e94afb2-75bc-436a-8293-b44eb62c1705 req-360a2b12-c78d-480a-926c-3874041a2057 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.534431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3e94afb2-75bc-436a-8293-b44eb62c1705 req-360a2b12-c78d-480a-926c-3874041a2057 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.553501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3e94afb2-75bc-436a-8293-b44eb62c1705 req-360a2b12-c78d-480a-926c-3874041a2057 service nova] Creating event network-changed:e803796e-dec2-4bf1-862b-d9088b0c5b59 for instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 on nch1-master-1 Jun 18 22:22:50.573211 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3e94afb2-75bc-436a-8293-b44eb62c1705 req-360a2b12-c78d-480a-926c-3874041a2057 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077561 Jun 18 22:22:50.573950 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2388/4760] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:50.586773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:50.592659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:50.606191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.606921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.608553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:50.609229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:50.968255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:50.976865 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9db8ceaf-6778-4985-a1f0-a707480bdbf3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.704925 Jun 18 22:22:50.987576 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2373/4761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:50 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:50.993061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:50.993911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:51.002346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.003619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.004615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.005247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.025863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:51.039840 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-abd53da1-fd70-4375-97ab-eac53408812e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.455895 Jun 18 22:22:51.043388 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2389/4762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:50 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:51.065668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:51.066695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:51.075040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.080825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.086378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.087098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.422351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:51.431617 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fe9dcb3-b3cf-4985-913f-b6d2643818d7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1680 microversion: 2.1 time: 0.442705 Jun 18 22:22:51.432576 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2374/4763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:50 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1680 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:51.446362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0d2e536c-5d94-4534-9d48-487fd80d7e82 req-7a54aaf3-fbe4-4615-a69c-2271e77fb275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82", "tag": "ae06257f-1684-4f22-9021-f5f2464bfba2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:51.461648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:51.468237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d2e536c-5d94-4534-9d48-487fd80d7e82 req-7a54aaf3-fbe4-4615-a69c-2271e77fb275 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.468937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d2e536c-5d94-4534-9d48-487fd80d7e82 req-7a54aaf3-fbe4-4615-a69c-2271e77fb275 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.471742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-518c41f0-abb0-4bd5-b1cc-dca921a8ac66 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.410670 Jun 18 22:22:51.485458 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0d2e536c-5d94-4534-9d48-487fd80d7e82 req-7a54aaf3-fbe4-4615-a69c-2271e77fb275 service nova] Creating event network-changed:ae06257f-1684-4f22-9021-f5f2464bfba2 for instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 on nch2-master-1 Jun 18 22:22:51.486114 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2390/4764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:51 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:51.491078 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0d2e536c-5d94-4534-9d48-487fd80d7e82 req-7a54aaf3-fbe4-4615-a69c-2271e77fb275 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057060 Jun 18 22:22:51.492351 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2375/4765] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:51.497591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:51.497784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:51.498552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:51.498676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:51.505651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.506108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.507118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.507724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.510232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.510913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.511881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.514960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.806608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:51.813432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:51.815556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-819782ae-1d84-4a7e-ae18-13f641007f3d tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.327568 Jun 18 22:22:51.816380 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2391/4766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:51 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:51.830641 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5bb2a1a4-d55d-44f5-a380-15ae3fb2e94b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.337057 Jun 18 22:22:51.841435 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2376/4767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:51 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:51.849554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:51.850372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:51.857895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.858444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.859125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:51.859563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:51.996933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:51.999771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:52.017588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:52.021641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:52.038427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:52.040522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:52.074484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:52.086675 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5c6850b1-5ce0-47ca-8510-b13e2bfcd733 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.242806 Jun 18 22:22:52.091867 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2392/4768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:51 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:52.168119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1555700145", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a4647eff-e46f-4758-90a6-f87dcd82bc48"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:52.236070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] validate_networks() for [('a4647eff-e46f-4758-90a6-f87dcd82bc48', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:22:52.516605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:52.525445 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-926c10f8-c1f7-44ed-921e-5f2e0850b827 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.532994 Jun 18 22:22:52.535489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2377/4769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:51 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:52.542303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:52.543240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:52.553859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:52.554731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:52.556269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:52.557001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:52.606771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:52.715817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:53.045482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:53.311807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:53.326807 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3f26692-e21f-4c6b-a17a-28ee0fb99c27 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1680 microversion: 2.1 time: 0.789768 Jun 18 22:22:53.327608 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2378/4770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:52 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1680 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:53.332385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:53.333017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:53.340727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:53.341453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:53.342332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:53.343126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:53.707086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:22:53.708858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:22:53.709628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:22:53.711254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:22:53.711946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:22:53.723797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:53.724313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:53.725278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:53.725833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:53.756729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:22:53.764819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Getting quotas for user ab975e8ffd0448939b2105aed58003fe and project 6269e5969c6a4957b3bb1816d93cebd0. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:22:53.781864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:22:53.785903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:22:53.820105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:53.837897 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e76005dc-554d-4339-9870-1114d3fb1b76 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.506176 Jun 18 22:22:53.840826 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2379/4771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:53 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:53.855123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:53.855985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:53.865608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:53.866325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:53.867339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:53.868116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:53.878681 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4c8573e-9a54-498a-ad95-f0db0a6e6261 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715199 Jun 18 22:22:53.879646 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2393/4772] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:22:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:22:53.890041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c1f45cc-e6c3-47bd-969f-935b3b571f51 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:53.895221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c1f45cc-e6c3-47bd-969f-935b3b571f51 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:54.137595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c1f45cc-e6c3-47bd-969f-935b3b571f51 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:54.155106 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c1f45cc-e6c3-47bd-969f-935b3b571f51 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1215 microversion: 2.1 time: 0.264974 Jun 18 22:22:54.158367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2394/4773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:53 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1215 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:54.345875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:54.347782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:54.358424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:54.362283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:54.363205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:54.363664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:54.386708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:54.397505 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80609809-b0ac-470c-abf3-7c9fbb8b2031 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.552068 Jun 18 22:22:54.414706 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2380/4774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:53 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:54.788477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:54.804054 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b8d12f8d-7c37-4d9e-b48f-bc03e7daf48e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1680 microversion: 2.1 time: 0.463597 Jun 18 22:22:54.804922 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2395/4775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:54 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1680 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:54.858767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:54.859410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:54.867331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:54.868046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:54.869292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:54.869899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.178068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:55.178877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:55.192789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.193571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.194616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.195940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.305213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:55.316706 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-86a4390c-0fd0-4379-b1d9-39bc32f108d4 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.463095 Jun 18 22:22:55.318206 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2381/4776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:54 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:55.359361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:55.385964 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7dd22761-a085-408f-8f1e-eeace3edf8a0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1267 microversion: 2.1 time: 0.215370 Jun 18 22:22:55.390797 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2396/4777] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:55 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:55.422901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:55.425627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:55.439708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.440280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.441658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.443339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.536515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:55.538050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:55.550541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.551239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.552174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.554125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.618228 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c19a31d-d0d5-4761-9073-d162ae40bdf6 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "POST /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1/action" status: 200 len: 32624 microversion: 2.1 time: 0.086133 Jun 18 22:22:55.619587 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2397/4778] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:22:55 2022] POST /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1/action => generated 32624 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:22:55.748289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:55.762538 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b3fd968-25ca-4387-8bd3-20a319cddb57 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.344647 Jun 18 22:22:55.763214 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2382/4779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:55 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:55.825170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:55.826508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:55.840740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.841636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:55.843098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:55.844115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.006199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dc4b352e-bfb7-4328-a6b6-96c9d05c323e req-daf12b8c-b5a3-402c-871a-b42caadfbb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82", "name": "network-vif-plugged", "status": "completed", "tag": "ae06257f-1684-4f22-9021-f5f2464bfba2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:56.019840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dc4b352e-bfb7-4328-a6b6-96c9d05c323e req-daf12b8c-b5a3-402c-871a-b42caadfbb04 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.020727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dc4b352e-bfb7-4328-a6b6-96c9d05c323e req-daf12b8c-b5a3-402c-871a-b42caadfbb04 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.056585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:56.072042 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-062578e2-96ff-49d5-ad01-d22a06612886 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 200 len: 1613 microversion: 2.1 time: 0.252818 Jun 18 22:22:56.083539 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dc4b352e-bfb7-4328-a6b6-96c9d05c323e req-daf12b8c-b5a3-402c-871a-b42caadfbb04 service nova] Creating event network-vif-plugged:ae06257f-1684-4f22-9021-f5f2464bfba2 for instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 on nch2-master-1 Jun 18 22:22:56.085505 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2398/4780] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:55 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 1613 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:56.089314 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dc4b352e-bfb7-4328-a6b6-96c9d05c323e req-daf12b8c-b5a3-402c-871a-b42caadfbb04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090321 Jun 18 22:22:56.090205 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2383/4781] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:22:56.128891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8bb69fec-941c-452e-88f9-0942ec62cff2 req-8a934a55-1caf-478b-924b-ede6505c156b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc927fb6-524d-4101-bc72-5939b8505361", "name": "network-vif-deleted", "tag": "e5c36ec9-9ac0-4532-ba55-3eb65c2272af"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:56.150053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8bb69fec-941c-452e-88f9-0942ec62cff2 req-8a934a55-1caf-478b-924b-ede6505c156b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.150515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8bb69fec-941c-452e-88f9-0942ec62cff2 req-8a934a55-1caf-478b-924b-ede6505c156b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.186530 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8bb69fec-941c-452e-88f9-0942ec62cff2 req-8a934a55-1caf-478b-924b-ede6505c156b service nova] Creating event network-vif-deleted:e5c36ec9-9ac0-4532-ba55-3eb65c2272af for instance bc927fb6-524d-4101-bc72-5939b8505361 on nch1-master-1 Jun 18 22:22:56.199454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8bb69fec-941c-452e-88f9-0942ec62cff2 req-8a934a55-1caf-478b-924b-ede6505c156b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074517 Jun 18 22:22:56.205480 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2399/4782] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:22:56.344594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:56.345978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:56.357626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.358709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.359714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.361311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.409974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:56.410733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:56.427059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.428999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.431031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.433699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.714884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:56.729662 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4383bfaf-5054-45c9-b8c7-37b0300a6612 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1273 microversion: 2.1 time: 0.323724 Jun 18 22:22:56.731022 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2400/4783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:56 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1273 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:56.786325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:56.789771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:56.816129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.816607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:56.818622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:56.819067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:57.194757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:57.206438 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67aa07cb-31c9-45d9-82f1-2356bc313286 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1325 microversion: 2.1 time: 0.874811 Jun 18 22:22:57.216923 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2384/4784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:56 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1325 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:57.226508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:57.227187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:57.240721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:57.241289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:57.245552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:57.246061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:57.272059 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 HTTP/1.1 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'bc927fb6-524d-4101-bc72-5939b8505361'} Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:57.274589 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-341f9295-2619-4161-876c-49c3f07d656e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 404 len: 111 microversion: 2.1 time: 0.058280 Jun 18 22:22:57.280313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2385/4785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:57 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:22:57.294270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f264c1b9-62c3-4d97-b64a-1d47f09c2b8a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '.version_select at 0x7fea142e3ee0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:57.325977 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f264c1b9-62c3-4d97-b64a-1d47f09c2b8a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404588194" status: 202 len: 0 microversion: 2.1 time: 0.042212 Jun 18 22:22:57.327167 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2386/4786] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:22:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404588194 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:22:57.486813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:57.487650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:57.503940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:57.504289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:57.507760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:57.511063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:57.545369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9cd39fa3-2218-42c9-877f-039a2357afd6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/ips" status: 200 len: 152 microversion: 2.20 time: 0.065322 Jun 18 22:22:57.546543 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2387/4787] 10.222.0.30 () {60 vars in 1288 bytes} [Sat Jun 18 22:22:57 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/ips => generated 152 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 18 22:22:57.619507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:57.632588 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-34f76439-44db-4087-907b-9fc64277f007 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.853412 Jun 18 22:22:57.633312 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2401/4788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:56 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:57.747623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:57.748477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:57.752516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:22:57.761387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:57.761859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:57.773169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:57.773701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.005768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:58.007929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:58.063696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.065450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.080565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.083850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.176968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:22:58.362577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:58.377846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a6fcd33d-631c-47d7-a8b2-af6a90e5a23b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 0.634790 Jun 18 22:22:58.382509 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2388/4789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:57 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:22:58.389543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ce8b3845-3ef4-4d04-8036-f743223e3ba7 req-6da27f9f-7bc8-4b81-8643-1b667b59ec50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82678d7b-d3bf-4ed3-b8f9-945d2279172e", "name": "network-vif-plugged", "status": "completed", "tag": "c53d5f7e-99ad-4718-b288-9c6b747e1b74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:58.391731 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-59df3fc1-7380-42fe-996b-62690303c017 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "DELETE /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 204 len: 0 microversion: 2.1 time: 0.385176 Jun 18 22:22:58.392968 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2402/4790] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:22:57 2022] DELETE /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:22:58.404645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:58.407838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:58.428741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.429511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.430511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.430965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ce8b3845-3ef4-4d04-8036-f743223e3ba7 req-6da27f9f-7bc8-4b81-8643-1b667b59ec50 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.431572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ce8b3845-3ef4-4d04-8036-f743223e3ba7 req-6da27f9f-7bc8-4b81-8643-1b667b59ec50 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.435162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.461583 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ce8b3845-3ef4-4d04-8036-f743223e3ba7 req-6da27f9f-7bc8-4b81-8643-1b667b59ec50 service nova] Creating event network-vif-plugged:c53d5f7e-99ad-4718-b288-9c6b747e1b74 for instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e on nch1-master-1 Jun 18 22:22:58.473306 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ce8b3845-3ef4-4d04-8036-f743223e3ba7 req-6da27f9f-7bc8-4b81-8643-1b667b59ec50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087169 Jun 18 22:22:58.473944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2389/4791] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:58.488739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-46d28cd0-dc06-4724-acf8-9424ba64dc44 req-d904ead4-0708-44b8-9369-1c63eb09600c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b9d81e-5b35-4bd1-bb60-f227804e41f1", "tag": "251edfcf-1c82-45d5-9965-7e832dbf289d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:22:58.509579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46d28cd0-dc06-4724-acf8-9424ba64dc44 req-d904ead4-0708-44b8-9369-1c63eb09600c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.511961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46d28cd0-dc06-4724-acf8-9424ba64dc44 req-d904ead4-0708-44b8-9369-1c63eb09600c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.543799 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-46d28cd0-dc06-4724-acf8-9424ba64dc44 req-d904ead4-0708-44b8-9369-1c63eb09600c service nova] Creating event network-changed:251edfcf-1c82-45d5-9965-7e832dbf289d for instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 on nch2-master-1 Jun 18 22:22:58.558299 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-46d28cd0-dc06-4724-acf8-9424ba64dc44 req-d904ead4-0708-44b8-9369-1c63eb09600c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080744 Jun 18 22:22:58.558958 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2390/4792] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:22:58.573258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:58.574106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:58.589406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.622658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:58.627718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:58.628481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:59.313481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:59.330484 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5192677a-bfe4-4925-9952-29b4260ab81c tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1523 microversion: 2.1 time: 0.935752 Jun 18 22:22:59.333416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2403/4793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:58 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1523 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:59.338919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:59.339874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:59.350141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:59.363622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:59.365832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:59.372318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:59.407314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:22:59.418996 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f08d4157-3a4c-4ea3-a2d8-19b7c51fa21d tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1670 microversion: 2.1 time: 0.858005 Jun 18 22:22:59.425383 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2391/4794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:58 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1670 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:22:59.425383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:59.431362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:59.438149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:59.438867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:59.439985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:59.440590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:59.499676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] HTTP exception thrown: Instance is not a member of specified network Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Request method failure captured: Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82/ips/invalid HTTP/1.1 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAwGXb1yTtKROq2yAxvy8PtnysMDWWGws3usWB0YYMm01fTxs2f4HYQQUlV_hiEOm2E1vSSYI6uP7C8qzyT2cKj_bN_2keRActX42mJXuU2GlBZd63Tx921wDexXMBxmxhWuxOpfMSlHIHknfVj8ak0x54zi1_VnEG3h_qROcBC5C4 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7dc17b4ab1a149728470cc0d7d1ff38f Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7dc17b4ab1a149728470cc0d7d1ff38f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7dc17b4ab1a149728470cc0d7d1ff38f Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerAddressesNegativeTestJSON-2012617714-project Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 247bbe467782453385f5d7b687597fee Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2012617714-project Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance is not a member of specified network Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': 'f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82', 'id': 'invalid'} Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jun 18 22:22:59.506238 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:22:59.511858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Returning 404 to user: Instance is not a member of specified network {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:22:59.513174 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dfb4691a-4d87-410e-b744-90603bbf087f tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.092019 Jun 18 22:22:59.514154 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2392/4795] 10.222.0.30 () {58 vars in 1271 bytes} [Sat Jun 18 22:22:59 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82/ips/invalid => generated 91 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:22:59.520453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:22:59.521718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:22:59.531975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:59.532757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:22:59.534037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:22:59.534673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.066862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:00.079702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c7152e6-0ac2-43ca-80d8-62e20e3e7317 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1316 microversion: 2.1 time: 0.744763 Jun 18 22:23:00.080293 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2404/4796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:59 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1316 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:00.086407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf35cbc2-708c-47ce-9c65-c01cc1846c03 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:00.087068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cf35cbc2-708c-47ce-9c65-c01cc1846c03 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Failed to fetch instance by id 999 {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:23:00.087749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-cf35cbc2-708c-47ce-9c65-c01cc1846c03 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] HTTP exception thrown: Instance 999 could not be found. Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf35cbc2-708c-47ce-9c65-c01cc1846c03 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Request method failure captured: Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAwGXb1yTtKROq2yAxvy8PtnysMDWWGws3usWB0YYMm01fTxs2f4HYQQUlV_hiEOm2E1vSSYI6uP7C8qzyT2cKj_bN_2keRActX42mJXuU2GlBZd63Tx921wDexXMBxmxhWuxOpfMSlHIHknfVj8ak0x54zi1_VnEG3h_qROcBC5C4 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 7dc17b4ab1a149728470cc0d7d1ff38f Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7dc17b4ab1a149728470cc0d7d1ff38f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 7dc17b4ab1a149728470cc0d7d1ff38f Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerAddressesNegativeTestJSON-2012617714-project Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 247bbe467782453385f5d7b687597fee Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2012617714-project Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 999 could not be found. Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '999'} Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 18 22:23:00.089981 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:00.096278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cf35cbc2-708c-47ce-9c65-c01cc1846c03 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Returning 404 to user: Instance 999 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:00.097241 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cf35cbc2-708c-47ce-9c65-c01cc1846c03 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.015555 Jun 18 22:23:00.098007 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2405/4797] 10.222.0.30 () {58 vars in 1148 bytes} [Sat Jun 18 22:23:00 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:23:00.103526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:00.104578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:00.113542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:00.116646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.117424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.118402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.119070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.147080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lazy-loading 'flavor' on Instance uuid 2a4646f0-25bf-42be-8cc1-a641b535d3f9 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:23:00.150862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:00.219208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:00.231840 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1fe9e21d-ec7c-4705-af1c-4fd00e99cf1f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 0.716158 Jun 18 22:23:00.233077 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2393/4798] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:22:59 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:00.242676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:00.243517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:00.254654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.255805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.257230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.257872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.303834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:23:00.311768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:00.464786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0bd2a37-44ee-425d-ac17-25ec92ca38fb tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 204 len: 0 microversion: 2.1 time: 0.228889 Jun 18 22:23:00.472418 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2394/4799] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:23:00 2022] DELETE /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:23:00.480952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:00.481869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:00.489948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.490610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.491541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.492155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.514347 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92c03605-f788-4ae6-bded-2c4bec2364cc tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/action" status: 202 len: 0 microversion: 2.20 time: 0.413906 Jun 18 22:23:00.519480 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2406/4800] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:23:00 2022] POST /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:23:00.526085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:00.527114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:00.534994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.535961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.536910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:00.537646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:00.936724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:00.946345 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4bffd1a-a3d0-4c23-8fb5-a4db653112f3 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1602 microversion: 2.1 time: 0.469599 Jun 18 22:23:00.947291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2395/4801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:00 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1602 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:00.967207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36531def-1de3-4358-b5b6-ac17fae68dbe tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: .version_select at 0x7fea140b51f0>, body: {"keypair": {"name": "tempest-keypair-794992573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj2VX/7PykVl1Ds1VKrF+rr+n3l4WWo92V32sOEPv0ZrWtKVBqfmbGQPSHK9Xv6cwQwW5/80d57DxUsu9zjmmtxBfr7XVl7M6z1HXxLRCTMl8B79XBlnKPnuC/vVGRkiw=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:00.982015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-36531def-1de3-4358-b5b6-ac17fae68dbe tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:23:00.987373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-36531def-1de3-4358-b5b6-ac17fae68dbe tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:23:01.019807 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36531def-1de3-4358-b5b6-ac17fae68dbe tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059597 Jun 18 22:23:01.021640 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2396/4802] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:23:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:01.044407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:01.045163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:01.056656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.057161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.058106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.059084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.093624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:01.103848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a009a8ba-e0e9-43f4-94af-aeb4010ecc1e tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1529 microversion: 2.1 time: 0.582771 Jun 18 22:23:01.117255 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2407/4803] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:00 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1529 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:01.125057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-57e6542f-63eb-40e5-9c79-b39944ea3240 req-53f39721-872e-4b0c-a85d-31d7f510e84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d26a21-15cf-4bd1-be51-8786cd9886e9", "tag": "e7f4a31c-4c09-4041-9779-5042bbe1f4c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:01.134791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-57e6542f-63eb-40e5-9c79-b39944ea3240 req-53f39721-872e-4b0c-a85d-31d7f510e84e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.135242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-57e6542f-63eb-40e5-9c79-b39944ea3240 req-53f39721-872e-4b0c-a85d-31d7f510e84e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.171381 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-57e6542f-63eb-40e5-9c79-b39944ea3240 req-53f39721-872e-4b0c-a85d-31d7f510e84e service nova] Creating event network-changed:e7f4a31c-4c09-4041-9779-5042bbe1f4c6 for instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 on nch2-master-1 Jun 18 22:23:01.183318 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-57e6542f-63eb-40e5-9c79-b39944ea3240 req-53f39721-872e-4b0c-a85d-31d7f510e84e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061961 Jun 18 22:23:01.187158 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2408/4804] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:01.199176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:01.199893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:01.211680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.212135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.213925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.214690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.440806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:01.455474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:01.458282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:01.460032 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7564bffe-403c-41a5-bfef-6143a4abdf85 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.436191 Jun 18 22:23:01.460851 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2397/4805] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:01 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:01.467298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:01.468833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:01.479204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.479681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.481565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.482921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.543044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:01.552288 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c445414-789d-4458-a118-14cf59ed6c86 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.364190 Jun 18 22:23:01.553332 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2409/4806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:01 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:01.690032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2020418505", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:01.765115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] validate_networks() for [('9b042883-87aa-470b-a375-8fa5157a8e61', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:23:01.855073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:01.868463 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d9f4c3e6-17b5-4d2b-a42a-f5f61a801499 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 0.405931 Jun 18 22:23:01.886657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2398/4807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:01 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:01.972817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:01.973478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:01.983166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.983883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:01.984701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:01.985424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:02.052901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:02.053440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:02.054081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lazy-loading 'fault' on Instance uuid 36b9d81e-5b35-4bd1-bb60-f227804e41f1 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:23:02.171080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa130c208d44d798cb0a5ba41193976', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '970d8031a4b149188d5a2bee95524169', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:02.179618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-066b8f73-9975-4998-92ca-ef11ce509380 tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 200 len: 1338 microversion: 2.1 time: 0.216314 Jun 18 22:23:02.189537 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2399/4808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:01 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:02.198253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:02.198874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:02.205902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:02.206428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:02.207331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:02.207901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:02.622004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:02.630083 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-84344617-c781-4723-bd6b-96b1560b33a3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1529 microversion: 2.1 time: 0.439290 Jun 18 22:23:02.631341 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2400/4809] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:02 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1529 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:02.636167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:02.636862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:02.643456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:02.644278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:02.645338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:02.646007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.022137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:23:03.023322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:23:03.024759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:23:03.025578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:23:03.026642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:23:03.040572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.041566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.042902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.043873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.090637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Getting quotas for project a88cba0e44af4875b05d6c3546cf0543. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:23:03.097010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Getting quotas for user 719d3fb4f7f44c239e03b5f7076edcc8 and project a88cba0e44af4875b05d6c3546cf0543. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:23:03.113308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:23:03.116161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:23:03.152221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:03.171360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:03.175796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8317d7ff-d146-4459-b02a-86d9127601f7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.489841 Jun 18 22:23:03.177299 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2410/4810] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:23:03.185343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:03.186246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:03.189458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:03.193351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.194028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.195024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.195526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b7bceec-ecea-4bc3-97ed-17f094ab5823 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.558556 Jun 18 22:23:03.196096 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2401/4811] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:02 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:03.196430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.218235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-96da1e7d-bbae-4183-8cc2-526c9253d754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:03.218886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-96da1e7d-bbae-4183-8cc2-526c9253d754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:03.384549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-96da1e7d-bbae-4183-8cc2-526c9253d754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:03.394094 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-96da1e7d-bbae-4183-8cc2-526c9253d754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1217 microversion: 2.1 time: 0.186375 Jun 18 22:23:03.406424 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2402/4812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:03 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:03.406424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:03.406424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] [instance: 36b9d81e-5b35-4bd1-bb60-f227804e41f1] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:03.412483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.413269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.414156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.414792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.435513 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] HTTP exception thrown: Instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 could not be found. Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Request method failure captured: Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 HTTP/1.1 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk8pf6lXk9rS5ppzqJrGEIlBUsvNlMkvvZc_OSJiyrUUthdGMtG7CJLO0K702KDlaqxMdnaJJayBbUcWELzDkmaDzjPlbSA7XenKQiHK_MpCVgknZXt9YZvS7s_UF-nAzr_jLpkpXUiCpq4NzyK8zp447xWeWyTRmCXQzmdz0u_HIjk Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 970d8031a4b149188d5a2bee95524169 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestNetworkBasicOps-665639190 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/970d8031a4b149188d5a2bee95524169"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/970d8031a4b149188d5a2bee95524169"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/970d8031a4b149188d5a2bee95524169"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_970d8031a4b149188d5a2bee95524169", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestNetworkBasicOps-665639190 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 970d8031a4b149188d5a2bee95524169 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestNetworkBasicOps-665639190 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestNetworkBasicOps-665639190-project Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: caa130c208d44d798cb0a5ba41193976 Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestNetworkBasicOps-665639190-project Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 could not be found. Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '36b9d81e-5b35-4bd1-bb60-f227804e41f1'} Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 could not be found. Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 could not be found. Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:03.437441 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 could not be found. Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Returning 404 to user: Instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:03.442240 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6fa05b46-bb5c-4f7a-bd4b-24443b322dfd tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1" status: 404 len: 111 microversion: 2.1 time: 0.043171 Jun 18 22:23:03.444429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2403/4813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:03 2022] GET /compute/v2.1/servers/36b9d81e-5b35-4bd1-bb60-f227804e41f1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:23:03.450226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-bd3b0df4-4233-4e8f-bbc3-a3998ab39e99 req-739d8703-d30f-446d-87f9-d7915edee46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b9d81e-5b35-4bd1-bb60-f227804e41f1", "name": "network-vif-deleted", "tag": "251edfcf-1c82-45d5-9965-7e832dbf289d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:03.461595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bd3b0df4-4233-4e8f-bbc3-a3998ab39e99 req-739d8703-d30f-446d-87f9-d7915edee46c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.462058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bd3b0df4-4233-4e8f-bbc3-a3998ab39e99 req-739d8703-d30f-446d-87f9-d7915edee46c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.476421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-bd3b0df4-4233-4e8f-bbc3-a3998ab39e99 req-739d8703-d30f-446d-87f9-d7915edee46c service nova] Creating event network-vif-deleted:251edfcf-1c82-45d5-9965-7e832dbf289d for instance 36b9d81e-5b35-4bd1-bb60-f227804e41f1 on nch2-master-1 Jun 18 22:23:03.481797 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-bd3b0df4-4233-4e8f-bbc3-a3998ab39e99 req-739d8703-d30f-446d-87f9-d7915edee46c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035600 Jun 18 22:23:03.482442 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2404/4814] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:03.652344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:03.653102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:03.668977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.669491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:03.670658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:03.671124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:04.183658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:04.193641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02c6ad0a-d503-4ea6-801a-8f4a11c7180d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 1.015060 Jun 18 22:23:04.204116 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2411/4815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:03 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:04.211736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23017e0f-9642-479a-8046-9a90040353cc tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] Calling method '.version_select at 0x7fea0796b1f0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:04.235565 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23017e0f-9642-479a-8046-9a90040353cc tempest-TestNetworkBasicOps-665639190 tempest-TestNetworkBasicOps-665639190-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1010574615" status: 202 len: 0 microversion: 2.1 time: 0.029967 Jun 18 22:23:04.236419 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2412/4816] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 22:23:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1010574615 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:23:04.242509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:04.243420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:04.250410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:04.251082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:04.252633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:04.253113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:04.351043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:04.364193 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3456b73b-a45e-4b07-8393-5cc79dc8672a tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1529 microversion: 2.1 time: 0.716977 Jun 18 22:23:04.373855 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2405/4817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:03 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1529 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:04.422278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:04.423904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:04.436453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:04.437479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:04.438137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:04.438679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:04.661858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:04.670805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-707e5ff2-cf62-4097-b011-b956d53888da tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1287 microversion: 2.1 time: 0.260060 Jun 18 22:23:04.671402 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2406/4818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:04 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1287 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:04.798045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:04.806499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:04.808043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:04.809278 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4654b0c-b728-4dd5-82d5-da8131eb1e89 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.571657 Jun 18 22:23:04.809830 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2413/4819] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:04 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:05.030714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6e122867-209d-43f5-b095-4d6b578b65e3 req-ab317969-6803-4801-ad73-be851557101d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82", "name": "network-vif-deleted", "tag": "ae06257f-1684-4f22-9021-f5f2464bfba2"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:05.051700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6e122867-209d-43f5-b095-4d6b578b65e3 req-ab317969-6803-4801-ad73-be851557101d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.052485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6e122867-209d-43f5-b095-4d6b578b65e3 req-ab317969-6803-4801-ad73-be851557101d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.078833 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6e122867-209d-43f5-b095-4d6b578b65e3 req-ab317969-6803-4801-ad73-be851557101d service nova] Creating event network-vif-deleted:ae06257f-1684-4f22-9021-f5f2464bfba2 for instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 on nch2-master-1 Jun 18 22:23:05.087621 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6e122867-209d-43f5-b095-4d6b578b65e3 req-ab317969-6803-4801-ad73-be851557101d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071949 Jun 18 22:23:05.089357 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2407/4820] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:05.211207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:05.215335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:05.232638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.233260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.234109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.234828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.386636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:05.388906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:05.399768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.400672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.402644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.403367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.468715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.469512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.470142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lazy-loading 'fault' on Instance uuid f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:23:05.599588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247bbe467782453385f5d7b687597fee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc17b4ab1a149728470cc0d7d1ff38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:05.614824 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20000f32-a90f-4b25-b6ba-3efcb0241c21 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 200 len: 1315 microversion: 2.1 time: 0.235844 Jun 18 22:23:05.630098 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2408/4821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:05 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:05.688891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:05.689647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:05.700723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.704933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.706051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.706503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.821392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:05.837643 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9acb6992-916c-41b3-a151-46ef0c3d8c70 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 0.630236 Jun 18 22:23:05.838528 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2414/4822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:05 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:05.851823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-489645562", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c338c1-54d0-4b94-9891-fcb2729daf72"}], "security_groups": [{"name": "tempest-securitygroup--1108329902"}], "key_name": "tempest-keypair-794992573", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:05.878615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:05.888881 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-defb9107-5824-44db-bbfd-fb17bb94549a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1275 microversion: 2.1 time: 0.204277 Jun 18 22:23:05.893654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2409/4823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:05 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:05.909372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:05.910012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:05.931790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.932254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:05.933065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:05.933704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:06.160085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] validate_networks() for [('b8c338c1-54d0-4b94-9891-fcb2729daf72', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:23:06.468476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:06.477635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:06.488205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:06.489820 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8e16a94e-c49d-40a1-8104-439e6719f3a9 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.595110 Jun 18 22:23:06.490682 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2410/4824] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:05 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:06.637119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:06.637994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] [instance: f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:06.653576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:06.654054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:06.656534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:06.657001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:06.688270 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] HTTP exception thrown: Instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 could not be found. Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Request method failure captured: Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 HTTP/1.1 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAwGXb1yTtKROq2yAxvy8PtnysMDWWGws3usWB0YYMm01fTxs2f4HYQQUlV_hiEOm2E1vSSYI6uP7C8qzyT2cKj_bN_2keRActX42mJXuU2GlBZd63Tx921wDexXMBxmxhWuxOpfMSlHIHknfVj8ak0x54zi1_VnEG3h_qROcBC5C4 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7dc17b4ab1a149728470cc0d7d1ff38f Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7dc17b4ab1a149728470cc0d7d1ff38f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7dc17b4ab1a149728470cc0d7d1ff38f", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7dc17b4ab1a149728470cc0d7d1ff38f Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2012617714 Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerAddressesNegativeTestJSON-2012617714-project Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 247bbe467782453385f5d7b687597fee Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2012617714-project Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 could not be found. Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82'} Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 could not be found. Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 could not be found. Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:06.689971 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 could not be found. Jun 18 22:23:06.695538 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:06.697282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] Returning 404 to user: Instance f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:06.698357 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22e2c202-fb1a-47ed-84fb-a94b4345d3f3 tempest-ServerAddressesNegativeTestJSON-2012617714 tempest-ServerAddressesNegativeTestJSON-2012617714-project] 10.222.0.30 "GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82" status: 404 len: 111 microversion: 2.1 time: 0.065398 Jun 18 22:23:06.702777 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2411/4825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:06 2022] GET /compute/v2.1/servers/f9f0e77a-e11d-4fa2-ae0a-d6e1cc4d3f82 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:23:06.859799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:06.860631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:06.875038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:06.878571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:06.879618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:06.880226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:07.918776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:07.928081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88a9fe74-15ee-466c-a0ce-ad0fff7a4e3c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 1.074322 Jun 18 22:23:07.931679 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2412/4826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:06 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:07.936884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:07.953524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:07.969978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:07.970605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:07.973664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:07.976695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:08.454873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:23:08.455413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:23:08.455773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:23:08.456409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:23:08.457226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:23:08.461077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:08.463767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:08.478677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:08.479304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:08.480998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:08.481660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:08.492093 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-626c885e-8c45-47c5-a612-ab18d0c5987c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.557274 Jun 18 22:23:08.501969 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2413/4827] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:07 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:08.506786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:08.508539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:08.536111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:08.538718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:08.542103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:08.543806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:08.551065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:23:08.558055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Getting quotas for user 7a41eb42094f418685b83cc0a57852d5 and project e7126d757bd748f291963f779f8eaad3. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:23:08.598953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:23:08.606527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:23:08.731074 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed86e80f-0c46-4304-85d7-fa4cc645ef49 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.889584 Jun 18 22:23:08.732864 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2415/4828] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:23:08.752749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a93016ad-ba24-491b-9582-f4da43561041 req-ef68b60c-10b4-4e6d-83aa-33f41ad71c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d26a21-15cf-4bd1-be51-8786cd9886e9", "name": "network-vif-plugged", "status": "completed", "tag": "e7f4a31c-4c09-4041-9779-5042bbe1f4c6"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:08.807488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a93016ad-ba24-491b-9582-f4da43561041 req-ef68b60c-10b4-4e6d-83aa-33f41ad71c92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:08.819241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a93016ad-ba24-491b-9582-f4da43561041 req-ef68b60c-10b4-4e6d-83aa-33f41ad71c92 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:08.844131 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a93016ad-ba24-491b-9582-f4da43561041 req-ef68b60c-10b4-4e6d-83aa-33f41ad71c92 service nova] Creating event network-vif-plugged:e7f4a31c-4c09-4041-9779-5042bbe1f4c6 for instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 on nch2-master-1 Jun 18 22:23:08.854883 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a93016ad-ba24-491b-9582-f4da43561041 req-ef68b60c-10b4-4e6d-83aa-33f41ad71c92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119077 Jun 18 22:23:08.855515 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2416/4829] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:08.867623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a49e841-4620-4a34-ac81-dc5ebe70d542 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:08.875787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8a49e841-4620-4a34-ac81-dc5ebe70d542 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:09.053472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a49e841-4620-4a34-ac81-dc5ebe70d542 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:09.072893 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a49e841-4620-4a34-ac81-dc5ebe70d542 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1240 microversion: 2.1 time: 0.208807 Jun 18 22:23:09.075108 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2417/4830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:08 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1240 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:09.085721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:09.088494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:09.104757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:09.106893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:09.109580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:09.110334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:09.187030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:09.201630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:09.204281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:09.205929 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f06fdbc9-5c44-4095-bc17-2837af95e2dd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.709894 Jun 18 22:23:09.222313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2414/4831] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:08 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:09.515217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:09.515931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:09.516969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:09.527957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:09.528679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:09.530054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:09.531786 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58c3861c-ed33-43a6-929a-2b5f4aa7252d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1315 microversion: 2.1 time: 0.453930 Jun 18 22:23:09.535111 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2418/4832] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:09 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:09.538428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:09.801592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:09.809918 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c4ff616-2538-4947-a2d4-2e78a9e0dcb9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.302107 Jun 18 22:23:09.810508 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2415/4833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:09 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:10.092497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:10.093569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:10.112376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.114074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.116506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.123183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.227004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:10.228453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:10.239005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.239852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.240869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.241683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.307050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:10.319618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5aae0943-b524-4abb-b6e3-4db4c602cb9b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1236 microversion: 2.1 time: 0.231059 Jun 18 22:23:10.320985 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2419/4834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:10 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1236 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:10.460080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-85745634-ea25-43a0-9701-4732f6415316 req-c4ee3abc-52e9-4b9d-9eeb-66c5e9cda6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c398202-642e-4031-bdc4-f9fc17356756", "tag": "798bc8c2-710d-4c03-a420-89ef757788b5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:10.493685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-85745634-ea25-43a0-9701-4732f6415316 req-c4ee3abc-52e9-4b9d-9eeb-66c5e9cda6b0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.498307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-85745634-ea25-43a0-9701-4732f6415316 req-c4ee3abc-52e9-4b9d-9eeb-66c5e9cda6b0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.535522 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-85745634-ea25-43a0-9701-4732f6415316 req-c4ee3abc-52e9-4b9d-9eeb-66c5e9cda6b0 service nova] Creating event network-changed:798bc8c2-710d-4c03-a420-89ef757788b5 for instance 1c398202-642e-4031-bdc4-f9fc17356756 on nch1-master-1 Jun 18 22:23:10.550931 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-85745634-ea25-43a0-9701-4732f6415316 req-c4ee3abc-52e9-4b9d-9eeb-66c5e9cda6b0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099843 Jun 18 22:23:10.551603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2420/4835] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:23:10.568282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:10.568705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:10.595210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.596102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.597311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.600623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.670637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:10.690351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:10.694589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:10.697562 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a24dba1-be50-44a3-b309-0bd5346b8d02 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.476806 Jun 18 22:23:10.698440 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2416/4836] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:10 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:10.828867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:10.829824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:10.845940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.847672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:10.850050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:10.850680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.287161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:11.312979 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5fc9fdd7-7e47-4579-b4a3-2bb0cfbf8851 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1502 microversion: 2.1 time: 0.740823 Jun 18 22:23:11.314418 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2421/4837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:10 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1502 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:11.330411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:11.337147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:11.356976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.361167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.362316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.362996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.420121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:11.431389 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-18e1de1f-23e8-4898-b2d0-8ddda30f0741 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.607352 Jun 18 22:23:11.445694 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2417/4838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:10 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:11.450788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:11.451410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:11.458015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.458913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.459892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.466566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.500257 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f27a4174-865c-4f60-bed2-a7d73d706ddf tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9/action" status: 202 len: 0 microversion: 2.1 time: 0.173635 Jun 18 22:23:11.504875 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2422/4839] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:23:11 2022] POST /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:23:11.512025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:11.512947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:11.520556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.521289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.522336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.522948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.655125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:11.663447 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-903c2a63-539a-48e8-8a92-35aae6c8dfa7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1298 microversion: 2.1 time: 0.216412 Jun 18 22:23:11.664248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2418/4840] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:11 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:11.724423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:11.725223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:11.731691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.732349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:11.733495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:11.733931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:12.303429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:12.316504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a08c9a9-f59d-4d1f-8809-d8be76dc7692 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1507 microversion: 2.1 time: 0.809564 Jun 18 22:23:12.318395 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2423/4841] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:11 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1507 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:12.448956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:12.449741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:12.465064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:12.467103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:12.469239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:12.470199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:12.515091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:12.552778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:12.562541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:12.565831 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-550c4302-63cd-4406-a288-c2719f059fb4 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.849940 Jun 18 22:23:12.567075 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2419/4842] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:11 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:12.681957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:12.682759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:12.689679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:12.690511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:12.691977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:12.692642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:12.831145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:12.840313 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-953227ae-495f-43bd-b709-44c3141c10da tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1298 microversion: 2.1 time: 0.161750 Jun 18 22:23:12.850656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2420/4843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:12 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:12.959226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:12.968834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f71d600-36fa-44ea-b3ee-baaf730e36e2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.524697 Jun 18 22:23:12.977636 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2424/4844] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:12 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:13.336181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:13.337295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:13.347025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:13.348001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:13.358191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:13.360275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:13.390085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:13.585734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:13.587023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:13.594470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:13.595184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:13.596731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:13.597396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:13.789138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:13.801507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-effc484d-d772-498b-900a-bda962563e3d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1487 microversion: 2.1 time: 0.470896 Jun 18 22:23:13.803651 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2421/4845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:13 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1487 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:13.818509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:13.819312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:13.828750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:13.829525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:13.830487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:13.831084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:13.866219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lazy-loading 'flavor' on Instance uuid 03d26a21-15cf-4bd1-be51-8786cd9886e9 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:23:14.280967 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9bcfb42d-dd0b-492a-9bbd-6d732712d1e0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9/action" status: 202 len: 0 microversion: 2.1 time: 0.465772 Jun 18 22:23:14.288101 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2422/4846] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:23:13 2022] POST /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:23:14.304086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:14.307767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:14.322380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:14.324957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:14.339297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:14.340920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:14.343073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:14.343404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:14.344305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:14.349940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:14.353313 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b26d390-e567-4bc7-89e0-02653cf46829 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1744 microversion: 2.20 time: 0.771548 Jun 18 22:23:14.356618 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2425/4847] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:13 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1744 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:14.367204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:14.372202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:14.403800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:14.406029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:14.407533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:14.411113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:15.050790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:15.072519 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-568a48bd-0995-41a0-b2da-02e1893e9b3a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.782655 Jun 18 22:23:15.073472 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2423/4848] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:14 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:15.081012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:15.082309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:15.094589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:15.095582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:15.096730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:15.097405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:15.180104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:15.223851 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1952080-537b-43a6-b229-189f4e27bbe4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.864572 Jun 18 22:23:15.224399 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2426/4849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:14 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:15.374066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:15.375040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:15.385632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:15.387746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:15.391177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:15.393509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:15.612290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:15.620300 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-84e51289-c0ef-49bf-be13-140f2017e7d5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1514 microversion: 2.1 time: 0.545601 Jun 18 22:23:15.624321 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2424/4850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:15 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1514 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:16.052494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-53a884f6-ba84-4fbd-a0b8-f806f52ef729 req-2702dbad-a2d7-4fad-9a67-a2dd13be828b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2bb1e2-5faa-463a-b3bf-3f63163cc71c", "tag": "4b048f89-2c90-48dd-9edc-60cdf4ab160a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:16.078276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-53a884f6-ba84-4fbd-a0b8-f806f52ef729 req-2702dbad-a2d7-4fad-9a67-a2dd13be828b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:16.079699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-53a884f6-ba84-4fbd-a0b8-f806f52ef729 req-2702dbad-a2d7-4fad-9a67-a2dd13be828b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:16.122823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:16.132870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:16.133992 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-53a884f6-ba84-4fbd-a0b8-f806f52ef729 req-2702dbad-a2d7-4fad-9a67-a2dd13be828b service nova] Creating event network-changed:4b048f89-2c90-48dd-9edc-60cdf4ab160a for instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c on nch2-master-1 Jun 18 22:23:16.135236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:16.136473 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9e2c96d-2ece-4f49-b071-a4e00056afb5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.766367 Jun 18 22:23:16.148103 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-53a884f6-ba84-4fbd-a0b8-f806f52ef729 req-2702dbad-a2d7-4fad-9a67-a2dd13be828b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098673 Jun 18 22:23:16.149691 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2425/4851] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:23:16.160349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2427/4852] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:15 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:16.177773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:16.178882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:16.203637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:16.204482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:16.205601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:16.206283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:16.240531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:16.241202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:16.248492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:16.248941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:16.272302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:16.273734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:17.467804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:17.477536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ad488f95-cb33-4b37-9a10-8ead8fc5d1f4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 1.317367 Jun 18 22:23:17.490006 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2426/4853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:16 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:17.495752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-87b0de79-c99b-4ea5-87cd-e54fb196de8f req-96b56717-88ed-42dc-a14e-5e14684fbf2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "name": "network-vif-plugged", "status": "completed", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:17.539328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:17.544326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-87b0de79-c99b-4ea5-87cd-e54fb196de8f req-96b56717-88ed-42dc-a14e-5e14684fbf2b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:17.560712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-87b0de79-c99b-4ea5-87cd-e54fb196de8f req-96b56717-88ed-42dc-a14e-5e14684fbf2b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:17.600174 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-87b0de79-c99b-4ea5-87cd-e54fb196de8f req-96b56717-88ed-42dc-a14e-5e14684fbf2b service nova] Creating event network-vif-plugged:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch2-master-1 Jun 18 22:23:17.632421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-87b0de79-c99b-4ea5-87cd-e54fb196de8f req-96b56717-88ed-42dc-a14e-5e14684fbf2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140658 Jun 18 22:23:17.633572 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2427/4854] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:17.642891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:17.650681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:17.664027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:17.665704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:17.669265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:17.670003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:17.876476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:17.885659 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b2e2199-cfc0-41aa-bafb-43a85ac965ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 1.649235 Jun 18 22:23:17.893846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2428/4855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:16 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:17.899183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:17.900688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:17.915105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:17.916019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:17.918901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:17.925594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:17.981272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:17.989805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d725fefd-a9fa-427b-bb52-6024e35d0c97 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.354835 Jun 18 22:23:17.997768 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2428/4856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:17 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:18.507391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:18.508882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:18.519485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:18.525997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:18.526455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:18.527250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:18.527688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:18.529302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:18.538719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:18.542498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:18.548169 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cdd43c62-75a1-41c8-9e11-db128be6effd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.652037 Jun 18 22:23:18.569052 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2429/4857] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:17 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:18.911831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:18.913888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:18.935169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:18.937685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:18.939652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:18.942196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:19.078093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=22 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:19.663476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:19.672300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:19.682840 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-175da18b-3d63-48eb-b79b-f13f02e942bb tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 1.179280 Jun 18 22:23:19.690220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2429/4858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:18 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:19.697253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:19.702442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:19.722995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:19.730364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:19.731697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:19.735732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:20.036320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:20.054757 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b1f10bb-0aae-49fe-9297-2e8d04bd1942 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 1.147130 Jun 18 22:23:20.062750 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2430/4859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:18 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:20.071582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:20.078838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:20.094927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:20.097472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:20.099434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:20.101828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:20.265380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:20.275553 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-808b465e-61ad-48f3-b664-c607ef97b7b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.583383 Jun 18 22:23:20.278589 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2430/4860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:19 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:20.298651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-79be1eaa-60ec-43c8-9c20-11cec47f2355 req-1e74048c-1939-4778-a2f3-03a9ccefd35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c398202-642e-4031-bdc4-f9fc17356756", "name": "network-vif-plugged", "status": "completed", "tag": "798bc8c2-710d-4c03-a420-89ef757788b5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:20.324345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-79be1eaa-60ec-43c8-9c20-11cec47f2355 req-1e74048c-1939-4778-a2f3-03a9ccefd35b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:20.328424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-79be1eaa-60ec-43c8-9c20-11cec47f2355 req-1e74048c-1939-4778-a2f3-03a9ccefd35b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:20.368556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-79be1eaa-60ec-43c8-9c20-11cec47f2355 req-1e74048c-1939-4778-a2f3-03a9ccefd35b service nova] Creating event network-vif-plugged:798bc8c2-710d-4c03-a420-89ef757788b5 for instance 1c398202-642e-4031-bdc4-f9fc17356756 on nch1-master-1 Jun 18 22:23:20.383581 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-79be1eaa-60ec-43c8-9c20-11cec47f2355 req-1e74048c-1939-4778-a2f3-03a9ccefd35b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100682 Jun 18 22:23:20.386670 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2431/4861] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:20.517662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:20.527321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:20.537726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:20.539046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86402331-3c72-4891-99e0-76cadbf78677 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.474934 Jun 18 22:23:20.548456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2431/4862] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:20 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:20.708482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:20.710390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:20.724565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:20.727823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:20.731759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:20.732455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:21.081512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:21.082899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:21.102280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:21.104548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:21.105749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:21.107694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:21.581797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:21.594689 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2dd89b3a-aabf-465e-aead-b808bc2d3c05 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.891552 Jun 18 22:23:21.598677 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2432/4863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:20 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:21.612781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:21.613706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:21.632489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:21.633113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:21.634275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:21.634708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:21.748329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:21.793143 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4aa9eac8-7859-4be6-a941-1303aed32475 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.706706 Jun 18 22:23:21.794565 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2432/4864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:21 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:21.802057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:21.811030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:21.842757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:21.853801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:21.855035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:21.863666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:22.192082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:22.212983 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5b0e9bb-938f-4c7c-921a-738685bdf0b7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.611840 Jun 18 22:23:22.227561 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2433/4865] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:21 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:22.421665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:22.442293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:22.450171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:22.454132 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c178eae-ab86-4cbe-8f35-d6641c865c23 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.656296 Jun 18 22:23:22.458057 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2433/4866] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:21 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:22.606514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-21793dbd-bfb9-48e6-808b-5c133779af17 req-74eecb93-4500-478a-a0e8-bcaab8531aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d26a21-15cf-4bd1-be51-8786cd9886e9", "name": "network-vif-plugged", "status": "completed", "tag": "e7f4a31c-4c09-4041-9779-5042bbe1f4c6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:22.623615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-21793dbd-bfb9-48e6-808b-5c133779af17 req-74eecb93-4500-478a-a0e8-bcaab8531aee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:22.624578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-21793dbd-bfb9-48e6-808b-5c133779af17 req-74eecb93-4500-478a-a0e8-bcaab8531aee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:22.639626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:22.640675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:22.658832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:22.659438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:22.660849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:22.667571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:22.681438 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-21793dbd-bfb9-48e6-808b-5c133779af17 req-74eecb93-4500-478a-a0e8-bcaab8531aee service nova] Creating event network-vif-plugged:e7f4a31c-4c09-4041-9779-5042bbe1f4c6 for instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 on nch2-master-1 Jun 18 22:23:22.697545 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-21793dbd-bfb9-48e6-808b-5c133779af17 req-74eecb93-4500-478a-a0e8-bcaab8531aee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095340 Jun 18 22:23:22.702071 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2434/4867] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:22.812026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:22.812842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:22.842513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:22.845301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:22.846698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:22.854701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:23.119722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:23.142951 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-916a1855-dd10-443e-b29d-ca172503c05c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.507987 Jun 18 22:23:23.161819 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2434/4868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:22 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:23.242376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:23.243289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:23.245987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:23.262812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:23.263642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:23.264958 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a61b3fc6-70d4-4093-baeb-1b402317903e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1317 microversion: 2.1 time: 0.457667 Jun 18 22:23:23.265962 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2435/4869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:22 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:23.267799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:23.268009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:23.475931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:23.476663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:23.487361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:23.488212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:23.500504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:23.501227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:23.689850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:23.718478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5d5a9f58-21dc-46a6-9e71-8e9a165b4483 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.482361 Jun 18 22:23:23.736420 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2435/4870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:23 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:23.891681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:23.906112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:23.908543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:23.911138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a953d448-c21e-4924-8e53-4fd6f331a80e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.439266 Jun 18 22:23:23.925521 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2436/4871] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:23 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:24.166454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:24.168858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:24.198358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.201698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.206102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.207479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.285755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:24.287560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:24.316578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.318385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.328912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.333524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.607148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:24.618859 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c0d96a2-47b6-479a-93b2-bea22370054e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.457464 Jun 18 22:23:24.621748 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2436/4872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:24 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:24.672648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:24.691815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-989c1edb-e811-4e3d-8d02-75123f2f4865 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1506 microversion: 2.1 time: 0.412275 Jun 18 22:23:24.696826 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2437/4873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:24 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:24.714539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:24.715127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:24.730845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.731313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.732571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.733014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.742951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:24.743345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:24.764965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.765442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.766252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:24.766686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:24.836327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:23:25.070186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:25.124481 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9ec35f6-12f6-4aa1-978a-88f7c8329018 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 204 len: 0 microversion: 2.1 time: 0.417277 Jun 18 22:23:25.133407 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2437/4874] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:23:24 2022] DELETE /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:23:25.146372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:25.148445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:25.175195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:25.176106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:25.179488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:25.181871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:25.190898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:25.209851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4d73f8e-d4c5-4065-91b1-53b44ebbd0c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.465043 Jun 18 22:23:25.210538 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2438/4875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:24 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:25.242264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:25.244703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:25.266890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:25.269131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:25.278688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:25.280158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:25.513340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:25.532294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:25.538067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:25.542500 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c8a23c85-fce3-45ab-9327-aa34385a0c06 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.404932 Jun 18 22:23:25.545305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2438/4876] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:25 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:25.604909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:25.622546 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56cdc6c6-a0d7-4d93-a14c-e00c06d70e31 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1512 microversion: 2.1 time: 0.404647 Jun 18 22:23:25.632886 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2439/4877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:25 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:25.640092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:25.640418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:25.651320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:25.653195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:25.656045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:25.657330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:25.953915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:25.970672 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a91ea630-7cc2-43a3-8778-c4d0dfbac433 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.338460 Jun 18 22:23:25.989535 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2439/4878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:25 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:26.227988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:26.228930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:26.245842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:26.247130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:26.253751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:26.254576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:26.564053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:26.565157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:26.587982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:26.593148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:26.597928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:26.600327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:26.645837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:26.673789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7e401cd4-846a-4a3c-885a-2b58869da2eb tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.450246 Jun 18 22:23:26.675808 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2440/4879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:26 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:26.700324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:26.703968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:26.739716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:26.743634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:26.752626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:26.765605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:27.227924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:27.242400 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e06271f1-a40f-4ce7-98da-ed65fdf002f9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1512 microversion: 2.1 time: 0.561926 Jun 18 22:23:27.265559 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2441/4880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:26 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:27.274336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9706033a-fd9d-48ca-bba7-d67b4e2578e1 req-980c4f36-1898-4f63-bcdc-6046bd8d99d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2bb1e2-5faa-463a-b3bf-3f63163cc71c", "name": "network-vif-plugged", "status": "completed", "tag": "4b048f89-2c90-48dd-9edc-60cdf4ab160a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:27.302013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9706033a-fd9d-48ca-bba7-d67b4e2578e1 req-980c4f36-1898-4f63-bcdc-6046bd8d99d8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:27.307141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9706033a-fd9d-48ca-bba7-d67b4e2578e1 req-980c4f36-1898-4f63-bcdc-6046bd8d99d8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:27.340375 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9706033a-fd9d-48ca-bba7-d67b4e2578e1 req-980c4f36-1898-4f63-bcdc-6046bd8d99d8 service nova] Creating event network-vif-plugged:4b048f89-2c90-48dd-9edc-60cdf4ab160a for instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c on nch2-master-1 Jun 18 22:23:27.354850 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9706033a-fd9d-48ca-bba7-d67b4e2578e1 req-980c4f36-1898-4f63-bcdc-6046bd8d99d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087041 Jun 18 22:23:27.356088 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2442/4881] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:27.370269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:27.373379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:27.389835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:27.408974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:27.415155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:27.416734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:27.417315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:27.419881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:27.434150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:27.444235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:27.446512 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35334ece-1228-41d1-9e32-dd5948082d1d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.887033 Jun 18 22:23:27.447354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2440/4882] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:26 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:27.692175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:27.693488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:27.726285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:27.730012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:27.734470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:27.735147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:27.852809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:27.866527 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf04a32b-d0e2-439a-8d8a-53359094fb7b tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.506935 Jun 18 22:23:27.867141 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2443/4883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:27 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:28.138846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:28.156635 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-74ac5024-b7e1-4e2d-af73-72736b673164 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.468455 Jun 18 22:23:28.157276 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2441/4884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:27 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:28.262105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:28.262735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:28.272121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.272582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.284270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.284746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.465875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:28.467182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:28.496895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:28.508373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.509656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.510675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.510995 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-620dddfb-73c5-48f6-a30f-2f91973d075f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 200 len: 1470 microversion: 2.1 time: 0.249338 Jun 18 22:23:28.529569 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2444/4885] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:28 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:28.530182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.753959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9aa0d6e8-4bf2-421a-afaa-bf8d03bd8af3 req-134a9a10-9622-430e-a664-867d6642f9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c398202-642e-4031-bdc4-f9fc17356756", "name": "network-vif-deleted", "tag": "798bc8c2-710d-4c03-a420-89ef757788b5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:28.775221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9aa0d6e8-4bf2-421a-afaa-bf8d03bd8af3 req-134a9a10-9622-430e-a664-867d6642f9ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.777146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9aa0d6e8-4bf2-421a-afaa-bf8d03bd8af3 req-134a9a10-9622-430e-a664-867d6642f9ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.808128 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9aa0d6e8-4bf2-421a-afaa-bf8d03bd8af3 req-134a9a10-9622-430e-a664-867d6642f9ad service nova] Creating event network-vif-deleted:798bc8c2-710d-4c03-a420-89ef757788b5 for instance 1c398202-642e-4031-bdc4-f9fc17356756 on nch1-master-1 Jun 18 22:23:28.825334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9aa0d6e8-4bf2-421a-afaa-bf8d03bd8af3 req-134a9a10-9622-430e-a664-867d6642f9ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071799 Jun 18 22:23:28.826578 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2445/4886] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:28.885677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:28.887329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:28.902949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.907019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.908130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:28.908756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:28.947023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:28.967722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:28.974579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:28.978048 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-018da13f-eb82-4572-b5b3-22619f5fd1a0 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 0.517081 Jun 18 22:23:28.983029 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2442/4887] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:28 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:23:29.175041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:29.176176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:29.186975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:29.189019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:29.191518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:29.193745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:29.751478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:29.759846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd9fea70-1c73-471a-b46b-9dd5852f7ed7 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1366 microversion: 2.1 time: 0.879992 Jun 18 22:23:29.760435 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2446/4888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:28 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1366 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:29.768426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:29.778786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:29.802777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:29.803530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:29.804535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:29.806818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:29.863272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 HTTP/1.1 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1c398202-642e-4031-bdc4-f9fc17356756'} Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:29.872879 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:23:29.877131 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:29.882728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:29.883913 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b0fbcd95-f50c-41a9-8631-a4e89c67083f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 404 len: 111 microversion: 2.1 time: 0.119254 Jun 18 22:23:29.887948 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2447/4889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:29 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:23:29.903774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:29.910232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:29.931306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:29.935045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:29.937085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:29.940459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:30.017728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:30.030532 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-885df69a-b13b-47e1-8be2-b453a828bd8b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.859031 Jun 18 22:23:30.032693 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2443/4890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:29 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:30.050596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:30.051631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:30.097278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:30.097814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:30.098692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:30.103505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:31.335540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:31.350609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:31.359032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:31.360719 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e44d6a0-5d61-401a-bbba-e94f2b5c9c19 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 1.326283 Jun 18 22:23:31.361650 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2444/4891] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:30 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:31.413090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:31.425815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-956e2750-3591-41c7-80f6-8f1fb85cf604 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 1.531519 Jun 18 22:23:31.429183 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2448/4892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:29 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:31.452109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:31.456135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:31.479845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:31.483569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:31.485911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:31.486470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:31.687404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-247187502", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": "none"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:31.978569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:31.981376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:31.991836 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-268fce9b-8f08-4e4e-81ed-c4764dd7a435 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1556 microversion: 2.1 time: 0.560914 Jun 18 22:23:31.996157 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2449/4893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:31 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1556 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:32.003820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:32.010263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:32.038535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:32.038535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:32.043850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:32.044311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:32.992670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:33.010386 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9bb26e86-bf75-42d5-928d-e1cf186d0a4b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 1.012733 Jun 18 22:23:33.011957 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2450/4894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:31 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:33.020408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a583fc5d-82ef-49a0-ac47-b0eeec0eb1b6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a583fc5d-82ef-49a0-ac47-b0eeec0eb1b6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 163 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": 12345, "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 12345 Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:23:33.034451 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 18 22:23:33.038546 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:33.041789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a583fc5d-82ef-49a0-ac47-b0eeec0eb1b6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:33.045257 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a583fc5d-82ef-49a0-ac47-b0eeec0eb1b6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.031832 Jun 18 22:23:33.046470 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2451/4895] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:33 2022] POST /compute/v2.1/servers => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:23:33.067597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:33.070128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:33.100716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:33.101445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:33.106462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:33.109324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:33.292299 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f92870a-127b-43f6-812d-ce7467940157 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244259 Jun 18 22:23:33.299823 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2452/4896] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:23:33 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:33.305645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:33.306595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:33.330081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:33.331407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:33.334811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:33.336151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:34.475655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:34.495546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:34.500688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:34.502988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8bec2a46-1d0d-458f-9000-fab756398229 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 1.201830 Jun 18 22:23:34.506081 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2453/4897] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:33 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:34.520203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:34.521131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:34.535381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:34.536149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:34.537137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:34.537738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:35.575967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:35.587750 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-86a748ff-9b5d-4991-935b-21378caf5e9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 1.078061 Jun 18 22:23:35.588945 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2454/4898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:34 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:35.597924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:35.606496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:35.637847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:35.640769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:35.643535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:35.644270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:35.832980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:23:35.833601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:23:35.834128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:23:35.834646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:23:35.835165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:23:35.855637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:35.856458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:35.858191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:35.859005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:35.885110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Getting quotas for project 878ebb841a1d45beb290d689fe7947f6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:23:35.892523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Getting quotas for user db591a1386ab46ca84a0473ad1c2e974 and project 878ebb841a1d45beb290d689fe7947f6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:23:35.908378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:23:35.911989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:23:36.025416 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b12ddb5a-d16c-43cc-a697-4d55e54abd86 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 4.656236 Jun 18 22:23:36.035351 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2445/4899] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:23:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:23:36.053673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:36.058694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:36.083670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:36.084138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:36.094505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:36.095397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:37.509264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:37.523975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:37.527593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:37.534008 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a184a640-d095-4d2c-a779-e3996da6bdae tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1739 microversion: 2.20 time: 1.497088 Jun 18 22:23:37.535466 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2446/4900] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:36 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1739 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:37.541158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:37.546274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:37.550454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:37.561675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:37.562414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:37.564703 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-add79ae5-2c29-4d51-9de6-49e72c7e7e06 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 1.974373 Jun 18 22:23:37.565002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:37.565364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2455/4901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:35 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:37.565981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:37.602286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:37.603308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:37.617570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:37.619191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:37.620974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:37.621647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:38.118510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:38.134637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:38.136317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:38.138672 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0af8f21e-4890-4315-9f3e-3c678734a310 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103" status: 200 len: 1329 microversion: 2.47 time: 0.558465 Jun 18 22:23:38.153059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2456/4902] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:37 2022] GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 => generated 1329 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:38.285911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-352212834", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": "none"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:38.382131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:38.390685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:23:38.391312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:23:38.392239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:23:38.392824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:23:38.393600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:23:38.396117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc962eae-f347-4d0b-a299-090269bbc4d6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.859379 Jun 18 22:23:38.405425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:38.407657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:38.408769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:38.409448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:38.417127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2447/4903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:37 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:38.435649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Getting quotas for project 878ebb841a1d45beb290d689fe7947f6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:23:38.442470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Getting quotas for user db591a1386ab46ca84a0473ad1c2e974 and project 878ebb841a1d45beb290d689fe7947f6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:23:38.459995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:23:38.462506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:23:38.526218 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ebf67282-7595-4ba5-852b-a148c216e42a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.244697 Jun 18 22:23:38.533814 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2457/4904] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:23:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 253 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 18 22:23:38.542133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4267ec25-b5eb-4f53-9329-8bfea4c1f6ee tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:38.548267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4267ec25-b5eb-4f53-9329-8bfea4c1f6ee tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:38.553298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:38.554006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:38.567066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:38.568011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:38.570381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:38.571394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:38.667104 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4267ec25-b5eb-4f53-9329-8bfea4c1f6ee tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "PUT /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 991 microversion: 2.47 time: 0.131793 Jun 18 22:23:38.683239 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2448/4905] 10.222.0.30 () {62 vars in 1296 bytes} [Sat Jun 18 22:23:38 2022] PUT /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 991 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:23:38.693813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:38.694818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:38.706533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:38.707257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:38.708353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:38.710207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:39.511823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:39.538360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:39.545983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:39.555297 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c02b6266-3499-4917-8322-8281e03eee73 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1721 microversion: 2.20 time: 1.004339 Jun 18 22:23:39.579054 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2458/4906] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:38 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1721 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:23:39.600945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:39.604590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:39.634621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:39.639548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:39.641072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:39.643529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:40.064736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:40.075246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:40.076756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:40.090889 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83d2c62a-3d47-4c4f-9d7f-d44a1e79958b tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1281 microversion: 2.47 time: 0.510389 Jun 18 22:23:40.091602 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2459/4907] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:39 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1281 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:40.139106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:40.160655 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58ae14a0-433c-4a3b-b2be-2afa9f42faab tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1506 microversion: 2.1 time: 1.476155 Jun 18 22:23:40.167786 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2449/4908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:38 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1506 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:40.468497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5d3626f5-661e-4941-89d9-3300e0c6b0e3 req-c4b52ecc-ad75-41d3-80d6-cd2b80386c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2bb1e2-5faa-463a-b3bf-3f63163cc71c", "tag": "4b048f89-2c90-48dd-9edc-60cdf4ab160a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:40.483318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5d3626f5-661e-4941-89d9-3300e0c6b0e3 req-c4b52ecc-ad75-41d3-80d6-cd2b80386c8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:40.488182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5d3626f5-661e-4941-89d9-3300e0c6b0e3 req-c4b52ecc-ad75-41d3-80d6-cd2b80386c8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:40.533642 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5d3626f5-661e-4941-89d9-3300e0c6b0e3 req-c4b52ecc-ad75-41d3-80d6-cd2b80386c8d service nova] Creating event network-changed:4b048f89-2c90-48dd-9edc-60cdf4ab160a for instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c on nch2-master-1 Jun 18 22:23:40.555935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5d3626f5-661e-4941-89d9-3300e0c6b0e3 req-c4b52ecc-ad75-41d3-80d6-cd2b80386c8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462738 Jun 18 22:23:40.559766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2460/4909] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:40.598202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:40.598840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:40.612399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:40.612855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:40.625678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:40.626140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:40.765333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08ce1458-3c20-4350-b928-5ec586d2e0c2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1008500008", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "27016f92-5a7a-435f-923e-b6679459fa15", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:40.919513 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-08ce1458-3c20-4350-b928-5ec586d2e0c2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Block Device 27016f92-5a7a-435f-923e-b6679459fa15 is not bootable. Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08ce1458-3c20-4350-b928-5ec586d2e0c2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 358 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1008500008", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "27016f92-5a7a-435f-923e-b6679459fa15", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: exception: Block Device 27016f92-5a7a-435f-923e-b6679459fa15 is not bootable. Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1008500008', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '27016f92-5a7a-435f-923e-b6679459fa15'}], 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 27016f92-5a7a-435f-923e-b6679459fa15 is not bootable. Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:40.939340 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 27016f92-5a7a-435f-923e-b6679459fa15 is not bootable. Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 27016f92-5a7a-435f-923e-b6679459fa15 is not bootable. Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08ce1458-3c20-4350-b928-5ec586d2e0c2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Block Device 27016f92-5a7a-435f-923e-b6679459fa15 is not bootable. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:40.943404 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08ce1458-3c20-4350-b928-5ec586d2e0c2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.180203 Jun 18 22:23:40.946058 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2461/4910] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:40 2022] POST /compute/v2.1/servers => generated 110 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:23:40.951650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c449ca37-33d9-4b91-92d4-5fd48b567815 req-1354325e-d3b7-4450-a2db-7544f93cecb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "name": "network-vif-unplugged", "status": "completed", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:40.961510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c449ca37-33d9-4b91-92d4-5fd48b567815 req-1354325e-d3b7-4450-a2db-7544f93cecb5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:40.961930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c449ca37-33d9-4b91-92d4-5fd48b567815 req-1354325e-d3b7-4450-a2db-7544f93cecb5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:40.973515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_external_events [req-c449ca37-33d9-4b91-92d4-5fd48b567815 req-1354325e-d3b7-4450-a2db-7544f93cecb5 service nova] Unable to find a host for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9. Dropping event network-vif-unplugged {{(pid=130903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 22:23:40.974432 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c449ca37-33d9-4b91-92d4-5fd48b567815 req-1354325e-d3b7-4450-a2db-7544f93cecb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027613 Jun 18 22:23:40.975391 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2462/4911] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 18 22:23:40.992336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:40.993573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:41.001874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:41.002728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:41.003758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:41.004436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:41.646663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:41.655314 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d08abc8b-8621-438f-ae75-78177bfc5f77 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.678586 Jun 18 22:23:41.670766 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2463/4912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:40 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:41.676211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:41.677261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:41.684997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:41.685800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:41.686838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:41.687504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:41.706309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:41.731931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:41.735797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:41.744529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0982e693-1fb9-4be2-9ce2-c88b1ecf242b tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1664 microversion: 2.20 time: 1.150817 Jun 18 22:23:41.750215 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2450/4913] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:40 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1664 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:41.773349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:41.774028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:41.806679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:41.807155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:41.808371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:41.808828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:42.073393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:42.084910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:42.090960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:42.092482 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d62d26f-f977-4def-8017-ea2b827518be tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1335 microversion: 2.47 time: 0.420444 Jun 18 22:23:42.110350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2464/4914] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:41 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1335 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:42.118188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:42.120877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:42.140422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:42.140422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:42.145546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:42.146450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:42.573790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:42.586852 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4fd1fd14-d67e-4b88-801b-9da7d6b43089 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1506 microversion: 2.1 time: 0.835369 Jun 18 22:23:42.598622 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2451/4915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:41 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:42.612152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bee43207-ade8-469e-aade-dadb074272c3"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:42.613664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:42.629846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:42.630541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:42.632980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:42.634408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:42.953139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:42.965089 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6f8bb5a-6f35-437a-bf38-b4a34ca101ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.853058 Jun 18 22:23:42.965728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2465/4916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:42 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:43.125877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:43.129082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:43.149334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.151639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:43.156987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.159916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:43.317468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:43.331510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:43.335031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:43.340559 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f024ce8c-a7b6-460c-a04d-6d9190764e25 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1335 microversion: 2.47 time: 0.219466 Jun 18 22:23:43.343634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2466/4917] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:43 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1335 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:43.372773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7986608c-393c-4ad3-bbbd-44b80721c2bb req-85eb55b5-981b-4f94-aec2-e0c61204e7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d26a21-15cf-4bd1-be51-8786cd9886e9", "name": "network-vif-unplugged", "status": "completed", "tag": "e7f4a31c-4c09-4041-9779-5042bbe1f4c6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:43.377058 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b516d16-62af-4c19-9d61-adb5592340c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.776949 Jun 18 22:23:43.378337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2452/4918] 10.222.0.30 () {62 vars in 1363 bytes} [Sat Jun 18 22:23:42 2022] POST /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-volume_attachments => generated 188 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:23:43.400559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7986608c-393c-4ad3-bbbd-44b80721c2bb req-85eb55b5-981b-4f94-aec2-e0c61204e7f9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.401071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7986608c-393c-4ad3-bbbd-44b80721c2bb req-85eb55b5-981b-4f94-aec2-e0c61204e7f9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:43.428698 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7986608c-393c-4ad3-bbbd-44b80721c2bb req-85eb55b5-981b-4f94-aec2-e0c61204e7f9 service nova] Creating event network-vif-unplugged:e7f4a31c-4c09-4041-9779-5042bbe1f4c6 for instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 on nch2-master-1 Jun 18 22:23:43.439334 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7986608c-393c-4ad3-bbbd-44b80721c2bb req-85eb55b5-981b-4f94-aec2-e0c61204e7f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082655 Jun 18 22:23:43.445175 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2467/4919] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:43.612767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:43.613821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:43.625536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.627502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:43.630369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.631130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:43.727733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:43.728412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:43.747466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.756032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:43.759908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:43.760497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:44.273680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:44.286320 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-498e24db-a38e-4549-86e3-62b426512472 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1506 microversion: 2.1 time: 0.677276 Jun 18 22:23:44.287281 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2453/4920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:43 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1506 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:44.371459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:44.372978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:44.389552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:44.393290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:44.395970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:44.396588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:44.404079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:44.416757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32e59e05-ce6b-483c-825a-9e31207df66e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-volume_attachments/bee43207-ade8-469e-aade-dadb074272c3" status: 202 len: 0 microversion: 2.20 time: 0.693429 Jun 18 22:23:44.423524 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2468/4921] 10.222.0.30 () {60 vars in 1456 bytes} [Sat Jun 18 22:23:43 2022] DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-volume_attachments/bee43207-ade8-469e-aade-dadb074272c3 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:23:44.499919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:44.523258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:44.524059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:44.526350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:44.529535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:44.531167 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-743aa4e6-6973-4a8b-a728-19b177db4f32 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1335 microversion: 2.47 time: 0.165482 Jun 18 22:23:44.532397 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2454/4922] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:44 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1335 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:44.538508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:44.539021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:44.539836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:44.540287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:44.665762 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-00d5beb4-0d88-480c-a090-0916f379d1ea tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "POST /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/action" status: 202 len: 0 microversion: 2.20 time: 0.147010 Jun 18 22:23:44.666989 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2469/4923] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:23:44 2022] POST /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:23:44.675381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:44.676010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:44.689939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:44.691607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:44.694692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:44.695257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.103670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c280cecb-6d7e-4855-a363-0662ec13caaf tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-831812449", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "destination_type": "local"}, {"source_type": "volume", "uuid": "8208790e-5d5d-46a9-8759-bba8289fd0dc", "destination_type": "invalid"}], "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c280cecb-6d7e-4855-a363-0662ec13caaf tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 494 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-831812449", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "destination_type": "local"}, {"source_type": "volume", "uuid": "8208790e-5d5d-46a9-8759-bba8289fd0dc", "destination_type": "invalid"}], "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-831812449', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8208790e-5d5d-46a9-8759-bba8289fd0dc', 'destination_type': 'invalid'}], 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'invalid' Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:45.107367 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c280cecb-6d7e-4855-a363-0662ec13caaf tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c280cecb-6d7e-4855-a363-0662ec13caaf tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013468 Jun 18 22:23:45.115387 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2470/4924] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:45 2022] POST /compute/v2.1/servers => generated 155 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:23:45.124930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:45.125588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:45.149592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:45.151449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:45.151917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.152716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:45.153175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.370428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:45.384919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:45.387506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:45.393330 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8b521abd-d0aa-4c1f-bb72-e0af743c27c7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1672 microversion: 2.20 time: 0.722251 Jun 18 22:23:45.395860 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2455/4925] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:44 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1672 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:45.414214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:45.421929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:45.435565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:45.439309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.440328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:45.443472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.467326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:45.867705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:45.872490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:45.876292 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b45b0ee-fe86-4b1c-bd57-f96ca892053c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.755131 Jun 18 22:23:45.881329 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2471/4926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:45 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:45.897225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:45.898320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:45.902757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:45.909434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:45.910037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.910942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:45.911629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:45.971200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:45.981362 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dcd0c44b-b336-46af-a353-6d438eabaf36 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 200 len: 1509 microversion: 2.1 time: 0.569062 Jun 18 22:23:45.987693 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2456/4927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:45 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:45.993151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:45.995453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:46.006786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:46.007482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:46.009375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:46.009940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:46.066546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:46.078153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:46.084047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:46.089525 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9463df95-9e96-4c56-bd19-e6c148f02175 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1356 microversion: 2.47 time: 0.204257 Jun 18 22:23:46.102932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2472/4928] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:45 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:46.114235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:46.115078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:46.132246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:46.133068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:46.134089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:46.136582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.101855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.114865 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ee98a12-7b83-4337-b443-17235129d6a8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 1.124561 Jun 18 22:23:47.118022 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2457/4929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:45 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:47.135019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:47.136923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:47.164474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.166326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.168907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.169706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.183056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.191654 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc565f20-e899-4d81-9915-279dca32e575 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 1.087316 Jun 18 22:23:47.201079 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2473/4930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:46 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:47.220903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:47.223181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:47.238439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.239329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.241781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.242433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.375805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:23:47.376527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:23:47.377905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:23:47.378485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:23:47.379076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:23:47.491362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:47.500442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.501291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.505110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.505819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.550351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1598e30-7edd-49a9-acb8-ded0c9373825 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "POST /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c/action" status: 202 len: 1078 microversion: 2.47 time: 0.429386 Jun 18 22:23:47.551538 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2458/4931] 10.222.0.30 () {62 vars in 1318 bytes} [Sat Jun 18 22:23:47 2022] POST /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c/action => generated 1078 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 18 22:23:47.558189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:47.559380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:47.571955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.573180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.574314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.575113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.668651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.705352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.713607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.716918 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-145d405f-1fce-43e3-96c2-10be04780937 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.514562 Jun 18 22:23:47.722005 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2474/4932] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:47 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:47.739839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea1eb3e5-00fe-4802-8d39-5993d6c205bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-695488966", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea1eb3e5-00fe-4802-8d39-5993d6c205bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 491 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-695488966", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-695488966', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jun 18 22:23:47.746921 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 18 22:23:47.750665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:47.754207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea1eb3e5-00fe-4802-8d39-5993d6c205bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:47.757760 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea1eb3e5-00fe-4802-8d39-5993d6c205bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.033416 Jun 18 22:23:47.761566 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2475/4933] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:47 2022] POST /compute/v2.1/servers => generated 624 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:23:47.772054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:47.776095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:47.797488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.798310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.799594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:47.800384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:47.973556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.996973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:47.998849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:48.000361 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cdcfc70-1fa2-4e90-8cda-eefc8c6da189 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.237516 Jun 18 22:23:48.001184 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2476/4934] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:47 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:48.017874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:48.023837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:48.039241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.040166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.041341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.042017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.094893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:48.108556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-32555cd2-a495-45e6-9d8c-685e4661a993 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.554833 Jun 18 22:23:48.110100 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2459/4935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:47 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:48.136178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:48.145669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:48.157965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.158811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.159832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.160518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.422451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:48.453111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:48.639967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:48.648807 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0069b0d6-9b3e-454c-80f6-93ab2529a571 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.634827 Jun 18 22:23:48.649420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2477/4936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:48 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:48.669792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:48.670689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:48.698464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.699042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.699892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.700328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.805703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:48.827678 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5072228-6a15-4e56-80cf-239f18764e0e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.695516 Jun 18 22:23:48.828337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2460/4937] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:48 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:48.855236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:48.857297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:48.879754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.881356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:48.883362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:48.883985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.228631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.244235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.245168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.261971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.263424 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bbe75a25-ea8b-4c7f-9ad4-b16881185e12 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.591452 Jun 18 22:23:49.263985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8097e9a9-50e4-408e-b1a7-d46d4279dfa6 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.434465 Jun 18 22:23:49.268094 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2478/4938] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:48 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:49.278131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:49.278953 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2461/4939] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:48 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:49.280042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:49.306983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:49.308245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.310464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:49.311034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:49.311397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.313491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:49.327982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:49.328731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.329870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:49.330684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.499383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.515305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.519153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.526893 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a2fbf3d-17a6-4f41-a1d1-eb7e6c87745e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.240559 Jun 18 22:23:49.527898 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2462/4940] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:49 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:49.532975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd53084b-f981-49ff-b3cd-44c19e2368c0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd53084b-f981-49ff-b3cd-44c19e2368c0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 416 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:49.541142 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd53084b-f981-49ff-b3cd-44c19e2368c0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:49.544758 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd53084b-f981-49ff-b3cd-44c19e2368c0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.013481 Jun 18 22:23:49.549685 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2463/4941] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:49 2022] POST /compute/v2.1/servers => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:23:49.559627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:49.560268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:49.581667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:49.582462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.584831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:49.585946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:49.976160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:49.995557 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1fed28e2-7b63-4144-bf44-dc309efe9d25 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.725159 Jun 18 22:23:49.996752 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2479/4942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:49 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:50.005996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b36df5c9-6cd3-46a9-8c60-c7b37600db35 req-8ff2527b-95e3-433d-b5ba-7a57a64144be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:50.037582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b36df5c9-6cd3-46a9-8c60-c7b37600db35 req-8ff2527b-95e3-433d-b5ba-7a57a64144be service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:50.037955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b36df5c9-6cd3-46a9-8c60-c7b37600db35 req-8ff2527b-95e3-433d-b5ba-7a57a64144be service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:50.065988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b36df5c9-6cd3-46a9-8c60-c7b37600db35 req-8ff2527b-95e3-433d-b5ba-7a57a64144be service nova] Creating event network-changed:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch1-master-1 Jun 18 22:23:50.073639 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b36df5c9-6cd3-46a9-8c60-c7b37600db35 req-8ff2527b-95e3-433d-b5ba-7a57a64144be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075326 Jun 18 22:23:50.074537 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2480/4943] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:23:50.085358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-309c1674-d7da-4cf3-bfa1-81a93df9e398 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:50.100272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-309c1674-d7da-4cf3-bfa1-81a93df9e398 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:50.101151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-309c1674-d7da-4cf3-bfa1-81a93df9e398 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:50.164902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-309c1674-d7da-4cf3-bfa1-81a93df9e398 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Going to try to stop instance {{(pid=130903) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:23:50.264513 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-309c1674-d7da-4cf3-bfa1-81a93df9e398 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.188507 Jun 18 22:23:50.265337 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2481/4944] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:23:50 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:23:50.282226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:50.283258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:50.290992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:50.292204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:50.294156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:50.294845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:50.323610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:50.338333 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4822c3b5-233f-4d68-a106-8a011ba7cdce tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.786155 Jun 18 22:23:50.342247 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2464/4945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:49 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:50.357832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:50.358563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:50.365564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:50.366108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:50.368237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:50.368763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:50.986971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.001126 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a804b7e4-ccdb-4511-9be7-8a109c91aa2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.725699 Jun 18 22:23:51.003429 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2482/4946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:50 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:51.016765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:51.020316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:51.045211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:51.045678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:51.046484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:51.046930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:51.065778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.082894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.084694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.086037 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b8122af-265a-4b69-90fb-793460cb4910 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.732376 Jun 18 22:23:51.086615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2465/4947] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:50 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:51.134075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:51.134712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:51.156890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:51.157394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:51.167749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:51.168813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:51.386697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.395762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.402295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.403556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ad4c60f-e08b-4d6f-a43d-db98853bb89e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.315989 Jun 18 22:23:51.404132 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2466/4948] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:51 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:51.441869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:51.451060 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7dfc8c4-31fe-4eba-b177-ecfa7825790a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.446354 Jun 18 22:23:51.452378 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2483/4949] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:51 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:51.540219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed18a4d5-80f2-45b2-8763-fd25719de436 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126513488", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": -1, "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:51.552891 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ed18a4d5-80f2-45b2-8763-fd25719de436 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Flavor -1 could not be found. Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed18a4d5-80f2-45b2-8763-fd25719de436 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 206 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126513488", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": -1, "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: exception: Flavor -1 could not be found. Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1126513488', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': -1, 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:51.571742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jun 18 22:23:51.576451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:51.579723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed18a4d5-80f2-45b2-8763-fd25719de436 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:51.582665 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed18a4d5-80f2-45b2-8763-fd25719de436 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.047461 Jun 18 22:23:51.584042 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2467/4950] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:51 2022] POST /compute/v2.1/servers => generated 73 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:51.594339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:51.595981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:51.609633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:51.625006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:51.627191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:51.630128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:52.021024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:52.022055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:52.034475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:52.039959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:52.044149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:52.045545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:53.093575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:53.101715 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5338bff-e4c7-4f0e-b77e-6bf0232a8ff7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 1.513125 Jun 18 22:23:53.107482 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2484/4951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:51 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:53.353016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:53.372730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65bc8da8-c639-4161-99d2-0af23fb0d117 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 1.354248 Jun 18 22:23:53.387587 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2468/4952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:52 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:53.397943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:53.407880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:53.434895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:53.442344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:53.449555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:53.452341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:53.632290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:53.638471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:53.647424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:53.649078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:53.652022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:53.652743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:53.743637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:53.754585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:53.756107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:53.757430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5323905-c65d-439a-964d-d4878fdd4db2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.368440 Jun 18 22:23:53.758006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2469/4953] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:53 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:53.782529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:53.788706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:53.815984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:53.816551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:53.832273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:53.832799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:54.202757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:54.226956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:54.235890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:54.237232 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-180ebe53-7b80-4060-81bd-ec00a8b59b99 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 1.121817 Jun 18 22:23:54.242241 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2485/4954] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:53 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:54.393992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:54.395173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:54.409663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:54.410713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:54.413107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:54.414043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:54.419805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:54.427650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:54.437797 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b1fa516-e88a-4102-8697-a10551b8c419 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.668535 Jun 18 22:23:54.438472 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2470/4955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:53 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:54.558995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca6f1684-1d58-496c-bbd8-3e8802302a48 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053743800", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca6f1684-1d58-496c-bbd8-3e8802302a48 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 173 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2053743800", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2053743800', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi -1 Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:23:54.562504 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca6f1684-1d58-496c-bbd8-3e8802302a48 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ca6f1684-1d58-496c-bbd8-3e8802302a48 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010003 Jun 18 22:23:54.572627 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2471/4956] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:54 2022] POST /compute/v2.1/servers => generated 145 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:23:54.573897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:54.576237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:54.594975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:54.595576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:54.596478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:54.596948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.116998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.128352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.130410 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4a7ba35-2f35-4573-b488-233ea29017c6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.560280 Jun 18 22:23:55.135139 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2472/4957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:54 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:55.141366 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4526f0a6-af7f-47d8-b5f5-fa84f007f84c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.752768 Jun 18 22:23:55.153806 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2486/4958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:54 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:55.154372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:55.158111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:55.170486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.172779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.174210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:55.175054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:55.175640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.176929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.185228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.186070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.187344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.188138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.350542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.368042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.376059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.389879 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ffb5d5ac-54b2-4c1c-b9e9-9153aea353cc tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.243463 Jun 18 22:23:55.392880 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2473/4959] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:55 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:55.421455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:55.422186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:55.425286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:55.458710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.459513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.460566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.461528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.504318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:23:55.711540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.731575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a3d1452-3fbb-42bb-86ae-4e4313feb81c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.576243 Jun 18 22:23:55.733614 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2487/4960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:55 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:55.804415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bad1224-d702-4451-a960-9e8615377db9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2049600730", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:55.815928 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-1bad1224-d702-4451-a960-9e8615377db9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bad1224-d702-4451-a960-9e8615377db9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 216 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2049600730", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2049600730', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:55.819440 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 18 22:23:55.824405 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:55.827566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bad1224-d702-4451-a960-9e8615377db9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:55.828624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1bad1224-d702-4451-a960-9e8615377db9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.032166 Jun 18 22:23:55.829738 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2488/4961] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:55 2022] POST /compute/v2.1/servers => generated 123 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:23:55.839749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:55.840709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:55.853825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.854750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.856152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:55.858082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:55.879545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.894237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.898864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:55.901767 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d9f7fbc-995b-444a-a822-cf6f7ead0182 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.506866 Jun 18 22:23:55.903733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2474/4962] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:55 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:56.094151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:56.105177 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40c0062e-6a9d-4065-924f-072fedb996bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.270985 Jun 18 22:23:56.108152 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2489/4963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:55 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:56.132570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:56.133683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:56.140930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.141690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.142657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.143257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.160482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:56.166240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:56.173961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.174656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.176076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.176678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.398820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:56.408084 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6728f7d3-3f9d-4a35-b603-8df6aa3eebd7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.287205 Jun 18 22:23:56.408669 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2475/4964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:56 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:56.440042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:56.450513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:56.488275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.488952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.489832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.490271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.685246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:56.695947 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2209bb74-3757-4d7c-811e-2fbc9c8b6775 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.540695 Jun 18 22:23:56.705862 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2490/4965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:56 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:23:56.708573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bc3348f-09ad-4a64-bce9-48e585b7a68f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1755401635", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "key_name": "tempest-key-1930686069", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:56.803313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:56.824755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:56.833783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-3bc3348f-09ad-4a64-bce9-48e585b7a68f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] validate_networks() for [('9b042883-87aa-470b-a375-8fa5157a8e61', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:23:56.840459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:56.842415 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7c0f2d10-bfc9-4c56-9750-9bca3e42a6e6 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.425780 Jun 18 22:23:56.843625 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2476/4966] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:56 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:56.922874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:56.923506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:56.937470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.938029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:56.940909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:56.941463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:57.599562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:57.615576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:57.622221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:57.626572 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4865a308-4531-4e82-a38b-0a4dd363503a tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.707756 Jun 18 22:23:57.645465 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2477/4967] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:56 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:57.720272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:57.721105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:57.749391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:57.763869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:57.765903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:57.775749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.109905 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3bc3348f-09ad-4a64-bce9-48e585b7a68f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Invalid key_name provided. Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bc3348f-09ad-4a64-bce9-48e585b7a68f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 247 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1755401635", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "key_name": "tempest-key-1930686069", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid key_name provided. Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1755401635', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'key_name': 'tempest-key-1930686069', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1930686069 not found for user 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:58.118552 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bc3348f-09ad-4a64-bce9-48e585b7a68f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid key_name provided. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:23:58.122783 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3bc3348f-09ad-4a64-bce9-48e585b7a68f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.420177 Jun 18 22:23:58.128047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2491/4968] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:56 2022] POST /compute/v2.1/servers => generated 70 bytes in 1425 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 18 22:23:58.139423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:58.154459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:58.162551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.163048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.181547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.182133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.343878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:58.359824 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b029d809-f66f-41d9-a8d3-58760a23607e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.646551 Jun 18 22:23:58.364462 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2478/4969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:57 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:58.377521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:58.378424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:58.387269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:58.392839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.398407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.399582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.400268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.403151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:58.412767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:58.421637 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5c81c266-406f-468d-b799-54058e3187c5 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.285180 Jun 18 22:23:58.433748 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2492/4970] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:58 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:23:58.654553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:58.655435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:58.693879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.695531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.701020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.701809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.765160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:58.774494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9166dad6-a774-4af5-9107-fb54b9ea8cca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.408086 Jun 18 22:23:58.777735 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2479/4971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:58 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:58.802953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:58.804168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:58.815943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.825260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:58.826402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:58.827070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:59.340584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.349503 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5eda67f9-fdc4-4c3a-960a-3cc8a4d62f46 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.550409 Jun 18 22:23:59.358896 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2480/4972] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:58 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:59.381343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:59.382219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:59.391592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:59.398769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:59.399645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:59.400050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:59.600516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.618772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.625449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.630915 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8adeb648-3ec2-423a-be30-0f836cf7efd7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.980637 Jun 18 22:23:59.643796 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2493/4973] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:58 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:23:59.664760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:23:59.665482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:23:59.701902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:59.702365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:59.703179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:23:59.708007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:23:59.853676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.863089 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9d5c2964-f2ab-4ad1-928c-786270e1a1b1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1676 microversion: 2.1 time: 0.485637 Jun 18 22:23:59.866960 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2481/4974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:23:59 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1676 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:23:59.884242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05548360-07e8-4b73-817d-5653a7954397 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-3012796", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:23:59.962167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.985791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.988529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:23:59.990398 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-073461b2-6239-4b1b-a3eb-1e685315fd46 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.344299 Jun 18 22:23:59.991598 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2494/4975] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:23:59 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:00.248655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.security_group_api [None req-05548360-07e8-4b73-817d-5653a7954397 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Neutron security group does_not_exist not found {{(pid=130902) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jun 18 22:24:00.249454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-05548360-07e8-4b73-817d-5653a7954397 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05548360-07e8-4b73-817d-5653a7954397 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 255 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-3012796", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: exception: Unable to find security_group with name or id 'does_not_exist' Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-3012796', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jun 18 22:24:00.274256 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jun 18 22:24:00.281187 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:00.297927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05548360-07e8-4b73-817d-5653a7954397 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:00.299119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05548360-07e8-4b73-817d-5653a7954397 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.430877 Jun 18 22:24:00.299972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2482/4976] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:23:59 2022] POST /compute/v2.1/servers => generated 106 bytes in 432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:24:00.309584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:00.310237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:00.323486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:00.323968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:00.324747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:00.336111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:00.653291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:00.654222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:00.681869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:00.682433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:00.685186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:00.685680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:00.738825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:00.747598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-07e196b0-783f-4c18-b8c3-ac3113ab1d04 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.443010 Jun 18 22:24:00.750633 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2495/4977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:00 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:00.773858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:00.775607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:00.799389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:00.805079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:00.809081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:00.810945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.242576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.256427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.258913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.262834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c13406e1-7c22-4a9f-8ef1-20b089a44d31 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.615633 Jun 18 22:24:01.290920 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2483/4978] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:00 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:01.299533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:01.300963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:01.318376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.321605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.322691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.324600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.348704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.357587 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d1b2b3e-a32b-44e9-beba-06722203b67e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.588709 Jun 18 22:24:01.367776 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2496/4979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:00 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:01.379747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:01.380693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:01.393338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.401838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.409763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.410661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.573142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.584638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.590211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.594052 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2fdbcdf1-d0da-4d7f-b7fc-d641b4785951 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.224837 Jun 18 22:24:01.616222 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2497/4980] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:01 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:01.622707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b3182dd-e898-4fd3-a38b-66319fb10799 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:01.639283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0b3182dd-e898-4fd3-a38b-66319fb10799 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 12a81cff-c2af-45fb-91c9-1f168264ad50] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:01.655936 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0b3182dd-e898-4fd3-a38b-66319fb10799 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 12a81cff-c2af-45fb-91c9-1f168264ad50 could not be found. Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b3182dd-e898-4fd3-a38b-66319fb10799 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/12a81cff-c2af-45fb-91c9-1f168264ad50 HTTP/1.1 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 12a81cff-c2af-45fb-91c9-1f168264ad50 could not be found. Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '12a81cff-c2af-45fb-91c9-1f168264ad50'} Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12a81cff-c2af-45fb-91c9-1f168264ad50 could not be found. Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12a81cff-c2af-45fb-91c9-1f168264ad50 could not be found. Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:01.666674 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12a81cff-c2af-45fb-91c9-1f168264ad50 could not be found. Jun 18 22:24:01.670682 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:01.676623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b3182dd-e898-4fd3-a38b-66319fb10799 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 12a81cff-c2af-45fb-91c9-1f168264ad50 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:01.677851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b3182dd-e898-4fd3-a38b-66319fb10799 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/12a81cff-c2af-45fb-91c9-1f168264ad50" status: 404 len: 111 microversion: 2.1 time: 0.060158 Jun 18 22:24:01.680637 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2498/4981] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:01 2022] DELETE /compute/v2.1/servers/12a81cff-c2af-45fb-91c9-1f168264ad50 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:01.698651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:01.699370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:01.733510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.733993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.734752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.735198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.757573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:01.774325 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b3e442c2-a309-4eb9-871b-fcc9ac4962aa tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1653 microversion: 2.1 time: 0.481886 Jun 18 22:24:01.778759 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2484/4982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:01 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1653 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:01.797314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f3849379-4d4e-4da1-a353-c05137474c85 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:01.809922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3849379-4d4e-4da1-a353-c05137474c85 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.810759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3849379-4d4e-4da1-a353-c05137474c85 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.841216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f3849379-4d4e-4da1-a353-c05137474c85 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Going to try to start instance {{(pid=130902) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 22:24:01.934276 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f3849379-4d4e-4da1-a353-c05137474c85 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.139158 Jun 18 22:24:01.939479 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2485/4983] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:01 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:24:01.951624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:01.952979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:01.963938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.964886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:01.966155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:01.966935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:02.290179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:02.318190 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e93d3873-3f5d-437e-a119-eed6e6b2796e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.619573 Jun 18 22:24:02.319623 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2499/4984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:01 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:02.330452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:02.334079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:02.365180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:02.366210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:02.367304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:02.367921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:02.463201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:02.472363 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a3ad9a12-c65d-4c1f-85fe-d7a8cdb9ac8d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1662 microversion: 2.1 time: 0.527219 Jun 18 22:24:02.473714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2486/4985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:01 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1662 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:02.481118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:02.482057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:02.488876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:02.489705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:02.490853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:02.491649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:02.859864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:02.875274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:02.880625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:02.899863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:02.903485 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-effa53eb-f4f4-4f9c-b040-d20c558d23f7 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.577455 Jun 18 22:24:02.906411 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2500/4986] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:02 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:02.911697 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e7777f2-8e26-454b-80b6-d589518083d0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.433462 Jun 18 22:24:02.919528 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2487/4987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:02 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:02.928415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:02.942015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9e7b5dc-7ad7-4c6b-8e5f-c0a2977b3b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:02.943075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:02.944696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9e7b5dc-7ad7-4c6b-8e5f-c0a2977b3b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Failed to fetch instance by id 9223372036854775808 {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:24:02.948755 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d9e7b5dc-7ad7-4c6b-8e5f-c0a2977b3b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9e7b5dc-7ad7-4c6b-8e5f-c0a2977b3b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 9223372036854775808 could not be found. Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '9223372036854775808'} Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:02.951079 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:02.956335 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:02.956335 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:02.956335 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:02.956335 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jun 18 22:24:02.956335 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:02.988893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:02.990538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:02.991848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9e7b5dc-7ad7-4c6b-8e5f-c0a2977b3b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:02.992573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:02.992734 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9e7b5dc-7ad7-4c6b-8e5f-c0a2977b3b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.062502 Jun 18 22:24:02.993735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:03.005981 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2488/4988] 10.222.0.30 () {58 vars in 1187 bytes} [Sat Jun 18 22:24:02 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:24:03.022861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:03.023778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:03.050024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:03.056895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:03.059146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:03.059595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:03.256912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:03.280259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:03.287939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:03.291920 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-86c24c53-f703-4d27-9545-a95b7506a732 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.379678 Jun 18 22:24:03.295923 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2501/4989] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:02 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:03.493277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:03.494325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:03.510563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:03.511616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:03.512559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:03.513067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:03.514499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:03.524106 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-09f0deba-7afc-4fed-905b-ef1fa512535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.512152 Jun 18 22:24:03.551902 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2489/4990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:03 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:03.562726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:03.563733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:03.582186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:03.583024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:03.586015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:03.586697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.081811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:04.096828 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a858b53-7ea9-44b3-83cb-57af596b6e3f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1662 microversion: 2.1 time: 0.609289 Jun 18 22:24:04.097553 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2502/4991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:03 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1662 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:04.123327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:04.127558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:04.143759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:04.144490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.145702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:04.146358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.180143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:04.221486 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93d3256d-da4c-46e4-acb4-5049409e124e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.657336 Jun 18 22:24:04.222337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2490/4992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:03 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:04.243567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97e4ed8c-d257-4334-8f90-cdce8246a153 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:04.244060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97e4ed8c-d257-4334-8f90-cdce8246a153 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Failed to fetch instance by id -1 {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 18 22:24:04.244583 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-97e4ed8c-d257-4334-8f90-cdce8246a153 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance -1 could not be found. Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97e4ed8c-d257-4334-8f90-cdce8246a153 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance -1 could not be found. Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '-1'} Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:04.259198 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:04.264894 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:04.264894 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:04.264894 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jun 18 22:24:04.264894 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:04.266642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97e4ed8c-d257-4334-8f90-cdce8246a153 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance -1 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:04.274421 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97e4ed8c-d257-4334-8f90-cdce8246a153 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.031086 Jun 18 22:24:04.277374 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2491/4993] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:24:04 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:24:04.319891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:04.323952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:04.349007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:04.356145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.360747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:04.361719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.859885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:04.898726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:04.905465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:04.906741 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e8890c2a-0bad-45b9-802e-3a3474dea6be tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.793299 Jun 18 22:24:04.913094 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2503/4994] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:04 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:04.942925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:04.943845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:04.963125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:04.967076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.970647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:04.973220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:04.995383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:05.019968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:05.030504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ea7cbca-5272-4503-b1a7-0c7dc84edb41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.740142 Jun 18 22:24:05.050483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2492/4995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:04 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:05.064301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:05.068237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:05.092199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.093721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.095140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.096068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.167154 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f7243051-c4c5-4a1c-a91a-2357a3d46117 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/ips" status: 200 len: 150 microversion: 2.1 time: 0.115125 Jun 18 22:24:05.168299 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2493/4996] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:24:05 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/ips => generated 150 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:05.175912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:05.176961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:05.207381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.210942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.210942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.210942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.219096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:05.234622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:05.246873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:05.248129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2ef0f27-4ee6-4431-98d3-d76084947b87 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.330357 Jun 18 22:24:05.255233 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2504/4997] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:04 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:05.271173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:05.287070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:05.326278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.331644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.333667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.335598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.412620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:05.424288 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-26d30020-8b3c-49d3-b16e-9951e6813bd4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.252307 Jun 18 22:24:05.443428 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2494/4998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:05 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:05.456611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c5ad0a1-c611-425a-b129-49476403fbd5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:05.463254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c5ad0a1-c611-425a-b129-49476403fbd5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 186ec9bd-9b40-4513-85ca-ac3d1ec5d895] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:05.483281 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4c5ad0a1-c611-425a-b129-49476403fbd5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 186ec9bd-9b40-4513-85ca-ac3d1ec5d895 could not be found. Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c5ad0a1-c611-425a-b129-49476403fbd5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/186ec9bd-9b40-4513-85ca-ac3d1ec5d895/action HTTP/1.1 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 19 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: {"forceDelete": {}} Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 186ec9bd-9b40-4513-85ca-ac3d1ec5d895 could not be found. Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '186ec9bd-9b40-4513-85ca-ac3d1ec5d895', 'body': {'forceDelete': {}}} Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 186ec9bd-9b40-4513-85ca-ac3d1ec5d895 could not be found. Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 186ec9bd-9b40-4513-85ca-ac3d1ec5d895 could not be found. Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:05.492358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:05.497864 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:05.497864 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:05.497864 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 186ec9bd-9b40-4513-85ca-ac3d1ec5d895 could not be found. Jun 18 22:24:05.497864 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:05.499025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c5ad0a1-c611-425a-b129-49476403fbd5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 186ec9bd-9b40-4513-85ca-ac3d1ec5d895 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:05.501023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c5ad0a1-c611-425a-b129-49476403fbd5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/186ec9bd-9b40-4513-85ca-ac3d1ec5d895/action" status: 404 len: 111 microversion: 2.1 time: 0.053744 Jun 18 22:24:05.506437 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2495/4999] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:05 2022] POST /compute/v2.1/servers/186ec9bd-9b40-4513-85ca-ac3d1ec5d895/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:05.517772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:05.518491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:05.542172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.542686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.543537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.543987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.867148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:05.872772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:05.886933 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8adfce83-2f2c-4b29-87be-5608b9c3a64b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.628601 Jun 18 22:24:05.897838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2505/5000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:05 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:05.915446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:05.915881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:05.932454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.932955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:05.936078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:05.936970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:06.019747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:06.036532 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ba803d3-1b17-40ee-8ec5-d4b06369282a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.528848 Jun 18 22:24:06.037454 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2496/5001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:05 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:06.042749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:06.043446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:06.063879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:06.064426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:06.065339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:06.066003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:06.833065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:06.849541 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d059a5e1-a810-42cb-aeaa-344c78717bba tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.938801 Jun 18 22:24:06.850793 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2506/5002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:05 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:06.858005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:06.862242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:06.866280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:06.873783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:06.885054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:06.886875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:06.887838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:06.890297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:06.904143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:06.925622 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b43b2f76-564d-49e8-8dc8-970ddd4610fd tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.886609 Jun 18 22:24:06.929242 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2497/5003] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:06 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:06.953270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:06.955100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:06.975235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:06.976878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:06.990529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:06.990529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.136123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:07.147980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:07.158116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:07.159369 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8d77efc-3c2b-48b6-b42f-979d5e0cfe22 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.228439 Jun 18 22:24:07.159929 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2498/5004] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:06 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:07.187812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:07.188638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:07.204908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.205761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.206766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.209423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.377953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:07.395244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca436a0a-00ce-4818-a21e-9db1fb8d454c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.538469 Jun 18 22:24:07.395244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2507/5005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:06 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:07.408580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660b098a-68b1-4990-bb0e-9b88a87c9d60"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:07.412009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:07.427228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.431909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.433117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.435840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.585074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:07.607132 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3263cf95-7dc0-4793-bf07-ed61c66a4b03 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.444025 Jun 18 22:24:07.608533 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2499/5006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:07 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:07.613972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47a73aae-0596-42c3-bfdb-3b1ed5ebc370 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:07.615582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47a73aae-0596-42c3-bfdb-3b1ed5ebc370 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 9ba27ce8-481f-4ef4-9e08-e4c12b920262] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:07.637178 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-47a73aae-0596-42c3-bfdb-3b1ed5ebc370 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 9ba27ce8-481f-4ef4-9e08-e4c12b920262 could not be found. Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47a73aae-0596-42c3-bfdb-3b1ed5ebc370 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/9ba27ce8-481f-4ef4-9e08-e4c12b920262/action HTTP/1.1 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 39 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: {"os-getConsoleOutput": {"length": 10}} Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 9ba27ce8-481f-4ef4-9e08-e4c12b920262 could not be found. Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '9ba27ce8-481f-4ef4-9e08-e4c12b920262', 'body': {'os-getConsoleOutput': {'length': 10}}} Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba27ce8-481f-4ef4-9e08-e4c12b920262 could not be found. Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba27ce8-481f-4ef4-9e08-e4c12b920262 could not be found. Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:07.646813 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba27ce8-481f-4ef4-9e08-e4c12b920262 could not be found. Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47a73aae-0596-42c3-bfdb-3b1ed5ebc370 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 9ba27ce8-481f-4ef4-9e08-e4c12b920262 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47a73aae-0596-42c3-bfdb-3b1ed5ebc370 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/9ba27ce8-481f-4ef4-9e08-e4c12b920262/action" status: 404 len: 111 microversion: 2.1 time: 0.039389 Jun 18 22:24:07.653367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2500/5007] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:07 2022] POST /compute/v2.1/servers/9ba27ce8-481f-4ef4-9e08-e4c12b920262/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:07.658045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:07.658683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:07.674590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.675344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.676983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.677765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.846362 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88a923fe-ace0-4dde-a411-ab329334f2b8 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "POST /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448763 Jun 18 22:24:07.847630 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2508/5008] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:24:07 2022] POST /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:07.856670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:07.857508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:07.874950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.877555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.880992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:07.885121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:07.980615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:07.988994 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-10c544b4-98de-41a5-89dd-917a4fe651cc tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.337620 Jun 18 22:24:07.989631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2501/5009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:07 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:08.001147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:08.001147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:08.011028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.011613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.012783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.012921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.520002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.533773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.556882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.558264 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aecf6e7e-6108-480b-9669-aa13df47b60e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.567528 Jun 18 22:24:08.559231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2502/5010] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:07 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:08.568552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:08.569597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:08.573849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.588155 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f672e1c-cf54-4ba8-b556-e71b41516f9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.736866 Jun 18 22:24:08.588772 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2509/5011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:07 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:08.594208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:08.603208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:08.610429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.612240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.612918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.613927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.614059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.614659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.617367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.617837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.925998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.935311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.940268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:08.944917 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81b66940-1397-4606-808f-353e61beff52 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.354402 Jun 18 22:24:08.952517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2510/5012] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:08 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:08.961349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:08.966410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:08.984291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.988530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:08.991175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:08.994895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:09.290795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:09.305763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50c44dd4-066a-4668-80eb-f20d2ee75389 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.745080 Jun 18 22:24:09.306368 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2503/5013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:08 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:09.327265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:09.328079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:09.336037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:09.336755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:09.337731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:09.338332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:09.388755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lazy-loading 'flavor' on Instance uuid 37ee6136-56ff-40f6-a614-b941bc50cc88 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:09.490162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:09.493754 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e19e03e-7765-48fb-b2e5-7c77c01d5b9a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.539923 Jun 18 22:24:09.497836 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2511/5014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:08 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:09.526190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-209a3e86-ed60-4efd-a8ec-6e7352bb3cef tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:09.527480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-209a3e86-ed60-4efd-a8ec-6e7352bb3cef tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: b8f2b0dc-1878-487f-80fe-e17289a87b83] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:09.532826 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b4c4162-3fbb-42cc-b99b-b337279c1380 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.209839 Jun 18 22:24:09.540714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2504/5015] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:09 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:09.541472 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-209a3e86-ed60-4efd-a8ec-6e7352bb3cef tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance b8f2b0dc-1878-487f-80fe-e17289a87b83 could not be found. Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-209a3e86-ed60-4efd-a8ec-6e7352bb3cef tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/b8f2b0dc-1878-487f-80fe-e17289a87b83 HTTP/1.1 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance b8f2b0dc-1878-487f-80fe-e17289a87b83 could not be found. Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'b8f2b0dc-1878-487f-80fe-e17289a87b83'} Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8f2b0dc-1878-487f-80fe-e17289a87b83 could not be found. Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8f2b0dc-1878-487f-80fe-e17289a87b83 could not be found. Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:09.545189 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:09.550165 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:09.550165 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:09.550165 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:09.550165 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8f2b0dc-1878-487f-80fe-e17289a87b83 could not be found. Jun 18 22:24:09.550165 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:09.551102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:09.551102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:09.554411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-209a3e86-ed60-4efd-a8ec-6e7352bb3cef tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance b8f2b0dc-1878-487f-80fe-e17289a87b83 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:09.556760 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-209a3e86-ed60-4efd-a8ec-6e7352bb3cef tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/b8f2b0dc-1878-487f-80fe-e17289a87b83" status: 404 len: 111 microversion: 2.1 time: 0.046569 Jun 18 22:24:09.558346 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2512/5016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:09 2022] GET /compute/v2.1/servers/b8f2b0dc-1878-487f-80fe-e17289a87b83 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:09.570904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:09.571812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:09.572310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:09.572986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:09.573204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:09.573660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:09.587193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:09.588106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:09.589927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:09.590578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.044012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.054850 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-de352a13-b713-4019-a960-056b22e22941 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1674 microversion: 2.1 time: 0.512343 Jun 18 22:24:10.056301 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2505/5017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:09 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1674 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:10.065655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:10.067459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:10.080411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:10.082138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.084732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:10.085820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.144817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.158019 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-07468fca-08d8-4664-b8a3-ed96ee1b4f01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.595040 Jun 18 22:24:10.169795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2513/5018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:09 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:10.185810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:10.187590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:10.196858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:10.197952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.201904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:10.202578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.349933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.382161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.387900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.389839 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c060a1c-45e3-46dd-9ad2-e0f78c55054a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.218621 Jun 18 22:24:10.393102 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2514/5019] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:10 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:10.398831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:10.399733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:10.407448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:10.408207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.409513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:10.410209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:10.440922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.453894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.457633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:10.458893 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19afecb3-b1cd-4470-ab8f-1a3061f9a525 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.400869 Jun 18 22:24:10.461011 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2506/5020] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:10 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:11.079263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:11.081472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:11.082234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:11.094241 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-496b0c02-8100-4957-a416-5ab7538033fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.699234 Jun 18 22:24:11.106909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.111213 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2515/5021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:10 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:11.113815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.114837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.115394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.172726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cdec7856-1613-46ac-a068-485fe9ba1634 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1886400798", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cdec7856-1613-46ac-a068-485fe9ba1634 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 238 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1886400798", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1886400798', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:24:11.179530 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cdec7856-1613-46ac-a068-485fe9ba1634 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:11.183683 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cdec7856-1613-46ac-a068-485fe9ba1634 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017468 Jun 18 22:24:11.188334 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2516/5022] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:24:11 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:24:11.200391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:11.201295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:11.213508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.214319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.216139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.216750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.611237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:11.619523 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-78891dd3-3950-475f-9e6e-7dc070736b23 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1674 microversion: 2.1 time: 0.550321 Jun 18 22:24:11.620099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2507/5023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:11 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1674 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:11.636548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:11.640230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:11.641123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:11.645346 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e1e09ea-bccf-4223-aea2-910085dbca9e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.455342 Jun 18 22:24:11.645931 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2517/5024] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:11 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:11.661543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:11.663826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.666928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.668779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.669372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:11.673838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.687051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.695036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.695887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.696339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.826423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:11.835913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:11.840455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:11.843805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4663898-d2b8-4d77-83d6-5580e4334baf tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.218377 Jun 18 22:24:11.857226 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2508/5025] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:11 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:11.862934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:11.864445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:11.884009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.884619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.887879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:11.888416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:11.995830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:12.007266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:12.008918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:12.010166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64fa95d8-61d1-4b08-bb03-18920671184e tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.357735 Jun 18 22:24:12.010742 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2518/5026] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:11 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:12.019955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:12.020623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:12.041004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.041507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.042316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.042780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.057167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lazy-loading 'services' on Instance uuid 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:12.061437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:12.202672 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d96bded-ee47-4368-b42c-beb230c21437 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments/660b098a-68b1-4990-bb0e-9b88a87c9d60" status: 202 len: 0 microversion: 2.1 time: 0.343905 Jun 18 22:24:12.204101 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2509/5027] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:24:11 2022] DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments/660b098a-68b1-4990-bb0e-9b88a87c9d60 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:12.221782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:12.227173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:12.245276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.246062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.247795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.248958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.348297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1728b3c-7d4b-4fef-af86-d98e00c8a58a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139375 Jun 18 22:24:12.356653 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2510/5028] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:24:12 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:24:12.405450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:12.417873 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-18c774dd-e3a5-4b78-86d1-f1498649f0fd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.406039 Jun 18 22:24:12.425184 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2519/5029] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:12 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:12.479326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54fcbc86-c90e-4064-9fab-7be7bc46a754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-779847355", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54fcbc86-c90e-4064-9fab-7be7bc46a754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 234 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-779847355", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-779847355', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = func(instance) Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi 'notvalid' Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:12.490424 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 18 22:24:12.494775 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:12.497833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-54fcbc86-c90e-4064-9fab-7be7bc46a754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:12.498945 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-54fcbc86-c90e-4064-9fab-7be7bc46a754 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.024290 Jun 18 22:24:12.500223 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2511/5030] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:24:12 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:24:12.508660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:12.509905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:12.517301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.518505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.519504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.520317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.639477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:12.639681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:12.654548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.656118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.659289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:12.659751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:12.940783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:12.960193 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32781f99-4d81-40c7-a05c-7bc94f4e4d2b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.453522 Jun 18 22:24:12.962093 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2520/5031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:12 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:12.978668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:12.982339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.005698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.010121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.012838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.014966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.015885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.026132 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a2596c2-4458-485c-8de7-d248abd9d998 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1657 microversion: 2.1 time: 0.393055 Jun 18 22:24:13.034603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2512/5032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:12 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1657 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:13.040385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:13.043927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.060109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.061100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.065106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.065750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.210080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.219124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.220649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.222159 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cef09300-7f0f-4bed-8eae-2f9de717a92e tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.258742 Jun 18 22:24:13.222698 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2521/5033] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:12 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:13.230928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:13.232121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.239444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.240184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.241293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.241852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.435549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.444509 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-85d873f4-ff24-409e-926e-df16ad5eaaa7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.407977 Jun 18 22:24:13.456379 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2513/5034] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:13 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:13.456379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:13.456379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.462008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.462411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.463368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.463851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.545105 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3ca540cb-db9a-4bc4-a392-8bd5732dea74 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action" status: 202 len: 0 microversion: 2.1 time: 0.098136 Jun 18 22:24:13.546132 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2514/5035] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:13 2022] POST /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:13.552433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:13.553783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.562010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.562861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.563932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.564589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.599723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d70c668-538e-49b9-8129-3a34e7cafe7e tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052167 Jun 18 22:24:13.603781 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2515/5036] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:24:13 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:13.609651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-082d3159-740e-4a33-8c29-6b0169729898 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:13.610445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-082d3159-740e-4a33-8c29-6b0169729898 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: b76cf11b-213c-4509-a19b-ca1484ce41a5] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.619346 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-082d3159-740e-4a33-8c29-6b0169729898 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance b76cf11b-213c-4509-a19b-ca1484ce41a5 could not be found. Jun 18 22:24:13.622862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-082d3159-740e-4a33-8c29-6b0169729898 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/b76cf11b-213c-4509-a19b-ca1484ce41a5/action HTTP/1.1 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 13 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: {"pause": {}} Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance b76cf11b-213c-4509-a19b-ca1484ce41a5 could not be found. Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'b76cf11b-213c-4509-a19b-ca1484ce41a5', 'body': {'pause': {}}} Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b76cf11b-213c-4509-a19b-ca1484ce41a5 could not be found. Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b76cf11b-213c-4509-a19b-ca1484ce41a5 could not be found. Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:13.624622 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:13.629382 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:13.629382 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:13.629382 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b76cf11b-213c-4509-a19b-ca1484ce41a5 could not be found. Jun 18 22:24:13.629382 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:13.630883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-082d3159-740e-4a33-8c29-6b0169729898 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance b76cf11b-213c-4509-a19b-ca1484ce41a5 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:13.632969 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-082d3159-740e-4a33-8c29-6b0169729898 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/b76cf11b-213c-4509-a19b-ca1484ce41a5/action" status: 404 len: 111 microversion: 2.1 time: 0.027726 Jun 18 22:24:13.633807 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2516/5037] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:13 2022] POST /compute/v2.1/servers/b76cf11b-213c-4509-a19b-ca1484ce41a5/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:13.634074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.635586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:13.636761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4984de8-9eee-4cfc-9579-d9e0b39f2ef1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.412981 Jun 18 22:24:13.640497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:13.643590 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2522/5038] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:13 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:13.649443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.659553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.660164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.661332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.661908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.676762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:13.683756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:13.697833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:13.704070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.704805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.705824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:13.706442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:13.713479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:14.023445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.026705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.038088 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5f30717-4cba-40ff-bcf5-8f6bd30a28d8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.392972 Jun 18 22:24:14.039051 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2523/5039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:13 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:14.051294 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9fb91186-8908-47f5-8ee6-c308d3a239a4 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1663 microversion: 2.1 time: 0.402752 Jun 18 22:24:14.054887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2517/5040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:13 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1663 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:14.063570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:14.064321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.084234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.084824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.085886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.086352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.243438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:14.245010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.260164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.260645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.262197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.262659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.407858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.424636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.430025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.438514 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2acc98a7-3933-439a-ba83-3fc35f002d5a tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1365 microversion: 2.47 time: 0.201063 Jun 18 22:24:14.439192 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2518/5041] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:14 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:24:14.616312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:14.618848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.631620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.632191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.633017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.633512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.633512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.647775 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d9ffb3c-785a-4615-901a-6d4a671920af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.595026 Jun 18 22:24:14.660694 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2524/5042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:14 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:14.669396 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:14.677364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.682100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-10a1e706-3294-435f-8bb9-f7cb2d70b591 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071392 Jun 18 22:24:14.683306 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2519/5043] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:24:14 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:24:14.702586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:14.703301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.704068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.704862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.707764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.709743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.720784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.722170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.722985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.729177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.822910 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93bd7eb4-43ec-437c-94af-2055212274bb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 202 len: 0 microversion: 2.1 time: 0.160594 Jun 18 22:24:14.824216 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2525/5044] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:14 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:14.832414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:14.834900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.843116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.843958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.845199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.845868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.897231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:14.934922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.945599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.965428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:14.967494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff447439-e1cc-445c-bb67-5dcee63846ca tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.282996 Jun 18 22:24:14.980631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2520/5045] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:14 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:14.986072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:14.986957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:14.994624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.995352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:14.996416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:14.997193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:15.084193 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-236f5c03-9c5d-4d01-84eb-4310f5ac428a tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 204 len: 0 microversion: 2.1 time: 0.257249 Jun 18 22:24:15.086587 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2526/5046] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:14 2022] DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:24:15.336311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:15.338471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:15.346628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:15.347358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:15.348339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:15.348769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:15.547093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:15.567152 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-889ec066-6b72-4f1a-979f-30799729e91d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1509 microversion: 2.1 time: 0.583186 Jun 18 22:24:15.570737 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2521/5047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:14 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1509 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:15.590488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:15.593229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:15.621673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:15.623286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:15.625279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:15.628193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.079562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.088728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8f6543de-1033-4828-9d91-8768940a89e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1663 microversion: 2.1 time: 1.000550 Jun 18 22:24:16.089362 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2527/5048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:15 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1663 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:16.094913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:16.096083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:16.103706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.104663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.105846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.107058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.222523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.231976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.233710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.234340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.235428 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-923574ee-5d5c-4f30-803c-9ff98d9f871c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1371 microversion: 2.47 time: 0.144853 Jun 18 22:24:16.236493 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2528/5049] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:16 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:16.241437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e4a42d83-96b5-4b07-bf4f-d7c0b744ffee req-659d2a65-27d3-430e-aa0d-710430d097be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "name": "network-vif-plugged", "status": "completed", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:16.250901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e4a42d83-96b5-4b07-bf4f-d7c0b744ffee req-659d2a65-27d3-430e-aa0d-710430d097be service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.251591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e4a42d83-96b5-4b07-bf4f-d7c0b744ffee req-659d2a65-27d3-430e-aa0d-710430d097be service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.265913 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb9ef178-a63f-4da4-84b4-b2b43a249986 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1681 microversion: 2.1 time: 0.690269 Jun 18 22:24:16.266474 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e4a42d83-96b5-4b07-bf4f-d7c0b744ffee req-659d2a65-27d3-430e-aa0d-710430d097be service nova] Creating event network-vif-plugged:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch1-master-1 Jun 18 22:24:16.272073 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e4a42d83-96b5-4b07-bf4f-d7c0b744ffee req-659d2a65-27d3-430e-aa0d-710430d097be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Jun 18 22:24:16.273186 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2529/5050] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:16.276975 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2522/5051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:15 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1681 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:16.288050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:16.289532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:16.295576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.296009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.296785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.297264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.578516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.587972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.590408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:16.592727 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3fe5900-77eb-4543-8485-a79c0a8135db tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 0.317594 Jun 18 22:24:16.593358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:16.594003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:16.595249 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2530/5052] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:16 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:16.602654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.603558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:16.604367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:16.604805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.106489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:17.107100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:17.117025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.121893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.123000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.123664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.606325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:17.625953 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f58444c-b846-4f71-8f0e-e0372742145f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1489 microversion: 2.1 time: 1.040128 Jun 18 22:24:17.626882 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2523/5053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:16 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1489 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:17.627887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:17.636425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de8eb48f-4f18-46bf-b483-5fb37ce2b4e5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.533972 Jun 18 22:24:17.640734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2531/5054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:17 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:17.641432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:17.644486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:17.651757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:17.652605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:17.655887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.656539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.657626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.658558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.672683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.673163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.673961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.674479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.789812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:17.805560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:17.807092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:17.808317 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ddb6f26f-2d5e-4dd0-a047-a9feaa111590 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1371 microversion: 2.47 time: 0.179791 Jun 18 22:24:17.821424 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2524/5055] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:17 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:17.829484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:17.830380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:17.843817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.845233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.846254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.846859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.854266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:17.875836 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f420c963-6aee-4ac8-8a28-7fff6b7ed2e6 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1613 microversion: 2.1 time: 0.229462 Jun 18 22:24:17.876821 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2532/5056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:17 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1613 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:17.890158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:17.893856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:17.921076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.922131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:17.923340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:17.938874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:18.055008 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'pause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state paused Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 13 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: {"pause": {}} Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'pause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state paused Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'pause': {}}} Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state paused. Cannot pause while the instance is in this state. Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state paused Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:18.057457 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:18.062390 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:18.062390 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:18.062390 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:18.062390 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state paused Jun 18 22:24:18.062390 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:18.062390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'pause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state paused {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:18.063601 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-077fea3e-f9ae-47d9-b910-62e71f04d7a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 143 microversion: 2.1 time: 0.184719 Jun 18 22:24:18.064308 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2533/5057] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:17 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 143 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:24:18.073683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:18.074494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:18.082743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:18.083481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:18.089132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:18.089783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:18.931122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:18.946701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:18.948489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:18.950250 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-60b4fa2a-ac00-48d8-acfe-1390c839e232 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1730 microversion: 2.20 time: 1.127188 Jun 18 22:24:18.958972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2525/5058] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:17 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1730 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:18.968877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5da3a9f3-4266-48d9-afae-0792117a4677 req-390d1402-ad7c-48e9-a51d-7d9f9c7685f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2bb1e2-5faa-463a-b3bf-3f63163cc71c", "name": "network-vif-deleted", "tag": "4b048f89-2c90-48dd-9edc-60cdf4ab160a"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:18.986504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5da3a9f3-4266-48d9-afae-0792117a4677 req-390d1402-ad7c-48e9-a51d-7d9f9c7685f0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:18.989682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5da3a9f3-4266-48d9-afae-0792117a4677 req-390d1402-ad7c-48e9-a51d-7d9f9c7685f0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.015418 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5da3a9f3-4266-48d9-afae-0792117a4677 req-390d1402-ad7c-48e9-a51d-7d9f9c7685f0 service nova] Creating event network-vif-deleted:4b048f89-2c90-48dd-9edc-60cdf4ab160a for instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c on nch2-master-1 Jun 18 22:24:19.021716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:19.027716 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5da3a9f3-4266-48d9-afae-0792117a4677 req-390d1402-ad7c-48e9-a51d-7d9f9c7685f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067034 Jun 18 22:24:19.034315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2526/5059] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:19.045631 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d7f58859-6216-444a-99da-3066316f40ad tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1666 microversion: 2.1 time: 0.980031 Jun 18 22:24:19.048803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2534/5060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:18 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1666 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:19.050081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:19.050857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:19.056949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:19.066246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:19.067150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:19.070263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.073119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.075039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.077627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.081263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.081820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.082818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.083269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.169317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:19.247229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:19.265819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:19.269709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:19.272744 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e30be077-9028-4670-915b-42aaeee860bb tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1356 microversion: 2.47 time: 0.221685 Jun 18 22:24:19.277895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2535/5061] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:19 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1356 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:19.294843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:19.297193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:19.314337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.315494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.318059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.321026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.367000 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f08e3370-d53a-4686-9d9e-45baa24bc73b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 202 len: 0 microversion: 2.1 time: 0.330743 Jun 18 22:24:19.380505 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2527/5062] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:19 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:19.401015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:19.403865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:19.409662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.410154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.410615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lazy-loading 'fault' on Instance uuid 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:19.424892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.432277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.433793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.434824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.505455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41eb42094f418685b83cc0a57852d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7126d757bd748f291963f779f8eaad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:19.513283 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-04386193-b534-414f-b3cc-73fca37d6174 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 200 len: 1330 microversion: 2.1 time: 0.234225 Jun 18 22:24:19.516004 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2536/5063] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:19 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 1330 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:19.521948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:19.528598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:19.537681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:19.539304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.api [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Working on deleting snapshot 90482e0e-07c1-4240-887b-4dc303a1cb84 from shelved instance... Jun 18 22:24:19.540774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Searching by: {'deleted': False, 'project_id': '878ebb841a1d45beb290d689fe7947f6'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:24:19.565240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.565956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.566920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:19.567517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:19.858518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:24:19.883559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:20.048935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:20.060677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:20.061213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:20.101950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:20.101950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:20.231332 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd2648b8-1770-4162-b898-914a8082fdfd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.714147 Jun 18 22:24:20.232348 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2537/5064] 10.222.0.30 () {60 vars in 1186 bytes} [Sat Jun 18 22:24:19 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:20.264355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:20.268836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:20.302097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:20.305709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:20.305709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:20.308022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:20.604997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Doing local delete in cell d349766c-949b-4923-9574-b93ba690371c(cell1) {{(pid=130902) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 18 22:24:20.605858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:20.606315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:20.606847 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.api [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 18 22:24:20.610897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] deallocate_for_instance() {{(pid=130902) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 18 22:24:20.652155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:20.662149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5e0e0e0d-0050-40be-ad40-8393673bcb03 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.414359 Jun 18 22:24:20.663653 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2538/5065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:20 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:20.669142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:20.669968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:20.682997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:20.683675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:20.684737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:20.685088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:21.124591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:21.136742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:21.138854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:21.140567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a94d5dd2-a002-4c95-ab59-e998ef946fc3 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1717 microversion: 2.20 time: 0.475711 Jun 18 22:24:21.142208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2539/5066] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:20 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1717 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:21.155736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:21.159685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:21.167206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:21.167977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:21.169143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:21.169754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:21.208711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:21.324540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ebdea99e-6554-4e3d-b2ef-da37b1bc685c tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 204 len: 0 microversion: 2.47 time: 0.180197 Jun 18 22:24:21.325398 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2540/5067] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:24:21 2022] DELETE /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:24:21.333707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:21.335102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:21.344027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:21.344925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:21.346327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:21.347444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:21.381483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c HTTP/1.1 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0a2bb1e2-5faa-463a-b3bf-3f63163cc71c'} Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:21.383856 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:21.388638 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:21.390911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:21.392042 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2b6c0789-84de-4477-ba1a-d674128e6220 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 404 len: 111 microversion: 2.1 time: 0.065045 Jun 18 22:24:21.392785 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2541/5068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:21 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:21.398059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:21.399001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:21.409348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:21.410220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:21.411417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:21.412129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.164750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:22.182516 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d73c3aee-98ed-47f5-af09-72aa05da377b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.788381 Jun 18 22:24:22.183121 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2542/5069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:21 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:22.192004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:22.192719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:22.213450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.213902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.214673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.215285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.368180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:22.389732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:22.393280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:22.394862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5bc659ee-00ee-4449-8828-fba7c4664588 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1362 microversion: 2.47 time: 0.210780 Jun 18 22:24:22.419555 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2543/5070] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:22 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:22.434244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-012805ae-d5e4-4eac-9551-fa7597884c69 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '.version_select at 0x7fea075273a0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:22.478388 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-012805ae-d5e4-4eac-9551-fa7597884c69 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794992573" status: 202 len: 0 microversion: 2.1 time: 0.056493 Jun 18 22:24:22.482892 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2544/5071] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:24:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794992573 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:22.509303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:22.513024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:22.539808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.540496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.541577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.544800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.570085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Updating instance_info_cache with network_info: [] {{(pid=130902) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 18 22:24:22.581677 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756/action HTTP/1.1 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 28 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: {"reboot": {"type": "SOFT"}} Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1c398202-642e-4031-bdc4-f9fc17356756', 'body': {'reboot': {'type': 'SOFT'}}} Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:22.592499 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e3757e5-fc88-43ec-be3c-61b3cc61b919 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756/action" status: 404 len: 111 microversion: 2.1 time: 0.113798 Jun 18 22:24:22.596832 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2545/5072] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:22 2022] POST /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756/action => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:22.604506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-47707e35-325c-4c48-aeda-56b9f0c959b8 req-c365038f-37bd-4ffa-a194-9eeae1f0cc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d26a21-15cf-4bd1-be51-8786cd9886e9", "name": "network-vif-deleted", "tag": "e7f4a31c-4c09-4041-9779-5042bbe1f4c6"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:22.616140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-47707e35-325c-4c48-aeda-56b9f0c959b8 req-c365038f-37bd-4ffa-a194-9eeae1f0cc96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.616642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-47707e35-325c-4c48-aeda-56b9f0c959b8 req-c365038f-37bd-4ffa-a194-9eeae1f0cc96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.656448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_external_events [req-47707e35-325c-4c48-aeda-56b9f0c959b8 req-c365038f-37bd-4ffa-a194-9eeae1f0cc96 service nova] Unable to find a host for instance 03d26a21-15cf-4bd1-be51-8786cd9886e9. Dropping event network-vif-deleted {{(pid=130903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 22:24:22.657924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-47707e35-325c-4c48-aeda-56b9f0c959b8 req-c365038f-37bd-4ffa-a194-9eeae1f0cc96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.060993 Jun 18 22:24:22.666244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2546/5073] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 18 22:24:22.672611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:22.674700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:22.687978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.689291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:22.690625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:22.691351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.056840 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ad0c1f0-e3bf-417a-a06f-6325e98a5c0b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 204 len: 0 microversion: 2.1 time: 3.671270 Jun 18 22:24:23.058377 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2528/5074] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:19 2022] DELETE /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 0 bytes in 3674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:24:23.081164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:23.082071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 03d26a21-15cf-4bd1-be51-8786cd9886e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.089493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:23.096343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.096857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.102062 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80b1595f-d5ae-43a7-a15e-13b10515b3c4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.433043 Jun 18 22:24:23.102406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.113085 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2547/5075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:22 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:23.114602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.124457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:23.125303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.138909 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] HTTP exception thrown: Instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 could not be found. Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Request method failure captured: Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 HTTP/1.1 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk42EGm5LQCR1sfLFnqveIKswEI9D2bNKgrJ79NnCDSEp3C60cses8yEF_0TpFNS4_J0-KILujwAHrR1O3siwHIDsdmZ3L3DB0dJiOytN29d_92zB4wbEvFqjLmwXmY9a0kwMjOWtzJJFQ1kUvb6r7MfQiXeM0B0x-YdIDo073fProg Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6269e5969c6a4957b3bb1816d93cebd0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ab975e8ffd0448939b2105aed58003fe Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 could not be found. Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '03d26a21-15cf-4bd1-be51-8786cd9886e9'} Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 could not be found. Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 could not be found. Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:23.141263 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 could not be found. Jun 18 22:24:23.145449 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.149673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.149673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.149673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.149673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.159976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Returning 404 to user: Instance 03d26a21-15cf-4bd1-be51-8786cd9886e9 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:23.163023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d23d8d3-5321-44b4-9543-c6904106d9c9 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9" status: 404 len: 111 microversion: 2.1 time: 0.098773 Jun 18 22:24:23.168162 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2529/5076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:23 2022] GET /compute/v2.1/servers/03d26a21-15cf-4bd1-be51-8786cd9886e9 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:23.174305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:23.175174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.185431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.187201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.188157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.189163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.246217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:23.386719 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-519da6e4-3cfa-493e-9275-52e704b40657 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 204 len: 0 microversion: 2.1 time: 0.216702 Jun 18 22:24:23.391423 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2530/5077] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:23 2022] DELETE /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:24:23.398431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:23.399240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.407398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.408215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.413684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.414149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.590830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:23.605826 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f6ce7a0-c4fc-4622-aea2-d937af38401a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.487409 Jun 18 22:24:23.606700 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2548/5078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:23 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:23.611866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:23.614793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.634658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:23.636250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.636702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.637543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.638168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.654884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2361aee9-c36b-4860-a47e-b2b2f79b9fa2 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1465 microversion: 2.1 time: 0.261560 Jun 18 22:24:23.655491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2531/5079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:23 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1465 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:23.670721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eecc912c-8972-460c-88c5-fa75c4203208 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:23.672849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eecc912c-8972-460c-88c5-fa75c4203208 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: d9698490-6e59-48db-9986-3daf74e934be] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.702060 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-eecc912c-8972-460c-88c5-fa75c4203208 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance d9698490-6e59-48db-9986-3daf74e934be could not be found. Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eecc912c-8972-460c-88c5-fa75c4203208 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/d9698490-6e59-48db-9986-3daf74e934be/action HTTP/1.1 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 28 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: {"reboot": {"type": "SOFT"}} Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance d9698490-6e59-48db-9986-3daf74e934be could not be found. Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd9698490-6e59-48db-9986-3daf74e934be', 'body': {'reboot': {'type': 'SOFT'}}} Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9698490-6e59-48db-9986-3daf74e934be could not be found. Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9698490-6e59-48db-9986-3daf74e934be could not be found. Jun 18 22:24:23.705290 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9698490-6e59-48db-9986-3daf74e934be could not be found. Jun 18 22:24:23.712990 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:23.713825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.714805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.716853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lazy-loading 'fault' on Instance uuid 3a6ad130-8db5-4e46-906b-e7f21910517c {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:23.759461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eecc912c-8972-460c-88c5-fa75c4203208 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance d9698490-6e59-48db-9986-3daf74e934be could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:23.759792 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eecc912c-8972-460c-88c5-fa75c4203208 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/d9698490-6e59-48db-9986-3daf74e934be/action" status: 404 len: 111 microversion: 2.1 time: 0.101607 Jun 18 22:24:23.765530 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2532/5080] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:23 2022] POST /compute/v2.1/servers/d9698490-6e59-48db-9986-3daf74e934be/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:23.776872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:23.777864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:23.794961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.795757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.797200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:23.811974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:23.865097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:23.885058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:23.895290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:23.899392 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-36007ad9-e63b-48fc-acfd-f78d01324076 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 200 len: 1367 microversion: 2.47 time: 0.291407 Jun 18 22:24:23.900018 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2549/5081] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:23 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:24.281783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:24.298678 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec0badf8-27c8-434c-9102-eb4108a0f846 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.531823 Jun 18 22:24:24.299796 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2533/5082] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:23 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:24.319899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:24.320982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:24.336496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:24.338793 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:24.340646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:24.341393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:24.717498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:24.720936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:24.753856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:24.761887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:24.784815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:24.788661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.145998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:25.155959 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-03f24e3b-d681-41ad-b104-f4a6762b0c2f tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1465 microversion: 2.1 time: 0.487795 Jun 18 22:24:25.156538 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2534/5083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:24 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1465 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:25.174308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:25.174986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 3a6ad130-8db5-4e46-906b-e7f21910517c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:25.189073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.190751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.190751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.191148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.217936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] HTTP exception thrown: Instance 3a6ad130-8db5-4e46-906b-e7f21910517c could not be found. Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Request method failure captured: Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c HTTP/1.1 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlBi5tQ-yFYMDKFdAwAZDafQ_1sYypBvq7zjuEjwgNAv45_ORZmU3Y_PcFBfWV3AfE9un_FG3bbdtVLrh6yTlb0DFPhVOCyVxQcKhnzV-wXWbc6MDe03GPfZKbeWAtWKv0vtkmdpZo7SfhwEn8PGjVDJZUWeq3f5-PvjAmgAWD2ScWg Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.47 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 878ebb841a1d45beb290d689fe7947f6 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerShowV247Test-1666347900 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/878ebb841a1d45beb290d689fe7947f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/878ebb841a1d45beb290d689fe7947f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/878ebb841a1d45beb290d689fe7947f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_878ebb841a1d45beb290d689fe7947f6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerShowV247Test-1666347900 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 878ebb841a1d45beb290d689fe7947f6 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerShowV247Test-1666347900 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerShowV247Test-1666347900-project Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: db591a1386ab46ca84a0473ad1c2e974 Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerShowV247Test-1666347900-project Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 3a6ad130-8db5-4e46-906b-e7f21910517c could not be found. Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3a6ad130-8db5-4e46-906b-e7f21910517c'} Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6ad130-8db5-4e46-906b-e7f21910517c could not be found. Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6ad130-8db5-4e46-906b-e7f21910517c could not be found. Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:25.220344 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6ad130-8db5-4e46-906b-e7f21910517c could not be found. Jun 18 22:24:25.224554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.227424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Returning 404 to user: Instance 3a6ad130-8db5-4e46-906b-e7f21910517c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:25.228531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-63fe6089-b01e-4028-b981-db232bf3e551 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c" status: 404 len: 111 microversion: 2.47 time: 0.064531 Jun 18 22:24:25.229625 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2535/5084] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:25 2022] GET /compute/v2.1/servers/3a6ad130-8db5-4e46-906b-e7f21910517c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:24:25.243091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:25.249199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:25.261255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.263303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.267540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.268453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.318845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:25.332433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb54fb1e-9390-4ff0-a2af-adc5a4be8711 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 1.015302 Jun 18 22:24:25.334464 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2550/5085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:24 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:25.344553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:25.373135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:25.387564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:25.401250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:25.412203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.413649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.416339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.420465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.457152 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756/action HTTP/1.1 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 65 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1c398202-642e-4031-bdc4-f9fc17356756', 'body': {'rebuild': {'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad'}}} Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 18 22:24:25.458959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b529b432-ff14-441d-9521-2b1ca44a6332 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756/action" status: 404 len: 111 microversion: 2.1 time: 0.111860 Jun 18 22:24:25.465788 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2551/5086] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:25 2022] POST /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756/action => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:25.471093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:25.471727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:25.491314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.491854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.492650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.493294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.520223 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1ad1917-6dba-4207-920c-f4214c92fc93 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103" status: 204 len: 0 microversion: 2.47 time: 0.284507 Jun 18 22:24:25.521165 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2536/5087] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:24:25 2022] DELETE /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:24:25.533239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:25.534327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:25.551498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.552134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.553547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:25.554567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:25.791627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:25.834120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:25.835613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:25.836812 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c1da3be-5935-46d8-b688-ff7b521f9ff7 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103" status: 200 len: 1362 microversion: 2.47 time: 0.310965 Jun 18 22:24:25.844442 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2537/5088] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:25 2022] GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:26.182069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:26.183371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:26.205624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.206512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.207613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.208086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.213916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:26.231277 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56e11970-226c-4b86-a86e-dc04fc32de64 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.760631 Jun 18 22:24:26.232671 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2552/5089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:25 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:26.252827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:26.254447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:26.265858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.266758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.267834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.268465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.519330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:26.558675 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8710871f-db25-4a37-931f-2e6e1e7c5942 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1465 microversion: 2.1 time: 0.382455 Jun 18 22:24:26.560099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2538/5090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:26 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1465 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:26.565503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-590e6f81-723e-4dd7-b282-d803fa11723c req-4012a8bd-4969-4e9b-b4bd-1a4aa3b5d0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aacbb16-218a-4c65-8f79-5c5b2c4d5f79", "name": "network-vif-deleted", "tag": "e803796e-dec2-4bf1-862b-d9088b0c5b59"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:26.579005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-590e6f81-723e-4dd7-b282-d803fa11723c req-4012a8bd-4969-4e9b-b4bd-1a4aa3b5d0ee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.579883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-590e6f81-723e-4dd7-b282-d803fa11723c req-4012a8bd-4969-4e9b-b4bd-1a4aa3b5d0ee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.596497 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-590e6f81-723e-4dd7-b282-d803fa11723c req-4012a8bd-4969-4e9b-b4bd-1a4aa3b5d0ee service nova] Creating event network-vif-deleted:e803796e-dec2-4bf1-862b-d9088b0c5b59 for instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 on nch1-master-1 Jun 18 22:24:26.606430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-590e6f81-723e-4dd7-b282-d803fa11723c req-4012a8bd-4969-4e9b-b4bd-1a4aa3b5d0ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044772 Jun 18 22:24:26.607394 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2539/5091] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:26.706004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:26.717164 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fdf37540-afc4-49b5-8734-cb7d020cd8d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.470569 Jun 18 22:24:26.718715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2553/5092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:26 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:26.738393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d34e5fca-f778-4359-aa48-53153de032f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:26.740204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d34e5fca-f778-4359-aa48-53153de032f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: ef0aa7e6-1506-4fb7-8377-1aafce195ec4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:26.745851 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d34e5fca-f778-4359-aa48-53153de032f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance ef0aa7e6-1506-4fb7-8377-1aafce195ec4 could not be found. Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d34e5fca-f778-4359-aa48-53153de032f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/ef0aa7e6-1506-4fb7-8377-1aafce195ec4/action HTTP/1.1 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 65 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance ef0aa7e6-1506-4fb7-8377-1aafce195ec4 could not be found. Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'ef0aa7e6-1506-4fb7-8377-1aafce195ec4', 'body': {'rebuild': {'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad'}}} Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0aa7e6-1506-4fb7-8377-1aafce195ec4 could not be found. Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 18 22:24:26.747613 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0aa7e6-1506-4fb7-8377-1aafce195ec4 could not be found. Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0aa7e6-1506-4fb7-8377-1aafce195ec4 could not be found. Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d34e5fca-f778-4359-aa48-53153de032f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance ef0aa7e6-1506-4fb7-8377-1aafce195ec4 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d34e5fca-f778-4359-aa48-53153de032f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/ef0aa7e6-1506-4fb7-8377-1aafce195ec4/action" status: 404 len: 111 microversion: 2.1 time: 0.016361 Jun 18 22:24:26.752531 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2540/5093] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:26 2022] POST /compute/v2.1/servers/ef0aa7e6-1506-4fb7-8377-1aafce195ec4/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:26.764055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:26.764927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:26.776129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.776623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.777481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.777981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.863866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:26.864568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:26.874375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.874953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:26.876723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:26.877572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.004534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:27.024882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:27.030068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:27.031327 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06b0eaae-0bd1-4467-aae4-0218d6efd7dd tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103" status: 200 len: 1362 microversion: 2.47 time: 0.171931 Jun 18 22:24:27.031906 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2541/5094] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:26 2022] GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:24:27.086267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:27.094713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cd9f340-4c62-4782-84fc-0a9a0b300678 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.339260 Jun 18 22:24:27.096383 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2554/5095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:26 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:27.120961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:27.121843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:27.137138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.137598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.145059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.145059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.577452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:27.578192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:27.591170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.591947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.594796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.596446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.611950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:27.633698 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f7962c8d-9e45-4dc1-ab90-d358b8bf8406 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.517290 Jun 18 22:24:27.638569 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2542/5096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:27 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:27.667712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:27.669108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee0db940-4ab0-4b13-b31d-2969c8b36808 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:27.670659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee0db940-4ab0-4b13-b31d-2969c8b36808 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: f646637c-3a15-45fb-b326-b84ab571c44e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:27.692982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.694292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.694947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lazy-loading 'fault' on Instance uuid 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:27.697885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ee0db940-4ab0-4b13-b31d-2969c8b36808 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance f646637c-3a15-45fb-b326-b84ab571c44e could not be found. Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee0db940-4ab0-4b13-b31d-2969c8b36808 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/f646637c-3a15-45fb-b326-b84ab571c44e/action HTTP/1.1 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: {"restore": {}} Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance f646637c-3a15-45fb-b326-b84ab571c44e could not be found. Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f646637c-3a15-45fb-b326-b84ab571c44e', 'body': {'restore': {}}} Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f646637c-3a15-45fb-b326-b84ab571c44e could not be found. Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f646637c-3a15-45fb-b326-b84ab571c44e could not be found. Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:27.699940 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:27.706710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:27.706710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:27.706710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f646637c-3a15-45fb-b326-b84ab571c44e could not be found. Jun 18 22:24:27.706710 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:27.712186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee0db940-4ab0-4b13-b31d-2969c8b36808 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance f646637c-3a15-45fb-b326-b84ab571c44e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:27.714489 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee0db940-4ab0-4b13-b31d-2969c8b36808 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/f646637c-3a15-45fb-b326-b84ab571c44e/action" status: 404 len: 111 microversion: 2.1 time: 0.060462 Jun 18 22:24:27.721385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2543/5097] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:27 2022] POST /compute/v2.1/servers/f646637c-3a15-45fb-b326-b84ab571c44e/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:27.726889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:27.731077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:27.740745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.741345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.743109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:27.743842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:27.792044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:27.802153 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f39b209-e0da-4da4-ba04-a5581862d016 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1304 microversion: 2.1 time: 0.229227 Jun 18 22:24:27.803718 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2555/5098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:27 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:28.054022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:28.055230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.064543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:28.077861 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-787e3abb-cb71-4167-9b5c-b127097d907a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.354985 Jun 18 22:24:28.085314 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2544/5099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:27 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:28.086402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.087518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.089975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.091567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.113642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:28.114450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.158380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.158832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.160129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.160129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.199037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.199496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.200477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lazy-loading 'fault' on Instance uuid 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:28.283172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:28.302436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:28.306351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db591a1386ab46ca84a0473ad1c2e974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878ebb841a1d45beb290d689fe7947f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:28.312968 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2676f93e-09b9-4e01-98d0-7edae4be93c4 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103" status: 200 len: 1367 microversion: 2.47 time: 0.264096 Jun 18 22:24:28.324659 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2556/5100] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:28 2022] GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:28.329959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:28.330577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.342933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.343390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.344244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.344684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.355604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:28.364707 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ae6102e9-8c47-44cf-a2cc-43c227af4537 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.262042 Jun 18 22:24:28.366969 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2545/5101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:28 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:28.394036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:28.398004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.400761 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c HTTP/1.1 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0a2bb1e2-5faa-463a-b3bf-3f63163cc71c'} Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:28.403915 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.410967 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.418292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:28.418477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.419175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.419983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.420264 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-81a803d3-7b80-4ee7-b7ee-149820e2854d tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 404 len: 111 microversion: 2.1 time: 0.104101 Jun 18 22:24:28.421157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.421614 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2557/5102] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:28 2022] DELETE /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:28.431313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:28.432165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.440797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.441540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.442494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.443346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.470910 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'restore' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: {"restore": {}} Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'restore' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'restore': {}}} Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state active. Cannot restore while the instance is in this state. Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.473601 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:28.478533 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:28.478533 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:28.478533 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:28.478533 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:28.478533 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c HTTP/1.1 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0a2bb1e2-5faa-463a-b3bf-3f63163cc71c'} Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:28.478954 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 0a2bb1e2-5faa-463a-b3bf-3f63163cc71c could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca02f910-72a4-4420-994e-98eba9336589 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c" status: 404 len: 111 microversion: 2.1 time: 0.050816 Jun 18 22:24:28.485951 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2558/5103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:28 2022] GET /compute/v2.1/servers/0a2bb1e2-5faa-463a-b3bf-3f63163cc71c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:28.489239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'restore' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:28.489239 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1db9767d-d634-434a-be98-38be300164b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 145 microversion: 2.1 time: 0.102584 Jun 18 22:24:28.489239 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2546/5104] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:28 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 145 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:24:28.498941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:28.499586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.531139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.532423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.533481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.533932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.820676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:28.821838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:28.834768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.837274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.838383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.840823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.994631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:28.995571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:28.996268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lazy-loading 'fault' on Instance uuid 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:29.201009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:29.210964 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-376cc52a-447a-4d0b-b109-bf2a2b7329d7 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 200 len: 1304 microversion: 2.1 time: 0.394886 Jun 18 22:24:29.212937 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2547/5105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:28 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 1304 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:29.333300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.334201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] [instance: 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.343223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.343687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.344478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.344918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.349076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:29.358593 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c705be51-29a6-4371-b005-9273dfe6768a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.863426 Jun 18 22:24:29.362260 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2559/5106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:28 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:29.370232 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] HTTP exception thrown: Instance 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 could not be found. Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Request method failure captured: Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 HTTP/1.1 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlBi5tQ-yFYMDKFdAwAZDafQ_1sYypBvq7zjuEjwgNAv45_ORZmU3Y_PcFBfWV3AfE9un_FG3bbdtVLrh6yTlb0DFPhVOCyVxQcKhnzV-wXWbc6MDe03GPfZKbeWAtWKv0vtkmdpZo7SfhwEn8PGjVDJZUWeq3f5-PvjAmgAWD2ScWg Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.47 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 878ebb841a1d45beb290d689fe7947f6 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerShowV247Test-1666347900 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/878ebb841a1d45beb290d689fe7947f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/878ebb841a1d45beb290d689fe7947f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/878ebb841a1d45beb290d689fe7947f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_878ebb841a1d45beb290d689fe7947f6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerShowV247Test-1666347900 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 878ebb841a1d45beb290d689fe7947f6 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerShowV247Test-1666347900 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerShowV247Test-1666347900-project Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: db591a1386ab46ca84a0473ad1c2e974 Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerShowV247Test-1666347900-project Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 could not be found. Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103'} Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 could not be found. Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 could not be found. Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.371908 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 could not be found. Jun 18 22:24:29.376023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.380293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.381812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.385811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] Returning 404 to user: Instance 5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:29.386576 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4ae2976-f8dc-497b-98b3-5aa6b0613bc2 tempest-ServerShowV247Test-1666347900 tempest-ServerShowV247Test-1666347900-project] 10.222.0.30 "GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103" status: 404 len: 111 microversion: 2.47 time: 0.058367 Jun 18 22:24:29.389721 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2548/5107] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:29 2022] GET /compute/v2.1/servers/5ecbfa8a-47bf-46fe-ba3c-9e9aaa4f2103 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:24:29.398725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.399638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.400611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.401237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.672200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:29.697280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:29.716325 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-100b52cf-d360-4178-852c-d28be4b904a3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.340865 Jun 18 22:24:29.716945 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2560/5108] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:29 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:29.740645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c7b5373e-e996-4dce-8625-edc282df9549 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:29.741243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c7b5373e-e996-4dce-8625-edc282df9549 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 153ff8fc-fb54-449d-8a08-13fade40da89] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.751346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.752272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.754060 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c7b5373e-e996-4dce-8625-edc282df9549 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 153ff8fc-fb54-449d-8a08-13fade40da89 could not be found. Jun 18 22:24:29.755990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:29.770688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.771437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.772566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.773187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c7b5373e-e996-4dce-8625-edc282df9549 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/153ff8fc-fb54-449d-8a08-13fade40da89/action HTTP/1.1 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 14 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: {"resume": {}} Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 153ff8fc-fb54-449d-8a08-13fade40da89 could not be found. Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '153ff8fc-fb54-449d-8a08-13fade40da89', 'body': {'resume': {}}} Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153ff8fc-fb54-449d-8a08-13fade40da89 could not be found. Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153ff8fc-fb54-449d-8a08-13fade40da89 could not be found. Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.776358 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153ff8fc-fb54-449d-8a08-13fade40da89 could not be found. Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c7b5373e-e996-4dce-8625-edc282df9549 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 153ff8fc-fb54-449d-8a08-13fade40da89 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c7b5373e-e996-4dce-8625-edc282df9549 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/153ff8fc-fb54-449d-8a08-13fade40da89/action" status: 404 len: 111 microversion: 2.1 time: 0.042901 Jun 18 22:24:29.781681 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2549/5109] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:29 2022] POST /compute/v2.1/servers/153ff8fc-fb54-449d-8a08-13fade40da89/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:29.788780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.789701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.800814 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 HTTP/1.1 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'bc927fb6-524d-4101-bc72-5939b8505361'} Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:29.802723 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.806617 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.809415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:29.810841 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f87a27ae-e119-49e2-b50b-14b8129d482c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 404 len: 111 microversion: 2.1 time: 0.063100 Jun 18 22:24:29.812395 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2561/5110] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:29 2022] DELETE /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:29.815644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.816124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.816971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.817447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.821086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.821709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: bc927fb6-524d-4101-bc72-5939b8505361] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.843008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.843459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.844232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.850466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.878647 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 HTTP/1.1 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'bc927fb6-524d-4101-bc72-5939b8505361'} Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.885393 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. Jun 18 22:24:29.890292 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.891579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance bc927fb6-524d-4101-bc72-5939b8505361 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:29.892602 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bf00b57e-e192-4134-b260-89045d96f1cf tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361" status: 404 len: 111 microversion: 2.1 time: 0.076035 Jun 18 22:24:29.895694 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2562/5111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:29 2022] GET /compute/v2.1/servers/bc927fb6-524d-4101-bc72-5939b8505361 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:29.904546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.911220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.918832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.919547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.920726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.921444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.945317 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec HTTP/1.1 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2255804c-8789-4f0c-b90f-d8783df8bdec'} Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:29.946883 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:29.952756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:29.961382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c53c1fa2-f4cb-4b54-8745-4645760ecb7c tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 404 len: 111 microversion: 2.1 time: 0.060324 Jun 18 22:24:29.961382 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2563/5112] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:29 2022] DELETE /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:29.968991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:29.969637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 2255804c-8789-4f0c-b90f-d8783df8bdec] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:29.985263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.986003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:29.986959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:29.987552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.020407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:30.025854 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec HTTP/1.1 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2255804c-8789-4f0c-b90f-d8783df8bdec'} Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:30.027592 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.031618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 2255804c-8789-4f0c-b90f-d8783df8bdec could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:30.032225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-581a5d92-1cc7-41be-bd6d-920c718865b4 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec" status: 404 len: 111 microversion: 2.1 time: 0.066981 Jun 18 22:24:30.033675 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2564/5113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:29 2022] GET /compute/v2.1/servers/2255804c-8789-4f0c-b90f-d8783df8bdec => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:30.156772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:30.165885 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0f9d929-c9c5-48c1-b78b-caf4ec08a455 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.381532 Jun 18 22:24:30.166478 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2550/5114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:29 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:30.190223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:30.193734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:30.210881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.211337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.212200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.212559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.227746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:30.229694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:30.239456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.245377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.246346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.247066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.279917 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] HTTP exception thrown: Instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 could not be found. Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Request method failure captured: Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 HTTP/1.1 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk42EGm5LQCR1sfLFnqveIKswEI9D2bNKgrJ79NnCDSEp3C60cses8yEF_0TpFNS4_J0-KILujwAHrR1O3siwHIDsdmZ3L3DB0dJiOytN29d_92zB4wbEvFqjLmwXmY9a0kwMjOWtzJJFQ1kUvb6r7MfQiXeM0B0x-YdIDo073fProg Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6269e5969c6a4957b3bb1816d93cebd0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ab975e8ffd0448939b2105aed58003fe Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 could not be found. Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7aacbb16-218a-4c65-8f79-5c5b2c4d5f79'} Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 could not be found. Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 could not be found. Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:30.281780 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 could not be found. Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.287451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Returning 404 to user: Instance 7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:30.288585 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7d58114-ec4f-4131-aa27-6ba14d70dd1e tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79" status: 404 len: 111 microversion: 2.1 time: 0.063644 Jun 18 22:24:30.295671 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2551/5115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:30 2022] GET /compute/v2.1/servers/7aacbb16-218a-4c65-8f79-5c5b2c4d5f79 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:30.305437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:30.305991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:30.312813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.313731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.316069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.316703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.369444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:30.482379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:30.496611 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d19f7b6e-eac4-4831-847a-1c82e9416c37 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.312552 Jun 18 22:24:30.498043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-95348825-27be-4eae-bbd4-9633ba72e989 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 204 len: 0 microversion: 2.1 time: 0.197746 Jun 18 22:24:30.498723 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2552/5116] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:30 2022] DELETE /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:24:30.499747 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2565/5117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:30 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:30.518486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:30.519261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:30.519849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:30.520772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:30.527946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.528714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.528868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.529487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.530345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.530768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.530946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.531580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.591880 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'resume' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 14 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: {"resume": {}} Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'resume' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'resume': {}}} Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state active. Cannot resume while the instance is in this state. Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:30.593942 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'resume' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d40e192-80b2-4058-81ea-9d4b36e315db tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 144 microversion: 2.1 time: 0.081438 Jun 18 22:24:30.597984 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2566/5118] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:30 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 144 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:24:30.606697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:30.607319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:30.617507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.617959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.618750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:30.619557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:30.932300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:30.943860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69b2e10c-f281-444b-95b4-b64a348ec01c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1508 microversion: 2.1 time: 0.430799 Jun 18 22:24:30.953055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:30.960843 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2553/5119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:30 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:30.969359 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a1781a1-2a34-4476-b111-5ab50f3114c1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.366430 Jun 18 22:24:30.970314 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2567/5120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:30 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:30.989562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:30.990778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:31.000874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.005889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.007108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.007673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.285604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:31.286239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:31.294665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.299857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.300876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.301444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.328782 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 HTTP/1.1 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '89e5a035-772d-471a-96ab-ce0bfce14d85'} Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:31.335731 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:31.343945 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62893f6b-6cc9-4a2c-8bb4-ed0be429e1ba tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 404 len: 111 microversion: 2.1 time: 0.061065 Jun 18 22:24:31.347373 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2568/5121] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:31 2022] DELETE /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:31.351933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:31.353325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] [instance: 89e5a035-772d-471a-96ab-ce0bfce14d85] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:31.359620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:31.369654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2fb90160-ebd0-4414-862d-4d10d3286e16 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.384003 Jun 18 22:24:31.387571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.387571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.387571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.387571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.388707 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2554/5122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:30 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:31.413709 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] HTTP exception thrown: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Request method failure captured: Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 HTTP/1.1 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk7zS0j2heMJbl5T7IQRXNTFza2O8SC6p5XKC3UnErb9HcOnAGfs9vHA42BMXaKtq2NTuz6P_LDt5-LGJ9RjIF0o5S0L506AbKZaCELBecmuc0oR8Qk4m-AdxafVTBV_vEPhNNMhkUeVQ-k_r3dJi2eROFjC-t9E1reVPNARAOBsGqI Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7126d757bd748f291963f779f8eaad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7126d757bd748f291963f779f8eaad3", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: e7126d757bd748f291963f779f8eaad3 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1910758346 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 7a41eb42094f418685b83cc0a57852d5 Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeNegativeTest-1910758346-project Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '89e5a035-772d-471a-96ab-ce0bfce14d85'} Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:31.415241 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] Returning 404 to user: Instance 89e5a035-772d-471a-96ab-ce0bfce14d85 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:31.423679 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3a5766d7-20c9-46ac-8ca4-cd6f33001482 tempest-AttachVolumeNegativeTest-1910758346 tempest-AttachVolumeNegativeTest-1910758346-project] 10.222.0.30 "GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85" status: 404 len: 111 microversion: 2.1 time: 0.069510 Jun 18 22:24:31.429573 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2569/5123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:31 2022] GET /compute/v2.1/servers/89e5a035-772d-471a-96ab-ce0bfce14d85 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:31.546291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2678f433-f8b5-450c-b9f5-5b07d7418166 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2678f433-f8b5-450c-b9f5-5b07d7418166 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 160 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b042883-87aa-470b-a375-8fa5157a8e61"}]}} Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'server': {'name': '', 'imageRef': '5a3e12b2-cae5-4235-b8ef-6052c81f2dad', 'flavorRef': '452', 'networks': [{'uuid': '9b042883-87aa-470b-a375-8fa5157a8e61'}]}}} Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi '' Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:24:31.548754 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2678f433-f8b5-450c-b9f5-5b07d7418166 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2678f433-f8b5-450c-b9f5-5b07d7418166 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008171 Jun 18 22:24:31.553144 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2555/5124] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:24:31 2022] POST /compute/v2.1/servers => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:24:31.558967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:31.559937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:31.570807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.571390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.572237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.573120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.807531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:31.821688 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90a90120-2867-4ca0-9c6b-43778ee6bc78 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.266446 Jun 18 22:24:31.823276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2570/5125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:31 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:31.844832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:31.845614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:31.854791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.855556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.856694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.857367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.966395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:31.967361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:31.979805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.981269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:31.982570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:31.984967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.402129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:32.415723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d41460d5-6d60-431d-bb07-04ac052c88c5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.573699 Jun 18 22:24:32.416928 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2556/5126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:31 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:32.484023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:32.493526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75a0854e-b464-4377-8c11-c1671fe126c5 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1508 microversion: 2.1 time: 0.531745 Jun 18 22:24:32.495521 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2571/5127] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:31 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:32.502297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fae0be30-5afb-4381-be29-601072323197 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:32.503221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fae0be30-5afb-4381-be29-601072323197 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: ac5493af-16fe-49e7-8676-3ac994a1f6f8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:32.512265 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fae0be30-5afb-4381-be29-601072323197 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance ac5493af-16fe-49e7-8676-3ac994a1f6f8 could not be found. Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fae0be30-5afb-4381-be29-601072323197 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/ac5493af-16fe-49e7-8676-3ac994a1f6f8/action HTTP/1.1 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 14 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: {"shelve": {}} Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance ac5493af-16fe-49e7-8676-3ac994a1f6f8 could not be found. Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'ac5493af-16fe-49e7-8676-3ac994a1f6f8', 'body': {'shelve': {}}} Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5493af-16fe-49e7-8676-3ac994a1f6f8 could not be found. Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5493af-16fe-49e7-8676-3ac994a1f6f8 could not be found. Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:32.515751 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:32.520105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:32.520105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:32.520105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5493af-16fe-49e7-8676-3ac994a1f6f8 could not be found. Jun 18 22:24:32.520105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:32.520105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fae0be30-5afb-4381-be29-601072323197 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance ac5493af-16fe-49e7-8676-3ac994a1f6f8 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:32.520520 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fae0be30-5afb-4381-be29-601072323197 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/ac5493af-16fe-49e7-8676-3ac994a1f6f8/action" status: 404 len: 111 microversion: 2.1 time: 0.023086 Jun 18 22:24:32.521649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2572/5128] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:32 2022] POST /compute/v2.1/servers/ac5493af-16fe-49e7-8676-3ac994a1f6f8/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:32.539196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:32.542062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:32.562482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:32.566582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.570068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:32.571928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.683095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1858952736", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": "none"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:32.758233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:24:32.759654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:24:32.761877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:24:32.762595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:24:32.763387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:24:32.778826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:32.779785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.780887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:32.781582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.795300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:32.810538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Getting quotas for project 98994a513d8148718997fb1c02dd6833. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:24:32.817480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Getting quotas for user 5e97368d9959490bac08b91bc86d8687 and project 98994a513d8148718997fb1c02dd6833. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:24:32.837012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:24:32.839872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:24:32.862174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:32.866782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:32.875586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b1dc2cc-0078-4913-b2b3-5c989b6dc888 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.348823 Jun 18 22:24:32.876196 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2573/5129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:32 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:32.895131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:32.897412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:32.929317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:32.931982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.940786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:32.945527 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c31795c6-b78c-4b13-97fc-1938b46f5ba5 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.526087 Jun 18 22:24:32.946515 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2557/5130] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:24:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:24:32.952688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:32.963873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b9015da-7444-41b7-accc-2871f9aaa769 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:32.967819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b9015da-7444-41b7-accc-2871f9aaa769 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:33.130007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b9015da-7444-41b7-accc-2871f9aaa769 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:33.146361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b9015da-7444-41b7-accc-2871f9aaa769 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:33.150051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b9015da-7444-41b7-accc-2871f9aaa769 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:33.155853 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b9015da-7444-41b7-accc-2871f9aaa769 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1278 microversion: 2.57 time: 0.202491 Jun 18 22:24:33.167611 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2558/5131] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:32 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:33.368882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:33.379912 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f2119bf-11b1-4f6e-87c5-df7712de31ab tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.488552 Jun 18 22:24:33.392996 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2574/5132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:32 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:33.405281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:33.407486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:33.425512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:33.426335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:33.429275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:33.430107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:33.503732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lazy-loading 'flavor' on Instance uuid 82678d7b-d3bf-4ed3-b8f9-945d2279172e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:33.516159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:33.517378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:33.530455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:33.533709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:33.535179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:33.537677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:33.797287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:33.820470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c64212d9-2293-49b1-8539-858f160dc7dd tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 200 len: 1466 microversion: 2.1 time: 0.308684 Jun 18 22:24:33.822249 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2575/5133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:33 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 1466 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:33.843889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-30975c2b-6652-41a3-8344-19b883d21bdb req-c5a4f4a1-9f5e-440e-b352-e6bc4d2441df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b01742a-9619-4cd5-8d4f-01c0364a7355", "name": "network-vif-deleted", "tag": "c27d85de-aa63-4273-9105-be49acb3188a"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:33.867010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-30975c2b-6652-41a3-8344-19b883d21bdb req-c5a4f4a1-9f5e-440e-b352-e6bc4d2441df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:33.869190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-30975c2b-6652-41a3-8344-19b883d21bdb req-c5a4f4a1-9f5e-440e-b352-e6bc4d2441df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:33.931129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-30975c2b-6652-41a3-8344-19b883d21bdb req-c5a4f4a1-9f5e-440e-b352-e6bc4d2441df service nova] Creating event network-vif-deleted:c27d85de-aa63-4273-9105-be49acb3188a for instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 on nch1-master-1 Jun 18 22:24:33.942638 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-30975c2b-6652-41a3-8344-19b883d21bdb req-c5a4f4a1-9f5e-440e-b352-e6bc4d2441df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106890 Jun 18 22:24:33.946592 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2576/5134] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:34.177635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:34.178773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:34.186669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:34.187426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:34.188415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:34.189074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:34.295336 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a95689a-b60b-4a77-b720-4c67451371fc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 202 len: 0 microversion: 2.1 time: 0.899422 Jun 18 22:24:34.311802 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2559/5135] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:24:33 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:34.335070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:34.341152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:34.352561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:34.352900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:34.353834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:34.354463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:34.951727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:35.000718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:35.004605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:35.006501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5e626a6a-0733-4373-84b9-e49e2276829b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1274 microversion: 2.57 time: 0.834364 Jun 18 22:24:35.007286 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2577/5136] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:34 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1274 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:35.053608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:35.057138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 8b01742a-9619-4cd5-8d4f-01c0364a7355] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:35.073669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:35.074454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:35.075564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:35.076433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:35.147150 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] HTTP exception thrown: Instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 could not be found. Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Request method failure captured: Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 HTTP/1.1 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk42EGm5LQCR1sfLFnqveIKswEI9D2bNKgrJ79NnCDSEp3C60cses8yEF_0TpFNS4_J0-KILujwAHrR1O3siwHIDsdmZ3L3DB0dJiOytN29d_92zB4wbEvFqjLmwXmY9a0kwMjOWtzJJFQ1kUvb6r7MfQiXeM0B0x-YdIDo073fProg Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6269e5969c6a4957b3bb1816d93cebd0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ab975e8ffd0448939b2105aed58003fe Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 could not be found. Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8b01742a-9619-4cd5-8d4f-01c0364a7355'} Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 could not be found. Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 could not be found. Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:35.148990 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 could not be found. Jun 18 22:24:35.156105 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:35.162279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Returning 404 to user: Instance 8b01742a-9619-4cd5-8d4f-01c0364a7355 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:35.166912 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae7890a2-68e9-4e21-98cb-4369e05ac8d0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355" status: 404 len: 111 microversion: 2.1 time: 0.154104 Jun 18 22:24:35.169354 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2578/5137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:35 2022] GET /compute/v2.1/servers/8b01742a-9619-4cd5-8d4f-01c0364a7355 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:35.194239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:35.195168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:35.210935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:35.215975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:35.220112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:35.221009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:35.313307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:35.327294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:35.335400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:35.347503 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da7cd1e1-50ef-4c0d-82ff-c66001070218 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 1.033354 Jun 18 22:24:35.357940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2560/5138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:34 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:35.507281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-004fb0f9-5a0b-4270-b84e-88a131918ea6 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 204 len: 0 microversion: 2.1 time: 0.327590 Jun 18 22:24:35.510902 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2579/5139] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:35 2022] DELETE /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:24:35.541240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:35.542028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:35.579720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:35.580609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:35.581769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:35.594769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:35.963847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:35.984619 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6940d11b-7978-46de-aa59-742de2c99455 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1495 microversion: 2.1 time: 0.471873 Jun 18 22:24:35.985980 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2561/5140] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:35 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1495 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:36.046135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:36.047592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:36.064164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:36.064918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:36.065947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:36.066562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:36.312656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:36.324076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:36.328629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:36.330613 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e933a788-d799-4f33-a5a6-c7f557c1b08b tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1336 microversion: 2.57 time: 0.300997 Jun 18 22:24:36.343356 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2580/5141] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:36 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1336 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:36.375432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:36.376141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:36.399162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:36.399667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:36.405157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:36.411169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:36.840965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:36.851905 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec869ef2-7515-4e88-8271-6039ec5d5b7d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.480749 Jun 18 22:24:36.867480 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2562/5142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:36 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:37.003566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:37.004121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:37.036729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:37.037236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:37.045229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:37.048920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:37.354042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:37.355027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:37.371182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:37.372054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:37.373120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:37.373787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:37.705072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:37.721932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:37.724303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:37.729326 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d54f8b7-d543-45e2-a065-300ff96a7a3c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1336 microversion: 2.57 time: 0.377586 Jun 18 22:24:37.742306 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2563/5143] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:37 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1336 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:37.876978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:37.878067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:37.892865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:37.893455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:37.894373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:37.894904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:37.932071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:38.043647 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6d2dcb7-648d-4585-b5b0-17f535ade6c1 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1495 microversion: 2.1 time: 1.040621 Jun 18 22:24:38.045780 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2581/5144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:36 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1495 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:38.494121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:38.541098 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-359014df-3c4f-4358-af38-ac74ca7e9b53 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.666232 Jun 18 22:24:38.544703 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2564/5145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:37 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:38.770819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:38.774972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:38.780300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f79ac0dd-ec19-47f2-84a7-a6afb0cae514 req-f80a7329-eb05-404f-96e2-da4a30a7942d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dae9ded-d68a-47f1-b2cb-762ba19f91cc", "name": "network-vif-deleted", "tag": "f62a3bcb-9abc-4923-8596-cb8240cff0f8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:38.808822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:38.809748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f79ac0dd-ec19-47f2-84a7-a6afb0cae514 req-f80a7329-eb05-404f-96e2-da4a30a7942d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:38.810384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f79ac0dd-ec19-47f2-84a7-a6afb0cae514 req-f80a7329-eb05-404f-96e2-da4a30a7942d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:38.811114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:38.814150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:38.817698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:38.866049 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f79ac0dd-ec19-47f2-84a7-a6afb0cae514 req-f80a7329-eb05-404f-96e2-da4a30a7942d service nova] Creating event network-vif-deleted:f62a3bcb-9abc-4923-8596-cb8240cff0f8 for instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc on nch1-master-1 Jun 18 22:24:38.889341 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f79ac0dd-ec19-47f2-84a7-a6afb0cae514 req-f80a7329-eb05-404f-96e2-da4a30a7942d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112046 Jun 18 22:24:38.890041 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2565/5146] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:24:39.065139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:39.066146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:39.078006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.087342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.088613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.089256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.219478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.225449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.226061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lazy-loading 'fault' on Instance uuid 9dae9ded-d68a-47f1-b2cb-762ba19f91cc {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:39.349551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:39.367726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:39.373071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:39.374639 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-33928320-cd86-42e8-8b42-448f074ff51c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1357 microversion: 2.57 time: 0.627162 Jun 18 22:24:39.375355 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2582/5147] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:38 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1357 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:39.410189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:39.433362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:39.460106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.460582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.461420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.461865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.665015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:24:39.665514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:24:39.666003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:24:39.666421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:24:39.683360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:24:39.780882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:39.793936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a77611e4-3fb4-48b7-b927-8d4aac9f1a64 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 200 len: 1305 microversion: 2.1 time: 0.732880 Jun 18 22:24:39.794712 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2566/5148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:39 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 1305 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:39.809191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:39.813444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:39.829064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.832578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.834245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.835128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.914010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:39.933675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.934129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:39.940984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:39.942180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.021500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9b3a98ac-ad8c-4a50-91ad-e2c2cccb5919 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "POST /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8/action" status: 202 len: 1138 microversion: 2.57 time: 0.625242 Jun 18 22:24:40.023535 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2583/5149] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Jun 18 22:24:39 2022] POST /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8/action => generated 1138 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 18 22:24:40.045094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:40.046728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:40.057927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:40.059370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.061260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:40.061879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.225963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:40.255138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:40.257053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:40.258586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d9b50ee-289b-4245-8cc7-7958c8bf2bf2 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.223944 Jun 18 22:24:40.270306 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2584/5150] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:40 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:40.438341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:40.459729 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5befd00-f391-4aee-8bdf-91cde8f5db81 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.659131 Jun 18 22:24:40.467583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2567/5151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:39 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:40.814818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:40.815437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 9dae9ded-d68a-47f1-b2cb-762ba19f91cc] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:40.824058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:40.824789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.825791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:40.826393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.843632 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] HTTP exception thrown: Instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc could not be found. Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Request method failure captured: Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc HTTP/1.1 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk42EGm5LQCR1sfLFnqveIKswEI9D2bNKgrJ79NnCDSEp3C60cses8yEF_0TpFNS4_J0-KILujwAHrR1O3siwHIDsdmZ3L3DB0dJiOytN29d_92zB4wbEvFqjLmwXmY9a0kwMjOWtzJJFQ1kUvb6r7MfQiXeM0B0x-YdIDo073fProg Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6269e5969c6a4957b3bb1816d93cebd0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ab975e8ffd0448939b2105aed58003fe Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc could not be found. Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '9dae9ded-d68a-47f1-b2cb-762ba19f91cc'} Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc could not be found. Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc could not be found. Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:40.845783 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc could not be found. Jun 18 22:24:40.850817 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:24:40.853949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Returning 404 to user: Instance 9dae9ded-d68a-47f1-b2cb-762ba19f91cc could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:40.853949 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a9eb2bc-5372-415a-aa48-59c30a396df0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc" status: 404 len: 111 microversion: 2.1 time: 0.044174 Jun 18 22:24:40.863355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:40.864547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:40.869186 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2585/5152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:40 2022] GET /compute/v2.1/servers/9dae9ded-d68a-47f1-b2cb-762ba19f91cc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:24:40.877428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:40.877919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.878831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:40.879340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:40.949115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:24:41.099834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-694e6095-5e8d-4a6e-b490-38eb75d828c0 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "DELETE /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 204 len: 0 microversion: 2.1 time: 0.239322 Jun 18 22:24:41.100909 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2568/5153] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:24:40 2022] DELETE /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:24:41.111151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:41.112446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:41.128558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:41.129076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:41.130464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:41.132685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:41.288278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:41.289339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:41.297225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:41.297992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:41.299270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:41.300198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:41.672284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:41.687961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:41.689726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:41.691115 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-33882002-0a0d-410a-bf4f-e98834dbf524 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.408561 Jun 18 22:24:41.692227 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2569/5154] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:41 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:41.701625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:41.713399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:41.723607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:41.724371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:41.726197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:41.727286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:41.906416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:41.914719 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9f17613-492d-402e-b7f5-a4b8b5065c63 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1672 microversion: 2.1 time: 0.809658 Jun 18 22:24:41.915723 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2586/5155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:41 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1672 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:41.920903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d92cfcc-6b00-4851-bef5-64af3eff3c41 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Action: 'create', calling method: .version_select at 0x7fea0783b430>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2000751185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMvlfMkNUK55BcwzhFUdMtQqhQUxjHKNm1Oeq5G0/BUDLlE8hadonZzjjILoj9O+2Esh9hwrbFSAF+ZKv9jkiFrypC/Ixn6x3hcB4uJ5CvIL8SNmF+AHvOTgSEM1P3bGA=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:41.936309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-1d92cfcc-6b00-4851-bef5-64af3eff3c41 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Getting quotas for project 106e2aa0adfd40da9a2d689f3b4653db. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:24:41.942767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-1d92cfcc-6b00-4851-bef5-64af3eff3c41 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Getting quotas for user 01ecbaf0e5004723bd6a96296ea135d8 and project 106e2aa0adfd40da9a2d689f3b4653db. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:24:41.979766 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d92cfcc-6b00-4851-bef5-64af3eff3c41 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062551 Jun 18 22:24:41.981449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2587/5156] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:24:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:42.020311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:42.036469 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50678468-c774-4b87-8c99-8a090a8a2d34 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.342585 Jun 18 22:24:42.047106 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2570/5157] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:41 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:42.716414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:42.717303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:42.734336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:42.734962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:42.736011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:42.736551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:42.842199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:42.863007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:42.864486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:42.865784 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-549bbb3c-4064-4d17-aa0d-f4f6dc7673f1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.158906 Jun 18 22:24:42.873413 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2588/5158] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:42 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:42.933072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:42.933895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:42.936650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:42.945712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:42.946687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:42.947728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:42.948323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:43.055675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:43.056255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:43.073652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:43.073652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:43.074336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:43.074772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:43.141952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:43.294227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:43.309930 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e492b16a-08ef-4a00-a103-0f844af3b46c tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1672 microversion: 2.1 time: 0.380919 Jun 18 22:24:43.312318 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2571/5159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:42 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1672 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:43.365908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:43.374495 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f247056-8250-42c5-bf12-ba2de24d7118 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.322666 Jun 18 22:24:43.375859 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2589/5160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:43 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:43.890594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:43.892029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:43.909648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:43.911335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:43.912445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:43.913218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:43.918795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:44.082126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:44.108931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:44.110587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:44.116541 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad1df820-9965-4dea-9b59-46b94c8016de tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.235015 Jun 18 22:24:44.117526 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2572/5161] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:43 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:44.329827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:44.330606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:44.341362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:44.342116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:44.343121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:44.343767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:44.411790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:44.417891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:44.428756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:44.429368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:44.430254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:44.430771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:44.659691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:44.677759 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e17a8a6e-d95b-4f32-b0bb-4d5cc6c120cc tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.287164 Jun 18 22:24:44.679771 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2573/5162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:44 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:44.694311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:44.703869 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d32c36e-be72-436f-b61d-ffb41a12509d tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1672 microversion: 2.1 time: 0.378133 Jun 18 22:24:44.714313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2590/5163] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:44 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1672 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:45.148297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:45.148840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:45.164212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.167997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.169197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.171631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.355837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:45.365372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:45.386311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:45.401694 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e3f378e-b9c1-4f22-baf1-5d367e618a52 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.261551 Jun 18 22:24:45.413918 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2574/5164] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:45 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:45.680153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0c97785a-b6a6-496f-b99a-11a31370f6a5 req-1cc93aa4-cb14-43c6-91c2-2b7ea68ddd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ee6136-56ff-40f6-a614-b941bc50cc88", "name": "network-vif-deleted", "tag": "57ba3eb6-9d3b-421c-90d7-fe38776c9661"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:45.699955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:45.700598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:45.708287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0c97785a-b6a6-496f-b99a-11a31370f6a5 req-1cc93aa4-cb14-43c6-91c2-2b7ea68ddd61 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.708813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0c97785a-b6a6-496f-b99a-11a31370f6a5 req-1cc93aa4-cb14-43c6-91c2-2b7ea68ddd61 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.715024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.717491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.719695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.732522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.742700 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0c97785a-b6a6-496f-b99a-11a31370f6a5 req-1cc93aa4-cb14-43c6-91c2-2b7ea68ddd61 service nova] Creating event network-vif-deleted:57ba3eb6-9d3b-421c-90d7-fe38776c9661 for instance 37ee6136-56ff-40f6-a614-b941bc50cc88 on nch1-master-1 Jun 18 22:24:45.770989 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0c97785a-b6a6-496f-b99a-11a31370f6a5 req-1cc93aa4-cb14-43c6-91c2-2b7ea68ddd61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095981 Jun 18 22:24:45.774695 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2591/5165] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:45.787803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:45.788825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:45.798261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.798958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.800720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.801606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.855722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:45.856616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:45.857399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lazy-loading 'fault' on Instance uuid 37ee6136-56ff-40f6-a614-b941bc50cc88 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:24:45.969913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab975e8ffd0448939b2105aed58003fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6269e5969c6a4957b3bb1816d93cebd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:45.987908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-115c61d4-48ae-4428-92fe-5fb9c8c6dd08 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 200 len: 1327 microversion: 2.1 time: 0.206723 Jun 18 22:24:46.002721 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2592/5166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:45 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:46.066116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:46.069185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1302573840", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "03029fa6-9d19-40c2-951e-e96cf9fbc135", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2000751185", "security_groups": [{"name": "tempest-secgroup-smoke-869480766"}], "networks": [{"uuid": "b620b20a-fabc-4a3b-b88f-68c7e6573f60"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:46.083801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f5498dcf-7d96-4ab6-b548-3933f7d1cdfb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.390234 Jun 18 22:24:46.094508 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2575/5167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:45 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:46.245303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] validate_networks() for [('b620b20a-fabc-4a3b-b88f-68c7e6573f60', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:24:46.421175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:46.421915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:46.440041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:46.441736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:46.444922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:46.446250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:46.605809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:46.616248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:46.618186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:46.619627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b44d65a2-6659-480f-a5e7-60ee0897f722 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.203094 Jun 18 22:24:46.620784 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2576/5168] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:46 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:24:47.002811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:24:47.004525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:24:47.005673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:24:47.006437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:24:47.007167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:24:47.009217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:47.010059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] [instance: 37ee6136-56ff-40f6-a614-b941bc50cc88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:47.018498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.019129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.020084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.022193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.027646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.029961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.030955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.032912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.057987 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] HTTP exception thrown: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 could not be found. Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Request method failure captured: Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 HTTP/1.1 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk42EGm5LQCR1sfLFnqveIKswEI9D2bNKgrJ79NnCDSEp3C60cses8yEF_0TpFNS4_J0-KILujwAHrR1O3siwHIDsdmZ3L3DB0dJiOytN29d_92zB4wbEvFqjLmwXmY9a0kwMjOWtzJJFQ1kUvb6r7MfQiXeM0B0x-YdIDo073fProg Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6269e5969c6a4957b3bb1816d93cebd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6269e5969c6a4957b3bb1816d93cebd0", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6269e5969c6a4957b3bb1816d93cebd0 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1029636871 Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ab975e8ffd0448939b2105aed58003fe Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1029636871-project Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 could not be found. Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '37ee6136-56ff-40f6-a614-b941bc50cc88'} Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 could not be found. Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 could not be found. Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:24:47.062542 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 could not be found. Jun 18 22:24:47.067576 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:24:47.071045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Returning 404 to user: Instance 37ee6136-56ff-40f6-a614-b941bc50cc88 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:24:47.072148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43018198-73e7-4398-9de5-8dc9d6cc1e67 tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88" status: 404 len: 111 microversion: 2.1 time: 0.067139 Jun 18 22:24:47.073318 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2577/5169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:47 2022] GET /compute/v2.1/servers/37ee6136-56ff-40f6-a614-b941bc50cc88 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:24:47.081365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Getting quotas for project 106e2aa0adfd40da9a2d689f3b4653db. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:24:47.102001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4119079-6696-49dc-b80d-e9d6330c4a5b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] Calling method '.version_select at 0x7fea19bd9670>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:47.108673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Getting quotas for user 01ecbaf0e5004723bd6a96296ea135d8 and project 106e2aa0adfd40da9a2d689f3b4653db. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:24:47.140112 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4119079-6696-49dc-b80d-e9d6330c4a5b tempest-ServerActionsTestJSON-1029636871 tempest-ServerActionsTestJSON-1029636871-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-688489798" status: 202 len: 0 microversion: 2.1 time: 0.060171 Jun 18 22:24:47.144818 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2578/5170] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-688489798 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:24:47.148401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:47.149580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:47.158615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.159644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.161166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.161766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.224530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:24:47.228791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03029fa6-9d19-40c2-951e-e96cf9fbc135',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:24:47.425944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:47.505675 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b3d1968a-e152-4ac7-a5f1-ad103f655de2 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.441188 Jun 18 22:24:47.506969 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2593/5171] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:24:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:24:47.517082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6db2fab6-c9e1-4de4-a127-1d389068e13b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:47.523222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6db2fab6-c9e1-4de4-a127-1d389068e13b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:47.744044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6db2fab6-c9e1-4de4-a127-1d389068e13b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:47.756678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6db2fab6-c9e1-4de4-a127-1d389068e13b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1099 microversion: 2.1 time: 0.242356 Jun 18 22:24:47.758672 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2594/5172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:47 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1099 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:47.774649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:47.775457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:47.785235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.785760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.786908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:47.788166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:47.895741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:47.909720 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65de7cab-cd97-423c-a8b8-b1efe11eac1f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.766531 Jun 18 22:24:47.910240 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2579/5173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:47 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:48.012001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:48.041494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:48.043014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:48.049776 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d9291a6-df9e-46bd-ae36-99112c4384bd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.277118 Jun 18 22:24:48.050861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2595/5174] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:47 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:48.777148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:48.779838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:48.804936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:48.806342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:48.807829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:48.811938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:48.929157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:48.929765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:48.930500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:48.939035 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2b086fe-90eb-48d5-a229-1fba603d52e8 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1197 microversion: 2.1 time: 0.167723 Jun 18 22:24:48.943733 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2580/5175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:48 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:48.950438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:48.951133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:48.952287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:48.952880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:48.965921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:49.070953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:49.071507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:49.080373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:49.081118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:49.082111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:49.083725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:49.189465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:49.202831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:49.205218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:49.206637 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf6c709e-da0e-4c9d-a97a-42ebf7359426 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.142113 Jun 18 22:24:49.207817 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2581/5176] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:49 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:49.461439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:49.472121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9afccf17-6b56-4b4a-9666-781ae23b9b8e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.547531 Jun 18 22:24:49.473311 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2596/5177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:48 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:49.965351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:49.966520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:49.978786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:49.981139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:49.984024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:49.985745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:50.223213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:50.226798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:50.227667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:50.241552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:50.247410 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8dc6c145-2a8c-4052-85c8-46958e050da1 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1215 microversion: 2.1 time: 0.293996 Jun 18 22:24:50.247891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:50.249763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:50.250617 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2582/5178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:49 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:50.251862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:50.380021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:50.396711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:50.398646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:50.400666 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee423a11-2c3b-4fc2-9f73-0fa355c879d1 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.178307 Jun 18 22:24:50.414103 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2597/5179] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:50 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:24:50.500976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:50.501841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:50.516550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:50.518636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:50.520882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:50.522810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:51.227933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:51.239043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7eee8bcd-00e2-4003-a8aa-df8363abe460 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.752894 Jun 18 22:24:51.241750 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2583/5180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:50 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:51.266168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:51.267566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:51.274596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:51.275044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:51.275828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:51.276262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:51.419936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:51.420561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:51.432959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:51.433713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:51.434501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:51.434936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:51.580731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:51.595403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:51.597987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:51.599726 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-631e64b5-68f0-42ff-9dd9-6012239274dd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.183786 Jun 18 22:24:51.601072 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2584/5181] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:51 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:24:51.702847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:51.717592 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b11bbc6-e2ad-44de-a74b-365e7c92d694 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.454962 Jun 18 22:24:51.730014 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2598/5182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:51 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:52.261918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:52.262478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:52.288596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.289308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.290149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.290766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.616761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:52.620844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:52.623324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:52.632778 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b2d608b-bd4f-4786-a264-67cbd40be9e3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1531 microversion: 2.1 time: 0.377566 Jun 18 22:24:52.634049 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2585/5183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:52 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1531 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:52.647009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.647537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.650471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.651364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.736181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:52.736869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:52.747621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.748108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.748926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.749388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.814917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:52.831257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:52.838995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:52.841679 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ed61b0b-bc20-4e3c-9316-bc08ee2b1b3a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.226596 Jun 18 22:24:52.845320 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2599/5184] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:52 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:52.857969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9c934de8-1903-44a2-9c72-a1070cdb44bf req-1937a814-5752-41a4-9cb1-47269cf58ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:52.880481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9c934de8-1903-44a2-9c72-a1070cdb44bf req-1937a814-5752-41a4-9cb1-47269cf58ef4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:52.883670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9c934de8-1903-44a2-9c72-a1070cdb44bf req-1937a814-5752-41a4-9cb1-47269cf58ef4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:52.915967 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9c934de8-1903-44a2-9c72-a1070cdb44bf req-1937a814-5752-41a4-9cb1-47269cf58ef4 service nova] Creating event network-changed:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:24:52.935393 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9c934de8-1903-44a2-9c72-a1070cdb44bf req-1937a814-5752-41a4-9cb1-47269cf58ef4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085839 Jun 18 22:24:52.937486 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2600/5185] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:53.325762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:53.335956 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6be415b3-20be-49e2-b0bf-dfa0b45c91eb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.603966 Jun 18 22:24:53.337274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2586/5186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:52 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:53.652085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:53.652791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:53.661333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:53.661674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:53.662499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:53.662935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:53.864411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:53.865384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:53.877348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:53.878009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:53.879919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:53.880515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:54.110648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:54.126264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:54.128881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:54.131564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-87602bf0-8e39-4b00-a0c7-d59fad74ac07 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.271629 Jun 18 22:24:54.149735 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2587/5187] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:53 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:54.271906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:54.287755 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb7b9e77-7017-4102-8ae3-b20ad645655e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1531 microversion: 2.1 time: 0.639726 Jun 18 22:24:54.289124 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2601/5188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:53 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1531 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:54.355092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:54.357200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:54.369271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:54.371711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:54.385784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:54.387271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:54.602903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:54.611113 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f94253c2-1d1a-49bc-b8d2-d99128451d38 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.261530 Jun 18 22:24:54.620972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2588/5189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:54 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:55.152871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:55.154276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:55.164631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.182593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.183842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.186878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.306602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:55.307758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:55.320121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.320610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.325907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.326485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.362420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:55.389688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:55.396000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:55.399622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e66a459-ef8a-4baf-ad2d-8d7261d8badd tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.249269 Jun 18 22:24:55.406070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2602/5190] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:55 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:55.423457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-21d751f9-9261-4892-9870-4384700dfc74 req-84910411-4c2f-4fc8-9f93-7ab33b4fd1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82678d7b-d3bf-4ed3-b8f9-945d2279172e", "name": "network-vif-plugged", "status": "completed", "tag": "c53d5f7e-99ad-4718-b288-9c6b747e1b74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:24:55.441767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-21d751f9-9261-4892-9870-4384700dfc74 req-84910411-4c2f-4fc8-9f93-7ab33b4fd1f5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.445399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-21d751f9-9261-4892-9870-4384700dfc74 req-84910411-4c2f-4fc8-9f93-7ab33b4fd1f5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.472150 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-21d751f9-9261-4892-9870-4384700dfc74 req-84910411-4c2f-4fc8-9f93-7ab33b4fd1f5 service nova] Creating event network-vif-plugged:c53d5f7e-99ad-4718-b288-9c6b747e1b74 for instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e on nch1-master-1 Jun 18 22:24:55.484703 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-21d751f9-9261-4892-9870-4384700dfc74 req-84910411-4c2f-4fc8-9f93-7ab33b4fd1f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072752 Jun 18 22:24:55.499450 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2603/5191] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:24:55.608328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:55.619389 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-077846a6-4296-46a6-aa6c-b9b0139cd8a0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1531 microversion: 2.1 time: 0.316294 Jun 18 22:24:55.639229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:55.640286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:55.643779 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2589/5192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:55 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1531 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:55.647681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.649233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.651266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:55.652125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:55.900606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:55.930467 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73ccf1a6-138b-4ed4-bdf8-c77ed351fc06 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.299237 Jun 18 22:24:55.933217 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2604/5193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:55 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:56.421761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:56.422881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:56.432818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:56.433622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:56.434772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:56.435703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:56.467668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:56.591831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:56.605710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:56.607593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:56.608791 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ad88bed-06c4-4650-b0b2-c82b6692f225 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.192591 Jun 18 22:24:56.610174 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2590/5194] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:56 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:56.640616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:56.641467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:56.650478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:56.651033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:56.651911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:56.653357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:56.951023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:56.951391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:56.962999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:56.963393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:56.967940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:56.968517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:56.996571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:57.007695 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ea77c57-a17a-43ef-bf15-887f5675594b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1531 microversion: 2.1 time: 0.371870 Jun 18 22:24:57.011877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2605/5195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:56 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1531 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:57.434341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:57.449982 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fed36049-f6b5-4b8c-8b10-65952965cf2c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.503435 Jun 18 22:24:57.450854 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2591/5196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:56 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:24:57.631021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:57.652176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:57.667713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:57.686439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:57.688607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:57.691589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:57.692599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:57.776871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:24:57.849463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:57.869912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:57.876990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:57.878838 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3621959-c92d-4463-9cb7-a23ffe3bf795 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.254125 Jun 18 22:24:57.881251 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2606/5197] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:57 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:24:58.038811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:58.039511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:58.059211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:58.060560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:58.062842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:58.065434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:58.346907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:58.356139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8907c57f-35ad-4cb2-9dcf-0c7c542fa1eb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.336038 Jun 18 22:24:58.360805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2592/5198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:58 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:58.469497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:58.470445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:58.484528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:58.485291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:58.486092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:58.489446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:58.901282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:58.902918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:58.921394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:58.922853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:58.926301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:58.926977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:59.101786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:59.113604 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9c051cb6-8b86-4f10-84e3-7cdd7c44cbcb tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.648386 Jun 18 22:24:59.126701 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2607/5199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:58 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:24:59.274905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:59.287996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:59.306761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:59.309618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-935bfae3-2807-4edb-af97-dabdb3e3755c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.412473 Jun 18 22:24:59.313339 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2593/5200] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:24:58 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:24:59.376649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:24:59.377672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:24:59.397319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:59.402512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:59.404800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:24:59.405552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:24:59.760838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:24:59.771060 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c0e2f972-ad6f-40b3-a0e7-81ce0f258400 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.399310 Jun 18 22:24:59.771639 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2608/5201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:24:59 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:00.133564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:00.134252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:00.156267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:00.159050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:00.167897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:00.171775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:00.332632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:00.336639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:00.348516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:00.349225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:00.359461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:00.360326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:00.445890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:00.467469 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f1d0983-e133-459e-a754-e16d1676be93 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.338143 Jun 18 22:25:00.468820 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2594/5202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:00 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:00.589704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:00.599446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:00.618220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:00.622963 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e4a8c04-f859-4c3d-8477-6e808911e09a tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.294799 Jun 18 22:25:00.624187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2609/5203] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:00 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:00.808357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:00.815020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:00.837291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:00.843662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:00.846294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:00.846816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:01.358782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:01.407351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9b662b44-3ff5-4750-b0da-45ba2c290167 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.620199 Jun 18 22:25:01.412656 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2595/5204] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:00 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:01.484392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:01.485105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:01.497377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:01.499422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:01.500404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:01.502075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:01.642988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:01.643628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:01.655490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:01.655955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:01.656716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:01.657190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:01.930234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:01.946874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:01.949176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:01.951820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:01.958605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-25a5ba4e-6c06-4029-a90c-d4cbae5964f0 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.318722 Jun 18 22:25:01.962733 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-633c3606-9aba-4b83-b78c-000743903de5 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.482552 Jun 18 22:25:01.973805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2596/5205] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:01 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:25:01.979355 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2610/5206] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:01 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:02.427766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:02.428861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:02.440610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:02.445594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:02.448442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:02.452233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:02.981236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:02.983069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:03.001209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:03.002961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:03.008264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:03.010590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:03.240882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:03.254616 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dbbd4a37-902e-403c-b6a7-b857712e3f68 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.831079 Jun 18 22:25:03.264285 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2597/5207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:02 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:03.285272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:03.305605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:03.331379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:03.334775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:03.337464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:03.340414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:03.341004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:03.818084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:03.833904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:03.838352 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3c45bf6c-ea7f-4b7c-9bd3-bbf8af687d69 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.859599 Jun 18 22:25:03.842257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2611/5208] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:02 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:03.850015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:03.853336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:03.874180 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-581f90b4-e3a0-4c59-a0ea-4ff0aa365af3 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.601656 Jun 18 22:25:03.880740 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2598/5209] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:03 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:04.280355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:04.281132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:04.305508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:04.306249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:04.310306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:04.310817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:04.790443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:04.802818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bca2443c-b05d-488b-89b5-692cd9d4fd49 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.526888 Jun 18 22:25:04.803651 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2612/5210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:04 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:04.859301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:04.862010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:04.901870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:04.902097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:04.902379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:04.903434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:04.916698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:04.921810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:04.928359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:04.930729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:04.933506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:04.935943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:05.406853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:05.424138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:05.426056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:05.435829 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c5f3bda-527f-4f07-9bca-2f016241c52c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 0.536644 Jun 18 22:25:05.450513 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2613/5211] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:04 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:05.456333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-267fe193-cbee-47d4-8d90-9f30cb50809a req-17005ade-7674-4aff-a79f-ec17fcdaa319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "name": "network-vif-plugged", "status": "completed", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:05.467871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-267fe193-cbee-47d4-8d90-9f30cb50809a req-17005ade-7674-4aff-a79f-ec17fcdaa319 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:05.468715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-267fe193-cbee-47d4-8d90-9f30cb50809a req-17005ade-7674-4aff-a79f-ec17fcdaa319 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:05.482690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:05.488812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:05.492702 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-267fe193-cbee-47d4-8d90-9f30cb50809a req-17005ade-7674-4aff-a79f-ec17fcdaa319 service nova] Creating event network-vif-plugged:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:25:05.499060 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-267fe193-cbee-47d4-8d90-9f30cb50809a req-17005ade-7674-4aff-a79f-ec17fcdaa319 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046729 Jun 18 22:25:05.500409 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2614/5212] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:25:05.502966 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ad28391-ebd6-4ddd-b4b6-df056e077c79 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1270 microversion: 2.1 time: 0.639500 Jun 18 22:25:05.512575 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2599/5213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:04 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1270 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:05.823573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:05.824605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:05.845999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:05.849174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:05.855383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:05.856152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:06.486843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:06.489482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:06.545659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:06.548097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:06.550074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:06.550773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:07.884923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:07.901189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:07.902763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:07.904016 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9136a3e6-9c97-48d8-adc6-0a5c983fa632 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1366 microversion: 2.57 time: 1.450279 Jun 18 22:25:07.914744 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2600/5214] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:06 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1366 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:25:07.926283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:07.939032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:07.940792 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95568b83-eb79-4675-bb52-64de6dc43b20 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 2.123009 Jun 18 22:25:07.941842 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2615/5215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:05 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:07.941995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:07.959556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:07.969445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:07.970725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:07.974787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:08.606243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:08.618587 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a80fc294-9611-4a71-be87-71ef807f82ef tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1459 microversion: 2.1 time: 0.700563 Jun 18 22:25:08.624143 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2601/5216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:07 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1459 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:08.643821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:08.646323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:08.670137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:08.672419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:08.677430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:08.678579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:08.926597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:08.927495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:08.954376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:08.955763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:08.956931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:08.958749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:09.307643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:09.320755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:09.327023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:09.334559 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50337d53-e313-4c58-9f54-fe3acf1336a7 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1372 microversion: 2.57 time: 0.414880 Jun 18 22:25:09.335869 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2602/5217] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:08 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1372 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:25:09.346564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:09.347547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:09.364172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:09.364897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:09.365979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:09.369704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:09.526646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:09.545127 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8bcddb3c-25cd-4ea9-b8e3-6fed536c2a54 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1459 microversion: 2.1 time: 0.905294 Jun 18 22:25:09.548988 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2616/5218] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:08 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1459 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:09.982312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:09.995015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-860b9539-6f67-4aac-817c-f529e613571a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.657722 Jun 18 22:25:10.003191 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2603/5219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:09 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:10.356010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:10.356898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:10.378444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:10.384168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:10.388521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:10.394583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:10.667004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:10.678870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:10.690446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:10.695675 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c1f78e7a-da69-4832-a1c4-e1083071fb2c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1357 microversion: 2.57 time: 0.340302 Jun 18 22:25:10.698878 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2617/5220] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:10 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1357 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:10.731991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:10.734312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:10.756572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:10.757658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:10.759422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:10.771220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:10.848229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:25:11.025487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:11.027384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:11.045881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:11.051648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:11.052635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:11.056430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:11.089581 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93916637-8348-406a-8b1f-183a6f1909be tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "DELETE /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 204 len: 0 microversion: 2.57 time: 0.360878 Jun 18 22:25:11.096612 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2604/5221] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:25:10 2022] DELETE /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:25:11.118878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:11.120419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:11.144925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:11.145803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:11.146962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:11.149170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:11.214479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:11.856363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:11.875495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:11.879030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:11.884015 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f521a8fb-1542-46b5-bac5-207af2398e01 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1363 microversion: 2.57 time: 0.785759 Jun 18 22:25:11.893202 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2605/5222] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:11 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1363 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:11.950467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:11.962714 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8232a6e3-b8ff-4586-8ca5-0386bbc07ab3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.945945 Jun 18 22:25:11.963324 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2618/5223] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:11 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:12.911988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:12.915342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:12.939659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:12.940463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:12.943015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:12.943797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:12.980909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:12.982531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:13.029682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:13.032965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:13.034633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:13.039714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:13.352980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:13.369112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:13.381458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:13.382832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0e8c194d-6661-419d-bb10-93182f366c22 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1363 microversion: 2.57 time: 0.475763 Jun 18 22:25:13.383447 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2606/5224] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:12 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:13.763465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:13.780086 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd732c85-7840-4f96-8c09-ac22966ecb1c tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.797619 Jun 18 22:25:13.786133 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2619/5225] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:12 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:14.404117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:14.404756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:14.424285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:14.426769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:14.430091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:14.433001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:14.680533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:14.707484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:14.709086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5e97368d9959490bac08b91bc86d8687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98994a513d8148718997fb1c02dd6833', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:14.710502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d566c668-98d8-47a3-a029-91b9a5e9816c tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 200 len: 1363 microversion: 2.57 time: 0.312553 Jun 18 22:25:14.710944 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2607/5226] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:14 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:14.805907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:14.806636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:14.822961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:14.831034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:14.834752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:14.837846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:15.672957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:15.698551 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af4fb9a4-0229-491e-aef5-d17c4fe2d5ae tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.899490 Jun 18 22:25:15.699696 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2620/5227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:14 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:15.730332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:15.731724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] [instance: 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:15.746825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:15.747549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:15.748778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:15.752649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:15.826005 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] HTTP exception thrown: Instance 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 could not be found. Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Request method failure captured: Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 HTTP/1.1 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlCg1K5_YFU7OV6l-jz5nHbRZ-snAJxKg6QxpAWE8iB1lTuJB2DwNo-0Pb9vj1qH5_mgHvb_UxLnbnH9DU4s7mMe5WnqOoX85MUlBRPkEO-PDrzCS-hd4uri9S_oX0EisNlf6ytXduD66BppivCglNsRHx41L9u49xaI_DwnY3pKKZo Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.57 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 98994a513d8148718997fb1c02dd6833 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerShowV257Test-1761612946 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/98994a513d8148718997fb1c02dd6833"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98994a513d8148718997fb1c02dd6833"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/98994a513d8148718997fb1c02dd6833"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_98994a513d8148718997fb1c02dd6833", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerShowV257Test-1761612946 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 98994a513d8148718997fb1c02dd6833 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerShowV257Test-1761612946 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerShowV257Test-1761612946-project Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 5e97368d9959490bac08b91bc86d8687 Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerShowV257Test-1761612946-project Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 could not be found. Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8'} Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 could not be found. Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 could not be found. Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:15.830027 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 could not be found. Jun 18 22:25:15.835540 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:15.837762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] Returning 404 to user: Instance 30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:15.839285 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c0d41fa-9054-433c-af2a-8be26293fc84 tempest-ServerShowV257Test-1761612946 tempest-ServerShowV257Test-1761612946-project] 10.222.0.30 "GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8" status: 404 len: 111 microversion: 2.57 time: 0.112981 Jun 18 22:25:15.842183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2608/5228] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:15 2022] GET /compute/v2.1/servers/30c28f8a-bfcb-4a9e-9a58-c75bb827e7d8 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:25:16.715979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:16.716890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:16.728733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:16.739055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:16.740365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:16.741072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:17.370249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a00ee28f-752b-448d-a458-a6ab514c87cb req-46195cc2-3638-4278-8389-1aee0d2db90d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:17.388053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a00ee28f-752b-448d-a458-a6ab514c87cb req-46195cc2-3638-4278-8389-1aee0d2db90d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:17.388507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a00ee28f-752b-448d-a458-a6ab514c87cb req-46195cc2-3638-4278-8389-1aee0d2db90d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:17.453155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a00ee28f-752b-448d-a458-a6ab514c87cb req-46195cc2-3638-4278-8389-1aee0d2db90d service nova] Creating event network-changed:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:25:17.470915 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a00ee28f-752b-448d-a458-a6ab514c87cb req-46195cc2-3638-4278-8389-1aee0d2db90d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101619 Jun 18 22:25:17.472516 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2609/5229] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:25:17.568045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:17.582984 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a6fbf998-47b5-424d-acac-46d2d1a9b5f3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.870877 Jun 18 22:25:17.597836 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2621/5230] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:16 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:18.604084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:18.614625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:18.663485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:18.670400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:18.678292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:18.678812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:19.853969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:19.864843 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0538e46a-d342-423c-8d14-586169b7b563 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 1.265661 Jun 18 22:25:19.874839 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2610/5231] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:18 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:20.806620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d372a5a5-6209-4d44-8c6f-15389d491c10 req-c09b7a12-6073-47a9-9c22-e1cf15e44e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:20.813142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=59 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:20.824193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d372a5a5-6209-4d44-8c6f-15389d491c10 req-c09b7a12-6073-47a9-9c22-e1cf15e44e2d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:20.824660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d372a5a5-6209-4d44-8c6f-15389d491c10 req-c09b7a12-6073-47a9-9c22-e1cf15e44e2d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:20.851090 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d372a5a5-6209-4d44-8c6f-15389d491c10 req-c09b7a12-6073-47a9-9c22-e1cf15e44e2d service nova] Creating event network-changed:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:25:20.868834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d372a5a5-6209-4d44-8c6f-15389d491c10 req-c09b7a12-6073-47a9-9c22-e1cf15e44e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065807 Jun 18 22:25:20.870047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2622/5232] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:25:20.892600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:20.896890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:20.920159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:20.921773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:20.922635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:20.923078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:21.252568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:21.265000 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e0a38fcd-c442-4166-a9df-4927b241c46d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.374452 Jun 18 22:25:21.266811 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2611/5233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:20 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:22.285909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:22.287236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:22.299386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:22.299837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:22.300683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:22.301146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:22.957164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e3242852-92d9-47d5-a490-3ff20705cf37 req-149cb6af-17f0-4848-8a95-a5667cfe9b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:22.979296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e3242852-92d9-47d5-a490-3ff20705cf37 req-149cb6af-17f0-4848-8a95-a5667cfe9b6a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:22.979755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e3242852-92d9-47d5-a490-3ff20705cf37 req-149cb6af-17f0-4848-8a95-a5667cfe9b6a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:23.038251 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e3242852-92d9-47d5-a490-3ff20705cf37 req-149cb6af-17f0-4848-8a95-a5667cfe9b6a service nova] Creating event network-changed:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:25:23.069108 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e3242852-92d9-47d5-a490-3ff20705cf37 req-149cb6af-17f0-4848-8a95-a5667cfe9b6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115590 Jun 18 22:25:23.070877 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2612/5234] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:25:23.393880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:23.403766 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fadedb5-89ad-4f57-aab9-724350577b92 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 1.123756 Jun 18 22:25:23.411278 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2623/5235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:22 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:23.986996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-197902537", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:24.080684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] validate_networks() for [('514c5463-b7bc-4e63-9bdf-3ed56386de4c', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:25:24.278592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2507793a-c52b-479f-986d-15e99969aa24 tempest-ComputeTenantNetworksTest-1731354450 tempest-ComputeTenantNetworksTest-1731354450-project] Calling method '.version_select at 0x7fea07102310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:24.515413 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2507793a-c52b-479f-986d-15e99969aa24 tempest-ComputeTenantNetworksTest-1731354450 tempest-ComputeTenantNetworksTest-1731354450-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.362197 Jun 18 22:25:24.516270 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2624/5236] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:25:24 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:25:24.523773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:24.524889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:24.546494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:24.548535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:24.551974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:24.554431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:25.072481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:25.103371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d58f59b-6422-42f2-989a-fb0ac1738947 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.563138 Jun 18 22:25:25.110433 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2625/5237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:24 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:25.136846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-01924116-d46b-49e5-becb-aa2deb4340b4 tempest-ComputeTenantNetworksTest-1731354450 tempest-ComputeTenantNetworksTest-1731354450-project] Calling method '.version_select at 0x7fea07557040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:25.940158 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-01924116-d46b-49e5-becb-aa2deb4340b4 tempest-ComputeTenantNetworksTest-1731354450 tempest-ComputeTenantNetworksTest-1731354450-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/99149457-4d12-44a8-8246-f2c23ef4ecbf" status: 200 len: 139 microversion: 2.1 time: 0.828318 Jun 18 22:25:25.941566 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2626/5238] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:25:25 2022] GET /compute/v2.1/os-tenant-networks/99149457-4d12-44a8-8246-f2c23ef4ecbf => generated 139 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:25:26.120610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:26.121603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:26.134765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:26.135219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:26.136018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:26.136470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:27.378274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:25:27.379002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:25:27.379608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:25:27.380511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:25:27.381056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:25:27.424087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:27.436109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:27.436522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:27.445810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:27.453374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:27.469601 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d81ca6c5-c619-43ed-a0a6-c2e1b493b032 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 1.350897 Jun 18 22:25:27.476208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2627/5239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:26 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:27.605903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Getting quotas for project 8f9a7d50200443418ef0c6a20a608bb9. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:25:27.667370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Getting quotas for user 39c2337d42bc426abed2ed2fb5000753 and project 8f9a7d50200443418ef0c6a20a608bb9. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:25:27.760860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:25:27.780455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:25:28.006259 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf910c0f-3dac-4eab-8daf-44118bc7dd17 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.920909 Jun 18 22:25:28.006935 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2613/5240] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:25:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 4922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:25:28.017986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40e2e4ff-5d16-428e-8c0f-3951dd0f6e9a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:28.019428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40e2e4ff-5d16-428e-8c0f-3951dd0f6e9a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:28.166981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-40e2e4ff-5d16-428e-8c0f-3951dd0f6e9a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:28.180360 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40e2e4ff-5d16-428e-8c0f-3951dd0f6e9a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1213 microversion: 2.1 time: 0.163489 Jun 18 22:25:28.181956 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2628/5241] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:28 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:28.461000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:28.464251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:28.495395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:28.497716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:28.504360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:28.504823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:28.514521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:28.515285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:28.517119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:28.517922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:28.526794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:28.527256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:28.711892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e24d646f-c993-4692-921a-6ec275a787ce tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.260624 Jun 18 22:25:28.719509 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2614/5242] 10.222.0.30 () {60 vars in 1342 bytes} [Sat Jun 18 22:25:28 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9/os-volume_attachments => generated 25 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:28.891569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:28.892286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:28.915787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:28.919290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:28.922034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:28.922742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:29.020723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:25:29.179221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:29.193189 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc2766e5-2150-4c9e-909c-a743f57d88a9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.699649 Jun 18 22:25:29.200174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2629/5243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:28 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:29.213928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-777eb923-7914-4d5c-8a54-77602e6bd2fb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:29.214558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-777eb923-7914-4d5c-8a54-77602e6bd2fb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:29.332781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-32e14142-3cfe-465c-b149-d108a22ddc20 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 204 len: 0 microversion: 2.20 time: 0.447885 Jun 18 22:25:29.333819 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2615/5244] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:25:28 2022] DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:25:29.351948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:29.353118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:29.371015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:29.371850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:29.372851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:29.373526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:29.453575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-777eb923-7914-4d5c-8a54-77602e6bd2fb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:29.460842 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-777eb923-7914-4d5c-8a54-77602e6bd2fb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1213 microversion: 2.1 time: 0.258619 Jun 18 22:25:29.465160 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2630/5245] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:29 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:29.971394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:29.987304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:29.992325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:29.997740 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7798bbd9-3581-497a-a50d-0f838d8b2367 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.657098 Jun 18 22:25:30.000241 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2616/5246] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:29 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:30.210345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:30.213965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:30.245844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:30.247977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:30.251785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:30.252909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:30.482004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:30.482963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:30.506613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:30.510254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:30.514323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:30.516506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:30.910602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:30.930926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-772c0eaa-c333-490f-8144-d668facf13fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.721653 Jun 18 22:25:30.933228 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2631/5247] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:30 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:31.026038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:31.027561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:31.055983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:31.056750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:31.064023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:31.064832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:31.074289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:31.092965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f8fc6d75-b34f-4bfb-a96c-5d6c39c959bb tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1265 microversion: 2.1 time: 0.615404 Jun 18 22:25:31.100153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2617/5248] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:30 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1265 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:31.715531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:31.735621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:31.742098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:31.746324 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ae80af1-f361-43df-beb0-e0ea87cca592 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.729602 Jun 18 22:25:31.764511 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2632/5249] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:31 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:25:31.954497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:31.955771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:31.973444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:31.977900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:31.978987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:31.979598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:32.124341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:32.125250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:32.142216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:32.142380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:32.147479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:32.147989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:32.351411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:32.364917 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1271 microversion: 2.1 time: 0.244637 Jun 18 22:25:32.377853 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2633/5250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:32 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:32.463244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:32.477621 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1526 microversion: 2.1 time: 0.521515 Jun 18 22:25:32.489481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2618/5251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:31 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1526 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:32.504780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:32.506212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001796 Jun 18 22:25:32.506572 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2634/5252] 10.222.0.30 () {56 vars in 885 bytes} [Sat Jun 18 22:25:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 18 22:25:32.513823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:32.515272 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002236 Jun 18 22:25:32.516595 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2619/5253] 10.222.0.30 () {54 vars in 1034 bytes} [Sat Jun 18 22:25:32 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jun 18 22:25:32.523325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:32.524657 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f10d6c72-2f7e-413f-bbdc-b2e14a1ea0d0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001856 Jun 18 22:25:32.525403 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2635/5254] 10.222.0.30 () {54 vars in 1040 bytes} [Sat Jun 18 22:25:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:25:32.533338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:32.534897 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52c18c3f-166b-4118-9a8f-f03a6d871335 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001787 Jun 18 22:25:32.535794 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2620/5255] 10.222.0.30 () {56 vars in 885 bytes} [Sat Jun 18 22:25:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 18 22:25:32.764624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:32.765774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:32.783438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:32.785811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:32.792607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:32.795533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:33.367979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:33.385654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:33.386600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:33.387747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:33.394345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:33.400612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb94cf52-e286-4dd1-aa06-3562b3a7e98d tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1723 microversion: 2.20 time: 0.635587 Jun 18 22:25:33.401577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:33.403049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:33.408144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:33.408945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:33.419320 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2636/5256] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:32 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1723 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:33.496804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:33.497616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:33.513246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:33.513890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:33.524062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:33.524062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:33.646923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:33.657439 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fb935d78-c138-43f5-9bc7-93bb51fa5fb9 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1271 microversion: 2.1 time: 0.276685 Jun 18 22:25:33.658072 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2621/5257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:33 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:34.027440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:34.065580 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e146db98-1216-4233-987d-da20de32252e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1508 microversion: 2.1 time: 0.573450 Jun 18 22:25:34.081521 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2637/5258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:33 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:34.421992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:34.422735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:34.426433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:34.457356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:34.459412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:34.462840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:34.464725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:34.533280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a3d12223-bd37-4269-80ee-3c81569a6058 req-6a6ee9d1-dcd7-45cc-a214-3a7ad6dd6fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4646f0-25bf-42be-8cc1-a641b535d3f9", "name": "network-vif-deleted", "tag": "f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:34.613458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a3d12223-bd37-4269-80ee-3c81569a6058 req-6a6ee9d1-dcd7-45cc-a214-3a7ad6dd6fa1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:34.614122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a3d12223-bd37-4269-80ee-3c81569a6058 req-6a6ee9d1-dcd7-45cc-a214-3a7ad6dd6fa1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:34.645126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:34.680644 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a3d12223-bd37-4269-80ee-3c81569a6058 req-6a6ee9d1-dcd7-45cc-a214-3a7ad6dd6fa1 service nova] Creating event network-vif-deleted:f3ba37ee-6b6d-4f89-a7d6-f2c455b68cb0 for instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 on nch1-master-1 Jun 18 22:25:34.688102 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a3d12223-bd37-4269-80ee-3c81569a6058 req-6a6ee9d1-dcd7-45cc-a214-3a7ad6dd6fa1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166586 Jun 18 22:25:34.689089 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2638/5259] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:25:34.697728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:34.698779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:34.708354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:34.709289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:34.710412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:34.711222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:34.930299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:34.942939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:34.957386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d81ad22e9434bff9b01fb434231428f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c1a383333e4e30ace00bcdba714600', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:34.960884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9208992b-43b1-4e06-bdc4-1585e79f8bb1 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 200 len: 1656 microversion: 2.20 time: 0.544898 Jun 18 22:25:34.961540 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2622/5260] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:34 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 1656 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:25:35.069650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:35.087178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:35.088043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:35.091464 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff13cb38-ddca-4cd4-be06-3e63b85f1db1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.398778 Jun 18 22:25:35.093563 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2639/5261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:34 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:35.120494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:35.121832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:35.129822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:35.130722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:35.495690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:35.506796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-791e0a12-7a22-447a-8bba-34d7153f4534 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1508 microversion: 2.1 time: 0.426192 Jun 18 22:25:35.507952 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2623/5262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:35 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:35.828009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-001718de-1581-44bb-bac2-cf52b3a70d3a req-5366edc6-5e45-433d-a41e-4e4a28a767fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82678d7b-d3bf-4ed3-b8f9-945d2279172e", "name": "network-vif-unplugged", "status": "completed", "tag": "c53d5f7e-99ad-4718-b288-9c6b747e1b74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:35.848283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-001718de-1581-44bb-bac2-cf52b3a70d3a req-5366edc6-5e45-433d-a41e-4e4a28a767fd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:35.849820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-001718de-1581-44bb-bac2-cf52b3a70d3a req-5366edc6-5e45-433d-a41e-4e4a28a767fd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:35.868834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-001718de-1581-44bb-bac2-cf52b3a70d3a req-5366edc6-5e45-433d-a41e-4e4a28a767fd service nova] Creating event network-vif-unplugged:c53d5f7e-99ad-4718-b288-9c6b747e1b74 for instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e on nch1-master-1 Jun 18 22:25:35.877154 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-001718de-1581-44bb-bac2-cf52b3a70d3a req-5366edc6-5e45-433d-a41e-4e4a28a767fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052685 Jun 18 22:25:35.878564 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2640/5263] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:25:35.981722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:35.983725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:35.996428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:35.997352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:35.999019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:36.001441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:36.045968 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] HTTP exception thrown: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Request method failure captured: Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 HTTP/1.1 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9N6pJ0MfiJVZQsIRmPpiXe3LyMytLJseAgzJ8zWOn2vVh4vjwlsUvCUyg6Yh8SAEA02KbXgBGfd018xkWy-aiaFdpbdr5XKZEaEGtHGMxVR2kmnqk9TWwsut9BffYKszcrKNAd1q7BRQn4IiYj64J_JnUMZYn_yj2wOTLK0Qo1Zwg Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6c1a383333e4e30ace00bcdba714600", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8d81ad22e9434bff9b01fb434231428f Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2a4646f0-25bf-42be-8cc1-a641b535d3f9'} Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:36.055929 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:36.061333 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:36.068444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Returning 404 to user: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:36.070526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-def4e54d-1508-491f-a321-bdee4e719739 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 404 len: 111 microversion: 2.20 time: 0.092492 Jun 18 22:25:36.071747 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2624/5264] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:35 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:25:36.081880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9930152-521a-401a-b462-fade042e5be5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '.version_select at 0x7fea1404ee50>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:36.111756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:36.112336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:36.132286 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9930152-521a-401a-b462-fade042e5be5 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375239381" status: 204 len: 0 microversion: 2.20 time: 0.055304 Jun 18 22:25:36.134111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2641/5265] 10.222.0.30 () {60 vars in 1261 bytes} [Sat Jun 18 22:25:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375239381 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:25:36.136420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:36.136885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:36.137892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:36.138373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:36.458550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:36.461442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:36.473068 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ca8b0d91-b9af-47dd-b754-d2c6d7f2f000 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.366575 Jun 18 22:25:36.474582 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2625/5266] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:36 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:36.527195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:36.528103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:36.569698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:36.571654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:36.577238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:36.578034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:36.927598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:36.942920 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d58ec08-f01a-46e1-9232-f49bf2de633b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1508 microversion: 2.1 time: 0.421910 Jun 18 22:25:36.943682 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2642/5267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:36 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:37.491278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:37.491972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:37.504642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:37.506353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:37.508771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:37.508972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:37.550078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:37.716540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:37.851796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:37.865965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-edf1f1b8-2ffd-45de-aabe-4e0c94f533ef tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.378844 Jun 18 22:25:37.866972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2626/5268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:37 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:37.961791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:37.963130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:37.979810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:37.993611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:37.996221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:37.999945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:38.445859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:38.456470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7be582b-23c6-4473-81b6-7356a4ce0e94 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1511 microversion: 2.1 time: 0.499433 Jun 18 22:25:38.464755 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2643/5269] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:37 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:38.474885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:38.475868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:38.483870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:38.484335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:38.485216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:38.485690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:38.581011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dc9f50e2-0f9b-4e08-85e3-1f5b21b6f847 req-7023eb01-edc4-4b4d-8005-2d72eb5bb68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b47c81a-0fdd-47a0-9468-4cab0b84ba1e", "tag": "4ce5aa4f-ac8c-4616-894f-41f8b504b0f9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:38.616652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dc9f50e2-0f9b-4e08-85e3-1f5b21b6f847 req-7023eb01-edc4-4b4d-8005-2d72eb5bb68d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:38.621640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dc9f50e2-0f9b-4e08-85e3-1f5b21b6f847 req-7023eb01-edc4-4b4d-8005-2d72eb5bb68d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:38.651121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dc9f50e2-0f9b-4e08-85e3-1f5b21b6f847 req-7023eb01-edc4-4b4d-8005-2d72eb5bb68d service nova] Creating event network-changed:4ce5aa4f-ac8c-4616-894f-41f8b504b0f9 for instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e on nch2-master-1 Jun 18 22:25:38.665983 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dc9f50e2-0f9b-4e08-85e3-1f5b21b6f847 req-7023eb01-edc4-4b4d-8005-2d72eb5bb68d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095012 Jun 18 22:25:38.669263 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2644/5270] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:25:38.894855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:38.897257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:38.913725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:38.921063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:38.924093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:38.932645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:38.936750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:38.939892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1903fdf-b49d-4ff9-8327-3c5a214e6137 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1451 microversion: 2.1 time: 0.470129 Jun 18 22:25:38.940692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2627/5271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:38 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1451 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:39.008347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:39.009367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:39.016564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:39.019043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:39.020720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:39.021407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:39.094258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lazy-loading 'flavor' on Instance uuid 82678d7b-d3bf-4ed3-b8f9-945d2279172e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:25:39.121171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'shelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state shelved_offloaded Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 14 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: {"shelve": {}} Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'shelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state shelved_offloaded Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'shelve': {}}} Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jun 18 22:25:39.143637 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state shelved_offloaded Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state shelved_offloaded Jun 18 22:25:39.149394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:39.153118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'shelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state shelved_offloaded {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:39.153118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37f0bba1-b6f8-48ec-8bba-bc7911ec7964 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 155 microversion: 2.1 time: 0.149893 Jun 18 22:25:39.153118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2628/5272] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:25:39 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 155 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:25:39.163326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:39.174323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:39.182890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:39.183702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:39.184846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:39.185425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:39.460327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:39.489533 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-870d1ef4-80e4-41d7-8156-db2ccf64b39f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 202 len: 0 microversion: 2.1 time: 0.329898 Jun 18 22:25:39.493562 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2629/5273] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:25:39 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:25:39.512356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:39.513338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:39.539137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:39.539653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:39.542737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:39.544461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:39.625354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:39.645881 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25c6517c-b64e-4fbe-a958-8f05ac122a6a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.757942 Jun 18 22:25:39.646632 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2645/5274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:38 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:40.012688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:40.034126 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a033f79b-c750-4fe5-be27-0ce80ae5a896 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1459 microversion: 2.1 time: 0.536926 Jun 18 22:25:40.041880 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2630/5275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:39 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1459 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:40.628573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:40.629413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:40.647854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:40.650115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:40.652880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:40.654165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:40.667242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:40.669276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:40.689148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:40.689601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:40.690490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:40.690969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:40.693685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] HTTP exception thrown: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Request method failure captured: Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 HTTP/1.1 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9N6pJ0MfiJVZQsIRmPpiXe3LyMytLJseAgzJ8zWOn2vVh4vjwlsUvCUyg6Yh8SAEA02KbXgBGfd018xkWy-aiaFdpbdr5XKZEaEGtHGMxVR2kmnqk9TWwsut9BffYKszcrKNAd1q7BRQn4IiYj64J_JnUMZYn_yj2wOTLK0Qo1Zwg Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6c1a383333e4e30ace00bcdba714600", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d81ad22e9434bff9b01fb434231428f Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2a4646f0-25bf-42be-8cc1-a641b535d3f9'} Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:25:40.696880 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Returning 404 to user: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:40.705413 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ba160eb4-6a0f-4bff-a644-7fd2b0966dd2 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 404 len: 111 microversion: 2.20 time: 0.078253 Jun 18 22:25:40.710932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2646/5276] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:25:40 2022] DELETE /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:25:40.727248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:40.728803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 2a4646f0-25bf-42be-8cc1-a641b535d3f9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:40.741338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:40.757257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:40.763244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:40.765618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:40.836898 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] HTTP exception thrown: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Request method failure captured: Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 HTTP/1.1 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirk9N6pJ0MfiJVZQsIRmPpiXe3LyMytLJseAgzJ8zWOn2vVh4vjwlsUvCUyg6Yh8SAEA02KbXgBGfd018xkWy-aiaFdpbdr5XKZEaEGtHGMxVR2kmnqk9TWwsut9BffYKszcrKNAd1q7BRQn4IiYj64J_JnUMZYn_yj2wOTLK0Qo1Zwg Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6c1a383333e4e30ace00bcdba714600", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8d81ad22e9434bff9b01fb434231428f Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2a4646f0-25bf-42be-8cc1-a641b535d3f9'} Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.840239 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. Jun 18 22:25:40.850322 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:25:40.853640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Returning 404 to user: Instance 2a4646f0-25bf-42be-8cc1-a641b535d3f9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:40.855434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d094f14c-baa3-4f0a-b86e-662306685eeb tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9" status: 404 len: 111 microversion: 2.20 time: 0.142716 Jun 18 22:25:40.856613 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2647/5277] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:40 2022] GET /compute/v2.1/servers/2a4646f0-25bf-42be-8cc1-a641b535d3f9 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:25:41.063917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:41.070385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:41.096347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:41.097483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:41.099813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:41.100819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:42.015505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:42.070372 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-10b5aa84-6abc-429c-b5ba-10616b99ced0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 1.408916 Jun 18 22:25:42.071046 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2631/5278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:40 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:42.225186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:42.242418 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd245d3d-258a-4d57-b612-3b5a757cb190 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1459 microversion: 2.1 time: 1.184717 Jun 18 22:25:42.256949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2648/5279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:41 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1459 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:43.096509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:43.101704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:43.121873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.124095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.129284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.130215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.263535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:43.267077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:43.279722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.280797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.283013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.284672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.604685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:43.617269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4655f832-9b0a-40ba-aab9-df1f9b14ae23 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.533424 Jun 18 22:25:43.617898 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2632/5280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:43 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:43.643505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:43.652724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:43.666374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.667225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.669003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.672246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.709260 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] HTTP exception thrown: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Request method failure captured: Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 HTTP/1.1 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9N6pJ0MfiJVZQsIRmPpiXe3LyMytLJseAgzJ8zWOn2vVh4vjwlsUvCUyg6Yh8SAEA02KbXgBGfd018xkWy-aiaFdpbdr5XKZEaEGtHGMxVR2kmnqk9TWwsut9BffYKszcrKNAd1q7BRQn4IiYj64J_JnUMZYn_yj2wOTLK0Qo1Zwg Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6c1a383333e4e30ace00bcdba714600", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8d81ad22e9434bff9b01fb434231428f Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '662b2510-85bb-41de-85c9-6b498e04b6b1'} Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:25:43.712512 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.719041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.724712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Returning 404 to user: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:43.725995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-af989546-aad2-4a94-95cd-d3c28e025e32 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 404 len: 111 microversion: 2.20 time: 0.091220 Jun 18 22:25:43.727141 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2633/5281] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:25:43 2022] DELETE /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:25:43.746993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:43.749705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] [instance: 662b2510-85bb-41de-85c9-6b498e04b6b1] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:43.757392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.758063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.759057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:43.759786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:43.795630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] HTTP exception thrown: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Request method failure captured: Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 HTTP/1.1 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirk9N6pJ0MfiJVZQsIRmPpiXe3LyMytLJseAgzJ8zWOn2vVh4vjwlsUvCUyg6Yh8SAEA02KbXgBGfd018xkWy-aiaFdpbdr5XKZEaEGtHGMxVR2kmnqk9TWwsut9BffYKszcrKNAd1q7BRQn4IiYj64J_JnUMZYn_yj2wOTLK0Qo1Zwg Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Openstack-Nova-Api-Version: 2.20 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6c1a383333e4e30ace00bcdba714600"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6c1a383333e4e30ace00bcdba714600", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: b6c1a383333e4e30ace00bcdba714600 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1650157146 Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 8d81ad22e9434bff9b01fb434231428f Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1650157146-project Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '662b2510-85bb-41de-85c9-6b498e04b6b1'} Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.797956 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. Jun 18 22:25:43.807965 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:25:43.812268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] Returning 404 to user: Instance 662b2510-85bb-41de-85c9-6b498e04b6b1 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:25:43.813623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-530b1e51-5456-4f38-8cce-0337340b9629 tempest-AttachVolumeShelveTestJSON-1650157146 tempest-AttachVolumeShelveTestJSON-1650157146-project] 10.222.0.30 "GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1" status: 404 len: 111 microversion: 2.20 time: 0.071962 Jun 18 22:25:43.815761 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2634/5282] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:25:43 2022] GET /compute/v2.1/servers/662b2510-85bb-41de-85c9-6b498e04b6b1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:25:44.088913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:44.110297 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-efb5478b-6cba-44b6-a299-83b59c0dfb96 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.850060 Jun 18 22:25:44.112996 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2649/5283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:43 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:44.638300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:44.638869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:44.655489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:44.655961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:44.660828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:44.661361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:45.147259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:45.149768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:45.164886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:45.167122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:45.168243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:45.171536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:45.499458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:45.514051 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad975973-1d36-4649-9fa0-77238ffdea05 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 0.879501 Jun 18 22:25:45.516354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2635/5284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:44 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:45.603064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:45.619054 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20e0ec27-17f3-4b1b-9432-4ea42bb38b71 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.490192 Jun 18 22:25:45.624059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2650/5285] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:45 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:46.532163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:46.532788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:46.570405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:46.570868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:46.574799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:46.578579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:46.641528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:46.643547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:46.667572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:46.673614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:46.676505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:46.677181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:47.730449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:47.752665 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e21ece26-2910-4278-87b9-b982c08c48b9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 1.114849 Jun 18 22:25:47.755786 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2651/5286] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:46 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:48.051262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c3ec4541-9f1d-4e6a-9c6a-49819f5153e5 req-72b285bd-e213-4e02-8352-ab373adfb151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b47c81a-0fdd-47a0-9468-4cab0b84ba1e", "name": "network-vif-plugged", "status": "completed", "tag": "4ce5aa4f-ac8c-4616-894f-41f8b504b0f9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:48.078049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c3ec4541-9f1d-4e6a-9c6a-49819f5153e5 req-72b285bd-e213-4e02-8352-ab373adfb151 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:48.084610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c3ec4541-9f1d-4e6a-9c6a-49819f5153e5 req-72b285bd-e213-4e02-8352-ab373adfb151 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:48.128927 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c3ec4541-9f1d-4e6a-9c6a-49819f5153e5 req-72b285bd-e213-4e02-8352-ab373adfb151 service nova] Creating event network-vif-plugged:4ce5aa4f-ac8c-4616-894f-41f8b504b0f9 for instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e on nch2-master-1 Jun 18 22:25:48.148865 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c3ec4541-9f1d-4e6a-9c6a-49819f5153e5 req-72b285bd-e213-4e02-8352-ab373adfb151 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105779 Jun 18 22:25:48.156673 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2652/5287] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:25:48.285531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:48.304078 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b4d1620-2a3a-482c-8b2f-9205b184a803 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 1.774678 Jun 18 22:25:48.326739 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2636/5288] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:46 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:48.791753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:48.796905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:48.833489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:48.836853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:48.839468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:48.841229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:49.331482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:49.332265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:49.394181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:49.398862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:49.410634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:49.413782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:50.516041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:50.540916 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd0fb121-3573-4472-afcc-d82d758d8488 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1313 microversion: 2.1 time: 1.211665 Jun 18 22:25:50.556178 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2637/5289] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:49 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1313 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:50.657703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:50.662510 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e74377b5-d670-4cce-b7c6-059fa2b95c80 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 1.893723 Jun 18 22:25:50.671799 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2653/5290] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:48 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:51.567004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:51.570711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:51.614235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:51.624841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:51.628722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:51.638167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:51.687346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:51.688007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:51.705912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:51.706364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:51.709496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:51.709496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:53.863412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:53.894615 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e7aba6b3-84f7-4751-a381-34ffc4a85d4c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1498 microversion: 2.1 time: 2.326394 Jun 18 22:25:53.897653 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2638/5291] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:51 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1498 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:53.929963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:25:53.931567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:53.944217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:53.945123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:53.946997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:53.948818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:53.992914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:54.001231 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-471aa811-1b09-450a-814b-4eec31d7edc2 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 2.318491 Jun 18 22:25:54.001880 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2654/5292] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:51 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:25:54.038712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lazy-loading 'flavor' on Instance uuid 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:25:54.312719 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52c246bc-d19d-46c8-a4ab-1edcc2e08b99 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "POST /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e/action" status: 200 len: 32 microversion: 2.1 time: 0.385012 Jun 18 22:25:54.316193 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2639/5293] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:25:53 2022] POST /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:25:54.331785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:54.332720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:54.335404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:54.361908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:54.366691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:54.368130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:54.368863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:55.020374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:55.021327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:55.036788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:55.038420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:55.041788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:55.042469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:55.703910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:55.752187 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-012cc86d-6012-4e54-a2b7-aa66d6503d65 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 1.424128 Jun 18 22:25:55.755144 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2655/5294] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:54 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:56.055450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:56.058294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:25:56.074516 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db9c6493-f5a1-4f1e-a7b0-b1288781bbcd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 1.058957 Jun 18 22:25:56.094734 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2640/5295] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:55 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:56.776245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:56.778047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:56.803426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:56.805013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:56.808221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:56.809534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:57.110848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:25:57.111584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:25:57.148301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:57.149393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:57.152969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:25:57.155053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:25:59.021272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:59.082506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad238050-7366-4497-9ba0-a1d0b6d169d4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 1.974749 Jun 18 22:25:59.101989 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2641/5296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:57 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:25:59.382658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:25:59.396685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6c402e5b-48de-4503-9671-46f867609ea5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 2.628254 Jun 18 22:25:59.397330 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2656/5297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:25:56 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 2631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:00.102214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:00.103706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:00.133163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:00.136191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:00.142263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:00.142990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:00.521861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:00.540117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5768dcce-b0a6-43f8-8cba-3b7c73c2fdfd tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.442099 Jun 18 22:26:00.543200 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2642/5298] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:00 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:00.556547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:00.560790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:00.581476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:00.584223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:00.585956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:00.587764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:01.041589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc4c3337-c430-4b41-b595-0b91b056c9f0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: .version_select at 0x7fea06f06ee0>, body: {"keypair": {"name": "tempest-keypair-947044579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0kKLZPeBJlJU12lNQBu4RKx4kmpFU7h+DUQWEpSgiQXrRhHFbln9QHptbnRUqWqS3JUEqhnXGCpgST9soiLIFibds8DreTFkltl0pVkY3VCmw3JKlkhxMSbfISgPWvUQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:01.113711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-bc4c3337-c430-4b41-b595-0b91b056c9f0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for project 76301551c4574f299511a993dc871890. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:26:01.136066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-bc4c3337-c430-4b41-b595-0b91b056c9f0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for user 3f6133e6ab7745118bc629dd126189e8 and project 76301551c4574f299511a993dc871890. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:26:01.220205 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc4c3337-c430-4b41-b595-0b91b056c9f0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.045615 Jun 18 22:26:01.221724 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2657/5299] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:26:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:26:01.452380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:01.464252 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69fdd30e-92c7-4ac4-ad81-cfa59333106a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.918688 Jun 18 22:26:01.468850 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2643/5300] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:00 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:01.565710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:01.566427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:01.576744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:01.582001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:01.583216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:01.583876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:02.203718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:02.233509 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-df9a128b-446a-4f93-8edb-7708c8dc1a01 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.671990 Jun 18 22:26:02.236833 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2658/5301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:01 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:02.487560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:02.488175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:02.496909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:02.507213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:02.508114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:02.513328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:02.901000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:02.921160 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7599c118-7c48-4c84-8f7b-37a37f2f3539 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.438467 Jun 18 22:26:02.925441 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2644/5302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:02 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:03.257307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:03.258308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:03.276051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:03.284425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:03.297652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:03.298880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:03.484763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-21b68287-8351-4295-aafe-e25dac926ba9 tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Action: 'create', calling method: .version_select at 0x7fea06fbad30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-136809590", "metadata": {"Type": "work"}}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:03.714867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:03.725432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65c18d18-6745-492f-bb02-1df23adc46de tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.473318 Jun 18 22:26:03.726121 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2645/5303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:03 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:03.940119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:03.940768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:03.956366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:03.958013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:03.959366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:03.959967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:04.317224 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-21b68287-8351-4295-aafe-e25dac926ba9 tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.578165 Jun 18 22:26:04.317865 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2659/5304] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:26:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1580 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 18 22:26:04.329308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc37ae72-d73e-4672-a309-17579b338151 tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Calling method '.version_select at 0x7fea06fbab80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:04.490930 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc37ae72-d73e-4672-a309-17579b338151 tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74" status: 200 len: 345 microversion: 2.1 time: 0.165761 Jun 18 22:26:04.492139 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2660/5305] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:26:04 2022] GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 => generated 345 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:26:04.738542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:04.744267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:04.744887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:04.749314 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-198095a8-847e-4645-9e9b-b419f3f54eab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.813856 Jun 18 22:26:04.754566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:04.755936 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2646/5306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:03 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:04.768047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:04.769139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:04.769649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:04.866540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=89 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:05.255296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:05.293369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-628c9709-0d9a-4a27-a73c-f90a5f263d3a tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.551205 Jun 18 22:26:05.296069 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2661/5307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:04 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:05.504419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4f10de60-1a4e-4f7f-84da-c4e9843182cb tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Calling method '.version_select at 0x7fea0762f040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:05.605753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4f10de60-1a4e-4f7f-84da-c4e9843182cb tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74" status: 200 len: 346 microversion: 2.1 time: 0.105403 Jun 18 22:26:05.606578 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2647/5308] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:26:05 2022] GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 => generated 346 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:05.619133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a5e14c9-0b88-4842-93d6-9aec0cab8f6b tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Calling method '.version_select at 0x7fea06f93670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:05.731286 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a5e14c9-0b88-4842-93d6-9aec0cab8f6b tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74" status: 200 len: 346 microversion: 2.1 time: 0.116826 Jun 18 22:26:05.733143 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2662/5309] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:26:05 2022] GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:05.746832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Calling method '.version_select at 0x7fea07695820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:05.773375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:05.775914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:05.787993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:05.789549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:05.791958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:05.793741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:05.897854 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c1511fa2-2b0e-4173-ab2f-cfec034775e5 tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74" status: 202 len: 0 microversion: 2.1 time: 0.156186 Jun 18 22:26:05.901990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2648/5310] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:26:05 2022] DELETE /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:26:05.911295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-216245359", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ed0c64b-f3e2-471b-bb19-37ccd5600a59"}], "security_groups": [{"name": "tempest-securitygroup--39487279"}], "key_name": "tempest-keypair-947044579", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:05.927172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=52 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:06.244005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] validate_networks() for [('8ed0c64b-f3e2-471b-bb19-37ccd5600a59', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:26:06.356734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:06.365685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b808424-5720-4741-9ee2-5d2621390417 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.597289 Jun 18 22:26:06.366287 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2663/5311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:05 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:06.374853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b3924b4d-6e71-42e6-95da-2cb27a8a0f3d tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Calling method '.version_select at 0x7fea14278b80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:06.452477 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b3924b4d-6e71-42e6-95da-2cb27a8a0f3d tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74" status: 200 len: 345 microversion: 2.1 time: 0.085116 Jun 18 22:26:06.453087 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2664/5312] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:26:06 2022] GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:06.458098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:06.458914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:06.472778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:06.473302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:06.474274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:06.474790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:06.949536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:06.971146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-830515b8-919f-4f78-8cef-39fe38e72b79 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.516426 Jun 18 22:26:06.971751 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2665/5313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:06 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:07.137359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:26:07.138416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:26:07.139135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:26:07.139813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:26:07.140416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:26:07.154669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:07.155207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:07.156637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:07.157746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:07.180884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for project 76301551c4574f299511a993dc871890. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:26:07.187635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for user 3f6133e6ab7745118bc629dd126189e8 and project 76301551c4574f299511a993dc871890. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:26:07.204113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:26:07.206963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:26:07.272884 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7505cd21-6c17-4c29-aa27-0e70507a41dc tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.372584 Jun 18 22:26:07.274894 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2649/5314] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:26:05 2022] POST /compute/v2.1/servers => generated 400 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:26:07.285918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c7eeeb1-f323-4036-938e-0a4ae183f0da tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:07.286093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c7eeeb1-f323-4036-938e-0a4ae183f0da tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:07.373784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c7eeeb1-f323-4036-938e-0a4ae183f0da tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:07.385789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c7eeeb1-f323-4036-938e-0a4ae183f0da tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1236 microversion: 2.1 time: 0.104815 Jun 18 22:26:07.386963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:07.387845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:07.391492 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2666/5315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:07 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1236 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:07.407264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:07.410138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:07.411275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:07.412743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:07.465808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbbceb1a-d9c0-4643-8a51-b38d1b02cded tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Calling method '.version_select at 0x7fea06f71700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:07.526475 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-bbbceb1a-d9c0-4643-8a51-b38d1b02cded tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] HTTP exception thrown: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbbceb1a-d9c0-4643-8a51-b38d1b02cded tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Request method failure captured: Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 HTTP/1.1 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlD6_9zQh32yoDtdX-z8zf1C7elwRChhdGwfo45pZK7biomtGz6VLEuHdNVm1ttkspdWbQJl5Hb9bLobMDgUWz3GltEAOKgJzBy3Tq0aCK_C0yu8B01zN4iSwEkKGnbGYeh37lHHNxweGSrOuB-hMmU2D9CXDg2tem2Dnc9k_xX5ka0 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 7c7fe1f21f51409983c5138795103066 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesGetTestJSON-2037134410 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7c7fe1f21f51409983c5138795103066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7c7fe1f21f51409983c5138795103066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7c7fe1f21f51409983c5138795103066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7c7fe1f21f51409983c5138795103066", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesGetTestJSON-2037134410 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 7c7fe1f21f51409983c5138795103066 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesGetTestJSON-2037134410 Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesGetTestJSON-2037134410-project Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: f9165a71c5cf45cebce374e33f4beb4b Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesGetTestJSON-2037134410-project Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: exception: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0afb57ac-b5fc-405a-bfc5-02ff53d84d74'} Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. (HTTP 404) (Request-ID: req-0286d5de-a63b-41e5-b432-7b46804604a5) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:26:07.529381 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. Jun 18 22:26:07.535236 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:07.541208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bbbceb1a-d9c0-4643-8a51-b38d1b02cded tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] Returning 404 to user: Volume 0afb57ac-b5fc-405a-bfc5-02ff53d84d74 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:07.542346 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bbbceb1a-d9c0-4643-8a51-b38d1b02cded tempest-VolumesGetTestJSON-2037134410 tempest-VolumesGetTestJSON-2037134410-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74" status: 404 len: 109 microversion: 2.1 time: 0.080431 Jun 18 22:26:07.542733 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2667/5316] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:26:07 2022] GET /compute/v2.1/os-volumes/0afb57ac-b5fc-405a-bfc5-02ff53d84d74 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:07.683179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:07.707096 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f7099a1e-05d6-4c77-b27e-9dd6ce0d9422 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.327364 Jun 18 22:26:07.710514 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2650/5317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:07 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:07.991657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:07.992543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:08.010252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:08.013122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:08.016999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:08.019315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:08.406992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:08.407648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:08.426075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:08.426531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:08.433004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:08.433513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:08.808242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:08.825294 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a2bd5af-f1fe-4ee9-8d9d-1b09615e54b7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1232 microversion: 2.1 time: 0.422379 Jun 18 22:26:08.827406 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2651/5318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:08 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1232 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:08.857967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:08.858790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:08.875979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:08.876779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:08.878356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:08.882046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:08.902726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:08.915111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e44d047-f095-4d9d-a6ad-a93c860692a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.928035 Jun 18 22:26:08.920308 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2668/5319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:07 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:09.206637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:09.226553 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-409fdabd-d77e-492f-9168-7c757f6c6e1e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.396210 Jun 18 22:26:09.231760 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2652/5320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:08 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:09.844058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:09.844675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:09.867210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:09.868303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:09.870054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:09.870687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:09.938159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:09.938822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:09.957959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:09.960087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:09.964172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:09.967463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:10.384745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:10.428894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e2f922d-cf23-46c2-8b9d-7277f748d744 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1294 microversion: 2.1 time: 0.588776 Jun 18 22:26:10.431340 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2669/5321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:09 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1294 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:10.436573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4c5f9f88-4e69-45b4-aabb-7cd3c46f52e1 req-0b0f34a7-5a51-4e6c-8511-68033f3e7d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82678d7b-d3bf-4ed3-b8f9-945d2279172e", "name": "network-vif-plugged", "status": "completed", "tag": "c53d5f7e-99ad-4718-b288-9c6b747e1b74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:10.455204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4c5f9f88-4e69-45b4-aabb-7cd3c46f52e1 req-0b0f34a7-5a51-4e6c-8511-68033f3e7d96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:10.456218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4c5f9f88-4e69-45b4-aabb-7cd3c46f52e1 req-0b0f34a7-5a51-4e6c-8511-68033f3e7d96 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:10.477138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4c5f9f88-4e69-45b4-aabb-7cd3c46f52e1 req-0b0f34a7-5a51-4e6c-8511-68033f3e7d96 service nova] Creating event network-vif-plugged:c53d5f7e-99ad-4718-b288-9c6b747e1b74 for instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e on nch1-master-1 Jun 18 22:26:10.483654 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4c5f9f88-4e69-45b4-aabb-7cd3c46f52e1 req-0b0f34a7-5a51-4e6c-8511-68033f3e7d96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050994 Jun 18 22:26:10.484964 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2670/5322] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:10.492381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:10.493405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:10.506747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:10.507941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:10.508975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:10.510371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:10.774234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:10.789049 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-502bf1c5-2091-4c41-9876-85b7e2d0535b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.855232 Jun 18 22:26:10.791037 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2653/5323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:09 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:11.166275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:11.183812 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e04971b1-3a1f-4abf-b826-d4edd42c842c tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.697044 Jun 18 22:26:11.184911 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2671/5324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:10 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:11.446896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:11.448146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:11.459774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:11.461377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:11.462398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:11.463222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:11.694979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:11.706875 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50e85730-eb36-463d-b9be-af75e7a0160f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1360 microversion: 2.1 time: 0.262634 Jun 18 22:26:11.710746 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2654/5325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:11 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:11.810707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:11.811766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:11.826418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:11.828251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:11.829829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:11.830324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:12.012649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:12.045758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3984a3e6-3e46-4b2a-8f16-9447917ddf67 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.240683 Jun 18 22:26:12.046357 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2672/5326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:11 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:12.201569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:12.202739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:12.210057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:12.211131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:12.212386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:12.213078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:12.540002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:12.549743 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6ec1334d-7c79-496e-ae11-26e85cd2157f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1504 microversion: 2.1 time: 0.351960 Jun 18 22:26:12.562914 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2655/5327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:12 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1504 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:12.727982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:12.728826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:12.743218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:12.743767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:12.745849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:12.746320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:12.989859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:13.011151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-515e48e0-5174-4369-8d9c-15e09e2f6086 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1360 microversion: 2.1 time: 0.287070 Jun 18 22:26:13.012180 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2673/5328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:12 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1360 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:13.024789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-807bf90d-914c-4f57-944a-01be11730d59 req-257e7fd9-e701-4351-8e3c-688cced268c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a0ac3f-2e1b-423a-8476-d9deb8eec449", "tag": "754bea67-c445-4d31-9cd9-8d467714927d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:13.077938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-807bf90d-914c-4f57-944a-01be11730d59 req-257e7fd9-e701-4351-8e3c-688cced268c9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:13.078529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:13.082050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:13.082992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-807bf90d-914c-4f57-944a-01be11730d59 req-257e7fd9-e701-4351-8e3c-688cced268c9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:13.114605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:13.121137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:13.122085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:13.124851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:13.135584 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-807bf90d-914c-4f57-944a-01be11730d59 req-257e7fd9-e701-4351-8e3c-688cced268c9 service nova] Creating event network-changed:754bea67-c445-4d31-9cd9-8d467714927d for instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 on nch1-master-1 Jun 18 22:26:13.155148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-807bf90d-914c-4f57-944a-01be11730d59 req-257e7fd9-e701-4351-8e3c-688cced268c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144933 Jun 18 22:26:13.156058 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2656/5329] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:26:13.503966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:13.514843 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5124a7be-5a0b-4e66-8d55-a0c82ca82def tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1517 microversion: 2.1 time: 0.454463 Jun 18 22:26:13.517529 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2674/5330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:13 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:13.571665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:13.572369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:13.590647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:13.591616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:13.592624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:13.593257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:14.034775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:14.044804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:14.058755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:14.064622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:14.065309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:14.067187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:14.067645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:14.079783 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8c7ac88-4bca-430c-8f28-bb79f387c118 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1484 microversion: 2.1 time: 0.514003 Jun 18 22:26:14.081890 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2657/5331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:13 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1484 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:14.261872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1551240428", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:14.345627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:14.347078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] validate_networks() for [('514c5463-b7bc-4e63-9bdf-3ed56386de4c', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:26:14.365760 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c94a07ea-4b77-43db-b76d-4110143c0b29 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1360 microversion: 2.1 time: 0.334516 Jun 18 22:26:14.366714 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2675/5332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:14 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1360 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:14.535195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:14.535909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:14.546996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:14.553647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:14.556979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:14.557840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.233589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:15.254983 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d40248a7-d3a6-4e08-88ed-d239ce5edfe3 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.715082 Jun 18 22:26:15.256099 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2676/5333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:14 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:15.273771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:15.274334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:15.287640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.288390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.289382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.289985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.373232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:26:15.374420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:26:15.375171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:26:15.375888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:26:15.377147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:26:15.395526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.396066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.396962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.397555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.447375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Getting quotas for project 8f9a7d50200443418ef0c6a20a608bb9. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:26:15.453926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Getting quotas for user 39c2337d42bc426abed2ed2fb5000753 and project 8f9a7d50200443418ef0c6a20a608bb9. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:26:15.481660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:26:15.485434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:26:15.635971 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3600cd3e-900d-4d67-80c9-3e58242671b2 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.375672 Jun 18 22:26:15.637387 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2658/5334] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:26:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:26:15.658869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:15.664507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:15.666157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:15.674094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.674854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.676945 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d6dda4ea-8826-4925-bd50-32e50b4bc557 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.406866 Jun 18 22:26:15.690346 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2677/5335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:15 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:15.690577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.690577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.702785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aad4a082-7cba-4ad7-954c-6f7f93a6b37f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:15.709380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aad4a082-7cba-4ad7-954c-6f7f93a6b37f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:15.823180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aad4a082-7cba-4ad7-954c-6f7f93a6b37f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:15.832406 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aad4a082-7cba-4ad7-954c-6f7f93a6b37f tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1214 microversion: 2.1 time: 0.149581 Jun 18 22:26:15.842155 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2678/5336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:15 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:15.845987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:15.846626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:15.862607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.862996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:15.863786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:15.864209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.190396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:16.211759 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75fd285e-edb1-4209-9f46-ce7ec031c945 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1360 microversion: 2.1 time: 0.568340 Jun 18 22:26:16.216429 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2659/5337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:15 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1360 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:16.219022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:16.237012 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20836365-28e8-4a52-9e65-db4e2b027ce6 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.398715 Jun 18 22:26:16.238619 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2679/5338] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:15 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:16.258995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f3f905d-a523-4e7e-ade5-72fdea6c3b41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:16.268992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5f3f905d-a523-4e7e-ade5-72fdea6c3b41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance ecdefce7-a504-4a77-9c8a-f88b412b5d6c has no mapping to a cell. Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f3f905d-a523-4e7e-ade5-72fdea6c3b41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/ecdefce7-a504-4a77-9c8a-f88b412b5d6c/action HTTP/1.1 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: {"os-stop": {}} Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance ecdefce7-a504-4a77-9c8a-f88b412b5d6c has no mapping to a cell. Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'ecdefce7-a504-4a77-9c8a-f88b412b5d6c', 'body': {'os-stop': {}}} Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance ecdefce7-a504-4a77-9c8a-f88b412b5d6c has no mapping to a cell. Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:16.286837 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdefce7-a504-4a77-9c8a-f88b412b5d6c has no mapping to a cell. Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdefce7-a504-4a77-9c8a-f88b412b5d6c has no mapping to a cell. Jun 18 22:26:16.292497 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.295453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f3f905d-a523-4e7e-ade5-72fdea6c3b41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance ecdefce7-a504-4a77-9c8a-f88b412b5d6c has no mapping to a cell. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:16.296639 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5f3f905d-a523-4e7e-ade5-72fdea6c3b41 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/ecdefce7-a504-4a77-9c8a-f88b412b5d6c/action" status: 404 len: 117 microversion: 2.1 time: 0.043546 Jun 18 22:26:16.298088 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2660/5339] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:16 2022] POST /compute/v2.1/servers/ecdefce7-a504-4a77-9c8a-f88b412b5d6c/action => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:16.308646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:16.309523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:16.327496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:16.328096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.330442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:16.332600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.550807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:16.564668 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-147508c9-e93b-4d58-8714-7a8dbab8652e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.261609 Jun 18 22:26:16.565305 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2680/5340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:16 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:16.586212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:16.586973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:16.608128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:16.612667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.613628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:16.614091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.849828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:16.850624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:16.861934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:16.870665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.873118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:16.877575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:16.946289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:16.958014 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-305d5ac7-f996-4bc7-a22b-82bbcb289136 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.377679 Jun 18 22:26:16.966821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2661/5341] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:16 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:16.981608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-49e31c74-f0e7-4027-a915-8ae21a810f06 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:16.983415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-49e31c74-f0e7-4027-a915-8ae21a810f06 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 3ccb2130-e2f9-4532-a05d-bd0c7d051f93] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:16.994331 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-49e31c74-f0e7-4027-a915-8ae21a810f06 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 3ccb2130-e2f9-4532-a05d-bd0c7d051f93 could not be found. Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-49e31c74-f0e7-4027-a915-8ae21a810f06 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/3ccb2130-e2f9-4532-a05d-bd0c7d051f93/action HTTP/1.1 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: {"suspend": {}} Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 3ccb2130-e2f9-4532-a05d-bd0c7d051f93 could not be found. Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3ccb2130-e2f9-4532-a05d-bd0c7d051f93', 'body': {'suspend': {}}} Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ccb2130-e2f9-4532-a05d-bd0c7d051f93 could not be found. Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ccb2130-e2f9-4532-a05d-bd0c7d051f93 could not be found. Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:16.996354 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ccb2130-e2f9-4532-a05d-bd0c7d051f93 could not be found. Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-49e31c74-f0e7-4027-a915-8ae21a810f06 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 3ccb2130-e2f9-4532-a05d-bd0c7d051f93 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-49e31c74-f0e7-4027-a915-8ae21a810f06 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/3ccb2130-e2f9-4532-a05d-bd0c7d051f93/action" status: 404 len: 111 microversion: 2.1 time: 0.023464 Jun 18 22:26:17.008496 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2662/5342] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:16 2022] POST /compute/v2.1/servers/3ccb2130-e2f9-4532-a05d-bd0c7d051f93/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:17.016206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:17.017022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:17.071540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:17.075339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:17.078680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:17.079696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:17.085605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:17.104657 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-385b9534-b2db-4887-8ca7-b5297c411625 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1266 microversion: 2.1 time: 0.254714 Jun 18 22:26:17.106034 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2681/5343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:16 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:17.123111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:17.233639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:17.234349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:17.267095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:17.270736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:17.273340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:17.274098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:17.395924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:17.410334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e090b462-775e-4bb6-a3cf-70f8260a3ea8 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.406649 Jun 18 22:26:17.411972 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2663/5344] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:17 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:17.437960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:17.444959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:17.458614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:17.460414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:17.463950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:17.464407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.190746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:18.201350 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ceb3c0c3-5a1a-490a-bec8-88858b5d07fb tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.770386 Jun 18 22:26:18.206120 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2664/5345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:17 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:18.217348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:18.218363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:18.234277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:18.235329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.236362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:18.237003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.405732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:18.423554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a3ffa40-74bb-4e8b-b7a7-0578d0781280 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1272 microversion: 2.1 time: 0.215884 Jun 18 22:26:18.424513 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2665/5346] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:18 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:18.429546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:18.430352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:18.445798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:18.446687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.447889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:18.449665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.496316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lazy-loading 'flavor' on Instance uuid 82678d7b-d3bf-4ed3-b8f9-945d2279172e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:26:18.639542 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef02ca01-9322-4a4d-94e2-723a9f43083d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 202 len: 0 microversion: 2.1 time: 0.213239 Jun 18 22:26:18.643851 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2666/5347] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:18 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:26:18.651151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:18.652370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:18.660921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:18.661854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.663168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:18.664374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:18.974128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:18.989309 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c67ea9e-fa6a-41f7-a4d5-393d275adf8c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1360 microversion: 2.1 time: 1.760666 Jun 18 22:26:18.990795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2682/5348] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:17 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1360 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:19.402349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:19.416735 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-144c09b5-1374-49a1-966b-e706e48eb1ee tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1512 microversion: 2.1 time: 0.769817 Jun 18 22:26:19.417789 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2667/5349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:18 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1512 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:19.443805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:19.444503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:19.467159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:19.468572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:19.482870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:19.483644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:19.563163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=100 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:19.841609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-029107b8-d088-4f9f-abc9-b8e5fbbd6035 req-70c56489-490d-4084-b1dc-05f67f835d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a0ac3f-2e1b-423a-8476-d9deb8eec449", "name": "network-vif-plugged", "status": "completed", "tag": "754bea67-c445-4d31-9cd9-8d467714927d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:19.877411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-029107b8-d088-4f9f-abc9-b8e5fbbd6035 req-70c56489-490d-4084-b1dc-05f67f835d46 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:19.877990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-029107b8-d088-4f9f-abc9-b8e5fbbd6035 req-70c56489-490d-4084-b1dc-05f67f835d46 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:19.935284 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-029107b8-d088-4f9f-abc9-b8e5fbbd6035 req-70c56489-490d-4084-b1dc-05f67f835d46 service nova] Creating event network-vif-plugged:754bea67-c445-4d31-9cd9-8d467714927d for instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 on nch1-master-1 Jun 18 22:26:19.956239 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-029107b8-d088-4f9f-abc9-b8e5fbbd6035 req-70c56489-490d-4084-b1dc-05f67f835d46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121363 Jun 18 22:26:19.959354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2668/5350] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:20.015602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:20.017911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:20.071319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:20.072068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:20.075796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:20.077785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.160777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:21.192124 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa09ccc3-5119-4a4b-bc0a-ccef69089637 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1314 microversion: 2.1 time: 1.753504 Jun 18 22:26:21.195637 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2683/5351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:19 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1314 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:21.237439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:21.238420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:21.248420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.249439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.250818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.251872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.579588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:21.603147 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a32bb52d-15d0-446f-aac4-3605090cec7f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1360 microversion: 2.1 time: 1.595647 Jun 18 22:26:21.605618 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2669/5352] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:20 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1360 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:21.616303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-fa53569d-5798-4c4b-aad6-0dfa2e936e80 req-0ed48ba5-39aa-4aa8-9d09-86d9ee1a8de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e44f1a-a481-48b6-84f5-4e4f9f896966", "tag": "69e23949-9056-4586-ace6-2e3ba0d61572"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:21.632695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fa53569d-5798-4c4b-aad6-0dfa2e936e80 req-0ed48ba5-39aa-4aa8-9d09-86d9ee1a8de9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.634087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fa53569d-5798-4c4b-aad6-0dfa2e936e80 req-0ed48ba5-39aa-4aa8-9d09-86d9ee1a8de9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.656019 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-fa53569d-5798-4c4b-aad6-0dfa2e936e80 req-0ed48ba5-39aa-4aa8-9d09-86d9ee1a8de9 service nova] Creating event network-changed:69e23949-9056-4586-ace6-2e3ba0d61572 for instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 on nch2-master-1 Jun 18 22:26:21.663849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-fa53569d-5798-4c4b-aad6-0dfa2e936e80 req-0ed48ba5-39aa-4aa8-9d09-86d9ee1a8de9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054981 Jun 18 22:26:21.665075 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2670/5353] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:21.673211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:21.674276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:21.682572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.684538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.685574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.687216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.708814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:21.743846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4fc6ad41-9382-45b3-bd72-72d212c255a1 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1495 microversion: 2.1 time: 0.543525 Jun 18 22:26:21.753472 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2684/5354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:21 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1495 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:21.775228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6218ee41-37b6-40f5-8759-76e3d310faf4 req-b274f9b7-ee7e-4aff-bd06-55f83cf54656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:21.818918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6218ee41-37b6-40f5-8759-76e3d310faf4 req-b274f9b7-ee7e-4aff-bd06-55f83cf54656 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.824217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:26:21.825907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6218ee41-37b6-40f5-8759-76e3d310faf4 req-b274f9b7-ee7e-4aff-bd06-55f83cf54656 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.876207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6218ee41-37b6-40f5-8759-76e3d310faf4 req-b274f9b7-ee7e-4aff-bd06-55f83cf54656 service nova] Creating event network-changed:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:26:21.894362 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6218ee41-37b6-40f5-8759-76e3d310faf4 req-b274f9b7-ee7e-4aff-bd06-55f83cf54656 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131202 Jun 18 22:26:21.895471 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2685/5355] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:21.916022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:21.917736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:21.928797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.931727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:21.933323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:21.934240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.003725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lazy-loading 'flavor' on Instance uuid 82678d7b-d3bf-4ed3-b8f9-945d2279172e {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:26:22.035498 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'suspend' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state suspended Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 15 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: {"suspend": {}} Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'suspend' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state suspended Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'suspend': {}}} Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state suspended. Cannot suspend while the instance is in this state. Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jun 18 22:26:22.059573 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state suspended Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state suspended Jun 18 22:26:22.064873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:22.069387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'suspend' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state suspended {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:22.071080 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-faa7fdbc-c345-444a-af06-0f3c11aad8e9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 148 microversion: 2.1 time: 0.174239 Jun 18 22:26:22.074739 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2686/5356] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:21 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 148 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:26:22.084991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:22.088022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:22.104451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:22.113371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.117634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:22.128940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.250150 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68b39077-3cb8-48e6-82c3-c3d8d711abd0 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 204 len: 0 microversion: 2.1 time: 0.580794 Jun 18 22:26:22.252889 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2671/5357] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:26:21 2022] DELETE /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:26:22.273540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:22.274702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:22.316619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:22.320930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.324205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:22.327993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.399073 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62e244c8-e71c-4ea2-86f1-404b476c7619 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 202 len: 0 microversion: 2.1 time: 0.320734 Jun 18 22:26:22.403665 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2687/5358] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:22 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:26:22.416553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:22.418200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:22.437563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:22.438159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.441424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:22.443038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:22.985783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:23.010089 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9653855c-a479-44f9-8d95-d07e0d9d86f8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1314 microversion: 2.1 time: 0.747269 Jun 18 22:26:23.010313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:23.010720 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2672/5359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:22 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:23.018729 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5f122e6a-12ea-4190-af28-d841fb30211b tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1583 microversion: 2.1 time: 0.613714 Jun 18 22:26:23.019302 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2688/5360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:22 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1583 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:23.027652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:23.030167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:23.038733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:23.039766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:23.041917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:23.042553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:23.051233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:23.057666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:23.068973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:23.069459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:23.074772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:23.075260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:23.770556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:23.783749 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eb92b2cc-29ab-4978-a0c2-6ada040b7004 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1546 microversion: 2.1 time: 0.763365 Jun 18 22:26:23.785897 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2689/5361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:23 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1546 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:23.798280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:23.822794 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80077412-9e89-4a28-a965-cfdba3cc4304 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1501 microversion: 2.1 time: 0.810811 Jun 18 22:26:23.823684 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2673/5362] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:23 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1501 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:23.828516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:23.830758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:23.848877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:23.849574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:23.851742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:23.855074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:24.027264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:24.028629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:24.038261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:24.048842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:24.049747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:24.050188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:24.116138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16ffb26f-2ca7-4698-8b20-720e0511bf58 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.307361 Jun 18 22:26:24.117198 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2690/5363] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:26:23 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:24.145853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:24.147705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:24.167068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:24.168618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:24.175771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:24.176928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:24.597298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:24.610357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8eceb762-1418-4fad-973a-6f7c2343adf6 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1314 microversion: 2.1 time: 0.585951 Jun 18 22:26:24.612445 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2674/5364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:24 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:24.621453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:24.629894 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa99a3d2-d706-45af-a151-70c19e41a8c9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1583 microversion: 2.1 time: 0.511384 Jun 18 22:26:24.636780 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2691/5365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:24 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1583 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:24.842920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:24.843965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:24.855689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:24.856438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:24.861213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:24.861928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:25.204596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:25.218898 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06592d6f-3244-4c03-995f-38c453dd04af tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1501 microversion: 2.1 time: 0.381364 Jun 18 22:26:25.229290 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2675/5366] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:24 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1501 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:25.630760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:25.632059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:25.635628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:25.647813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:25.648434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:25.648646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:25.649541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:25.651186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:25.651879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:25.653587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:25.654287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:25.687481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:25.687995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:25.688798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:25.689648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:25.832291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:26.142071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:26.155287 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e71894a5-52e5-40bf-9057-1c81e8bda084 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1314 microversion: 2.1 time: 0.529036 Jun 18 22:26:26.167278 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2692/5367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:25 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:26.217921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:26.232234 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fdf2a46-9fb7-4f1e-ad75-607071c5fcc9 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1583 microversion: 2.1 time: 0.586271 Jun 18 22:26:26.242526 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2676/5368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:25 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1583 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:26.246638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:26.247356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:26.257381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:26.259365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:26.261814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:26.262351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:26.972932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a3a61ff9-737a-40b7-9d23-0aa141f5d011 req-36c4f80f-ca56-4d1b-982a-5830f8556edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e44f1a-a481-48b6-84f5-4e4f9f896966", "name": "network-vif-plugged", "status": "completed", "tag": "69e23949-9056-4586-ace6-2e3ba0d61572"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:26.998853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a3a61ff9-737a-40b7-9d23-0aa141f5d011 req-36c4f80f-ca56-4d1b-982a-5830f8556edf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:26.999914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a3a61ff9-737a-40b7-9d23-0aa141f5d011 req-36c4f80f-ca56-4d1b-982a-5830f8556edf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.015465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:27.033948 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a3a61ff9-737a-40b7-9d23-0aa141f5d011 req-36c4f80f-ca56-4d1b-982a-5830f8556edf service nova] Creating event network-vif-plugged:69e23949-9056-4586-ace6-2e3ba0d61572 for instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 on nch2-master-1 Jun 18 22:26:27.044214 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a3a61ff9-737a-40b7-9d23-0aa141f5d011 req-36c4f80f-ca56-4d1b-982a-5830f8556edf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077398 Jun 18 22:26:27.046134 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2677/5369] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:27.047716 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2be78f51-aaa8-4db9-a602-e1b6c9d4cbc5 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.812846 Jun 18 22:26:27.048344 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2693/5370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:26 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:27.094280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:27.096113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:27.112146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.113637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.115155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.116932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.175581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:27.176830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:27.188664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.189361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.193798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.194508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.618241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:27.629075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e37a76da-cdec-4d7a-9a85-aa295117680d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1314 microversion: 2.1 time: 0.458471 Jun 18 22:26:27.632173 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2694/5371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:27 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:27.647312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:27.651196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:27.661529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.662196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.663176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.663785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.672997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:27.677392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:27.689907 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-469eb1af-bf45-4773-91f2-54cc1ab36728 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.604506 Jun 18 22:26:27.691318 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2678/5372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:27 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:27.709392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6bfcc6ce-370d-414a-b57b-0d84c42df104 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:27.710271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6bfcc6ce-370d-414a-b57b-0d84c42df104 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: d349266e-af10-432f-bfad-732eb5431bb7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:27.725417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6bfcc6ce-370d-414a-b57b-0d84c42df104 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance d349266e-af10-432f-bfad-732eb5431bb7 could not be found. Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6bfcc6ce-370d-414a-b57b-0d84c42df104 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/d349266e-af10-432f-bfad-732eb5431bb7/action HTTP/1.1 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 15 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: {"unpause": {}} Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance d349266e-af10-432f-bfad-732eb5431bb7 could not be found. Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd349266e-af10-432f-bfad-732eb5431bb7', 'body': {'unpause': {}}} Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d349266e-af10-432f-bfad-732eb5431bb7 could not be found. Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d349266e-af10-432f-bfad-732eb5431bb7 could not be found. Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:27.728870 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:27.735610 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:27.735610 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:27.735610 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d349266e-af10-432f-bfad-732eb5431bb7 could not be found. Jun 18 22:26:27.735610 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:27.738837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6bfcc6ce-370d-414a-b57b-0d84c42df104 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance d349266e-af10-432f-bfad-732eb5431bb7 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:27.739949 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6bfcc6ce-370d-414a-b57b-0d84c42df104 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/d349266e-af10-432f-bfad-732eb5431bb7/action" status: 404 len: 111 microversion: 2.1 time: 0.035740 Jun 18 22:26:27.740973 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2679/5373] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:27 2022] POST /compute/v2.1/servers/d349266e-af10-432f-bfad-732eb5431bb7/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:27.750231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:27.765100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:27.798209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.798721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.802431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.803173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.850239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01ecbaf0e5004723bd6a96296ea135d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '106e2aa0adfd40da9a2d689f3b4653db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:27.858798 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ac1dab10-6c5f-4e24-a66b-063fc3f14af4 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 200 len: 1398 microversion: 2.1 time: 0.225243 Jun 18 22:26:27.863178 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2695/5374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:27 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 1398 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:27.893977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ecdac178-264d-4555-b2b4-bba98bb0a8d0 req-8683daa0-dc7a-4959-9503-cf4b8ab99407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13cfe0a-259d-4aa8-afda-3b2bb4de94bb", "name": "network-vif-deleted", "tag": "46e151f1-9ba2-4d05-a38d-85f55ad0a3ea"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:27.903769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ecdac178-264d-4555-b2b4-bba98bb0a8d0 req-8683daa0-dc7a-4959-9503-cf4b8ab99407 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:27.904528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ecdac178-264d-4555-b2b4-bba98bb0a8d0 req-8683daa0-dc7a-4959-9503-cf4b8ab99407 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:27.919584 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ecdac178-264d-4555-b2b4-bba98bb0a8d0 req-8683daa0-dc7a-4959-9503-cf4b8ab99407 service nova] Creating event network-vif-deleted:46e151f1-9ba2-4d05-a38d-85f55ad0a3ea for instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb on nch1-master-1 Jun 18 22:26:27.926465 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ecdac178-264d-4555-b2b4-bba98bb0a8d0 req-8683daa0-dc7a-4959-9503-cf4b8ab99407 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061407 Jun 18 22:26:27.927350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2696/5375] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:28.331834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:28.347161 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18fee2ed-3ca5-45d6-b9e5-8a97bd211c2e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.601948 Jun 18 22:26:28.362405 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2680/5376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:27 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:28.366697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:28.367403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:28.379875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.380330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.381888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.382331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.649132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:28.649813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:28.666071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:28.676566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.678151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.681055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.686532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.813394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:28.829197 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-983aee74-2810-4504-ab40-63e501b1e74d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.467597 Jun 18 22:26:28.830035 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2697/5377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:28 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:28.849004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:28.850036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:28.857603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.858341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.859344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.860148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.890315 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'unpause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 15 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: {"unpause": {}} Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: exception: Cannot 'unpause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'unpause': {}}} Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state active. Cannot unpause while the instance is in this state. Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:28.892670 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:28.897321 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:28.897321 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:28.897321 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:28.897321 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:28.897321 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.899686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'unpause' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:28.900829 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5dad737-7126-4ec6-9e62-0968b2fb519f tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 145 microversion: 2.1 time: 0.057941 Jun 18 22:26:28.902025 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2698/5378] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:28 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 18 22:26:28.907686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:28.909584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] [instance: c13cfe0a-259d-4aa8-afda-3b2bb4de94bb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:28.920983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.921831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.922939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.923805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.941385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] HTTP exception thrown: Instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb could not be found. Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Request method failure captured: Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb HTTP/1.1 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlBs0SVqogxikZppda1IgOLpk2N1DjNXRO8uIm_gCNIEBqYXWYyVyKvMZOUqtNBwsRFK38ql4AiFS8F0XEzF4rOi31ouLRIWBhKblrw8D5bTvyS1q34eKPR_uy9jz2jWTZhOSO6Uxb1CKVDcTdSUjW6LUqHxXoZdI_WS_KshXXlJq5g Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 106e2aa0adfd40da9a2d689f3b4653db Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBackupRestore-341744755 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/106e2aa0adfd40da9a2d689f3b4653db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/106e2aa0adfd40da9a2d689f3b4653db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/106e2aa0adfd40da9a2d689f3b4653db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_106e2aa0adfd40da9a2d689f3b4653db", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBackupRestore-341744755 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 106e2aa0adfd40da9a2d689f3b4653db Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBackupRestore-341744755 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBackupRestore-341744755-project Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 01ecbaf0e5004723bd6a96296ea135d8 Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBackupRestore-341744755-project Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb could not be found. Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'c13cfe0a-259d-4aa8-afda-3b2bb4de94bb'} Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb could not be found. Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb could not be found. Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:28.943450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb could not be found. Jun 18 22:26:28.948742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:28.951229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Returning 404 to user: Instance c13cfe0a-259d-4aa8-afda-3b2bb4de94bb could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:28.951398 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d18aae7-8d3f-407d-97bc-e39746ff4b96 tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb" status: 404 len: 111 microversion: 2.1 time: 0.047848 Jun 18 22:26:28.960330 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2699/5379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:28 2022] GET /compute/v2.1/servers/c13cfe0a-259d-4aa8-afda-3b2bb4de94bb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:28.968232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:28.970705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:28.986068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.986537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:28.987494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:28.990191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:29.184036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:29.197674 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-685f8596-9bda-4a30-9170-e8306e5b1925 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1314 microversion: 2.1 time: 0.550960 Jun 18 22:26:29.200638 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2681/5380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:28 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:29.349371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:29.376595 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09c3b68a-a6b9-434b-a1b4-80663b233a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.409468 Jun 18 22:26:29.380127 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2700/5381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:28 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:29.404828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:29.406155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:29.427571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:29.433608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:29.437966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:29.441355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:29.582470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83aba922-c494-496c-8293-1bb1007f404c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] Calling method '.version_select at 0x7fea06f9cd30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:29.637198 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83aba922-c494-496c-8293-1bb1007f404c tempest-TestVolumeBackupRestore-341744755 tempest-TestVolumeBackupRestore-341744755-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2000751185" status: 202 len: 0 microversion: 2.1 time: 0.059025 Jun 18 22:26:29.643010 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2701/5382] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2000751185 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:26:29.783169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:29.794359 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4160c575-c68f-4902-81bf-d59f096f11a4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.394534 Jun 18 22:26:29.805978 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2682/5383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:29 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:29.817170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa3b923a-53eb-4259-a61a-0494bca8dbf9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:29.817745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa3b923a-53eb-4259-a61a-0494bca8dbf9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 32cdcfc0-4731-456f-ae2b-17f59dff959b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:29.831399 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-aa3b923a-53eb-4259-a61a-0494bca8dbf9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 32cdcfc0-4731-456f-ae2b-17f59dff959b could not be found. Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa3b923a-53eb-4259-a61a-0494bca8dbf9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/32cdcfc0-4731-456f-ae2b-17f59dff959b/action HTTP/1.1 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 18 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: {"unshelve": null} Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 32cdcfc0-4731-456f-ae2b-17f59dff959b could not be found. Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '32cdcfc0-4731-456f-ae2b-17f59dff959b', 'body': {'unshelve': None}} Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32cdcfc0-4731-456f-ae2b-17f59dff959b could not be found. Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32cdcfc0-4731-456f-ae2b-17f59dff959b could not be found. Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:29.835097 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32cdcfc0-4731-456f-ae2b-17f59dff959b could not be found. Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:29.841961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa3b923a-53eb-4259-a61a-0494bca8dbf9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 32cdcfc0-4731-456f-ae2b-17f59dff959b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:29.843432 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa3b923a-53eb-4259-a61a-0494bca8dbf9 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/32cdcfc0-4731-456f-ae2b-17f59dff959b/action" status: 404 len: 111 microversion: 2.1 time: 0.034037 Jun 18 22:26:29.848567 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2702/5384] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:29 2022] POST /compute/v2.1/servers/32cdcfc0-4731-456f-ae2b-17f59dff959b/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:26:29.859865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:29.860909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:29.869386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:29.873198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:29.874813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:29.875336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:29.959398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-553b3a98-095c-4241-bc66-b1777d4813ce req-e388c600-1ed9-4566-8252-225ae14085c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a0ac3f-2e1b-423a-8476-d9deb8eec449", "tag": "754bea67-c445-4d31-9cd9-8d467714927d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:29.976627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-553b3a98-095c-4241-bc66-b1777d4813ce req-e388c600-1ed9-4566-8252-225ae14085c9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:29.978237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-553b3a98-095c-4241-bc66-b1777d4813ce req-e388c600-1ed9-4566-8252-225ae14085c9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.006879 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-553b3a98-095c-4241-bc66-b1777d4813ce req-e388c600-1ed9-4566-8252-225ae14085c9 service nova] Creating event network-changed:754bea67-c445-4d31-9cd9-8d467714927d for instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 on nch1-master-1 Jun 18 22:26:30.018217 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-553b3a98-095c-4241-bc66-b1777d4813ce req-e388c600-1ed9-4566-8252-225ae14085c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065076 Jun 18 22:26:30.042449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2703/5385] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:30.218480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:30.221366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:30.221756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:30.230439 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65d83b49-d67c-4453-8e90-d2f7dfb3418d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.377505 Jun 18 22:26:30.232024 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2683/5386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:29 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:30.246420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.247752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.248679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.249156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.252069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:30.254183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:30.269955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.272290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.273332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.274542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.285831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:30.681020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:30.695848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8580f6c7-eba4-4f36-abc7-0ae60a28fff4 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.448722 Jun 18 22:26:30.696801 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2684/5387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:30 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:30.703822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:30.712545 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-23f20790-34e3-456a-9aa6-4522a3d7a8ac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1500 microversion: 2.1 time: 0.500263 Jun 18 22:26:30.713224 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2704/5388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:30 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1500 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:30.733001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:30.734221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:30.737516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:30.741427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:30.754939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.760192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.763815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.764521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.765777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.767883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.769954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.770664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.813234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lazy-loading 'flavor' on Instance uuid d5e44f1a-a481-48b6-84f5-4e4f9f896966 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:26:30.837499 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Cannot 'unshelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action HTTP/1.1 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 18 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: {"unshelve": null} Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: exception: Cannot 'unshelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'unshelve': None}} Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e in vm_state active. Cannot unshelve while the instance is in this state. Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 18 22:26:30.847714 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 409 to user: Cannot 'unshelve' instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e while it is in vm_state active {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-daff132e-bcdb-411d-ab08-4733b894672d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action" status: 409 len: 146 microversion: 2.1 time: 0.138950 Jun 18 22:26:30.860605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2685/5389] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:30 2022] POST /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:26:30.866814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:30.867455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:30.896192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.901754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.904753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:30.907301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:30.979186 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9366b048-5280-4498-a20b-b77415a4ef66 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "POST /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966/action" status: 200 len: 32 microversion: 2.1 time: 0.250203 Jun 18 22:26:30.986859 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2705/5390] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:26:30 2022] POST /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:26:30.995408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:30.996115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:31.005286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:31.006127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:31.007363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:31.008384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:31.259454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:31.272442 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9cee8ddd-15dc-44a2-b52c-665ba595cc37 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.283637 Jun 18 22:26:31.273126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2706/5391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:30 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:31.312215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:31.328780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f390a212-9c4f-47e8-94ea-a39477409fca tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.467532 Jun 18 22:26:31.330670 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2686/5392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:30 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:31.354423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:31.355340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:31.362915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:31.363882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:31.365485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:31.366835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:31.645310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:31.654899 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e9063b9-009a-4e63-b1bc-563d3395391b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.306366 Jun 18 22:26:31.655493 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2707/5393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:31 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:31.677102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d976078f-6737-4700-b1da-5bbff2f2552d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1426581080_updated"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:31.678854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d976078f-6737-4700-b1da-5bbff2f2552d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: b295228c-3a9f-4868-a4fb-956c0bb153e7] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:31.695614 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d976078f-6737-4700-b1da-5bbff2f2552d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance b295228c-3a9f-4868-a4fb-956c0bb153e7 could not be found. Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d976078f-6737-4700-b1da-5bbff2f2552d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/servers/b295228c-3a9f-4868-a4fb-956c0bb153e7 HTTP/1.1 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 81 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1426581080_updated"}} Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance b295228c-3a9f-4868-a4fb-956c0bb153e7 could not be found. Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'b295228c-3a9f-4868-a4fb-956c0bb153e7', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1426581080_updated'}}} Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b295228c-3a9f-4868-a4fb-956c0bb153e7 could not be found. Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 18 22:26:31.701624 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b295228c-3a9f-4868-a4fb-956c0bb153e7 could not be found. Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b295228c-3a9f-4868-a4fb-956c0bb153e7 could not be found. Jun 18 22:26:31.708469 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:31.714466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d976078f-6737-4700-b1da-5bbff2f2552d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance b295228c-3a9f-4868-a4fb-956c0bb153e7 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:31.717057 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d976078f-6737-4700-b1da-5bbff2f2552d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "PUT /compute/v2.1/servers/b295228c-3a9f-4868-a4fb-956c0bb153e7" status: 404 len: 111 microversion: 2.1 time: 0.043434 Jun 18 22:26:31.721583 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2687/5394] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:26:31 2022] PUT /compute/v2.1/servers/b295228c-3a9f-4868-a4fb-956c0bb153e7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:31.730425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:31.732356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:31.745181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:31.745749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:31.747377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:31.748039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.018075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:32.035211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c1c178e-6130-4ea7-801e-49de0d525a5d tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.310524 Jun 18 22:26:32.044057 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2708/5395] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:31 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:32.071388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:32.072292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:32.082439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.083031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.084751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.085536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.252709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:32.263658 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f1b94662-8284-4c83-b913-60806e4fd1fa tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.206429 Jun 18 22:26:32.264545 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2688/5396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:32 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:32.280529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e188165-68cb-413c-b116-2f23fc6a0115 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e188165-68cb-413c-b116-2f23fc6a0115 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: request: PUT /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e HTTP/1.1 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 280 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.283167 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e188165-68cb-413c-b116-2f23fc6a0115 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e188165-68cb-413c-b116-2f23fc6a0115 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "PUT /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 400 len: 619 microversion: 2.1 time: 0.008421 Jun 18 22:26:32.287164 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2709/5397] 10.222.0.30 () {60 vars in 1256 bytes} [Sat Jun 18 22:26:32 2022] PUT /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:26:32.300467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:32.302651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:32.303265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:32.305241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:32.317074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.317532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.318312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.318747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.324252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.324956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.326355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.326953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.542095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:32.551857 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-255b70ed-43d9-4f18-978f-06b448a85b21 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.255570 Jun 18 22:26:32.554887 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2710/5398] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:32 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:32.579898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:32.580796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:32.597950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.598498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.599614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.602360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.629271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:32.659003 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7defd421-fcb5-4eef-8c83-ec1de077c177 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.371103 Jun 18 22:26:32.669100 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2689/5399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:32 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:32.843203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:32.856923 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c640fb80-c86d-42f4-9dce-9ab61f87b68b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.287967 Jun 18 22:26:32.858337 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2711/5400] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:32 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:32.875274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3f0b11d-f879-4be5-b01d-ec6124f0f33e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3f0b11d-f879-4be5-b01d-ec6124f0f33e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: request: PUT /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e HTTP/1.1 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 24 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: {"server": {"name": ""}} Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e', 'body': {'server': {'name': ''}}} Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi '' Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:26:32.877774 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3f0b11d-f879-4be5-b01d-ec6124f0f33e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3f0b11d-f879-4be5-b01d-ec6124f0f33e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "PUT /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 400 len: 108 microversion: 2.1 time: 0.008303 Jun 18 22:26:32.885193 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2690/5401] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:26:32 2022] PUT /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:26:32.895621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:32.896427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:32.905351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.906137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:32.907196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:32.907877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:33.179476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:33.191975 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15b5db7b-02d2-4af2-9841-21a7212394a7 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1504 microversion: 2.1 time: 0.302996 Jun 18 22:26:33.193925 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2712/5402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:32 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:33.676596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:33.678132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:33.693408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:33.694192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:33.696571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:33.697628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:34.101419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:34.110255 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f88d5d3d-40d8-44c0-abf9-7376c08230b1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.438415 Jun 18 22:26:34.115084 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2691/5403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:33 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:35.131030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:35.132697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:35.143519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.144390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.145296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.146183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.411285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:35.440523 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5596e5ab-23eb-45dd-935a-0d8b5dfbd8b5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.314121 Jun 18 22:26:35.453475 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2713/5404] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:35 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:35.602398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:35.603811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:35.626418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.628363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.629911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.631744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.667076 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 HTTP/1.1 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '1c398202-642e-4031-bdc4-f9fc17356756'} Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:35.669913 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.675177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.676296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:35.677245 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24aaf002-1782-4ee4-b100-5214eee9bc5b tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 404 len: 111 microversion: 2.1 time: 0.078851 Jun 18 22:26:35.683131 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2692/5405] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:26:35 2022] DELETE /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:35.694305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:35.694931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 1c398202-642e-4031-bdc4-f9fc17356756] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:35.705281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.705733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.706848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.706979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.763567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 HTTP/1.1 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1c398202-642e-4031-bdc4-f9fc17356756'} Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:35.770888 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 1c398202-642e-4031-bdc4-f9fc17356756 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:35.776120 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0de9d097-695d-4e35-a0d7-e027bdaba19e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756" status: 404 len: 111 microversion: 2.1 time: 0.086979 Jun 18 22:26:35.781982 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2714/5406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:35 2022] GET /compute/v2.1/servers/1c398202-642e-4031-bdc4-f9fc17356756 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:35.785828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:35.786461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:35.800984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.800984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.801982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:35.804925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:35.884986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:26:36.060304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e179c8e3-2828-4473-95cd-8b949ceab527 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 204 len: 0 microversion: 2.1 time: 0.279692 Jun 18 22:26:36.065658 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2693/5407] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:26:35 2022] DELETE /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:26:36.073670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:36.074430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:36.086845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:36.090391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:36.093802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:36.096199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:36.459824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:36.460704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:36.472261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:36.481848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:36.482258 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ed71236-77f7-4f0d-8b28-82859cb13904 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.413630 Jun 18 22:26:36.482565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:36.484216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:36.490501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:36.493207 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2715/5408] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:36 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:36.930852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:36.956184 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d23de0f6-a800-4881-9135-89aa9ad9fe12 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.497827 Jun 18 22:26:36.957294 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2694/5409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:36 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:37.504190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:37.506503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:37.523515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:37.524691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:37.527567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:37.529308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:37.763439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:37.772802 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-891197e2-9fff-4748-a2bf-4af9761f67be tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.276917 Jun 18 22:26:37.785422 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2716/5410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:37 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:37.973935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:37.974557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:37.983464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:37.987778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:37.991361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:37.994479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:38.498035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:38.507021 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe05a9d0-3aba-4fd7-8a45-89482d20fca8 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.536902 Jun 18 22:26:38.521675 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2695/5411] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:37 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:38.791699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:38.792304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:38.810760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:38.818825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:38.819834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:38.820327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:39.377456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-5b3051d1-30cd-410f-802b-0264d1b817f0 req-29b17a69-e22a-45e5-9c88-360f5d7d337f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82678d7b-d3bf-4ed3-b8f9-945d2279172e", "name": "network-vif-deleted", "tag": "c53d5f7e-99ad-4718-b288-9c6b747e1b74"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:26:39.393832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5b3051d1-30cd-410f-802b-0264d1b817f0 req-29b17a69-e22a-45e5-9c88-360f5d7d337f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:39.394759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-5b3051d1-30cd-410f-802b-0264d1b817f0 req-29b17a69-e22a-45e5-9c88-360f5d7d337f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:39.414403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-5b3051d1-30cd-410f-802b-0264d1b817f0 req-29b17a69-e22a-45e5-9c88-360f5d7d337f service nova] Creating event network-vif-deleted:c53d5f7e-99ad-4718-b288-9c6b747e1b74 for instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e on nch1-master-1 Jun 18 22:26:39.430887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-5b3051d1-30cd-410f-802b-0264d1b817f0 req-29b17a69-e22a-45e5-9c88-360f5d7d337f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060414 Jun 18 22:26:39.442099 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2696/5412] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:26:39.536768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:39.539254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:39.573644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:39.577350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:39.583520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:39.586155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:39.610498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '719d3fb4f7f44c239e03b5f7076edcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a88cba0e44af4875b05d6c3546cf0543', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:39.627518 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-71ecd1f3-fc03-4176-8ac3-5593f01e07b0 tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 200 len: 1510 microversion: 2.1 time: 0.839619 Jun 18 22:26:39.653815 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2717/5413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:38 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 1510 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:39.973855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:39.986686 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7f975a4-0ded-49e6-81af-af04569ce7c5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.462093 Jun 18 22:26:39.987976 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2697/5414] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:39 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:40.659350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:40.660176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] [instance: 82678d7b-d3bf-4ed3-b8f9-945d2279172e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:40.669955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:40.670681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:40.671948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:40.672686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:40.692981 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] HTTP exception thrown: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e could not be found. Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Request method failure captured: Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e HTTP/1.1 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlAup5kVO9vDMZxdc31gvfpq5rCF8VPQ-YEQ95AGDCVb9t1mhOalXFsfUa0x6ru1AsdQRLrjYDpuu1f54tmFSuF0K5_odDF7Ea7XNMU8A4NnTrCqybHZ3PBCSoz7-naAiGh40_K_aH_EO2wruCRu6oOOowx1y1vNxBnRT3TrKaMDxjM Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a88cba0e44af4875b05d6c3546cf0543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a88cba0e44af4875b05d6c3546cf0543", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: a88cba0e44af4875b05d6c3546cf0543 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1979982008 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 719d3fb4f7f44c239e03b5f7076edcc8 Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-1979982008-project Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e could not be found. Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82678d7b-d3bf-4ed3-b8f9-945d2279172e'} Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e could not be found. Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e could not be found. Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:26:40.695338 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e could not be found. Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:26:40.710256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] Returning 404 to user: Instance 82678d7b-d3bf-4ed3-b8f9-945d2279172e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:26:40.713526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc7223a7-73d2-4149-b3d8-6287538bb28e tempest-ServersNegativeTestJSON-1979982008 tempest-ServersNegativeTestJSON-1979982008-project] 10.222.0.30 "GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e" status: 404 len: 111 microversion: 2.1 time: 0.054637 Jun 18 22:26:40.714685 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2718/5415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:40 2022] GET /compute/v2.1/servers/82678d7b-d3bf-4ed3-b8f9-945d2279172e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:26:41.003903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:41.004525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:41.023999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:41.024526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:41.025422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:41.025856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:41.053193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:41.617363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:41.630431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc8aeda7-7d6c-4f2d-9810-e66273c6e387 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.630537 Jun 18 22:26:41.632089 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2698/5416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:40 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:42.648571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:42.650152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:42.667785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:42.668723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:42.672443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:42.673364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:43.017579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:43.060916 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-306620c9-ec8d-430d-98d2-b3a9dda45a81 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.416605 Jun 18 22:26:43.076458 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2719/5417] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:42 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:44.083058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:44.083900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:44.102091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:44.102780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:44.103623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:44.104067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:44.437383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:44.450315 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16dc23cc-8ee2-42a2-b134-da20f92fb7ae tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.371230 Jun 18 22:26:44.450921 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2699/5418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:44 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:26:45.468093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:45.468776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:45.494734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:45.499368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:45.504739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:45.506115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:45.803799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:45.816028 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-948060a1-5b65-4491-8b5b-72b237e3d130 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.352290 Jun 18 22:26:45.816658 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2720/5419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:45 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:46.834666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:46.836091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:46.846889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:46.851811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:46.853177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:46.855294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:47.135271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:47.144779 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc4f7ab1-2e07-4016-8191-625c597bc6ab tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.315022 Jun 18 22:26:47.146795 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2700/5420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:46 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:48.165260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:48.166656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:48.175840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:48.175840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:48.175840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:48.175840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:48.198404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:48.316453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:48.324844 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b49f7a65-c7c0-4b9b-8d74-ba5edcdda773 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.165254 Jun 18 22:26:48.325803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2721/5421] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:48 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:49.343308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:49.343938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:49.351993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:49.353118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:49.354142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:49.354864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:49.494616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:49.502475 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3796322-52af-4226-afce-9f62424e850e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.164389 Jun 18 22:26:49.503050 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2701/5422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:49 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:50.523839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:50.524582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:50.533084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:50.533428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:50.534212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:50.534647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:50.689016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:50.698940 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea063fff-3239-4f4a-9f8a-ad60cd95a4e1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.182647 Jun 18 22:26:50.699750 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2722/5423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:50 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:51.716821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:51.717544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:51.726597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:51.727056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:51.727845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:51.728275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:52.147582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:52.167048 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3b5c2e43-3726-4ec9-898b-3fdc73b487e7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.454295 Jun 18 22:26:52.170204 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2702/5424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:51 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:53.186899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:53.188493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:53.196802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:53.197622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:53.201307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:53.202028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:54.356077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:54.364992 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-140cbe70-9628-448a-abf1-0ce1e3783dac tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 1.182552 Jun 18 22:26:54.365621 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2723/5425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:53 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:55.384194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:55.384887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:55.401272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:55.406263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:55.407279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:55.407741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:55.808509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:55.826103 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bc3ff599-a5de-45fd-9e5e-896ee283616e tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.447969 Jun 18 22:26:55.826936 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2703/5426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:55 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:56.843927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:56.844568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:56.859855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:56.865756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:56.866467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:56.868025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:56.870720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:57.228996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:57.247211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.408171 Jun 18 22:26:57.248271 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2724/5427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:56 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:58.266220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:58.266959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:58.291822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:58.292323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:58.298254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:58.298719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:58.791997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:26:58.809068 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8dafd2ee-3cb8-4458-9411-147880692aba tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.545096 Jun 18 22:26:58.811844 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2704/5428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:58 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:26:58.820599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:58.822302 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d4af2ba-0a71-48ea-8739-661ceadd83a3 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002965 Jun 18 22:26:58.825220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2725/5429] 10.222.0.30 () {56 vars in 885 bytes} [Sat Jun 18 22:26:58 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 18 22:26:59.842248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:26:59.843587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:26:59.871160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:26:59.878223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:59.879416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:26:59.881594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:26:59.882278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:00.098394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:00.110915 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0c672fa0-0d97-4be2-866a-dd0f11edac7b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1486 microversion: 2.1 time: 0.286471 Jun 18 22:27:00.114669 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2705/5430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:26:59 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1486 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:00.128705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:00.129932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:00.145026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:00.145520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:00.146310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:00.146747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:00.290191 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d1da926-0bf6-4dcc-b3eb-a1e0e6b609a0 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "POST /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966/action" status: 202 len: 0 microversion: 2.1 time: 0.165336 Jun 18 22:27:00.291149 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2726/5431] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:27:00 2022] POST /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:27:00.300261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:00.301280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:00.313397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:00.319817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:00.320875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:00.321789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:00.648020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:00.656810 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-33bf50cd-c9b1-47ae-9d86-e2d69dcda00a tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1494 microversion: 2.1 time: 0.361599 Jun 18 22:27:00.661637 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2706/5432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:00 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1494 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:01.679966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:01.681844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:01.696579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:01.702356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:01.706245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:01.707171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:01.987087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:02.007574 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6c560b10-6855-4555-8689-421095916751 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1494 microversion: 2.1 time: 0.332244 Jun 18 22:27:02.008385 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2727/5433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:01 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1494 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:03.028720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:03.029365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:03.043510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:03.046021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:03.052593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:03.053325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:03.533573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:03.543213 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f72fe9a0-03be-4b68-b33a-b422af3bdeb5 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1500 microversion: 2.1 time: 0.520354 Jun 18 22:27:03.553833 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2707/5434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:03 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1500 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:03.567536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:03.568141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:03.576945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:03.577497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:03.578277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:03.579175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:03.607473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:27:03.709473 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bf86bda3-38be-42ab-bcf3-13affa783226 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 204 len: 0 microversion: 2.1 time: 0.146506 Jun 18 22:27:03.710476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2728/5435] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:27:03 2022] DELETE /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:27:03.722225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:03.723033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:03.731723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:03.732434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:03.733566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:03.734546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:04.172632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:04.185444 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f591fb34-1e8a-4fc9-b0d2-2f2719356ffe tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.469567 Jun 18 22:27:04.185981 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2708/5436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:03 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:05.135399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1911555040", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1f2fb9d8-0b0c-48e6-89df-b7beef37e6ff"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:05.202794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:05.203564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:05.204349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] validate_networks() for [('1f2fb9d8-0b0c-48e6-89df-b7beef37e6ff', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:27:05.217853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:05.218318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:05.219419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:05.220254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:05.894258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:05.910956 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3d93b37-9df9-4d5b-94d4-7b7d2331ceb1 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.711884 Jun 18 22:27:05.917962 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2709/5437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:05 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:06.336689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:27:06.337234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:27:06.337676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:27:06.338110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:27:06.338522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:27:06.359309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:06.360272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:06.362013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:06.362951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:06.424886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Getting quotas for project 17e29d31b0974eeebe8ef48f0de23582. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:27:06.438000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Getting quotas for user dcd1462ff001498e8776b711e121817f and project 17e29d31b0974eeebe8ef48f0de23582. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:27:06.454445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:27:06.457937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:27:06.517607 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c84ba5cd-3711-42d4-9869-54d412c9b1ee tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.809048 Jun 18 22:27:06.526162 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2729/5438] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:27:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:27:06.531072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02d52003-e229-402d-bb25-73d6ae6b50f6 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:06.532981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02d52003-e229-402d-bb25-73d6ae6b50f6 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:06.615887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02d52003-e229-402d-bb25-73d6ae6b50f6 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:06.627485 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02d52003-e229-402d-bb25-73d6ae6b50f6 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1214 microversion: 2.1 time: 0.099982 Jun 18 22:27:06.631389 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2710/5439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:06 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:06.936125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:06.936773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:06.959890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:06.960347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:06.961170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:06.967941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:07.298448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:07.311866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc10cc55-b9af-46bc-9256-582df250390b tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1506 microversion: 2.1 time: 0.381132 Jun 18 22:27:07.322452 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2730/5440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:06 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:07.651560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba3b9abb-771d-4323-9add-d77d327bd24e tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:07.654714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ba3b9abb-771d-4323-9add-d77d327bd24e tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:07.788072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7dbcf76a-b2f2-4081-8076-1c6af3cb3228 tempest-ExtensionsTest-1268307576 tempest-ExtensionsTest-1268307576-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:07.797891 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7dbcf76a-b2f2-4081-8076-1c6af3cb3228 tempest-ExtensionsTest-1268307576 tempest-ExtensionsTest-1268307576-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.585000 Jun 18 22:27:07.810876 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2711/5441] 10.222.0.30 () {58 vars in 1169 bytes} [Sat Jun 18 22:27:07 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:27:07.847487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-227bdc52-de6a-4508-befb-f626cb3775dd tempest-ExtensionsTest-1268307576 tempest-ExtensionsTest-1268307576-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:07.863963 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-227bdc52-de6a-4508-befb-f626cb3775dd tempest-ExtensionsTest-1268307576 tempest-ExtensionsTest-1268307576-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.045393 Jun 18 22:27:07.865359 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2712/5442] 10.222.0.30 () {58 vars in 1133 bytes} [Sat Jun 18 22:27:07 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:27:07.873896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ba3b9abb-771d-4323-9add-d77d327bd24e tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:07.889477 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ba3b9abb-771d-4323-9add-d77d327bd24e tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1214 microversion: 2.1 time: 0.242669 Jun 18 22:27:07.892388 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2731/5443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:07 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:08.124016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9b11e981-2a4c-4216-b7d9-9f5d10b0f689 req-15c75d18-3317-458c-9a75-d80fca930a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e44f1a-a481-48b6-84f5-4e4f9f896966", "name": "network-vif-deleted", "tag": "69e23949-9056-4586-ace6-2e3ba0d61572"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:08.142307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9b11e981-2a4c-4216-b7d9-9f5d10b0f689 req-15c75d18-3317-458c-9a75-d80fca930a60 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:08.143167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9b11e981-2a4c-4216-b7d9-9f5d10b0f689 req-15c75d18-3317-458c-9a75-d80fca930a60 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:08.179553 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9b11e981-2a4c-4216-b7d9-9f5d10b0f689 req-15c75d18-3317-458c-9a75-d80fca930a60 service nova] Creating event network-vif-deleted:69e23949-9056-4586-ace6-2e3ba0d61572 for instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 on nch2-master-1 Jun 18 22:27:08.195386 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9b11e981-2a4c-4216-b7d9-9f5d10b0f689 req-15c75d18-3317-458c-9a75-d80fca930a60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257897 Jun 18 22:27:08.196037 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2713/5444] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:08.330061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:08.330870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:08.343141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:08.344392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:08.346306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:08.346999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:08.392788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:08.393453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:08.394080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lazy-loading 'fault' on Instance uuid d5e44f1a-a481-48b6-84f5-4e4f9f896966 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:08.457945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:08.470206 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5c0bc65-63ed-41d4-a2e2-fc3959c7ada7 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 200 len: 1304 microversion: 2.1 time: 0.144490 Jun 18 22:27:08.471634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2732/5445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:08 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:08.912138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:08.913745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:08.922855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:08.923645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:08.925000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:08.925772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:09.070297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:09.079606 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9545ba03-3b37-491a-a08f-86fd5625c3c1 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1272 microversion: 2.1 time: 0.172650 Jun 18 22:27:09.080211 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2714/5446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:08 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:09.488018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:09.488622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: d5e44f1a-a481-48b6-84f5-4e4f9f896966] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:09.498878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:09.499410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:09.501931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:09.502384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:09.534951 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] HTTP exception thrown: Instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 could not be found. Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Request method failure captured: Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 HTTP/1.1 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlDSLGJkNiiMksTyi_WQovqFSndlfWb139yuZ0K6Te0h48iFvHsL2hNVrAZt8Y1vwkkr4pbqJIvYO6dX8IZMzNExH75gwfNtYurHwMtmTw0BhE-o3E7NvPtCb1UaovGQejuQQUADUrIjgs6Jb9pNmzlmn-8O8K_DFi7xFERI7WtbITc Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8f9a7d50200443418ef0c6a20a608bb9 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueTestJSON-1616292622 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8f9a7d50200443418ef0c6a20a608bb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8f9a7d50200443418ef0c6a20a608bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8f9a7d50200443418ef0c6a20a608bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8f9a7d50200443418ef0c6a20a608bb9", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueTestJSON-1616292622 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8f9a7d50200443418ef0c6a20a608bb9 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueTestJSON-1616292622 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueTestJSON-1616292622-project Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 39c2337d42bc426abed2ed2fb5000753 Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueTestJSON-1616292622-project Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 could not be found. Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd5e44f1a-a481-48b6-84f5-4e4f9f896966'} Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 could not be found. Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 could not be found. Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:27:09.536703 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 could not be found. Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Returning 404 to user: Instance d5e44f1a-a481-48b6-84f5-4e4f9f896966 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef9510d7-8f4e-4fc6-800b-bb0513370c1d tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966" status: 404 len: 111 microversion: 2.1 time: 0.054147 Jun 18 22:27:09.543157 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2733/5447] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:09 2022] GET /compute/v2.1/servers/d5e44f1a-a481-48b6-84f5-4e4f9f896966 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:09.548959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:09.550235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:09.563765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:09.564300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:09.567168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:09.568328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:09.628552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:27:09.754101 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eaaf58c0-0e3e-4cb6-aaf9-d83664cbd576 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 204 len: 0 microversion: 2.1 time: 0.210386 Jun 18 22:27:09.756108 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2715/5448] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:27:09 2022] DELETE /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:27:09.764587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:09.765249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:09.782356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:09.782920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:09.783617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:09.786189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:10.097227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:10.097951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:10.109247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:10.109709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:10.110515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:10.110947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:10.112413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:10.123534 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12c15fce-7405-44c8-a825-4026dd0331ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1490 microversion: 2.1 time: 0.363156 Jun 18 22:27:10.124331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2734/5449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:09 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1490 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:10.335899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:10.347312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27d3501c-89d9-4df4-95b0-dd9394d97cc2 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.254500 Jun 18 22:27:10.348066 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2716/5450] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:10 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:10.657681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cd36e1e0-e0c7-47ff-aa75-35b778d9fafa tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Calling method '.version_select at 0x7fea06f79d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:10.764851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cd36e1e0-e0c7-47ff-aa75-35b778d9fafa tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.321964 Jun 18 22:27:10.773677 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2735/5451] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:27:10 2022] GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7/defaults => generated 371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:10.778541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c0c9b7e5-e39b-4319-aab0-5223229728b8 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Calling method '.version_select at 0x7fea07288ee0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:10.913823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f19d922e-e842-45ae-aa3b-d79f5c1d7433 req-03643ebf-c670-4f26-b698-53cb9e1fd808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b0e532-5527-4b12-99ef-a37d00064f88", "tag": "e8ef816b-1c59-40e9-bc8f-3fa5f818d360"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:10.941939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f19d922e-e842-45ae-aa3b-d79f5c1d7433 req-03643ebf-c670-4f26-b698-53cb9e1fd808 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:10.942697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f19d922e-e842-45ae-aa3b-d79f5c1d7433 req-03643ebf-c670-4f26-b698-53cb9e1fd808 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:10.956970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f19d922e-e842-45ae-aa3b-d79f5c1d7433 req-03643ebf-c670-4f26-b698-53cb9e1fd808 service nova] Creating event network-changed:e8ef816b-1c59-40e9-bc8f-3fa5f818d360 for instance 22b0e532-5527-4b12-99ef-a37d00064f88 on nch1-master-1 Jun 18 22:27:10.964622 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f19d922e-e842-45ae-aa3b-d79f5c1d7433 req-03643ebf-c670-4f26-b698-53cb9e1fd808 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056477 Jun 18 22:27:10.965377 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c0c9b7e5-e39b-4319-aab0-5223229728b8 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7" status: 200 len: 371 microversion: 2.1 time: 0.191740 Jun 18 22:27:10.966631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2717/5453] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:27:10 2022] GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7 => generated 371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:27:10.969193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2736/5453] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:10.981820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72ba764a-5265-40d7-8016-c559f7e6bb86 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Calling method '.version_select at 0x7fea0726ef70>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:11.062821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72ba764a-5265-40d7-8016-c559f7e6bb86 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.086893 Jun 18 22:27:11.063535 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2718/5454] 10.222.0.30 () {58 vars in 1268 bytes} [Sat Jun 18 22:27:10 2022] GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7/defaults => generated 371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:11.077895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f508d58-6be8-4899-9bae-2d64c28864d8 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Calling method '.version_select at 0x7fea06edb040>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:11.142864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:11.145002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:11.164183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:11.164797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:11.169228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:11.169688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:11.179806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f508d58-6be8-4899-9bae-2d64c28864d8 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7" status: 200 len: 371 microversion: 2.1 time: 0.106791 Jun 18 22:27:11.182319 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2737/5455] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:27:11 2022] GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7 => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:27:11.199464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-871c8036-f0f6-4ff6-8314-3e9dcf49c193 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] Calling method '.version_select at 0x7fea06f79550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:11.203638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:11.317994 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-871c8036-f0f6-4ff6-8314-3e9dcf49c193 tempest-QuotasTestJSON-2089690871 tempest-QuotasTestJSON-2089690871-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7?user_id=74d5884f52f24625a843da2bade3de07" status: 200 len: 371 microversion: 2.1 time: 0.129151 Jun 18 22:27:11.321067 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2738/5456] 10.222.0.30 () {58 vars in 1322 bytes} [Sat Jun 18 22:27:11 2022] GET /compute/v2.1/os-quota-sets/50dad433928c4ccabf3b120c9f9bdff7?user_id=74d5884f52f24625a843da2bade3de07 => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:11.364782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:11.365705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:11.375280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:11.376252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:11.381161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:11.384020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:11.806919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:11.817379 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2523cf2d-1c09-4256-876f-bae583351f41 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1490 microversion: 2.1 time: 0.679106 Jun 18 22:27:11.818874 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2719/5457] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:11 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1490 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:11.994774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:12.009596 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab2bfba2-c0fe-4c59-88f4-0e9dc531a12a tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.649462 Jun 18 22:27:12.010210 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2739/5458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:11 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:12.836206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:12.837544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:12.853724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:12.854399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:12.855543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:12.856308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:12.908529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:12.909178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:12.909921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lazy-loading 'fault' on Instance uuid 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:12.971708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39c2337d42bc426abed2ed2fb5000753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9a7d50200443418ef0c6a20a608bb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:12.985218 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a54c0061-5224-4d28-afe9-e3bbbc84a9ce tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 200 len: 1303 microversion: 2.1 time: 0.154652 Jun 18 22:27:12.987677 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2720/5459] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:12 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 1303 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:12.993711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9eee2418-6f8b-4493-8781-96f85cf47163 req-a68ba2be-2632-4a66-a12f-d9eeca990ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b47c81a-0fdd-47a0-9468-4cab0b84ba1e", "name": "network-vif-deleted", "tag": "4ce5aa4f-ac8c-4616-894f-41f8b504b0f9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:13.010864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9eee2418-6f8b-4493-8781-96f85cf47163 req-a68ba2be-2632-4a66-a12f-d9eeca990ea0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:13.011602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9eee2418-6f8b-4493-8781-96f85cf47163 req-a68ba2be-2632-4a66-a12f-d9eeca990ea0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:13.029569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:13.030533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:13.065687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:13.066050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:13.076487 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9eee2418-6f8b-4493-8781-96f85cf47163 req-a68ba2be-2632-4a66-a12f-d9eeca990ea0 service nova] Creating event network-vif-deleted:4ce5aa4f-ac8c-4616-894f-41f8b504b0f9 for instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e on nch2-master-1 Jun 18 22:27:13.077275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:13.078054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:13.099223 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9eee2418-6f8b-4493-8781-96f85cf47163 req-a68ba2be-2632-4a66-a12f-d9eeca990ea0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105857 Jun 18 22:27:13.102759 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2740/5460] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:13.341126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:13.356257 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92712d7d-9c28-4928-ba4a-86fc510d57b3 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.332894 Jun 18 22:27:13.357708 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2721/5461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:13 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:14.005639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:14.006737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] [instance: 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:14.019475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:14.020106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:14.026805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:14.028258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:14.069378 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] HTTP exception thrown: Instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e could not be found. Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Request method failure captured: Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e HTTP/1.1 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlDSLGJkNiiMksTyi_WQovqFSndlfWb139yuZ0K6Te0h48iFvHsL2hNVrAZt8Y1vwkkr4pbqJIvYO6dX8IZMzNExH75gwfNtYurHwMtmTw0BhE-o3E7NvPtCb1UaovGQejuQQUADUrIjgs6Jb9pNmzlmn-8O8K_DFi7xFERI7WtbITc Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 8f9a7d50200443418ef0c6a20a608bb9 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerRescueTestJSON-1616292622 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8f9a7d50200443418ef0c6a20a608bb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8f9a7d50200443418ef0c6a20a608bb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8f9a7d50200443418ef0c6a20a608bb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8f9a7d50200443418ef0c6a20a608bb9", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerRescueTestJSON-1616292622 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 8f9a7d50200443418ef0c6a20a608bb9 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerRescueTestJSON-1616292622 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerRescueTestJSON-1616292622-project Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 39c2337d42bc426abed2ed2fb5000753 Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerRescueTestJSON-1616292622-project Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e could not be found. Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8b47c81a-0fdd-47a0-9468-4cab0b84ba1e'} Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e could not be found. Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e could not be found. Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:27:14.077933 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e could not be found. Jun 18 22:27:14.083498 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:27:14.091241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] Returning 404 to user: Instance 8b47c81a-0fdd-47a0-9468-4cab0b84ba1e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:27:14.092305 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6fb57b8-8d04-41f1-b0fb-5585e2871d47 tempest-ServerRescueTestJSON-1616292622 tempest-ServerRescueTestJSON-1616292622-project] 10.222.0.30 "GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e" status: 404 len: 111 microversion: 2.1 time: 0.093616 Jun 18 22:27:14.092954 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2741/5462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:13 2022] GET /compute/v2.1/servers/8b47c81a-0fdd-47a0-9468-4cab0b84ba1e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:14.374378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:14.375476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:14.388413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:14.389697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:14.390793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:14.391426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:14.747909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:14.760064 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-973cf7ab-1e4c-4a5a-b3e1-ee65afca2cbf tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.389629 Jun 18 22:27:14.773631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2722/5463] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:14 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:15.779924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:15.780548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:15.792883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:15.794927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:15.796115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:15.797759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:16.342794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:16.351262 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32a24a16-1e13-484c-9870-5a85ccdf0a7f tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.575212 Jun 18 22:27:16.354524 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2742/5464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:15 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:17.372949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:17.374005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:17.386977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:17.389665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:17.390990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:17.393948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:17.909797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:17.924921 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d1535b7f-24c7-4df0-b3b4-7d7c231ca0a4 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.557728 Jun 18 22:27:17.935265 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2723/5465] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:17 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:18.004169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:18.527358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1bf4970f-ac6a-44dc-8c3a-abaaca4443e4 req-425c2088-4870-4403-af36-b103f0efe498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0e532-5527-4b12-99ef-a37d00064f88", "name": "network-vif-plugged", "status": "completed", "tag": "e8ef816b-1c59-40e9-bc8f-3fa5f818d360"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:18.539142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bf4970f-ac6a-44dc-8c3a-abaaca4443e4 req-425c2088-4870-4403-af36-b103f0efe498 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:18.539929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bf4970f-ac6a-44dc-8c3a-abaaca4443e4 req-425c2088-4870-4403-af36-b103f0efe498 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:18.554741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:18.557862 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1bf4970f-ac6a-44dc-8c3a-abaaca4443e4 req-425c2088-4870-4403-af36-b103f0efe498 service nova] Creating event network-vif-plugged:e8ef816b-1c59-40e9-bc8f-3fa5f818d360 for instance 22b0e532-5527-4b12-99ef-a37d00064f88 on nch1-master-1 Jun 18 22:27:18.566793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1bf4970f-ac6a-44dc-8c3a-abaaca4443e4 req-425c2088-4870-4403-af36-b103f0efe498 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.567358 Jun 18 22:27:18.568090 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2743/5466] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:27:18.942972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:18.944347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:18.952599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:18.953495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:18.954607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:18.955457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:19.280625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:19.292726 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e514da0c-24a3-42a8-8f54-feffab58ab21 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1314 microversion: 2.1 time: 0.354786 Jun 18 22:27:19.294778 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2724/5467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:18 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:20.312226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:20.312943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:20.321160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:20.322268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:20.323237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:20.323817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:20.491458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:20.500807 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d8c997a-5a42-4121-b89b-14f8e31fd816 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1497 microversion: 2.1 time: 0.193040 Jun 18 22:27:20.502110 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2744/5468] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:20 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:24.041409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:24.043205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:24.047334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:24.054668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:24.055369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:24.056316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:24.057372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:24.091712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:27:24.212920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4336a776-6a21-469f-95f3-c86f6dc09246 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 204 len: 0 microversion: 2.1 time: 0.193348 Jun 18 22:27:24.213614 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2725/5469] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:27:24 2022] DELETE /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:27:24.221841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:24.223195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:24.225918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:24.234436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:24.234617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:24.235413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:24.236042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:24.392722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:24.404625 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3f394b1b-b5fe-4b1e-84a9-ce64295fa966 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1503 microversion: 2.1 time: 0.186524 Jun 18 22:27:24.416645 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2745/5470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:24 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:25.423902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:25.424675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:25.439095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:25.439908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:25.440731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:25.441191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:25.846387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:25.859171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-212840b2-9c75-4402-b0ea-09f00bc34ce9 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1503 microversion: 2.1 time: 0.438473 Jun 18 22:27:25.861412 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2726/5471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:25 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:26.882245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:26.883296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:26.903198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:26.904620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:26.905195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:26.905862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:27.512881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:27.526087 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58712f7b-fbfb-491d-91b4-69eb1274efe7 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1503 microversion: 2.1 time: 0.651230 Jun 18 22:27:27.529644 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2746/5472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:26 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1503 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:27.977678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6fc4c49c-aa46-4431-94c8-1aa328179ecb req-2ef9861f-5854-4c2b-ab4d-c79d66c13fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b0e532-5527-4b12-99ef-a37d00064f88", "name": "network-vif-deleted", "tag": "e8ef816b-1c59-40e9-bc8f-3fa5f818d360"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:28.003723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6fc4c49c-aa46-4431-94c8-1aa328179ecb req-2ef9861f-5854-4c2b-ab4d-c79d66c13fa3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:28.004546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6fc4c49c-aa46-4431-94c8-1aa328179ecb req-2ef9861f-5854-4c2b-ab4d-c79d66c13fa3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:28.037241 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6fc4c49c-aa46-4431-94c8-1aa328179ecb req-2ef9861f-5854-4c2b-ab4d-c79d66c13fa3 service nova] Creating event network-vif-deleted:e8ef816b-1c59-40e9-bc8f-3fa5f818d360 for instance 22b0e532-5527-4b12-99ef-a37d00064f88 on nch1-master-1 Jun 18 22:27:28.066210 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6fc4c49c-aa46-4431-94c8-1aa328179ecb req-2ef9861f-5854-4c2b-ab4d-c79d66c13fa3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087105 Jun 18 22:27:28.067183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2727/5473] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:28.549345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:28.550568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:28.554998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:28.594789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:28.595271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:28.603978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:28.605212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:28.754694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:28.756645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:28.758900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lazy-loading 'fault' on Instance uuid 22b0e532-5527-4b12-99ef-a37d00064f88 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:28.908005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd1462ff001498e8776b711e121817f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17e29d31b0974eeebe8ef48f0de23582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:28.936644 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e165382a-f14f-4ddd-8e89-72fa44d101ac tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 200 len: 1304 microversion: 2.1 time: 0.391519 Jun 18 22:27:28.938041 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2747/5474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:28 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 1304 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:29.965408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:29.968374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] [instance: 22b0e532-5527-4b12-99ef-a37d00064f88] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:29.982926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:29.989020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:29.989706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:29.991103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:29.993159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:30.063383 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] HTTP exception thrown: Instance 22b0e532-5527-4b12-99ef-a37d00064f88 could not be found. Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Request method failure captured: Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 HTTP/1.1 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlE0YW-pRKDJsRsnnCh2TZNHCaAVO473OvAwMPnKwzajO865DTR2Z7NXFww-CxE04vTayybYweawHd14NhlEvrIFFnAFT5F-a-NybHFrpVa2SDoQnCYu-SPh0C59YKfSQM6YYJGZLsn9Wfl5kmIP83jd5xl-gk6vMl8rqUf_iCgEO-M Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 17e29d31b0974eeebe8ef48f0de23582 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesActionsTest-584218559 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/17e29d31b0974eeebe8ef48f0de23582"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/17e29d31b0974eeebe8ef48f0de23582"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/17e29d31b0974eeebe8ef48f0de23582"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_17e29d31b0974eeebe8ef48f0de23582", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesActionsTest-584218559 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 17e29d31b0974eeebe8ef48f0de23582 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesActionsTest-584218559 Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesActionsTest-584218559-project Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: dcd1462ff001498e8776b711e121817f Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesActionsTest-584218559-project Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 22b0e532-5527-4b12-99ef-a37d00064f88 could not be found. Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '22b0e532-5527-4b12-99ef-a37d00064f88'} Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b0e532-5527-4b12-99ef-a37d00064f88 could not be found. Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b0e532-5527-4b12-99ef-a37d00064f88 could not be found. Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:27:30.070329 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b0e532-5527-4b12-99ef-a37d00064f88 could not be found. Jun 18 22:27:30.074532 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:27:30.078173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] Returning 404 to user: Instance 22b0e532-5527-4b12-99ef-a37d00064f88 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:27:30.079724 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2672afa6-6f21-4543-a7cf-0f7621518228 tempest-VolumesActionsTest-584218559 tempest-VolumesActionsTest-584218559-project] 10.222.0.30 "GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88" status: 404 len: 111 microversion: 2.1 time: 0.125395 Jun 18 22:27:30.084510 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2728/5475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:29 2022] GET /compute/v2.1/servers/22b0e532-5527-4b12-99ef-a37d00064f88 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:27:31.173926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:31.174597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:31.196543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:31.201299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:31.202356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:31.203403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:31.307478 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-573b9351-ca9f-433d-8b4d-69ab74aea95b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/ips" status: 200 len: 146 microversion: 2.1 time: 0.126587 Jun 18 22:27:31.310642 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2748/5476] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:27:31 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/ips => generated 146 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:27:33.828041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aba020c7-b736-46ee-a1d6-be5789623a04"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:33.829183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:33.837778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:33.838237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:33.839002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:33.839457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:34.426004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-89e74310-1bc9-4eb7-a563-9f67d3b10136 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.594900 Jun 18 22:27:34.426004 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2729/5477] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:27:33 2022] POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:38.087243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-910903116", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e4f901b4-6864-47c9-a6c8-7965a4c803b3"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:38.255206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] validate_networks() for [('e4f901b4-6864-47c9-a6c8-7965a4c803b3', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:27:39.482314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b234a585-625e-45ad-a879-7ff09214929f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:39.506933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b234a585-625e-45ad-a879-7ff09214929f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:39.508022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b234a585-625e-45ad-a879-7ff09214929f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:39.538074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b234a585-625e-45ad-a879-7ff09214929f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Going to try to stop instance {{(pid=130902) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:27:39.603339 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b234a585-625e-45ad-a879-7ff09214929f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action" status: 202 len: 0 microversion: 2.1 time: 0.123552 Jun 18 22:27:39.606266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2730/5478] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:27:39 2022] POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:27:39.620151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:39.629498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:39.651680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:39.653437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:39.656043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:39.656860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:40.046540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:40.058634 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1d39e294-a1d0-47d9-bc21-23651fa2a554 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.447273 Jun 18 22:27:40.062362 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2731/5479] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:39 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:40.591217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:27:40.591217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:27:40.591750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:27:40.592177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:27:40.592654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:27:40.607818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:40.608279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:40.616924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:40.622336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:40.694658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Getting quotas for project 9ccc2b1d2c4a49b59046bfc71b862519. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:27:40.701385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Getting quotas for user 1e582eb88d6740c1bf28911a53bd08c0 and project 9ccc2b1d2c4a49b59046bfc71b862519. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:27:40.720076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:27:40.725025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:27:40.857364 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7e8aa89-e99f-408d-9960-8b6d98fc3ede tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.019902 Jun 18 22:27:40.866557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2749/5480] 10.222.0.30 () {62 vars in 1187 bytes} [Sat Jun 18 22:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3037 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 18 22:27:40.870814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba025a73-b38e-499f-83ae-fb115a10bf27 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:40.871394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba025a73-b38e-499f-83ae-fb115a10bf27 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:40.992604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba025a73-b38e-499f-83ae-fb115a10bf27 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:41.014040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba025a73-b38e-499f-83ae-fb115a10bf27 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:41.015867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba025a73-b38e-499f-83ae-fb115a10bf27 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:41.020651 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba025a73-b38e-499f-83ae-fb115a10bf27 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1261 microversion: 2.26 time: 0.152978 Jun 18 22:27:41.022115 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2732/5481] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:40 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:41.079904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:41.080681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:41.096856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:41.097432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:41.098299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:41.098941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:41.508462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:41.527523 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-57f879cb-f833-47ac-89c8-e4316835f00b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.451419 Jun 18 22:27:41.545321 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2750/5482] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:41 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:42.041489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:42.043782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:42.056180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:42.057129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:42.060006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:42.061412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:42.103212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:42.180835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:42.195730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:42.205964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:42.207717 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41cdec0b-6c07-4f2c-8fb3-9009a08569c1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1313 microversion: 2.26 time: 0.171958 Jun 18 22:27:42.212205 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2733/5483] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:42 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:42.549347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:42.550278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:42.571887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:42.573691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:42.575467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:42.580188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:42.815971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:42.826764 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15687385-f18f-4c47-9a2e-d82c50ee14ed tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.281657 Jun 18 22:27:42.827868 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2751/5484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:42 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:43.232041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:43.233709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:43.270312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:43.271084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:43.272325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:43.274682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:43.845146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:43.845913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:43.853023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:43.869851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:43.870845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:43.871480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:44.461718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:44.475123 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e74b114d-4300-4675-a0c0-501145ed13f7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.635239 Jun 18 22:27:44.479198 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2752/5485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:43 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:44.482547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:44.501228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:44.503525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:44.506863 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-59e8657f-7efd-4773-b64d-d1140bede113 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1361 microversion: 2.26 time: 1.281755 Jun 18 22:27:44.520745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2734/5486] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:43 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1361 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:44.912997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e0647688-77bb-4a96-873d-dfa4ff4f8ce3 req-6e6f52e1-e4f5-4e5d-b735-8cb846011d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41660ae9-bd07-44d0-94de-e76ca41d7525", "tag": "cac36062-0237-4dd9-a108-d1cd34aa1f88"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:44.934983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e0647688-77bb-4a96-873d-dfa4ff4f8ce3 req-6e6f52e1-e4f5-4e5d-b735-8cb846011d01 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:44.938239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e0647688-77bb-4a96-873d-dfa4ff4f8ce3 req-6e6f52e1-e4f5-4e5d-b735-8cb846011d01 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:44.972560 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e0647688-77bb-4a96-873d-dfa4ff4f8ce3 req-6e6f52e1-e4f5-4e5d-b735-8cb846011d01 service nova] Creating event network-changed:cac36062-0237-4dd9-a108-d1cd34aa1f88 for instance 41660ae9-bd07-44d0-94de-e76ca41d7525 on nch2-master-1 Jun 18 22:27:44.982232 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e0647688-77bb-4a96-873d-dfa4ff4f8ce3 req-6e6f52e1-e4f5-4e5d-b735-8cb846011d01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072289 Jun 18 22:27:44.985878 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2753/5487] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:27:45.502008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:45.503630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:45.517724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:45.518413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:45.527347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:45.528299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:45.530839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:45.533763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:45.538542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:45.542382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:45.544857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:45.545585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:46.003562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:46.012047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:46.017300 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a59a93fb-4c52-4cf5-93d6-c45ad4d89b2d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.521251 Jun 18 22:27:46.017887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2735/5488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:45 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:46.023029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:46.024736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:46.026071 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-87511253-ccc3-4593-99bb-5a0d4e6dcdcb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1361 microversion: 2.26 time: 0.503377 Jun 18 22:27:46.026760 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2754/5489] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:45 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1361 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:47.035525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:47.037574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:47.047553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:47.048181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:47.055294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:47.062186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:47.062639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:47.063416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:47.064633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:47.065904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:47.066504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:47.067097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:47.377741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:47.389583 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c8ecb5f-5f6e-4899-8dca-841c7f3cec36 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.358661 Jun 18 22:27:47.397405 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2736/5490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:47 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:47.414785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:47.431072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:47.436083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:47.440233 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b30f8fa-03fb-4d94-a559-65640057dd1f tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1361 microversion: 2.26 time: 0.397280 Jun 18 22:27:47.441439 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2755/5491] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:47 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:27:48.410386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:48.411281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:48.429221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:48.431821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:48.433645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:48.435506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:48.459734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:48.460301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:48.471051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:48.473387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:48.475006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:48.492499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:48.797150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:48.814703 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f25968c9-2b23-4c32-9bc7-9bcef4aedb70 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.410970 Jun 18 22:27:48.815556 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2737/5492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:48 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:48.879603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:48.893327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:48.896033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:48.898369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-58452a70-af7d-4047-bdd7-8aa2ce51018a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1361 microversion: 2.26 time: 0.442398 Jun 18 22:27:48.901558 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2756/5493] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:48 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1361 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:49.832297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:49.833625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:49.848713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:49.849434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:49.850427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:49.851059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:49.922079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:49.922853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:49.940722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:49.941261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:49.944907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:49.950751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:50.339656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:50.348873 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d69281e-720b-4c37-b657-06e8cbfd67cb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.520782 Jun 18 22:27:50.359267 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2738/5494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:49 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:50.365296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:50.372732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=76 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:50.380409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:50.382268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:50.386937 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03c75dc2-b820-4ed2-ab77-3b1cbfad882a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1361 microversion: 2.26 time: 0.471534 Jun 18 22:27:50.387765 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2757/5495] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:49 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1361 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 18 22:27:51.165103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e859bdb7-f7ec-4ed0-b5c6-2e0616919d2b req-40082259-fd0f-4838-96c7-db783945cb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41660ae9-bd07-44d0-94de-e76ca41d7525", "name": "network-vif-plugged", "status": "completed", "tag": "cac36062-0237-4dd9-a108-d1cd34aa1f88"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:51.188095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:51.201437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e859bdb7-f7ec-4ed0-b5c6-2e0616919d2b req-40082259-fd0f-4838-96c7-db783945cb72 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:51.201893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e859bdb7-f7ec-4ed0-b5c6-2e0616919d2b req-40082259-fd0f-4838-96c7-db783945cb72 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:51.240360 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e859bdb7-f7ec-4ed0-b5c6-2e0616919d2b req-40082259-fd0f-4838-96c7-db783945cb72 service nova] Creating event network-vif-plugged:cac36062-0237-4dd9-a108-d1cd34aa1f88 for instance 41660ae9-bd07-44d0-94de-e76ca41d7525 on nch2-master-1 Jun 18 22:27:51.268006 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e859bdb7-f7ec-4ed0-b5c6-2e0616919d2b req-40082259-fd0f-4838-96c7-db783945cb72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107616 Jun 18 22:27:51.270266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2739/5496] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:27:51.376021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:51.376911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:51.384118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:51.388165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:51.392076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:51.392570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:51.395148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:51.396738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:51.412631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:51.415140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:51.428592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:51.429442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:51.431127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:51.432101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:52.313506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:52.330323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:52.359151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:52.360203 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed667dbb-b6b5-4056-9331-b1a87a049b1f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.983594 Jun 18 22:27:52.361277 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2758/5497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:51 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:52.365779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:52.370004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d957629-4e4d-49cf-a238-88008d9dba59 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1361 microversion: 2.26 time: 0.967595 Jun 18 22:27:52.371145 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2740/5498] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:51 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1361 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:53.378098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:53.378578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:53.389961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.394110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.395500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.396097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.399642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:53.403358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:53.419158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.426547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.429465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.430112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.842072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:53.856149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:53.873973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:53.875034 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7791f6a-fc13-4053-91c3-29427be03f66 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.500969 Jun 18 22:27:53.876864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:53.889396 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2759/5499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:53 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:53.891046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2fb5e489-6b9e-46fd-96d3-77d2985986c6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1545 microversion: 2.26 time: 0.502067 Jun 18 22:27:53.904711 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2741/5500] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:53 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1545 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:53.913931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06ed4430>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:53.926819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.927312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.927960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:53.935310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.935833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.936702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.937313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.976262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.979552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:53.997119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:53.997581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.028918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:54.047377 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-138de71e-fe3b-434d-bc6c-e6e7a8e4f62c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-628588783" status: 201 len: 0 microversion: 2.26 time: 0.138283 Jun 18 22:27:54.048167 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2760/5501] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Jun 18 22:27:53 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-628588783 => generated 0 bytes in 140 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 18 22:27:54.060612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b33d03a9-c8a8-4f81-b9cd-797b8414998b tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea071e6940>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.078747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b33d03a9-c8a8-4f81-b9cd-797b8414998b tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.079731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b33d03a9-c8a8-4f81-b9cd-797b8414998b tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.102167 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b33d03a9-c8a8-4f81-b9cd-797b8414998b tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-628588783" status: 204 len: 0 microversion: 2.26 time: 0.048002 Jun 18 22:27:54.107617 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2742/5502] 10.222.0.30 () {60 vars in 1357 bytes} [Sat Jun 18 22:27:54 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-628588783 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:54.114614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06ee9ca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.126002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.126637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.127118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:54.133890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.134367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.135270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.136124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.166000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.166992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.191104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:54.208498 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7bff83c-8e38-418d-aa04-0339084f9f98 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 204 len: 0 microversion: 2.26 time: 0.099617 Jun 18 22:27:54.209329 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2761/5503] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Jun 18 22:27:54 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 18 22:27:54.220904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8579d1e2-7b91-40f5-bceb-e52cb565ffc5 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea071e65e0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.229135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8579d1e2-7b91-40f5-bceb-e52cb565ffc5 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.229593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8579d1e2-7b91-40f5-bceb-e52cb565ffc5 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.239857 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8579d1e2-7b91-40f5-bceb-e52cb565ffc5 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 200 len: 12 microversion: 2.26 time: 0.024575 Jun 18 22:27:54.240828 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2743/5504] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 22:27:54 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:54.252532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea07557c10>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.261177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.261624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.262200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:54.282444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.283653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.284850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.285769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.328868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.329457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.343762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.344302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.386122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:54.420083 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dbae690d-dd3e-44e6-bd0c-6360d0e4a210 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1224482890" status: 201 len: 0 microversion: 2.26 time: 0.173674 Jun 18 22:27:54.422520 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2762/5505] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Jun 18 22:27:54 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1224482890 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 18 22:27:54.439417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-01bef4c2-42d5-48bb-ac55-c57a9cd02057 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea07251820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.460920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01bef4c2-42d5-48bb-ac55-c57a9cd02057 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.461905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01bef4c2-42d5-48bb-ac55-c57a9cd02057 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.481279 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-01bef4c2-42d5-48bb-ac55-c57a9cd02057 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 200 len: 36 microversion: 2.26 time: 0.053388 Jun 18 22:27:54.486004 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2744/5506] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 22:27:54 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 36 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:54.493293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06f33b80>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.506178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.506790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.507424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:54.513845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.514631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.515587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.516168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.595747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.596195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.642850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:54.684225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6649645-fa7c-499d-9645-66a511c5c0b7 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1224482890" status: 204 len: 0 microversion: 2.26 time: 0.195756 Jun 18 22:27:54.685877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2763/5507] 10.222.0.30 () {60 vars in 1363 bytes} [Sat Jun 18 22:27:54 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1224482890 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:54.697075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b74a578-a461-4a2b-9bad-71d31059a815 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea076950d0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.710297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b74a578-a461-4a2b-9bad-71d31059a815 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.711125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b74a578-a461-4a2b-9bad-71d31059a815 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.737417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b74a578-a461-4a2b-9bad-71d31059a815 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 200 len: 12 microversion: 2.26 time: 0.044242 Jun 18 22:27:54.740376 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2745/5508] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 22:27:54 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:54.753683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06fbad30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.774924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.777157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.778424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:54.797630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.798184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.801210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.802684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.868182 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:27:54.869759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.870520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.874839 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 22:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:27:54.897013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:54.897931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:54.912603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.914704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.916435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:54.917415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:54.928631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:54.993485 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c798a29-1a71-4a74-9fb1-6054cdd7eabb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 204 len: 0 microversion: 2.26 time: 0.244624 Jun 18 22:27:54.994244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2764/5509] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Jun 18 22:27:54 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:55.018125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06ed4af0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:55.050036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.051997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.052605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:55.079866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.081651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.082787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.082906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.147308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.148925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.172407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.179194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.244959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:55.273170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:55.277737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4588f6e7-da35-417f-85b1-81b14144f6f6 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1776396615" status: 201 len: 0 microversion: 2.26 time: 0.270538 Jun 18 22:27:55.282385 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2120ef13-c09d-4191-8928-bc22014a1189 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1721 microversion: 2.1 time: 0.390677 Jun 18 22:27:55.283249 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2765/5510] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Jun 18 22:27:55 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1776396615 => generated 0 bytes in 281 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 18 22:27:55.284379 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2746/5511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:54 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:55.300409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06ee9d30>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:55.321778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.324466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.326386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:55.340399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.341121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.342297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.343193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.380665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.381383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.394220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:55.396942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.398028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.449905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:55.493146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4ab66780-68fc-4e3c-92e8-10b28805a590 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-424686651" status: 201 len: 0 microversion: 2.26 time: 0.196583 Jun 18 22:27:55.494104 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2766/5512] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Jun 18 22:27:55 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-424686651 => generated 0 bytes in 198 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 18 22:27:55.505051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea0729dee0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:55.519715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.520174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.520668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:55.547256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.553879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.558394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.559667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.619647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.620098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.660992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:55.706815 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1793129a-5e49-44c2-a6ab-972577dc8e39 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 204 len: 0 microversion: 2.26 time: 0.206192 Jun 18 22:27:55.707360 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2747/5513] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Jun 18 22:27:55 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:55.716747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-70fc2759-7d85-4c62-9ebf-f3fadaff7ac1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06f7a9d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:55.734856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70fc2759-7d85-4c62-9ebf-f3fadaff7ac1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.738250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70fc2759-7d85-4c62-9ebf-f3fadaff7ac1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.766539 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-70fc2759-7d85-4c62-9ebf-f3fadaff7ac1 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 200 len: 12 microversion: 2.26 time: 0.053168 Jun 18 22:27:55.771525 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2767/5514] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 22:27:55 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:55.781856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea072733a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:55.794723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.795493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.796185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:55.812809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.816469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.817507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.827665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.887766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.888469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.913469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:55.957201 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eab6aa66-11aa-4c7a-95b2-6a3639bf5172 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 204 len: 0 microversion: 2.26 time: 0.178810 Jun 18 22:27:55.960097 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2748/5515] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Jun 18 22:27:55 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:55.970633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea06ecdaf0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:55.992835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:55.993395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:55.993916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.006455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.007185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.008159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.010124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.043691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.044515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.068171 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.068577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.124081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:56.148593 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc0925ed-369c-4179-97bd-072cdb289c0c tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-661150302" status: 201 len: 0 microversion: 2.26 time: 0.182242 Jun 18 22:27:56.160816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea07739a60>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:56.164472 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2768/5516] 10.222.0.30 () {62 vars in 1376 bytes} [Sat Jun 18 22:27:55 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-661150302 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 18 22:27:56.180251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.189518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.190324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.210441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.212497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.213934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.217591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.280650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.281964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.305874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:56.306496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.307122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.312186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.324070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.324806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.325594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.326037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.358907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:27:56.372357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:56.416816 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f6e3c46-9fd9-4c77-aff6-9ef57a23e84a tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1703802990" status: 201 len: 0 microversion: 2.26 time: 0.260761 Jun 18 22:27:56.421225 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2749/5517] 10.222.0.30 () {62 vars in 1379 bytes} [Sat Jun 18 22:27:56 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags/tempest-tag-1703802990 => generated 0 bytes in 266 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jun 18 22:27:56.432160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Action: 'update_all', calling method: .version_select at 0x7fea19ca2e50>, body: {"tags": ["tempest-tag-1144248654", "tempest-tag-76947740"]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:56.465967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.469234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.470055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.494164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.496620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.497660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.498291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.540586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.541814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.568437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:56.594431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb8b4c21-5492-48a8-843f-693ff410c8f8 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 200 len: 60 microversion: 2.26 time: 0.168099 Jun 18 22:27:56.595769 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2750/5518] 10.222.0.30 () {62 vars in 1311 bytes} [Sat Jun 18 22:27:56 2022] PUT /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 60 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:56.616064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5721e136-0d5a-46f2-8aba-2fca6022b405 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea0720cc10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:56.627103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5721e136-0d5a-46f2-8aba-2fca6022b405 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.627990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5721e136-0d5a-46f2-8aba-2fca6022b405 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.640477 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5721e136-0d5a-46f2-8aba-2fca6022b405 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 200 len: 60 microversion: 2.26 time: 0.039138 Jun 18 22:27:56.641953 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2751/5519] 10.222.0.30 () {60 vars in 1291 bytes} [Sat Jun 18 22:27:56 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 60 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:56.684698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '.version_select at 0x7fea0720cb80>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:56.693062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:56.703919 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4ab25c3-79d1-4a7b-b9a6-718f94b4c9ef tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1698 microversion: 2.1 time: 0.404406 Jun 18 22:27:56.706075 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2769/5520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:56 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1698 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:56.712438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.717408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.718194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.735974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.736812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.738295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.738973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.739119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67291c09-19a7-4629-90d8-c7f8575e0008 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:27:56.756632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67291c09-19a7-4629-90d8-c7f8575e0008 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.759958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67291c09-19a7-4629-90d8-c7f8575e0008 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.771923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.774574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.803907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lazy-loading 'flavor' on Instance uuid 41660ae9-bd07-44d0-94de-e76ca41d7525 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:27:56.809082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67291c09-19a7-4629-90d8-c7f8575e0008 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Going to try to start instance {{(pid=130903) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 22:27:56.840177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d63db2a4-842a-49c7-ad38-c8ed45ad5dba tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags" status: 204 len: 0 microversion: 2.26 time: 0.186211 Jun 18 22:27:56.843282 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2752/5521] 10.222.0.30 () {60 vars in 1294 bytes} [Sat Jun 18 22:27:56 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:56.858961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:56.859819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.877025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.877893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.878696 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67291c09-19a7-4629-90d8-c7f8575e0008 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action" status: 202 len: 0 microversion: 2.1 time: 0.161749 Jun 18 22:27:56.880336 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2770/5522] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:27:56 2022] POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:27:56.880753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.881353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.893174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:56.894361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:56.906777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.908195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.911362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:56.924184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:56.968799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:27:57.201001 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4f72ad8-57c7-4431-a55a-a48d3a7907a9 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 204 len: 0 microversion: 2.26 time: 0.352324 Jun 18 22:27:57.206375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2753/5523] 10.222.0.30 () {60 vars in 1279 bytes} [Sat Jun 18 22:27:56 2022] DELETE /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 18 22:27:57.221964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:57.222679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:57.253839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:57.256084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:57.257157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:57.259661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:57.462277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:57.473605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-14f12835-4476-4877-bb6f-99b640c10014 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1707 microversion: 2.1 time: 0.585589 Jun 18 22:27:57.485233 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2771/5524] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:56 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1707 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:27:57.892224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:57.914477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:57.928796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:57.939941 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-81d4608d-f30c-4582-9c7e-9de538666f11 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1551 microversion: 2.26 time: 0.725705 Jun 18 22:27:57.944677 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2754/5525] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:57 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1551 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:27:58.495524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:58.496071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:58.546918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:58.548921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:58.552435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:58.553978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:58.958765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:27:58.960137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:27:58.969564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:58.970544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:58.971722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:27:58.973153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:27:59.097729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:59.109014 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dba748a8-18ab-4c50-a24d-030ba03954f2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1707 microversion: 2.1 time: 0.620880 Jun 18 22:27:59.114457 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2772/5526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:27:58 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1707 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:27:59.365784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:59.380428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:59.386474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:27:59.389394 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dfc6e2ee-1576-4915-85b1-5004c620de41 tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1551 microversion: 2.26 time: 0.433717 Jun 18 22:27:59.391573 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2755/5527] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:27:58 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1551 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:28:00.133404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:00.135163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:00.138448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:00.154041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:00.154494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:00.155692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:00.156329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:00.410141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:00.411540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:00.423378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:00.426589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:00.427560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:00.430264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:00.507735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:00.520375 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be7dc8b8-6751-4223-abee-64192a1385ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1707 microversion: 2.1 time: 0.390894 Jun 18 22:28:00.522010 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2773/5528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:00 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1707 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:01.213533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:01.231302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:01.234156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e582eb88d6740c1bf28911a53bd08c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccc2b1d2c4a49b59046bfc71b862519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:01.241189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-22212940-29ee-4664-9a8e-ef1a28422ceb tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 200 len: 1551 microversion: 2.26 time: 0.834980 Jun 18 22:28:01.252222 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2756/5529] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:28:00 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 1551 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 18 22:28:01.257955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d428d700-f599-42ea-8942-c6833188c1e3 req-6c463b9e-54d9-486b-b39a-789177c97e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41660ae9-bd07-44d0-94de-e76ca41d7525", "name": "network-vif-deleted", "tag": "cac36062-0237-4dd9-a108-d1cd34aa1f88"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:01.273947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d428d700-f599-42ea-8942-c6833188c1e3 req-6c463b9e-54d9-486b-b39a-789177c97e6b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:01.275686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d428d700-f599-42ea-8942-c6833188c1e3 req-6c463b9e-54d9-486b-b39a-789177c97e6b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:01.307905 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d428d700-f599-42ea-8942-c6833188c1e3 req-6c463b9e-54d9-486b-b39a-789177c97e6b service nova] Creating event network-vif-deleted:cac36062-0237-4dd9-a108-d1cd34aa1f88 for instance 41660ae9-bd07-44d0-94de-e76ca41d7525 on nch2-master-1 Jun 18 22:28:01.316081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d428d700-f599-42ea-8942-c6833188c1e3 req-6c463b9e-54d9-486b-b39a-789177c97e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063355 Jun 18 22:28:01.318778 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2774/5530] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:28:01.538943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:01.539550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:01.550519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:01.550946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:01.553419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:01.553864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:02.264856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:02.266292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] [instance: 41660ae9-bd07-44d0-94de-e76ca41d7525] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:02.278676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:02.279452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:02.280859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:02.282568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:02.299778 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] HTTP exception thrown: Instance 41660ae9-bd07-44d0-94de-e76ca41d7525 could not be found. Jun 18 22:28:02.300802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Request method failure captured: Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 HTTP/1.1 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlFZ71IEsv1RkTO854Lz2XsrcX22b6ZWhBB6dK2vsoW5UfZlN1k1ANF7VsUhCZMP3dLAMOQjesOcoSrxjZDE3AbkcSdz6JgLBVTEQURHns-KaaEUFP8x-sJi0LHUS4rbWoaHl968CG3ijLxOsoMvLoCpSHLawG0TWtvhZ77IDVV6PJ4 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Openstack-Nova-Api-Version: 2.26 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 9ccc2b1d2c4a49b59046bfc71b862519 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerTagsTestJSON-858771025 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9ccc2b1d2c4a49b59046bfc71b862519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9ccc2b1d2c4a49b59046bfc71b862519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9ccc2b1d2c4a49b59046bfc71b862519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9ccc2b1d2c4a49b59046bfc71b862519", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerTagsTestJSON-858771025 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 9ccc2b1d2c4a49b59046bfc71b862519 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerTagsTestJSON-858771025 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerTagsTestJSON-858771025-project Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 1e582eb88d6740c1bf28911a53bd08c0 Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerTagsTestJSON-858771025-project Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 41660ae9-bd07-44d0-94de-e76ca41d7525 could not be found. Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '41660ae9-bd07-44d0-94de-e76ca41d7525'} Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41660ae9-bd07-44d0-94de-e76ca41d7525 could not be found. Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41660ae9-bd07-44d0-94de-e76ca41d7525 could not be found. Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:02.303006 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41660ae9-bd07-44d0-94de-e76ca41d7525 could not be found. Jun 18 22:28:02.307330 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:02.308631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] Returning 404 to user: Instance 41660ae9-bd07-44d0-94de-e76ca41d7525 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:02.309850 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6735924d-2b68-47ab-aebe-ad8b0a77a6ae tempest-ServerTagsTestJSON-858771025 tempest-ServerTagsTestJSON-858771025-project] 10.222.0.30 "GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525" status: 404 len: 111 microversion: 2.26 time: 0.050891 Jun 18 22:28:02.310945 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2775/5531] 10.222.0.30 () {60 vars in 1276 bytes} [Sat Jun 18 22:28:02 2022] GET /compute/v2.1/servers/41660ae9-bd07-44d0-94de-e76ca41d7525 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:28:02.328160 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6cedf12-fb66-4d72-ba0d-064221825756 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1707 microversion: 2.1 time: 0.792966 Jun 18 22:28:02.332345 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2757/5532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:01 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1707 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:03.352524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:03.353977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:03.369797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:03.370527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:03.374227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:03.374788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:03.648545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:03.657552 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5eba64b-6f70-4b30-8839-4caeb8ad90a6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1711 microversion: 2.1 time: 0.311071 Jun 18 22:28:03.658795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2776/5533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:03 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1711 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:09.657571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-13a63dc2-7f4f-4c09-a9e1-775e4301504d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Action: 'create', calling method: .version_select at 0x7fea071e6e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-376657527", "metadata": {"Type": "work"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-13a63dc2-7f4f-4c09-a9e1-775e4301504d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Request method failure captured: Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 121 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlF5jUwSSaAbioo18ISbX-qpcuZb8NrQG4yOUtEcDhe87Y55Yuq5uREi4YCeujgULco5K8CWNCp7CL6VVQQk-jQkzECgaXEJUo4K8d6AE8fMLGS46HmPZ3DwQ8wiBhkrF1mjmAglhP082Qfu6eLtVoKBjMTRN7k5IXIVb5uMgJGiZuc Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44001d561e9f47a3a9981075fda8a9ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 654c2c17af464af2940f09d5e0cdbacf Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-376657527", "metadata": {"Type": "work"}}} Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-376657527', 'metadata': {'Type': 'work'}}}} Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi '#$%' Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:28:09.661806 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 18 22:28:09.665978 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.667703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-13a63dc2-7f4f-4c09-a9e1-775e4301504d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:09.668952 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-13a63dc2-7f4f-4c09-a9e1-775e4301504d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.249046 Jun 18 22:28:09.671241 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2758/5534] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:28:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 18 22:28:09.681633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a852299-2384-4c10-a226-0ae6b17e69ed tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Action: 'create', calling method: .version_select at 0x7fea06eea8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1196283292", "metadata": {"Type": "work"}}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a852299-2384-4c10-a226-0ae6b17e69ed tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Request method failure captured: Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 120 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlF5jUwSSaAbioo18ISbX-qpcuZb8NrQG4yOUtEcDhe87Y55Yuq5uREi4YCeujgULco5K8CWNCp7CL6VVQQk-jQkzECgaXEJUo4K8d6AE8fMLGS46HmPZ3DwQ8wiBhkrF1mjmAglhP082Qfu6eLtVoKBjMTRN7k5IXIVb5uMgJGiZuc Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44001d561e9f47a3a9981075fda8a9ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 654c2c17af464af2940f09d5e0cdbacf Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1196283292", "metadata": {"Type": "work"}}} Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1196283292', 'metadata': {'Type': 'work'}}}} Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi '0' Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:28:09.686497 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 18 22:28:09.690359 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.692970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a852299-2384-4c10-a226-0ae6b17e69ed tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:09.694089 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a852299-2384-4c10-a226-0ae6b17e69ed tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017359 Jun 18 22:28:09.698215 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2777/5535] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:28:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:28:09.710346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27651557-6d54-4c6b-a34b-b263c235cb5d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Action: 'create', calling method: .version_select at 0x7fea07273d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1520320561", "metadata": {"Type": "work"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27651557-6d54-4c6b-a34b-b263c235cb5d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Request method failure captured: Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 119 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlF5jUwSSaAbioo18ISbX-qpcuZb8NrQG4yOUtEcDhe87Y55Yuq5uREi4YCeujgULco5K8CWNCp7CL6VVQQk-jQkzECgaXEJUo4K8d6AE8fMLGS46HmPZ3DwQ8wiBhkrF1mjmAglhP082Qfu6eLtVoKBjMTRN7k5IXIVb5uMgJGiZuc Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44001d561e9f47a3a9981075fda8a9ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 654c2c17af464af2940f09d5e0cdbacf Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1520320561", "metadata": {"Type": "work"}}} Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1520320561', 'metadata': {'Type': 'work'}}}} Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi '' Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:28:09.713109 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 18 22:28:09.716708 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.724312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-27651557-6d54-4c6b-a34b-b263c235cb5d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:09.725651 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-27651557-6d54-4c6b-a34b-b263c235cb5d tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024239 Jun 18 22:28:09.726468 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2759/5536] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Jun 18 22:28:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:28:09.735656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8cea45be-ac00-46d4-a30c-cac765d0e747 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Calling method '.version_select at 0x7fea06e46dc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:09.786661 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8cea45be-ac00-46d4-a30c-cac765d0e747 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] HTTP exception thrown: Volume tempest-invalid-1017071522 could not be found. Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8cea45be-ac00-46d4-a30c-cac765d0e747 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Request method failure captured: Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1017071522 HTTP/1.1 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlF5jUwSSaAbioo18ISbX-qpcuZb8NrQG4yOUtEcDhe87Y55Yuq5uREi4YCeujgULco5K8CWNCp7CL6VVQQk-jQkzECgaXEJUo4K8d6AE8fMLGS46HmPZ3DwQ8wiBhkrF1mjmAglhP082Qfu6eLtVoKBjMTRN7k5IXIVb5uMgJGiZuc Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44001d561e9f47a3a9981075fda8a9ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 654c2c17af464af2940f09d5e0cdbacf Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: exception: Volume tempest-invalid-1017071522 could not be found. Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'tempest-invalid-1017071522'} Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1017071522 could not be found. (HTTP 404) (Request-ID: req-b2ab937d-9393-43e3-b9ba-18e1d49bfa3e) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:28:09.788753 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1017071522 could not be found. Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1017071522 could not be found. Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1017071522 could not be found. Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8cea45be-ac00-46d4-a30c-cac765d0e747 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Returning 404 to user: Volume tempest-invalid-1017071522 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8cea45be-ac00-46d4-a30c-cac765d0e747 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1017071522" status: 404 len: 99 microversion: 2.1 time: 0.058853 Jun 18 22:28:09.792697 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2778/5537] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:28:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1017071522 => generated 99 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 18 22:28:09.804058 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bfeeee4c-df59-4612-b980-6d451af21a56 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005852 Jun 18 22:28:09.804968 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2760/5538] 10.222.0.30 () {58 vars in 1139 bytes} [Sat Jun 18 22:28:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 22:28:09.817415 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-750d8898-7572-4cff-a361-9fd87143d5eb tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005758 Jun 18 22:28:09.818428 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2779/5539] 10.222.0.30 () {58 vars in 1136 bytes} [Sat Jun 18 22:28:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 18 22:28:09.829366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-edf1e6a5-67fc-4a87-abf0-4e9cb7f530d3 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Calling method '.version_select at 0x7fea072738b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:09.896124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-edf1e6a5-67fc-4a87-abf0-4e9cb7f530d3 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] HTTP exception thrown: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-edf1e6a5-67fc-4a87-abf0-4e9cb7f530d3 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Request method failure captured: Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/os-volumes/075c5ee1-fb9d-4abb-947c-10fdd5d80ebf HTTP/1.1 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlF5jUwSSaAbioo18ISbX-qpcuZb8NrQG4yOUtEcDhe87Y55Yuq5uREi4YCeujgULco5K8CWNCp7CL6VVQQk-jQkzECgaXEJUo4K8d6AE8fMLGS46HmPZ3DwQ8wiBhkrF1mjmAglhP082Qfu6eLtVoKBjMTRN7k5IXIVb5uMgJGiZuc Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44001d561e9f47a3a9981075fda8a9ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 654c2c17af464af2940f09d5e0cdbacf Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: method: Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: exception: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '075c5ee1-fb9d-4abb-947c-10fdd5d80ebf'} Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. (HTTP 404) (Request-ID: req-3a8467c9-afc5-460e-a913-85595fe394f2) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:28:09.905072 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. Jun 18 22:28:09.909513 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.914938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-edf1e6a5-67fc-4a87-abf0-4e9cb7f530d3 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Returning 404 to user: Volume 075c5ee1-fb9d-4abb-947c-10fdd5d80ebf could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:09.916396 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-edf1e6a5-67fc-4a87-abf0-4e9cb7f530d3 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/075c5ee1-fb9d-4abb-947c-10fdd5d80ebf" status: 404 len: 109 microversion: 2.1 time: 0.092402 Jun 18 22:28:09.917698 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2761/5540] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:28:09 2022] DELETE /compute/v2.1/os-volumes/075c5ee1-fb9d-4abb-947c-10fdd5d80ebf => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:28:09.927429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c48390f-71e6-4224-b641-02b472f0aa60 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Calling method '.version_select at 0x7fea06e46550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:09.962047 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-8c48390f-71e6-4224-b641-02b472f0aa60 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] HTTP exception thrown: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c48390f-71e6-4224-b641-02b472f0aa60 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Request method failure captured: Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/os-volumes/87b96f3d-73ab-4db5-b703-1b94b7554a5b HTTP/1.1 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlF5jUwSSaAbioo18ISbX-qpcuZb8NrQG4yOUtEcDhe87Y55Yuq5uREi4YCeujgULco5K8CWNCp7CL6VVQQk-jQkzECgaXEJUo4K8d6AE8fMLGS46HmPZ3DwQ8wiBhkrF1mjmAglhP082Qfu6eLtVoKBjMTRN7k5IXIVb5uMgJGiZuc Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/44001d561e9f47a3a9981075fda8a9ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_44001d561e9f47a3a9981075fda8a9ee", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 44001d561e9f47a3a9981075fda8a9ee Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesNegativeTest-1423919492 Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 654c2c17af464af2940f09d5e0cdbacf Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesNegativeTest-1423919492-project Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: method: Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: exception: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '87b96f3d-73ab-4db5-b703-1b94b7554a5b'} Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. (HTTP 404) (Request-ID: req-62ee90ca-2951-47d8-8be7-99969e9a3577) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 18 22:28:09.965551 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. Jun 18 22:28:09.970031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:09.974306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c48390f-71e6-4224-b641-02b472f0aa60 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] Returning 404 to user: Volume 87b96f3d-73ab-4db5-b703-1b94b7554a5b could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:09.975886 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8c48390f-71e6-4224-b641-02b472f0aa60 tempest-VolumesNegativeTest-1423919492 tempest-VolumesNegativeTest-1423919492-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/87b96f3d-73ab-4db5-b703-1b94b7554a5b" status: 404 len: 109 microversion: 2.1 time: 0.052913 Jun 18 22:28:09.983058 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2780/5541] 10.222.0.30 () {58 vars in 1244 bytes} [Sat Jun 18 22:28:09 2022] GET /compute/v2.1/os-volumes/87b96f3d-73ab-4db5-b703-1b94b7554a5b => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:19.964791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1237724023", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:19.972261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:19.973199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=61,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:20.025080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:28:20.332974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:28:20.333732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:28:20.334368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:28:20.335010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:28:20.335493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:28:20.349263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:20.349795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:20.350774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:20.352763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:20.375705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Getting quotas for project d2657072934844f9952c9c5e6b383d77. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:28:20.381609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Getting quotas for user 8bf0e99cc3bf40f29a8c1e6023718c56 and project d2657072934844f9952c9c5e6b383d77. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:28:20.396785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:28:20.399582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:28:20.476829 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7bd34579-9ffa-4952-8076-04d356420cb2 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514831 Jun 18 22:28:20.478235 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2762/5542] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:28:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:28:20.492761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:20.494299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=69,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:20.503685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6f38c7e-4ff1-47e0-8107-26711621f7dd tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:20.508778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6f38c7e-4ff1-47e0-8107-26711621f7dd tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:20.575599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f6f38c7e-4ff1-47e0-8107-26711621f7dd tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:20.586888 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6f38c7e-4ff1-47e0-8107-26711621f7dd tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1215 microversion: 2.1 time: 0.096089 Jun 18 22:28:20.588078 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2781/5543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:20 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:21.605020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:21.606218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:21.614269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:21.614955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:21.615929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:21.616519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:21.739866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:21.757749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d882dc74-4235-4d30-9e84-30823fa02ea7 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1267 microversion: 2.1 time: 0.157691 Jun 18 22:28:21.767943 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2763/5544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:21 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:22.778289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:22.778912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:22.795476 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:22.796120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:22.796906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:22.797706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:22.890156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:22.911035 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83ebed38-396e-4bd7-9eab-23d4a747ec1b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1273 microversion: 2.1 time: 0.137273 Jun 18 22:28:22.911915 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2782/5545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:22 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:23.930485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:23.931704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:23.941111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:23.941111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:23.942485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:23.942999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:24.057925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:24.069396 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a6939e3d-6191-474f-a779-1c72a1e6f3b5 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1273 microversion: 2.1 time: 0.144286 Jun 18 22:28:24.070775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2764/5546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:23 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:25.088378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:25.089136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:25.102201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:25.106023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:25.107404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:25.109414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:25.514143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:25.533847 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c02ef10a-ac99-4266-91bd-798c1ef1137a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1315 microversion: 2.1 time: 0.450627 Jun 18 22:28:25.543543 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2783/5547] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:25 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:26.320595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ac5c2718-bc55-4ebb-a019-13778851c247 req-c3220e23-0042-416e-9fb0-3f73dd1738fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "819d0898-d0f5-4089-880e-28cd8c0156e9", "tag": "c03f09c9-d92b-4bb7-b31d-268cfa9f8549"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:26.345074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ac5c2718-bc55-4ebb-a019-13778851c247 req-c3220e23-0042-416e-9fb0-3f73dd1738fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:26.345526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ac5c2718-bc55-4ebb-a019-13778851c247 req-c3220e23-0042-416e-9fb0-3f73dd1738fe service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:26.378553 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ac5c2718-bc55-4ebb-a019-13778851c247 req-c3220e23-0042-416e-9fb0-3f73dd1738fe service nova] Creating event network-changed:c03f09c9-d92b-4bb7-b31d-268cfa9f8549 for instance 819d0898-d0f5-4089-880e-28cd8c0156e9 on nch2-master-1 Jun 18 22:28:26.395072 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ac5c2718-bc55-4ebb-a019-13778851c247 req-c3220e23-0042-416e-9fb0-3f73dd1738fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083793 Jun 18 22:28:26.395692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2765/5548] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:28:26.551638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:26.552979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:26.560819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:26.561704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:26.562730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:26.563774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:27.031795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:27.040680 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c578fd71-bddc-4d66-814a-a1c3f3f0a334 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1315 microversion: 2.1 time: 0.493104 Jun 18 22:28:27.046640 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2784/5549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:26 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:28.065077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:28.065787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:28.072456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:28.072907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:28.073947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:28.074526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:28.464144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:28.481892 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-510dc976-1f77-4d6d-a63c-6908839a5589 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1315 microversion: 2.1 time: 0.421564 Jun 18 22:28:28.482744 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2766/5550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:28 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:29.501520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:29.502158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:29.514828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:29.515292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:29.519211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:29.519678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:29.883959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:29.891801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9993d31-0265-4b88-b3da-d906ba4a61dc tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1315 microversion: 2.1 time: 0.395095 Jun 18 22:28:29.892761 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2785/5551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:29 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:30.909295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:30.910546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:30.924816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:30.926813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:30.932865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:30.934358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:30.937317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:30.937937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:31.149073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:31.158499 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c17699d6-b5ba-4a02-9488-3c63f538dd0b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1315 microversion: 2.1 time: 0.254519 Jun 18 22:28:31.164349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2767/5552] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:30 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:31.337368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-95dccf76-d002-4e76-805c-ca3fda2caa36 req-9e73c2ab-dd7f-413d-bba2-c3c90d12e0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819d0898-d0f5-4089-880e-28cd8c0156e9", "name": "network-vif-plugged", "status": "completed", "tag": "c03f09c9-d92b-4bb7-b31d-268cfa9f8549"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:31.346775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:31.367563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-95dccf76-d002-4e76-805c-ca3fda2caa36 req-9e73c2ab-dd7f-413d-bba2-c3c90d12e0a2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:31.368813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-95dccf76-d002-4e76-805c-ca3fda2caa36 req-9e73c2ab-dd7f-413d-bba2-c3c90d12e0a2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:31.410692 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-95dccf76-d002-4e76-805c-ca3fda2caa36 req-9e73c2ab-dd7f-413d-bba2-c3c90d12e0a2 service nova] Creating event network-vif-plugged:c03f09c9-d92b-4bb7-b31d-268cfa9f8549 for instance 819d0898-d0f5-4089-880e-28cd8c0156e9 on nch2-master-1 Jun 18 22:28:31.427484 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-95dccf76-d002-4e76-805c-ca3fda2caa36 req-9e73c2ab-dd7f-413d-bba2-c3c90d12e0a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094157 Jun 18 22:28:31.431978 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2786/5553] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:28:32.185080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:32.187449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:32.200090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:32.200915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:32.202188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:32.202808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:32.376329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:32.384206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69e3aac5-9b15-449a-94ac-6687f671165f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1315 microversion: 2.1 time: 0.204061 Jun 18 22:28:32.385605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2768/5554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:32 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:33.403418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:33.404136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:33.419619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:33.420051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:33.420920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:33.425917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:33.609108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:33.617753 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9c693ce4-a1fb-44fe-b8fd-376367020e3f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1463 microversion: 2.1 time: 0.220241 Jun 18 22:28:33.618349 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2787/5555] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:33 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1463 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:33.663851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:33.665243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:33.675573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:33.676285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:33.680701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:33.681600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:33.720354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:28:33.824940 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ae8d9260-9610-42ba-a8ad-023c2e67914b tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "DELETE /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 204 len: 0 microversion: 2.1 time: 0.164833 Jun 18 22:28:33.825571 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2769/5556] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:28:33 2022] DELETE /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:28:33.837756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:33.838559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:33.846556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:33.847092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:33.848208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:33.849374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:34.028407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:34.040082 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5697658d-4dd3-42eb-9794-8ac08e11b257 tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1469 microversion: 2.1 time: 0.207663 Jun 18 22:28:34.041136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2788/5557] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:33 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:35.061766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:35.067143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:35.074326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:35.075063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:35.075915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:35.076550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:35.274347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:35.288441 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2f30fd3-93a3-4505-a413-b60c310e2e6c tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1469 microversion: 2.1 time: 0.232188 Jun 18 22:28:35.298728 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2770/5558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:35 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1469 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:36.306640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:36.307876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:36.315414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:36.315870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:36.316651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:36.317114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:36.553000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bf0e99cc3bf40f29a8c1e6023718c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2657072934844f9952c9c5e6b383d77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:36.566465 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-04cc9bd5-9fd8-48ab-bf83-df4243a5a18f tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 200 len: 1469 microversion: 2.1 time: 0.263874 Jun 18 22:28:36.570781 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2789/5559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:36 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:36.684931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-abd34641-04d3-40f1-82df-61b8015217fe req-167b48cf-0a05-4362-a00e-57249667e7ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "819d0898-d0f5-4089-880e-28cd8c0156e9", "name": "network-vif-deleted", "tag": "c03f09c9-d92b-4bb7-b31d-268cfa9f8549"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:36.703894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-abd34641-04d3-40f1-82df-61b8015217fe req-167b48cf-0a05-4362-a00e-57249667e7ac service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:36.706124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-abd34641-04d3-40f1-82df-61b8015217fe req-167b48cf-0a05-4362-a00e-57249667e7ac service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:36.725910 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-abd34641-04d3-40f1-82df-61b8015217fe req-167b48cf-0a05-4362-a00e-57249667e7ac service nova] Creating event network-vif-deleted:c03f09c9-d92b-4bb7-b31d-268cfa9f8549 for instance 819d0898-d0f5-4089-880e-28cd8c0156e9 on nch2-master-1 Jun 18 22:28:36.734169 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-abd34641-04d3-40f1-82df-61b8015217fe req-167b48cf-0a05-4362-a00e-57249667e7ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053472 Jun 18 22:28:36.735607 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2771/5560] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:28:37.586691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:37.588114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] [instance: 819d0898-d0f5-4089-880e-28cd8c0156e9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:37.596525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:37.597324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:37.598317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:37.598962 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:37.614244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] HTTP exception thrown: Instance 819d0898-d0f5-4089-880e-28cd8c0156e9 could not be found. Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Request method failure captured: Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 HTTP/1.1 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlGCBfrbH1Qyr6HGNg6y5Qms45lH5rn_M4P35P7g-KBjrsO2O-At0CPOs6Ux739j3JpdNNxljuj1c9im7DAv4mnkNR4U8lDZtkOQOjz4mi2OuZOObui0PHhcZkPmlxulZjmMSomMJisUadAQ6oh0ukO8YZLIBPQXKFnGTVRszMm3zSw Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: d2657072934844f9952c9c5e6b383d77 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-VolumesNegativeTest-1472555787 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2657072934844f9952c9c5e6b383d77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2657072934844f9952c9c5e6b383d77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2657072934844f9952c9c5e6b383d77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2657072934844f9952c9c5e6b383d77", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-VolumesNegativeTest-1472555787 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: d2657072934844f9952c9c5e6b383d77 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-VolumesNegativeTest-1472555787 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-VolumesNegativeTest-1472555787-project Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 8bf0e99cc3bf40f29a8c1e6023718c56 Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-VolumesNegativeTest-1472555787-project Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 819d0898-d0f5-4089-880e-28cd8c0156e9 could not be found. Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '819d0898-d0f5-4089-880e-28cd8c0156e9'} Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 819d0898-d0f5-4089-880e-28cd8c0156e9 could not be found. Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 819d0898-d0f5-4089-880e-28cd8c0156e9 could not be found. Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:28:37.616168 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 819d0898-d0f5-4089-880e-28cd8c0156e9 could not be found. Jun 18 22:28:37.619818 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:28:37.622547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] Returning 404 to user: Instance 819d0898-d0f5-4089-880e-28cd8c0156e9 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:28:37.623712 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f6172965-3ef9-434b-9398-45dd9f00203a tempest-VolumesNegativeTest-1472555787 tempest-VolumesNegativeTest-1472555787-project] 10.222.0.30 "GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9" status: 404 len: 111 microversion: 2.1 time: 0.041490 Jun 18 22:28:37.624534 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2790/5561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:37 2022] GET /compute/v2.1/servers/819d0898-d0f5-4089-880e-28cd8c0156e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:28:47.414728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:47.416613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:47.669667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Calling method '.version_select at 0x7fea071d6c10>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:47.671174 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:28:47.671174 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:28:47.672958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:47.673839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:47.702252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:47.703005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:47.718005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:47.718717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:47.725507 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c816996d-ec78-4997-b034-b06c74d5e077 tempest-PortsAdminExtendedAttrsTestJSON-693474455 tempest-PortsAdminExtendedAttrsTestJSON-693474455-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.317814 Jun 18 22:28:47.726438 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2772/5562] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:28:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:28:49.297155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=22 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:49.298084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=46 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:28:49.660375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1985843044", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1750f03c-d254-401c-9d9f-75c6f5e7be7c"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:49.739697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] validate_networks() for [('1750f03c-d254-401c-9d9f-75c6f5e7be7c', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:28:50.439130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:28:50.440236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:28:50.440930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:28:50.441424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:28:50.442015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:28:50.452737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:50.453458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:50.454939 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:50.455588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:50.476124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Getting quotas for project e9a9696c07e1419b93df7b56eec5fc8a. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:28:50.489549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Getting quotas for user d372d0f2489b4b0f86ccfc560cd27efd and project e9a9696c07e1419b93df7b56eec5fc8a. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:28:50.507109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:28:50.509505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:28:50.580988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e76ce223-742b-4d7b-9720-62961bd08616 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291202 Jun 18 22:28:50.582625 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2791/5563] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:28:50.593774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-32e0cfa2-e4d0-4c85-88d2-00a25945d61c tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:50.595244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-32e0cfa2-e4d0-4c85-88d2-00a25945d61c tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:50.685676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-32e0cfa2-e4d0-4c85-88d2-00a25945d61c tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:50.698007 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-32e0cfa2-e4d0-4c85-88d2-00a25945d61c tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1215 microversion: 2.1 time: 0.109445 Jun 18 22:28:50.708508 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2773/5564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:50 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:51.554926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:51.555557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:51.564749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:51.565604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:51.566996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:51.567582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:51.702419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lazy-loading 'services' on Instance uuid d2a0ac3f-2e1b-423a-8476-d9deb8eec449 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:28:51.717124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:51.717833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:51.746878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:51.747195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:51.751152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:51.751756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:51.837018 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-475386d1-9bec-4399-911f-332dc132e4d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-volume_attachments/aba020c7-b736-46ee-a1d6-be5789623a04" status: 202 len: 0 microversion: 2.1 time: 0.286597 Jun 18 22:28:51.838948 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2792/5565] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:28:51 2022] DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-volume_attachments/aba020c7-b736-46ee-a1d6-be5789623a04 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:28:51.852721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:51.870277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2bc5d02c-1e64-4d5f-ae6b-e09e2446707f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1267 microversion: 2.1 time: 0.156090 Jun 18 22:28:51.897846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2774/5566] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:51 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:52.891367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:52.893180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:52.905603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:52.906105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:52.907114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:52.907734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:53.121265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-79826d05-9b76-4186-a00d-343a5d325de6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:53.131152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79826d05-9b76-4186-a00d-343a5d325de6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:53.132020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79826d05-9b76-4186-a00d-343a5d325de6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:53.151635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:53.166516 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3bb77b4e-bdbe-440b-b268-58966c78a02f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1273 microversion: 2.1 time: 0.282298 Jun 18 22:28:53.168354 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2793/5567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:52 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:53.188738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-79826d05-9b76-4186-a00d-343a5d325de6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Going to try to stop instance {{(pid=130902) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:28:53.269720 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-79826d05-9b76-4186-a00d-343a5d325de6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action" status: 202 len: 0 microversion: 2.1 time: 0.151937 Jun 18 22:28:53.275328 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2775/5568] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:28:53 2022] POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:28:53.290516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:53.294734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:53.319966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:53.322259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:53.323675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:53.325382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:53.802301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:53.823445 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d28de27a-d307-4f09-8c55-f9435fe6ae86 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.543740 Jun 18 22:28:53.824517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2794/5569] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:53 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:54.196451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:54.197292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:54.255887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:54.261186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:54.270725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:54.271307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:54.821981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-fd92fdf1-5ed0-4c84-98a6-bb84822b5a0b req-18fa1a27-a5be-42b2-ba71-2ab42791539d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a4e71d-588f-40e2-944a-30424e996880", "tag": "0509c799-66b5-48d6-8641-293a595d6d7c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:54.834827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fd92fdf1-5ed0-4c84-98a6-bb84822b5a0b req-18fa1a27-a5be-42b2-ba71-2ab42791539d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:54.835669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fd92fdf1-5ed0-4c84-98a6-bb84822b5a0b req-18fa1a27-a5be-42b2-ba71-2ab42791539d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:54.858011 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-fd92fdf1-5ed0-4c84-98a6-bb84822b5a0b req-18fa1a27-a5be-42b2-ba71-2ab42791539d service nova] Creating event network-changed:0509c799-66b5-48d6-8641-293a595d6d7c for instance 88a4e71d-588f-40e2-944a-30424e996880 on nch2-master-1 Jun 18 22:28:54.866531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-fd92fdf1-5ed0-4c84-98a6-bb84822b5a0b req-18fa1a27-a5be-42b2-ba71-2ab42791539d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048876 Jun 18 22:28:54.868041 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2795/5570] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:28:54.876410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:54.878838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:54.886432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:54.886936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:54.887724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:54.888151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:55.175884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:55.188179 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9e261950-86e8-4918-85b8-283e02767aaf tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1315 microversion: 2.1 time: 0.999022 Jun 18 22:28:55.188992 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2776/5571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:54 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1315 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:55.333083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:55.341473 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9583373d-13f5-40e6-a01f-58bde79f5ef2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.471198 Jun 18 22:28:55.342059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2796/5572] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:54 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:56.206730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:56.207504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:56.223669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:56.224135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:56.224937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:56.225407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:56.360154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:56.361425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:56.374085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:56.378975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:56.380447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:56.383135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:56.704234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:56.714432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-25f366c2-a141-40c7-8684-13354f8a69f8 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1315 microversion: 2.1 time: 0.511691 Jun 18 22:28:56.715544 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2777/5573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:56 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:56.831314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:56.844221 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-92cf2cc6-799f-472d-ad12-62daa100007a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.488224 Jun 18 22:28:56.845587 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2797/5574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:56 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:28:57.733205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:57.733966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:57.760698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:57.765092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:57.771129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:57.771980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:57.862907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:57.863701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:57.879485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:57.882126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:57.885353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:57.888764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:58.319966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:58.328009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:58.328819 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd15c544-973b-4915-8527-f7e5b444ea11 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.471025 Jun 18 22:28:58.335978 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee9490a3-b038-4148-a316-8f2beaf790f7 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1315 microversion: 2.1 time: 0.608498 Jun 18 22:28:58.336552 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2778/5575] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:57 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:58.340197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2798/5576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:57 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:59.356060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:59.357463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:59.357825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:28:59.359018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:28:59.378337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:59.379078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:59.380684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:59.382444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:59.382775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:59.385414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:59.387460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:59.388978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:59.862238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:28:59.870582 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e1a68b96-c771-49ac-8f8f-3b3f1b34a5d0 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.527647 Jun 18 22:28:59.871195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2779/5577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:59 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:28:59.892713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cb1a9b3c-aa01-4990-8450-d2741bfa818b req-394ce352-e4ef-43a9-955a-151715630fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a4e71d-588f-40e2-944a-30424e996880", "name": "network-vif-plugged", "status": "completed", "tag": "0509c799-66b5-48d6-8641-293a595d6d7c"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:28:59.902376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cb1a9b3c-aa01-4990-8450-d2741bfa818b req-394ce352-e4ef-43a9-955a-151715630fc2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:28:59.902809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cb1a9b3c-aa01-4990-8450-d2741bfa818b req-394ce352-e4ef-43a9-955a-151715630fc2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:28:59.934666 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cb1a9b3c-aa01-4990-8450-d2741bfa818b req-394ce352-e4ef-43a9-955a-151715630fc2 service nova] Creating event network-vif-plugged:0509c799-66b5-48d6-8641-293a595d6d7c for instance 88a4e71d-588f-40e2-944a-30424e996880 on nch2-master-1 Jun 18 22:28:59.945729 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cb1a9b3c-aa01-4990-8450-d2741bfa818b req-394ce352-e4ef-43a9-955a-151715630fc2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066930 Jun 18 22:28:59.948271 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2780/5578] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:29:00.045554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:00.057336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3e9bc427-78ae-4a17-9ec5-a1b9dfa6c5f1 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1315 microversion: 2.1 time: 0.708369 Jun 18 22:29:00.059145 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2799/5579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:28:59 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1315 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:00.897149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:00.898096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:00.908275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:00.912561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:00.913320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:00.914593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:00.915214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:01.078257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:01.079512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:01.112093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:01.112873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:01.114859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:01.115346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:01.117001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:01.117907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:01.361402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:01.373283 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1814f140-3391-4eb8-88ce-5b2f8c1df0a2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.488509 Jun 18 22:29:01.376991 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2781/5580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:00 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:01.439894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:01.451370 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-525da0b5-811d-4b82-b2f6-0cd4a051650f tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1315 microversion: 2.1 time: 0.376794 Jun 18 22:29:01.452433 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2800/5581] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:01 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:02.398070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:02.399434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:02.440880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:02.442441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:02.444417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:02.448237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:02.468203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:02.468831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:02.486979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:02.487443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:02.488243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:02.488706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:02.885131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:02.900546 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d16efda-1e9e-4bec-ac41-b6d707ff1602 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.506210 Jun 18 22:29:02.902006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2782/5582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:02 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:02.965528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:02.985067 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2949900c-de15-404d-b628-e0451d405da4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1502 microversion: 2.1 time: 0.521139 Jun 18 22:29:02.986686 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2801/5583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:02 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1502 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:29:03.004453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:03.005656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:03.013637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.014224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.015422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.016017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.368673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:03.382709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b7bc714b-745a-4e86-ab53-134250e3be71 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1502 microversion: 2.1 time: 0.382387 Jun 18 22:29:03.384536 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2783/5584] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:02 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1502 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:03.401844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:29:03.402397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:03.422529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.423239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.427627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.429811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.473879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lazy-loading 'flavor' on Instance uuid 88a4e71d-588f-40e2-944a-30424e996880 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:29:03.576502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-69188e3f-819e-4abb-b6dd-8af8e667d631 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action" status: 202 len: 0 microversion: 2.1 time: 0.178293 Jun 18 22:29:03.577729 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2802/5585] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:29:03 2022] POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:29:03.586972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:03.588089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:03.604032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.605384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.611849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.612788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.919470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:03.920265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:03.927698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.928473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:03.929549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:03.930182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:04.064779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:04.077244 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a5c024b-b537-4690-9842-ff5a70274e2b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1510 microversion: 2.1 time: 0.494629 Jun 18 22:29:04.082605 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2784/5586] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:03 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:04.219998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:04.230443 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dea67987-6fab-4758-ba55-216212bd3767 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.315366 Jun 18 22:29:04.231446 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2803/5587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:03 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:29:05.100742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:05.101411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:05.115891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:05.126539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:05.131439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:05.143034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:05.249992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:05.250724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:05.268352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:05.269009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:05.271146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:05.272353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:05.827218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:05.836031 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30f1b87d-9a10-406e-99c2-ac5c78d96597 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1493 microversion: 2.1 time: 0.740481 Jun 18 22:29:05.837274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2785/5588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:05 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1493 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:05.841298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:05.853281 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-48e51b59-ba21-4003-9b3f-0bf7c8d02efd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.604775 Jun 18 22:29:05.863948 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2804/5589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:05 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:29:05.868446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:29:05.871055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:05.880122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:05.882429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:05.883435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:05.884095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:06.026667 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb61a913-c320-49bb-bf52-22ed36cf5849 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action" status: 202 len: 0 microversion: 2.1 time: 0.174945 Jun 18 22:29:06.027337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2786/5590] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:29:05 2022] POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:29:06.036697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:06.037776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:06.047249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:06.054635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:06.055850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:06.056378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:06.533420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:06.550279 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f59ffc3c-3339-4c60-b4db-b1c4d0435d6b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1499 microversion: 2.1 time: 0.518405 Jun 18 22:29:06.555043 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2805/5591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:06 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1499 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:06.871904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:06.872618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:06.891415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:06.891869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:06.892652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:06.893117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:07.325979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:07.339417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d71dbe5-6e25-49b2-95fe-1c2de59f493f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.471935 Jun 18 22:29:07.342117 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2787/5592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:06 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:07.571827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:07.572451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:07.599246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:07.599784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:07.607571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:07.607695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:07.665821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:08.158665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:08.172513 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60f128b6-02f0-40c1-ae75-70fd7fde178e tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1499 microversion: 2.1 time: 0.601713 Jun 18 22:29:08.176934 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2806/5593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:07 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1499 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:08.360905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:08.362351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:08.380963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:08.385766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:08.387536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:08.389482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:08.452992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:08.933561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:08.947318 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5b9a11b-1d82-4e99-a562-455cef2f6d19 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.591099 Jun 18 22:29:08.949613 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2788/5594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:08 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:09.191299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:09.192134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:09.213306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:09.213954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:09.223287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:09.233595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:09.838776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:09.850371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f4f5f30-3a0e-4233-b73f-21b71f10c974 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1502 microversion: 2.1 time: 0.663313 Jun 18 22:29:09.867247 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2807/5595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:09 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1502 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:09.873200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:29:09.874546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:09.883131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:09.884057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:09.885206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:09.886138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:09.933264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lazy-loading 'flavor' on Instance uuid 88a4e71d-588f-40e2-944a-30424e996880 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:29:09.966132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:09.966982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:09.979362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:09.981323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:09.982150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:09.982593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:10.098425 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eee0ba51-b173-477d-97fa-7fa7c1bd089d tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action" status: 202 len: 0 microversion: 2.1 time: 0.229102 Jun 18 22:29:10.103569 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2789/5596] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:29:09 2022] POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:29:10.124751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:10.131426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:10.140935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:10.141445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:10.142590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:10.143178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:10.280464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:10.289739 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9216794-9747-4641-a5a6-5f6f13f937a7 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.327308 Jun 18 22:29:10.290401 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2808/5597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:09 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:29:11.161713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:11.173664 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad93db54-1aa0-46c2-b760-7390c1a65b5a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1510 microversion: 2.1 time: 1.058118 Jun 18 22:29:11.185612 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2790/5598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:10 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1510 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:11.307620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:11.308263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:11.317682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:11.318234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:11.319098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:11.319703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:11.646321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:11.657877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-feb93972-3031-495a-a25f-1e64c2add792 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.354076 Jun 18 22:29:11.673470 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2809/5599] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:11 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:12.191729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:12.192343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:12.207028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.207485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.208271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.208709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.610717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:12.625308 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9b630ec4-a1c4-487d-b77a-3a0990ea1ee4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1493 microversion: 2.1 time: 0.437690 Jun 18 22:29:12.636875 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2791/5600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:12 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1493 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:12.643037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:29:12.644246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:12.652635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.653390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.654398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.655030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.677589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:12.678448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:12.689357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.691401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.692969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.697447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.781110 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e2ed762-17fe-45ae-8b49-5ccfec3a8099 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action" status: 202 len: 0 microversion: 2.1 time: 0.141534 Jun 18 22:29:12.787076 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2810/5601] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:29:12 2022] POST /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:29:12.795938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:12.797421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:12.807187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.808173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:12.809520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:12.810261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:13.097024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:13.117643 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be663caf-0740-43a7-8f04-8c7037d51ef9 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1675 microversion: 2.1 time: 0.444563 Jun 18 22:29:13.120711 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2792/5602] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:12 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1675 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:13.298750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:13.312634 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-92fb114c-3977-4231-a650-69b30f744dcd tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1499 microversion: 2.1 time: 0.523507 Jun 18 22:29:13.316835 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2811/5603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:12 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1499 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:14.139011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:14.141051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:14.150029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.151028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.152297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.152832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.338767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:14.340238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:14.364016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.364614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.368675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.369313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.443423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:14.463168 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a8e7584-7169-4def-b006-b86ef99b6b75 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1652 microversion: 2.1 time: 0.328456 Jun 18 22:29:14.464404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2793/5604] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:14 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1652 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:14.481625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f9eb0f33-bc20-48b2-8b29-f1e179bf509c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:29:14.488807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9eb0f33-bc20-48b2-8b29-f1e179bf509c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.489280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f9eb0f33-bc20-48b2-8b29-f1e179bf509c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.522048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f9eb0f33-bc20-48b2-8b29-f1e179bf509c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Going to try to start instance {{(pid=130902) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 22:29:14.579687 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f9eb0f33-bc20-48b2-8b29-f1e179bf509c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action" status: 202 len: 0 microversion: 2.1 time: 0.102472 Jun 18 22:29:14.581302 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2794/5605] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:29:14 2022] POST /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:29:14.607267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:14.608198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:14.634694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.635487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.637627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:14.640139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:14.679611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:14.692016 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc7b952a-21b3-447f-9197-eecfb636b2e4 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1499 microversion: 2.1 time: 0.361007 Jun 18 22:29:14.698416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2812/5606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:14 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1499 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:15.155153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:15.169240 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-988fe037-7696-44ea-b9cc-1bc421c31e7e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1661 microversion: 2.1 time: 0.570703 Jun 18 22:29:15.170714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2795/5607] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:14 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1661 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:15.710366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:15.710968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:15.718625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:15.719081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:15.719854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:15.720673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.128942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:16.143139 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-22373390-bd02-4b96-b954-b978a534b143 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1502 microversion: 2.1 time: 0.436810 Jun 18 22:29:16.145243 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2813/5608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:15 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1502 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:16.162027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:16.163043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:16.171254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:16.171925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.173398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:16.173834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.189868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:16.190760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:16.202410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:16.204236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.205064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:16.209125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.226051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:29:16.351175 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bba4dec9-31bb-4f40-88c1-7876721412cb tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 204 len: 0 microversion: 2.1 time: 0.189547 Jun 18 22:29:16.352914 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2796/5609] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:29:16 2022] DELETE /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:29:16.367269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:16.368483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:16.377297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:16.378050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.379240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:16.379880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:16.656607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:16.665433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0547355f-3890-4e89-9d3e-69d6cb84a9c6 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1665 microversion: 2.1 time: 0.481668 Jun 18 22:29:16.669648 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2814/5610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:16 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1665 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:16.775436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:16.784673 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-661721fa-4ffb-4f05-a2ea-298855e0c94a tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1508 microversion: 2.1 time: 0.424421 Jun 18 22:29:16.795835 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2797/5611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:16 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:17.813625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:17.817064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:17.827886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:17.828791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:17.830121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:17.831359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:18.122710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:18.131608 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e26c6de-2570-4b21-9434-5cdfafe3e558 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1508 microversion: 2.1 time: 0.331215 Jun 18 22:29:18.132600 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2815/5612] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:17 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:19.150337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:19.150892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:19.154961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:19.162938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:19.163512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:19.164170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:19.164821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:19.403541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd372d0f2489b4b0f86ccfc560cd27efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9a9696c07e1419b93df7b56eec5fc8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:29:19.412343 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be435881-95c9-4d7f-9daa-99cfcd56e58b tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 200 len: 1508 microversion: 2.1 time: 0.266279 Jun 18 22:29:19.414263 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2798/5613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:19 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:29:19.639046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-34e463a4-cc71-4691-8778-1f2eb8533dfa req-ac45a23d-207d-4553-bbe9-5d7d4cabf710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a4e71d-588f-40e2-944a-30424e996880", "name": "network-vif-deleted", "tag": "0509c799-66b5-48d6-8641-293a595d6d7c"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:29:19.653982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:29:19.656872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-34e463a4-cc71-4691-8778-1f2eb8533dfa req-ac45a23d-207d-4553-bbe9-5d7d4cabf710 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:19.658205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-34e463a4-cc71-4691-8778-1f2eb8533dfa req-ac45a23d-207d-4553-bbe9-5d7d4cabf710 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:19.694849 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-34e463a4-cc71-4691-8778-1f2eb8533dfa req-ac45a23d-207d-4553-bbe9-5d7d4cabf710 service nova] Creating event network-vif-deleted:0509c799-66b5-48d6-8641-293a595d6d7c for instance 88a4e71d-588f-40e2-944a-30424e996880 on nch2-master-1 Jun 18 22:29:19.702872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-34e463a4-cc71-4691-8778-1f2eb8533dfa req-ac45a23d-207d-4553-bbe9-5d7d4cabf710 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071909 Jun 18 22:29:19.721807 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2816/5614] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:29:20.429882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:29:20.431154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] [instance: 88a4e71d-588f-40e2-944a-30424e996880] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:29:20.440077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:20.440508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:20.441744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:29:20.442051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:29:20.465781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] HTTP exception thrown: Instance 88a4e71d-588f-40e2-944a-30424e996880 could not be found. Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Request method failure captured: Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 HTTP/1.1 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlGehhqVKIkb0_-ZLRuAFtsc76kmvRtcil1xmP9Og_Btdxy6-qnzRx4cFmftkvfS_HISBjsGGH_miD5sL7l47AaoBIQEexsw__NReHGa5ONhX5SuJz-KpWy8WbxXBTCUQO-qGinlpUbOSWRtdaH9nTbpnL2P6MdTaNX3BslLRUkPvvg Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: e9a9696c07e1419b93df7b56eec5fc8a Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestServerAdvancedOps-1310074482 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e9a9696c07e1419b93df7b56eec5fc8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e9a9696c07e1419b93df7b56eec5fc8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e9a9696c07e1419b93df7b56eec5fc8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e9a9696c07e1419b93df7b56eec5fc8a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestServerAdvancedOps-1310074482 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: e9a9696c07e1419b93df7b56eec5fc8a Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestServerAdvancedOps-1310074482 Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestServerAdvancedOps-1310074482-project Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d372d0f2489b4b0f86ccfc560cd27efd Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestServerAdvancedOps-1310074482-project Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 88a4e71d-588f-40e2-944a-30424e996880 could not be found. Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '88a4e71d-588f-40e2-944a-30424e996880'} Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a4e71d-588f-40e2-944a-30424e996880 could not be found. Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a4e71d-588f-40e2-944a-30424e996880 could not be found. Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:29:20.467742 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a4e71d-588f-40e2-944a-30424e996880 could not be found. Jun 18 22:29:20.471691 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:29:20.473593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] Returning 404 to user: Instance 88a4e71d-588f-40e2-944a-30424e996880 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:29:20.474576 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3891a39a-318e-4cb5-bebf-10d2cc1f9c85 tempest-TestServerAdvancedOps-1310074482 tempest-TestServerAdvancedOps-1310074482-project] 10.222.0.30 "GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880" status: 404 len: 111 microversion: 2.1 time: 0.048691 Jun 18 22:29:20.475221 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2799/5615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:29:20 2022] GET /compute/v2.1/servers/88a4e71d-588f-40e2-944a-30424e996880 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:30:04.643767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:04.647844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:04.653964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:04.663523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:04.664051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:04.665087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:04.665722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:04.755301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67eca8d2-db20-4127-a149-68df5da6c643 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129696 Jun 18 22:30:04.756607 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2817/5616] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:30:04 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 18 22:30:04.940444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:04.941200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:04.944348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:04.945062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:04.962841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:04.971872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:04.976115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:04.980052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:05.088980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:30:05.316644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68114c1c-43e0-4e01-9d4f-b0e30bedc556 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 204 len: 0 microversion: 2.1 time: 0.381007 Jun 18 22:30:05.326561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2800/5617] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:30:04 2022] DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:30:05.335998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:05.336641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:05.343824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:05.344277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:05.345077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:05.345518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:05.974147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:05.994926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20cdf950-6af7-48c3-aaf1-62fe9123bfe4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1671 microversion: 2.1 time: 0.658384 Jun 18 22:30:06.005815 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2818/5618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:05 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1671 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:07.015614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:07.019690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:07.076116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:07.077257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:07.077410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:07.082052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:07.982262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:07.993004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a49f2207-9663-4fc4-9a2d-0b77bd4eca7a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1671 microversion: 2.1 time: 0.984178 Jun 18 22:30:07.995148 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2801/5619] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:07 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1671 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:09.011952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:09.012714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:09.062019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:09.064208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:09.065880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:09.066346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:09.569999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:09.579123 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-70fef67d-52ac-40dc-a567-b271f5a41471 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1671 microversion: 2.1 time: 0.571551 Jun 18 22:30:09.580686 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2819/5620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:09 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1671 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:10.603856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:10.605880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:10.634802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:10.637297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:10.640128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:10.641400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:10.944687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:10.958771 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61c5bac5-dd08-46ea-ad08-59fd08625aeb tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1605 microversion: 2.1 time: 0.363304 Jun 18 22:30:10.961484 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2802/5621] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:10 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1605 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:11.797069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2748b8e6-cf34-4031-af2a-d5933cd75814 req-3eb82c7a-f16a-424d-b4f9-96b852276f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a0ac3f-2e1b-423a-8476-d9deb8eec449", "name": "network-vif-deleted", "tag": "754bea67-c445-4d31-9cd9-8d467714927d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:11.823493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2748b8e6-cf34-4031-af2a-d5933cd75814 req-3eb82c7a-f16a-424d-b4f9-96b852276f79 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:11.824870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2748b8e6-cf34-4031-af2a-d5933cd75814 req-3eb82c7a-f16a-424d-b4f9-96b852276f79 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:11.889872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2748b8e6-cf34-4031-af2a-d5933cd75814 req-3eb82c7a-f16a-424d-b4f9-96b852276f79 service nova] Creating event network-vif-deleted:754bea67-c445-4d31-9cd9-8d467714927d for instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 on nch1-master-1 Jun 18 22:30:11.937503 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2748b8e6-cf34-4031-af2a-d5933cd75814 req-3eb82c7a-f16a-424d-b4f9-96b852276f79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143649 Jun 18 22:30:11.946097 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2820/5622] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:30:11.979503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:11.980380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:11.999446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:11.999976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:12.000852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:12.006480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:12.153671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:12.154427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:12.155054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lazy-loading 'fault' on Instance uuid d2a0ac3f-2e1b-423a-8476-d9deb8eec449 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:30:12.403884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:12.425988 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b79a2c7f-8e8b-4db9-8635-3df8b08fdbe1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 200 len: 1326 microversion: 2.1 time: 0.451515 Jun 18 22:30:12.429327 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2803/5623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:11 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 1326 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:13.448965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:13.449727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:13.489248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:13.491923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:13.506813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:13.510088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:13.592209 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] HTTP exception thrown: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Request method failure captured: Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 HTTP/1.1 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlD3C6VMzPXlpXa3bczJgP-VZ2Gvx9vI8F0nQq-_q2byXKQDXy0qNFHEIe9RS_Jylo3K5zYqzgEECFdYUBOBeBgCQIMQ8gMVDVy61tgrfl-XknUE5XdVLwgOggCRPaJjZetsWvrqOLtUn2MMVS06mtCVBoRR_kw9rCLKnqpNf-4SSss Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 76301551c4574f299511a993dc871890 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76301551c4574f299511a993dc871890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76301551c4574f299511a993dc871890", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 76301551c4574f299511a993dc871890 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 3f6133e6ab7745118bc629dd126189e8 Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd2a0ac3f-2e1b-423a-8476-d9deb8eec449'} Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:30:13.599597 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:30:13.603609 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:30:13.609913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Returning 404 to user: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:30:13.611158 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-373527af-601b-4536-a1ef-dd06bf321d16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 404 len: 111 microversion: 2.1 time: 0.168096 Jun 18 22:30:13.623294 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2821/5624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:13 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:30:13.630118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3e19c37-2774-4b61-ab30-c282aefb4f37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '.version_select at 0x7fea071e6820>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:13.679640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3e19c37-2774-4b61-ab30-c282aefb4f37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947044579" status: 202 len: 0 microversion: 2.1 time: 0.052748 Jun 18 22:30:13.687386 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2804/5625] 10.222.0.30 () {58 vars in 1217 bytes} [Sat Jun 18 22:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947044579 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:30:15.774948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73f2eaf1-5d23-4f93-b8ce-d06f2b2af48e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: .version_select at 0x7fea06f7ad30>, body: {"keypair": {"name": "tempest-keypair-2131548835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgZhQRiNZOLATyhCfhE6JznuY1UqB+w9S/a2k+MQjYYd/d3+SpYmqyVqzWT+Vg0XDhPacsrpa2JzbBfC7KwerPKiSv0G+AVp4fj9RynQjmXc6pvf7p8ZqHbu9ICIP4wyw=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:15.806304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-73f2eaf1-5d23-4f93-b8ce-d06f2b2af48e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for project 76301551c4574f299511a993dc871890. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:30:15.816223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-73f2eaf1-5d23-4f93-b8ce-d06f2b2af48e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for user 3f6133e6ab7745118bc629dd126189e8 and project 76301551c4574f299511a993dc871890. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:30:15.860390 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73f2eaf1-5d23-4f93-b8ce-d06f2b2af48e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [e535473b-932d-4a87-8d12-06cfe1bb4552] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:30:16.869207 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [None req-73f2eaf1-5d23-4f93-b8ce-d06f2b2af48e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [e535473b-932d-4a87-8d12-06cfe1bb4552] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60170. Jun 18 22:30:16.905460 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73f2eaf1-5d23-4f93-b8ce-d06f2b2af48e tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.134296 Jun 18 22:30:16.906752 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2822/5626] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:30:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:30:20.559971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-319748411", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ed0c64b-f3e2-471b-bb19-37ccd5600a59"}], "security_groups": [{"name": "tempest-securitygroup--1100506999"}], "key_name": "tempest-keypair-2131548835", "user_data": "}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:20.902975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] validate_networks() for [('8ed0c64b-f3e2-471b-bb19-37ccd5600a59', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:30:22.415791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:23.667047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:30:23.667724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:30:23.668012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:30:23.670902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:30:23.671499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:30:23.704887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:23.705322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:23.706412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:23.707012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:23.728852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for project 76301551c4574f299511a993dc871890. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:30:23.743361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Getting quotas for user 3f6133e6ab7745118bc629dd126189e8 and project 76301551c4574f299511a993dc871890. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:30:23.768402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:30:23.786471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:30:23.923242 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b1d1417e-a65a-4484-b234-0458ca63191b tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.368447 Jun 18 22:30:23.926163 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2805/5627] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:30:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 3372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:30:23.934635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=22 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:23.943584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08758189-dfce-4bc8-ac1e-bd2134c7370a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:23.950794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08758189-dfce-4bc8-ac1e-bd2134c7370a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:24.160126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-08758189-dfce-4bc8-ac1e-bd2134c7370a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:24.167998 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08758189-dfce-4bc8-ac1e-bd2134c7370a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1237 microversion: 2.1 time: 0.235208 Jun 18 22:30:24.170587 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2823/5628] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:23 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1237 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:25.187467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-358aa23b-b34b-4295-b6de-2682b3a12e5a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:25.188657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-358aa23b-b34b-4295-b6de-2682b3a12e5a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:25.603858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-358aa23b-b34b-4295-b6de-2682b3a12e5a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:25.620139 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-358aa23b-b34b-4295-b6de-2682b3a12e5a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1237 microversion: 2.1 time: 0.432786 Jun 18 22:30:25.623549 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2806/5629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:25 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1237 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:26.639497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9c1996a1-1781-4270-8e49-f5b4ec552d8f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:26.640867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9c1996a1-1781-4270-8e49-f5b4ec552d8f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:26.823749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9c1996a1-1781-4270-8e49-f5b4ec552d8f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:26.831555 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9c1996a1-1781-4270-8e49-f5b4ec552d8f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1237 microversion: 2.1 time: 0.196614 Jun 18 22:30:26.835609 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2824/5630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:26 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1237 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:27.858007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:27.858752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:27.884383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:27.884832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:27.932776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:27.936770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:28.516861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:28.527150 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47daa7a0-b9ba-4127-8714-7fda0088abf2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1297 microversion: 2.1 time: 0.681732 Jun 18 22:30:28.529393 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2807/5631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:27 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1297 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:29.548001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:29.548824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:29.573256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:29.573556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:29.581674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:29.582618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:30.124547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:30.144363 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0da1e615-41e5-4d90-a583-b51e7f7705bf tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1295 microversion: 2.1 time: 0.602170 Jun 18 22:30:30.169657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2825/5632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:29 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1295 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:31.179091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:31.179795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:31.193529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:31.194048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:31.194848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:31.195312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:32.285985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:32.296971 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc601953-9795-4909-be34-02d7344e1b59 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 1.128110 Jun 18 22:30:32.298860 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2808/5633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:31 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:33.320248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:33.321732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:33.344125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:33.344835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:33.345865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:33.365969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:33.761675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:33.773115 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2b86c99c-ed75-4724-b8fc-5962d80496ee tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 0.460798 Jun 18 22:30:33.774553 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2826/5634] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:33 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:34.816129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:34.816809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:34.833230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:34.872742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:34.879463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:34.882126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:34.883067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:35.611771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:36.102576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:36.117686 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-01fdff0a-e90e-4382-b8dc-a85779bcbc31 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 1.323858 Jun 18 22:30:36.162859 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2809/5635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:34 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:36.980512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3aade2ea-5cfe-405e-96ed-dd5a21ee2913 req-95ff1b69-3e25-4a5b-931e-d3264753a958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9432d5-0027-49d6-ae4a-a44f8026e718", "tag": "44a742a1-121e-472d-9bd9-e9c191330488"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:37.000184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:37.003103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:37.011470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3aade2ea-5cfe-405e-96ed-dd5a21ee2913 req-95ff1b69-3e25-4a5b-931e-d3264753a958 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:37.012451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3aade2ea-5cfe-405e-96ed-dd5a21ee2913 req-95ff1b69-3e25-4a5b-931e-d3264753a958 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:37.059778 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3aade2ea-5cfe-405e-96ed-dd5a21ee2913 req-95ff1b69-3e25-4a5b-931e-d3264753a958 service nova] Creating event network-changed:44a742a1-121e-472d-9bd9-e9c191330488 for instance df9432d5-0027-49d6-ae4a-a44f8026e718 on nch2-master-1 Jun 18 22:30:37.082848 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3aade2ea-5cfe-405e-96ed-dd5a21ee2913 req-95ff1b69-3e25-4a5b-931e-d3264753a958 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106645 Jun 18 22:30:37.086629 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2827/5636] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:30:37.135822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:37.137067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:37.140212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:37.162855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:37.165081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:37.171037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:37.172704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:38.487388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:38.505576 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a46e755-4ec6-4eaf-98d4-b95774102ee1 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 1.374223 Jun 18 22:30:38.506183 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2810/5637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:37 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:39.523616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:39.526351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:39.554593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:39.562580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:39.567377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:39.570736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:40.145142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:40.207346 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83ee5bba-9227-4576-8509-ed2484ab34b4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 0.682114 Jun 18 22:30:40.210882 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2828/5638] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:39 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:41.229430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:41.230062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:41.239828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:41.250036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:41.251066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:41.255554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:42.194857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:42.210118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3839093b-8054-4d9a-991d-b40da64d30f5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 0.985822 Jun 18 22:30:42.216406 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2811/5639] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:41 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:43.236383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:43.237025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:43.262724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:43.263169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:43.263952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:43.264385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:43.880687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:43.889234 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de65606a-51f1-4f54-88b7-f56867551cf4 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 0.657270 Jun 18 22:30:43.898191 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2829/5640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:43 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:44.283457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-558453491", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9416ab76-3b7f-4e92-9b8b-77c271a3bf8f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:44.431320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] validate_networks() for [('b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:30:44.917889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:44.918527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:44.927055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:44.927490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:44.928472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:44.929078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:45.427615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:45.437966 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a5d77b2-fa9a-474b-a172-845b83b5a5a3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 0.525567 Jun 18 22:30:45.438575 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2830/5641] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:44 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:45.961844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:30:45.962351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:30:45.962769 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:30:45.964480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:30:45.964934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:30:45.993008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:45.995255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:45.996140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:45.996597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:46.013068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-81927c71-04c5-439b-a359-63dea31d344a req-2a260dac-1152-4cce-8bb3-7e28958fd057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9432d5-0027-49d6-ae4a-a44f8026e718", "name": "network-vif-plugged", "status": "completed", "tag": "44a742a1-121e-472d-9bd9-e9c191330488"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:46.043376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-81927c71-04c5-439b-a359-63dea31d344a req-2a260dac-1152-4cce-8bb3-7e28958fd057 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:46.046034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-81927c71-04c5-439b-a359-63dea31d344a req-2a260dac-1152-4cce-8bb3-7e28958fd057 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:46.095166 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-81927c71-04c5-439b-a359-63dea31d344a req-2a260dac-1152-4cce-8bb3-7e28958fd057 service nova] Creating event network-vif-plugged:44a742a1-121e-472d-9bd9-e9c191330488 for instance df9432d5-0027-49d6-ae4a-a44f8026e718 on nch2-master-1 Jun 18 22:30:46.099945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:30:46.112786 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-81927c71-04c5-439b-a359-63dea31d344a req-2a260dac-1152-4cce-8bb3-7e28958fd057 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101490 Jun 18 22:30:46.114898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2831/5642] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:30:46.151456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:30:46.195517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:30:46.197833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9416ab76-3b7f-4e92-9b8b-77c271a3bf8f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:30:46.399264 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b8175b1-4f45-4a04-828f-6b21edda06f5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.127788 Jun 18 22:30:46.399942 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2812/5643] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:30:46.410996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c86036dd-187f-4e62-bc19-f22ccd56f3a9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:46.411972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c86036dd-187f-4e62-bc19-f22ccd56f3a9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:46.456986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:46.457965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:46.507312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:46.507782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:46.528342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:46.528853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:46.625377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c86036dd-187f-4e62-bc19-f22ccd56f3a9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:46.637300 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c86036dd-187f-4e62-bc19-f22ccd56f3a9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1056 microversion: 2.1 time: 0.227699 Jun 18 22:30:46.639801 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2832/5644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:46 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1056 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:46.834707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:46.879357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb07558d-0d69-43bb-bb6a-60d4f1b54d4d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1363 microversion: 2.1 time: 0.426252 Jun 18 22:30:46.889151 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2813/5645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:46 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:47.655608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:47.657988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:47.705763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:47.708234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:47.714118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:47.716210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:47.886671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:47.896074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:47.896701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:47.916251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:47.917396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91f6e5ec-6428-48c4-ba34-7d8865cec2e2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1052 microversion: 2.1 time: 0.261543 Jun 18 22:30:47.918085 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2833/5646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:47 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1052 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:47.923649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:47.924500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:47.924939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:48.139868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:48.152740 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4db8de38-336b-47ce-9c49-e41e4a4497de tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1549 microversion: 2.1 time: 0.258651 Jun 18 22:30:48.170155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:48.170907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:48.179043 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2814/5647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:47 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1549 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:30:48.179194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:48.185862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:48.186582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:48.187026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:48.367151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8057efbc-3e42-48b0-810f-c83b853c9d82 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200857 Jun 18 22:30:48.367718 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2834/5648] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:30:48 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:30:48.934666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:48.935844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:48.952247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:48.953991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:48.955012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:48.958421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:49.115477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:49.126801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-66d7a47d-1f8f-4d32-a6aa-89a09154d659 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1126 microversion: 2.1 time: 0.196070 Jun 18 22:30:49.128036 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2815/5649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:48 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1126 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:50.145533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:50.146315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:50.159680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:50.160432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:50.164442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:50.164890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:50.301086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:50.316924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f141eb3a-ed59-4146-b00a-01af71182879 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1126 microversion: 2.1 time: 0.176236 Jun 18 22:30:50.318585 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2835/5650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:50 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1126 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:50.720774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-53fd31bf-5c3f-4431-9bc5-3c66c39c8d8c req-1fca2c7b-aa8c-4136-8ad1-743ba5846d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9432d5-0027-49d6-ae4a-a44f8026e718", "tag": "44a742a1-121e-472d-9bd9-e9c191330488"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:50.740283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-53fd31bf-5c3f-4431-9bc5-3c66c39c8d8c req-1fca2c7b-aa8c-4136-8ad1-743ba5846d76 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:50.740757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-53fd31bf-5c3f-4431-9bc5-3c66c39c8d8c req-1fca2c7b-aa8c-4136-8ad1-743ba5846d76 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:50.771687 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-53fd31bf-5c3f-4431-9bc5-3c66c39c8d8c req-1fca2c7b-aa8c-4136-8ad1-743ba5846d76 service nova] Creating event network-changed:44a742a1-121e-472d-9bd9-e9c191330488 for instance df9432d5-0027-49d6-ae4a-a44f8026e718 on nch2-master-1 Jun 18 22:30:50.790425 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-53fd31bf-5c3f-4431-9bc5-3c66c39c8d8c req-1fca2c7b-aa8c-4136-8ad1-743ba5846d76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245680 Jun 18 22:30:50.791937 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2816/5651] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:30:51.337723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:51.338897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:51.349733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:51.351095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:51.352603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:51.354890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:51.546002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:51.557469 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-76dd61e7-41d3-4a55-9cd9-1158e9bbbb6b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1126 microversion: 2.1 time: 0.226560 Jun 18 22:30:51.559530 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2836/5652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:51 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1126 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:52.587968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:52.588554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:52.601424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:52.601890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:52.611243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:52.611702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:52.629437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=55 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:53.388535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:53.405567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14f58630-a3dd-4873-855a-2e6b3a87398a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1168 microversion: 2.1 time: 0.830463 Jun 18 22:30:53.406200 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2817/5653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:52 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1168 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:54.424142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:54.425634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:54.449416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:54.453625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:54.456799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:54.457427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:54.526160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=57 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:55.106270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:55.118331 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-465695f2-5237-4a72-883f-a437428df452 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1214 microversion: 2.1 time: 0.695525 Jun 18 22:30:55.126710 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2837/5654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:54 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1214 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:55.813447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-fe6351f0-a143-4c28-af0c-50e26d9346be req-89f23992-d4ca-4fd6-9d51-b07bcab2a7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8967cc55-8af0-4c23-86e2-a2ea2b912232", "tag": "084c04db-fc5d-410e-be0d-c299d162f4b1"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:30:55.833245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fe6351f0-a143-4c28-af0c-50e26d9346be req-89f23992-d4ca-4fd6-9d51-b07bcab2a7e7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:55.833809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fe6351f0-a143-4c28-af0c-50e26d9346be req-89f23992-d4ca-4fd6-9d51-b07bcab2a7e7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:55.859780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-fe6351f0-a143-4c28-af0c-50e26d9346be req-89f23992-d4ca-4fd6-9d51-b07bcab2a7e7 service nova] Creating event network-changed:084c04db-fc5d-410e-be0d-c299d162f4b1 for instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 on nch1-master-1 Jun 18 22:30:55.871492 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-fe6351f0-a143-4c28-af0c-50e26d9346be req-89f23992-d4ca-4fd6-9d51-b07bcab2a7e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072292 Jun 18 22:30:55.874660 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2818/5655] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:30:56.138753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:56.139917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:56.148570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:56.149313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:56.150243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:56.150827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:56.635288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:56.685984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:56.703176 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-89481335-006c-471a-a61f-b5be2b27c71a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1202 microversion: 2.1 time: 0.568392 Jun 18 22:30:56.705985 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2838/5656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:56 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1202 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:57.721746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:57.723917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:30:57.730674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:57.733691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:57.748609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:57.749154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:57.762737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:57.764832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:58.112754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:58.123359 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1715e4d-15d2-4cfc-a7cd-720423cd2540 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1202 microversion: 2.1 time: 0.405249 Jun 18 22:30:58.127349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2819/5657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:57 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1202 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:30:59.140157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:30:59.140744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:30:59.163334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:59.164121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:59.165433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:30:59.166072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:30:59.956009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:30:59.967530 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d97445e5-6458-4b92-a498-0b9249180d3b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1202 microversion: 2.1 time: 0.831573 Jun 18 22:30:59.977881 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2839/5658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:30:59 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1202 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:00.994612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:00.999084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:01.012766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:01.013531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:01.015733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:01.016868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:01.479506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:01.489825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e691fb3-a2b4-4a92-97f4-08f7f3ebb29f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1202 microversion: 2.1 time: 0.507764 Jun 18 22:31:01.497790 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2820/5659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:00 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1202 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:02.514471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:02.515405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:02.532850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:02.533523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:02.535270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:02.536203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:02.919801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:02.931918 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3b5fac65-c69f-4cc5-b548-c80a1406d55c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1202 microversion: 2.1 time: 0.418926 Jun 18 22:31:02.932980 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2840/5660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:02 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1202 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:03.950710 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:03.951533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:03.965642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:03.966239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:03.967309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:03.967932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:04.054532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a8616b20-1b89-4ece-8e90-9b7bef323cad req-6668b794-ccda-41da-ac66-f9d11035900a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8967cc55-8af0-4c23-86e2-a2ea2b912232", "name": "network-vif-plugged", "status": "completed", "tag": "084c04db-fc5d-410e-be0d-c299d162f4b1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:04.081900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a8616b20-1b89-4ece-8e90-9b7bef323cad req-6668b794-ccda-41da-ac66-f9d11035900a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:04.082191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a8616b20-1b89-4ece-8e90-9b7bef323cad req-6668b794-ccda-41da-ac66-f9d11035900a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:04.113076 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a8616b20-1b89-4ece-8e90-9b7bef323cad req-6668b794-ccda-41da-ac66-f9d11035900a service nova] Creating event network-vif-plugged:084c04db-fc5d-410e-be0d-c299d162f4b1 for instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 on nch1-master-1 Jun 18 22:31:04.138993 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a8616b20-1b89-4ece-8e90-9b7bef323cad req-6668b794-ccda-41da-ac66-f9d11035900a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089911 Jun 18 22:31:04.139654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2841/5661] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:31:04.890698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:04.905763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aa972e4c-3929-4c4c-a97e-1d359436badd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1202 microversion: 2.1 time: 0.958826 Jun 18 22:31:04.917498 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2821/5662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:03 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1202 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:05.936961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:05.939236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:05.965654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:05.967541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:05.969986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:05.973663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:06.583009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:06.602652 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0cfa55e3-dd91-4a22-ae7f-5a4e7885913d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1390 microversion: 2.1 time: 0.682845 Jun 18 22:31:06.606015 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2842/5663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:05 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1390 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:06.623868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:06.625435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:06.642448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:06.642912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:06.644009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:06.644543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:07.054300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:07.067022 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9096415b-74c9-41e7-9469-98c55b3e9cc3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1390 microversion: 2.1 time: 0.448045 Jun 18 22:31:07.068653 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2822/5664] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:06 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1390 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:07.086405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:07.088472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:07.107475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:07.107942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:07.108756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:07.109241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:07.722768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:07.732926 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-adac94df-64ec-4d8d-8511-32f82614e3ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1390 microversion: 2.1 time: 0.652365 Jun 18 22:31:07.733794 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2843/5665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:07 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1390 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:07.849727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:07.850270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:07.853121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:07.868805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:07.869301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:07.875357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:07.876245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:07.936272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:31:08.081520 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-85954cce-5651-4b80-8e37-88a300027d71 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 204 len: 0 microversion: 2.1 time: 0.235172 Jun 18 22:31:08.092040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:08.092767 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2823/5666] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:31:07 2022] DELETE /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:31:08.093313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:08.110944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:08.121928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:08.123089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:08.123693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:08.435924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:08.447816 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0e1d3d9-b615-47ca-b30f-c37ee9016c9f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1396 microversion: 2.1 time: 0.359872 Jun 18 22:31:08.448680 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2844/5667] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:08 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1396 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:09.490791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:09.493172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:09.525215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:09.526190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:09.548834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:09.556339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:10.579273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:10.593972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6921e933-1629-40fd-b9b7-7dc8faa35c86 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1396 microversion: 2.1 time: 1.130481 Jun 18 22:31:10.611237 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2824/5668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:09 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1396 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:11.352332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-269aeae1-33e8-40c1-83ee-512e70d48b6d req-3152bf72-b274-430c-ac6a-6cb4cbd37ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8967cc55-8af0-4c23-86e2-a2ea2b912232", "name": "network-vif-deleted", "tag": "084c04db-fc5d-410e-be0d-c299d162f4b1"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:11.395971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=38 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:11.410817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-269aeae1-33e8-40c1-83ee-512e70d48b6d req-3152bf72-b274-430c-ac6a-6cb4cbd37ed5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:11.413294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-269aeae1-33e8-40c1-83ee-512e70d48b6d req-3152bf72-b274-430c-ac6a-6cb4cbd37ed5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:11.470174 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-269aeae1-33e8-40c1-83ee-512e70d48b6d req-3152bf72-b274-430c-ac6a-6cb4cbd37ed5 service nova] Creating event network-vif-deleted:084c04db-fc5d-410e-be0d-c299d162f4b1 for instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 on nch1-master-1 Jun 18 22:31:11.494178 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-269aeae1-33e8-40c1-83ee-512e70d48b6d req-3152bf72-b274-430c-ac6a-6cb4cbd37ed5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147146 Jun 18 22:31:11.501289 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2845/5669] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:11.615002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:11.616862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:11.657152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:11.657999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:11.658876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:11.659391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:11.944129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:11.983142 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3483927-6186-4a07-b352-abdc1f97c065 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 200 len: 1187 microversion: 2.1 time: 0.374690 Jun 18 22:31:12.007905 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2825/5670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:11 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 1187 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:13.011185 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:13.012302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:13.026076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:13.026608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:13.029644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:13.030124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:13.069905 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 HTTP/1.1 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8967cc55-8af0-4c23-86e2-a2ea2b912232'} Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:13.084665 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.088761 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.090456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:13.096405 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-44c542ca-4ff1-4154-b8b5-a99472d1c405 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 404 len: 111 microversion: 2.1 time: 0.090852 Jun 18 22:31:13.097686 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2846/5671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:13 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:13.156988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:13.157597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:13.186555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:13.187008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:13.191900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:13.192322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:13.635369 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 HTTP/1.1 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8967cc55-8af0-4c23-86e2-a2ea2b912232'} Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:13.638073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.642405 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.644774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:13.646076 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a303e3d2-c27b-41d4-8fa0-e1b1c82f4ff9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 404 len: 111 microversion: 2.1 time: 0.493459 Jun 18 22:31:13.646846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2826/5672] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:31:13 2022] DELETE /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 111 bytes in 495 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:13.656321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:13.657387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 8967cc55-8af0-4c23-86e2-a2ea2b912232] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:13.685452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:13.686198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:13.686894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:13.687436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:13.737821 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 HTTP/1.1 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '8967cc55-8af0-4c23-86e2-a2ea2b912232'} Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:13.739842 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. Jun 18 22:31:13.744271 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:13.745496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 8967cc55-8af0-4c23-86e2-a2ea2b912232 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:13.746605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d45b024c-6962-45f8-abf5-48c75503ef16 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232" status: 404 len: 111 microversion: 2.1 time: 0.094781 Jun 18 22:31:13.747472 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2847/5673] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:13 2022] GET /compute/v2.1/servers/8967cc55-8af0-4c23-86e2-a2ea2b912232 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:14.411583 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:31:14.412168 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 22:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:31:21.338825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-995796671", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "d82a492a-56cd-405c-a8fc-dccf065f949f"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:21.832950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-522499241", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2f117025-1ed5-4e5a-a29d-470d49e0c8c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:21.837935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] validate_networks() for [('d82a492a-56cd-405c-a8fc-dccf065f949f', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:31:22.003732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] validate_networks() for [('b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:31:23.198260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:23.383456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:31:23.385547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:31:23.386405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:31:23.387205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:31:23.389018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:31:23.403051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:23.403883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:23.404823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:23.405690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:23.425916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Getting quotas for project d65dfa8232fa458fb3c49822a1f4ede1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:31:23.430291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:31:23.430783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:31:23.431194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:31:23.431669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:31:23.432085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:31:23.433577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Getting quotas for user 61121749f1aa4a2285c8f270abb74fdf and project d65dfa8232fa458fb3c49822a1f4ede1. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:31:23.450117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:31:23.451515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:23.451974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:23.452782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:23.453259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:23.453593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:31:23.497086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:31:23.503097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:31:23.515801 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-261701ba-de4b-4dd2-b679-33badf1076e4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184506 Jun 18 22:31:23.516438 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2827/5674] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:31:23.613805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:31:23.616768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f117025-1ed5-4e5a-a29d-470d49e0c8c5',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:31:23.711812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:23.712542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:23.720418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:23.721142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:23.722272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:23.723785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:23.791769 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-787a7096-d74c-4166-ba83-32210becb75c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/ips" status: 200 len: 145 microversion: 2.1 time: 0.269534 Jun 18 22:31:23.797108 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2828/5675] 10.222.0.30 () {58 vars in 1247 bytes} [Sat Jun 18 22:31:23 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/ips => generated 145 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:23.811650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d11ae31-2583-4d75-9f51-cc2b5e0274f3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:23.817598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d11ae31-2583-4d75-9f51-cc2b5e0274f3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:23.973336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c5514e0-d84d-4af7-ada2-749e79a0f1fb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141398 Jun 18 22:31:23.979191 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2848/5676] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:31:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:31:23.995266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-02961183-2681-4a15-aa71-7a900816dcbf tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:23.995943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-02961183-2681-4a15-aa71-7a900816dcbf tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:24.390010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d11ae31-2583-4d75-9f51-cc2b5e0274f3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:24.400843 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d11ae31-2583-4d75-9f51-cc2b5e0274f3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1218 microversion: 2.1 time: 0.602290 Jun 18 22:31:24.401461 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2829/5677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:23 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1218 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:24.422533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-02961183-2681-4a15-aa71-7a900816dcbf tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:24.430463 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-02961183-2681-4a15-aa71-7a900816dcbf tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1070 microversion: 2.1 time: 0.450095 Jun 18 22:31:24.431175 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2849/5678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:23 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1070 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:25.421207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:25.421989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:25.450617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:25.451468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:25.459428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:25.462334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:25.465731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:25.474249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:25.480458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:25.481091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:25.481721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:25.482160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:25.514417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=52 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:25.750581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:25.764125 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-93bd5866-c8f6-4521-a7c3-72812f42346e tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1278 microversion: 2.1 time: 0.349604 Jun 18 22:31:25.765071 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2830/5679] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:25 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1278 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:25.792796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "391fe876-11d6-4b7c-b0cf-c698bbac3b21"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:25.794843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:25.813367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:25.814764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:25.816040 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:25.816675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:25.892744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:25.907163 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a356f73-9ce5-4c91-98e0-35a9f06fe16a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1168 microversion: 2.1 time: 0.463139 Jun 18 22:31:25.917083 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2850/5680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:25 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1168 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:26.557304 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-940568b7-fc80-41a4-9b0d-f015e2996fc3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790818 Jun 18 22:31:26.558213 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2831/5681] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:31:25 2022] POST /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:26.783215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:26.784071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:26.793593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:26.794507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:26.795680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:26.796333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:26.928926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:26.930306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:26.944504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:26.947482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:26.954018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:26.959393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:26.964505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:26.968775 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-272603c2-3178-48e8-b8bb-196347502f03 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1276 microversion: 2.1 time: 0.190364 Jun 18 22:31:26.972022 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2851/5682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:26 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:27.112462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:27.125341 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24b4cdfb-e769-4897-a110-ad698a0e7e13 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1186 microversion: 2.1 time: 0.205064 Jun 18 22:31:27.127728 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2832/5683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:26 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1186 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:27.988958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:27.991985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:28.005594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:28.006384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:28.007478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:28.008077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:28.149974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:28.149974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:28.168310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:28.169213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:28.170045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:28.172768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:28.678781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:28.691477 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-224b2285-68c0-4f30-9455-fa22bc3f6278 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1186 microversion: 2.1 time: 0.550766 Jun 18 22:31:28.703855 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2833/5684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:28 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1186 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:28.771129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:28.782970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20cb8188-2a27-41d7-ab88-a606a3a892a9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.798694 Jun 18 22:31:28.792523 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2852/5685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:27 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:29.712383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:29.713009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:29.724444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:29.729486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:29.730465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:29.730911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:29.804920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:29.806817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:29.819517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:29.821406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:29.822379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:29.822984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:30.233916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:30.249648 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e689b5c1-f92a-4a9c-aef1-7221eb543240 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.543357 Jun 18 22:31:30.251631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2834/5686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:29 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:30.296625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:30.306568 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b57d66d4-8592-477a-9da5-bc8be6789cda tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.508680 Jun 18 22:31:30.310656 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2853/5687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:29 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:30.423403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:30.436423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:30.455579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:30.456971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:30.459118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:30.460789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:30.515135 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e09d87f3-c79f-4f45-8364-533c36fe9ff8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095795 Jun 18 22:31:30.516281 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2835/5688] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:31:30 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:30.528686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:30.529225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:30.537133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:30.537816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:30.538759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:30.539358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:30.576959 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9d702d82-ed7c-46e3-939d-cf835933c2b3 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/391fe876-11d6-4b7c-b0cf-c698bbac3b21" status: 200 len: 194 microversion: 2.1 time: 0.053103 Jun 18 22:31:30.577787 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2854/5689] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Jun 18 22:31:30 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/391fe876-11d6-4b7c-b0cf-c698bbac3b21 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:31.269653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:31.270852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:31.287832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:31.288304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:31.289140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:31.293129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:31.326781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:31.327414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:31.342492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:31.343288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:31.346167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:31.347160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:31.754293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:31.766705 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b5740e48-83f8-4353-9a48-0aac3aa9c963 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.444145 Jun 18 22:31:31.767316 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2855/5690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:31 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:31.773393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:31.786140 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aef4e788-b140-4672-8f90-4fd2f33bae83 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.521711 Jun 18 22:31:31.795337 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2836/5691] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:31 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:31.882010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a6ef57f3-a4b2-4e01-ba57-f2d522dbff70 req-82a5791b-4523-42f2-b4e4-c0aeac81806c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8", "tag": "5e9f9ad9-6e05-484a-9521-04f0a1ff02a0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:31.898023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a6ef57f3-a4b2-4e01-ba57-f2d522dbff70 req-82a5791b-4523-42f2-b4e4-c0aeac81806c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:31.898472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a6ef57f3-a4b2-4e01-ba57-f2d522dbff70 req-82a5791b-4523-42f2-b4e4-c0aeac81806c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:31.919363 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a6ef57f3-a4b2-4e01-ba57-f2d522dbff70 req-82a5791b-4523-42f2-b4e4-c0aeac81806c service nova] Creating event network-changed:5e9f9ad9-6e05-484a-9521-04f0a1ff02a0 for instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 on nch1-master-1 Jun 18 22:31:31.929935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a6ef57f3-a4b2-4e01-ba57-f2d522dbff70 req-82a5791b-4523-42f2-b4e4-c0aeac81806c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057224 Jun 18 22:31:31.931084 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2856/5692] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:32.119660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18ebce1b-b229-419b-9410-7cece8102bf1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:32.120775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:32.128418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:32.128889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:32.130222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:32.130684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:32.525619 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-73a1a2d5-f773-4ba9-9879-28b63aaff734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "POST /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413972 Jun 18 22:31:32.526696 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2837/5693] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:31:32 2022] POST /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:32.787665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:32.790319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:32.804438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:32.805586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:32.818302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:32.823975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:32.824651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:32.826596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:32.830093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:32.831592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:32.834510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:32.834725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:33.248042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:33.260681 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-de050d80-6553-4492-9f77-686b22b20f79 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.477802 Jun 18 22:31:33.262185 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2857/5694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:32 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:33.299406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:33.317375 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a929bb5-40c4-46c6-bed7-d4d11fd3f906 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.516697 Jun 18 22:31:33.327970 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2838/5695] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:32 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:33.959955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-bcff838f-c456-406e-90df-640a3bf0012f req-4a219456-7e26-4cf1-b154-2fd368de2d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd42fcc6-8728-45b4-a297-d72326e41556", "tag": "35fec24d-2604-4af1-8dc3-3efe457dd6a7"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:33.973024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:33.977944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bcff838f-c456-406e-90df-640a3bf0012f req-4a219456-7e26-4cf1-b154-2fd368de2d9b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:33.978700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bcff838f-c456-406e-90df-640a3bf0012f req-4a219456-7e26-4cf1-b154-2fd368de2d9b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:33.992725 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-bcff838f-c456-406e-90df-640a3bf0012f req-4a219456-7e26-4cf1-b154-2fd368de2d9b service nova] Creating event network-changed:35fec24d-2604-4af1-8dc3-3efe457dd6a7 for instance dd42fcc6-8728-45b4-a297-d72326e41556 on nch1-master-1 Jun 18 22:31:34.001402 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-bcff838f-c456-406e-90df-640a3bf0012f req-4a219456-7e26-4cf1-b154-2fd368de2d9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042863 Jun 18 22:31:34.002275 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2858/5696] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:31:34.280307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:34.280971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:34.283175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:34.291847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:34.292502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:34.293481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:34.293923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:34.336566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:34.337313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:34.354956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:34.355416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:34.356205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:34.356647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:34.394799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:34.427266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:34.654859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:34.661384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:34.689764 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ec796a2-9e74-4929-a381-da5131e05d27 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.406479 Jun 18 22:31:34.690453 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2839/5697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:34 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:34.690572 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c530542a-4b1d-436d-8525-9941cfa023a7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.351528 Jun 18 22:31:34.691703 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2859/5698] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:34 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:34.730532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-114850563", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:34.836783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:31:35.217807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:31:35.218409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:31:35.218963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:31:35.219430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:31:35.219921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:31:35.235104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:35.235919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:35.237364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:35.240322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:35.290893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Getting quotas for project f7b4d0121cf24c619d4ad0f5af414dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:31:35.310437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Getting quotas for user a4b5f6d69d1e4804923d47dd4d71d443 and project f7b4d0121cf24c619d4ad0f5af414dd8. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:31:35.341272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:31:35.343615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:31:35.442985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a8aa9df-ccea-41ba-a925-3bf4abff8e6e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717740 Jun 18 22:31:35.445090 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2840/5699] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:31:35.456745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a80e5248-795f-4d99-a8fc-6dd0d3a278a5 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:35.458591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a80e5248-795f-4d99-a8fc-6dd0d3a278a5 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:35.539578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a80e5248-795f-4d99-a8fc-6dd0d3a278a5 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:35.551502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a80e5248-795f-4d99-a8fc-6dd0d3a278a5 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1213 microversion: 2.1 time: 0.101000 Jun 18 22:31:35.557828 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2860/5700] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:35 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:35.715027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:35.716501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:35.717356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:35.718128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:35.746683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:35.747535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:35.748147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:35.749435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:35.750589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:35.756213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:35.756672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:35.760194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.162316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:36.175374 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-583a71db-ed5f-49a4-a20b-0c7e49e43cbb tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.472899 Jun 18 22:31:36.175904 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2841/5701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:35 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:36.180610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:36.198599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:36.206587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.208337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.214579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.215476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.228719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:36.259843 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64587361-c15f-464f-bee2-367b26c45383 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.553567 Jun 18 22:31:36.260797 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2861/5702] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:35 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:36.312351 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-964cfc7b-20a0-40ce-a7e9-e26a12a848fa tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.135334 Jun 18 22:31:36.312946 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2842/5703] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:31:36 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:36.459484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:36.460221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:36.470743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.471488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.472678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.473153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.515058 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-79def3b3-5fd7-4341-a24b-48a4649c673a tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/391fe876-11d6-4b7c-b0cf-c698bbac3b21" status: 200 len: 194 microversion: 2.1 time: 0.063110 Jun 18 22:31:36.516982 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2862/5704] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Jun 18 22:31:36 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/391fe876-11d6-4b7c-b0cf-c698bbac3b21 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:36.529067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:36.529580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:36.544543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.545008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.545840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.546641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.574015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:36.576141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:36.576803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:36.595774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.596242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.598397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:36.600620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:36.685165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lazy-loading 'services' on Instance uuid df9432d5-0027-49d6-ae4a-a44f8026e718 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:31:36.801095 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3824b315-4a44-4d31-91fe-655c3f317e37 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/391fe876-11d6-4b7c-b0cf-c698bbac3b21" status: 202 len: 0 microversion: 2.1 time: 0.278062 Jun 18 22:31:36.801920 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2843/5705] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:31:36 2022] DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/391fe876-11d6-4b7c-b0cf-c698bbac3b21 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:31:37.194262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:37.197631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:37.210302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:37.210754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:37.216838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:37.218834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:37.422384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:37.442469 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2055eb5b-796f-4707-84aa-24645c17ef87 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1265 microversion: 2.1 time: 0.871246 Jun 18 22:31:37.443092 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2863/5706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:36 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1265 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:37.448337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:37.451981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:37.471848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:37.472400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:37.473138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:37.475532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:37.746371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:37.761513 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2bda1e80-4a9e-485c-beb3-dd7d2d2ad3e3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.571764 Jun 18 22:31:37.771992 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2844/5707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:37 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:37.868440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:37.877878 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4a93af11-6d14-4cef-8068-406d1cf85ed7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.433397 Jun 18 22:31:37.878478 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2864/5708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:37 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:38.044260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:38.044868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:38.050897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:38.052667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.053262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.054204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.054926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.103736 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39aed87b-c089-44d9-a1ca-d407bdef98a5 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/18ebce1b-b229-419b-9410-7cece8102bf1" status: 200 len: 194 microversion: 2.1 time: 0.066573 Jun 18 22:31:38.106346 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2845/5709] 10.222.0.30 () {58 vars in 1412 bytes} [Sat Jun 18 22:31:38 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/18ebce1b-b229-419b-9410-7cece8102bf1 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:38.115393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:38.116134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:38.122430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.122891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.123674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.124114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.221448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lazy-loading 'services' on Instance uuid df9432d5-0027-49d6-ae4a-a44f8026e718 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:31:38.331359 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-796f94f7-208f-453d-a7b6-096ac7b54e20 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/18ebce1b-b229-419b-9410-7cece8102bf1" status: 202 len: 0 microversion: 2.1 time: 0.219702 Jun 18 22:31:38.333762 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2865/5710] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:31:38 2022] DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments/18ebce1b-b229-419b-9410-7cece8102bf1 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:31:38.460723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:38.461706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:38.474714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.475052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.476260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.478253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.592946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:38.611866 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4c62be6-51b7-4bb9-9c22-867a6f9891ff tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1271 microversion: 2.1 time: 0.155304 Jun 18 22:31:38.622919 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2846/5711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:38 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:38.780442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:38.781177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:38.789659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.790140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.790928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.791352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.896351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:38.910593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:38.936333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.938361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:38.945328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:38.945998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.198514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:39.217219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b258f3db-f0ec-4ee4-b7ab-908f74ee5de1 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.441466 Jun 18 22:31:39.229676 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2866/5712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:38 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:39.296637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:39.309159 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19e9a763-1abb-4a7d-96b1-c5922bb8edab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.417002 Jun 18 22:31:39.309763 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2847/5713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:38 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:39.595679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:39.597348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:39.608033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:39.608033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.608195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:39.613434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.629205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:39.629837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:39.647849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:39.648605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.649949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:39.650676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.704934 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39f9543c-f0f3-425e-8d16-80ad44d04934 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113289 Jun 18 22:31:39.706147 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2867/5714] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:31:39 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:31:39.889050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:39.892228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:39.901774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:39.902285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.905166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:39.905626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:39.929349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:39.955306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:39.970670 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3023e49d-e7b1-4f7c-a04b-8731dc86a796 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1313 microversion: 2.1 time: 0.343851 Jun 18 22:31:39.973865 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2848/5715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:39 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:39.977230 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3b49cb1-91d0-42bb-bbe6-5573c4042fd8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094478 Jun 18 22:31:39.978405 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2868/5716] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:31:39 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:31:40.074851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:40.075478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:40.085318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.086257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.088753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.089306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.124515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:31:40.242340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:40.243665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:40.261114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.264034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.265708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.271124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.294382 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46f63891-1f3d-4f1a-8468-4220eafc712f tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 204 len: 0 microversion: 2.1 time: 0.223154 Jun 18 22:31:40.296587 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2849/5717] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:31:40 2022] DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:31:40.310328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7bda8f61-9168-466a-8069-ff5b73cf5086 req-0fe3d588-77d5-422b-b264-675c3fea6308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8", "name": "network-vif-plugged", "status": "completed", "tag": "5e9f9ad9-6e05-484a-9521-04f0a1ff02a0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:40.340263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7bda8f61-9168-466a-8069-ff5b73cf5086 req-0fe3d588-77d5-422b-b264-675c3fea6308 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.341950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7bda8f61-9168-466a-8069-ff5b73cf5086 req-0fe3d588-77d5-422b-b264-675c3fea6308 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.362468 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7bda8f61-9168-466a-8069-ff5b73cf5086 req-0fe3d588-77d5-422b-b264-675c3fea6308 service nova] Creating event network-vif-plugged:5e9f9ad9-6e05-484a-9521-04f0a1ff02a0 for instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 on nch1-master-1 Jun 18 22:31:40.374697 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7bda8f61-9168-466a-8069-ff5b73cf5086 req-0fe3d588-77d5-422b-b264-675c3fea6308 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074787 Jun 18 22:31:40.377197 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2850/5718] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:40.393101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:40.394264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:40.420856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.424794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.425866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.426537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.634829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:40.656149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-db2760cc-3b09-4867-97f5-fa3c70b47420 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.415064 Jun 18 22:31:40.657051 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2869/5719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:40 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:40.671977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:40.673936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:40.695796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.696399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.703984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:40.704666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:40.914451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:40.924939 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb87d10d-23f4-4109-b5a6-0aec778a8da2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1673 microversion: 2.1 time: 0.545179 Jun 18 22:31:40.928139 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2851/5720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:40 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1673 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:40.994882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:40.995767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:41.004529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.009661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:41.011055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.015344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:41.054735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:41.067829 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c6c9040d-6339-4b64-914b-ba631066922d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.408859 Jun 18 22:31:41.068793 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2870/5721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:40 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:41.154232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-61b25469-46b8-4512-ac56-5c9ab142fdd7 req-656f2c9e-90e9-4645-b7de-314adb45bee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ebb841b-32db-495b-8fea-bacf1539e29d", "tag": "bdfd1a0a-a11d-4eb2-8f3d-2ac76d385b5b"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:41.167156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61b25469-46b8-4512-ac56-5c9ab142fdd7 req-656f2c9e-90e9-4645-b7de-314adb45bee3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.171528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61b25469-46b8-4512-ac56-5c9ab142fdd7 req-656f2c9e-90e9-4645-b7de-314adb45bee3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:41.204713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-61b25469-46b8-4512-ac56-5c9ab142fdd7 req-656f2c9e-90e9-4645-b7de-314adb45bee3 service nova] Creating event network-changed:bdfd1a0a-a11d-4eb2-8f3d-2ac76d385b5b for instance 7ebb841b-32db-495b-8fea-bacf1539e29d on nch2-master-1 Jun 18 22:31:41.211226 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-61b25469-46b8-4512-ac56-5c9ab142fdd7 req-656f2c9e-90e9-4645-b7de-314adb45bee3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060593 Jun 18 22:31:41.219248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2871/5722] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:41.405962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:41.415246 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8a82c9d-6fdc-4f92-981b-d90b65a0b5f1 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1313 microversion: 2.1 time: 0.428301 Jun 18 22:31:41.423533 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2852/5723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:40 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:41.679980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:41.681512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:41.684790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:41.691833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.692683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:41.693998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.694729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:41.953133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:41.955568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:41.968552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.970010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:41.973325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:41.974529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:42.142060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:42.168070 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5e54039b-e991-4b50-a0a5-a972923b1e63 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1318 microversion: 2.1 time: 0.493660 Jun 18 22:31:42.182636 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2872/5724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:41 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:42.192844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:42.194781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:42.203717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:42.204937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:42.206339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:42.207053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:42.488126 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:42.498832 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ca3539c0-5c8f-44ea-86ea-9ccd4c832899 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1673 microversion: 2.1 time: 0.556573 Jun 18 22:31:42.511692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2853/5725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:41 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1673 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:42.515787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:42.516427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:42.530001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:42.530457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:42.531253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:42.531694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:42.915689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:42.928727 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-178621d6-de1e-4506-948e-a36d3a035367 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.742791 Jun 18 22:31:42.929748 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2873/5726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:42 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:43.055724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:43.071315 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9c4e6e0b-c603-415d-b863-411ca12f818b tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1313 microversion: 2.1 time: 0.564542 Jun 18 22:31:43.072257 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2854/5727] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:42 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:43.190113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:43.191510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:43.217000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.219611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:43.219965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6ea29c2f-45a2-4985-a128-367eca3446fd req-40ce1094-588c-4961-b684-b5bdd2721e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd42fcc6-8728-45b4-a297-d72326e41556", "name": "network-vif-plugged", "status": "completed", "tag": "35fec24d-2604-4af1-8dc3-3efe457dd6a7"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:43.221718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.225300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:43.231805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6ea29c2f-45a2-4985-a128-367eca3446fd req-40ce1094-588c-4961-b684-b5bdd2721e4a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.232608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6ea29c2f-45a2-4985-a128-367eca3446fd req-40ce1094-588c-4961-b684-b5bdd2721e4a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:43.253316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6ea29c2f-45a2-4985-a128-367eca3446fd req-40ce1094-588c-4961-b684-b5bdd2721e4a service nova] Creating event network-vif-plugged:35fec24d-2604-4af1-8dc3-3efe457dd6a7 for instance dd42fcc6-8728-45b4-a297-d72326e41556 on nch1-master-1 Jun 18 22:31:43.261100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6ea29c2f-45a2-4985-a128-367eca3446fd req-40ce1094-588c-4961-b684-b5bdd2721e4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045595 Jun 18 22:31:43.265068 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2855/5728] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:31:43.520442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:43.522070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:43.531480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.533274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:43.534275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.534888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:43.550178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:43.571044 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4bb5a94e-f47c-47c6-8de7-78110b1b7458 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1508 microversion: 2.1 time: 0.386129 Jun 18 22:31:43.588943 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2874/5729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:43 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1508 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:43.676405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:43.694526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a8cfb0e-afec-43f0-9ebf-df3d4186c0d2 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1605 microversion: 2.1 time: 0.178943 Jun 18 22:31:43.695609 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2856/5730] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:43 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1605 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:43.946766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:43.947397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:43.965377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.965856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:43.969963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:43.970561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.090047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:44.090932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:44.116277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:44.117665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.120982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:44.121671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.565874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:44.577512 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5aeb8728-830f-4e6f-9304-10080304aa67 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1216 microversion: 2.1 time: 0.634968 Jun 18 22:31:44.579285 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2875/5731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:43 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1216 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:44.593179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-91982256-c4f4-4487-8104-912ce73096b4 req-d2972f85-6d4d-483c-b981-bb3af72226d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9432d5-0027-49d6-ae4a-a44f8026e718", "name": "network-vif-deleted", "tag": "44a742a1-121e-472d-9bd9-e9c191330488"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:44.621597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-91982256-c4f4-4487-8104-912ce73096b4 req-d2972f85-6d4d-483c-b981-bb3af72226d4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:44.622247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-91982256-c4f4-4487-8104-912ce73096b4 req-d2972f85-6d4d-483c-b981-bb3af72226d4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.646556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-91982256-c4f4-4487-8104-912ce73096b4 req-d2972f85-6d4d-483c-b981-bb3af72226d4 service nova] Creating event network-vif-deleted:44a742a1-121e-472d-9bd9-e9c191330488 for instance df9432d5-0027-49d6-ae4a-a44f8026e718 on nch2-master-1 Jun 18 22:31:44.654083 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-91982256-c4f4-4487-8104-912ce73096b4 req-d2972f85-6d4d-483c-b981-bb3af72226d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073359 Jun 18 22:31:44.655629 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2876/5732] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:44.674852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:44.684204 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3e9b3c0-981d-49ad-b9a0-a694f8c16566 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1313 microversion: 2.1 time: 0.598302 Jun 18 22:31:44.701446 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2857/5733] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:44 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:44.721192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:44.725413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:44.765690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:44.766598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.773322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:44.775211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.877360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:44.877859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:44.878327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lazy-loading 'fault' on Instance uuid df9432d5-0027-49d6-ae4a-a44f8026e718 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:31:45.085224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f6133e6ab7745118bc629dd126189e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76301551c4574f299511a993dc871890', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:45.096151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51ff254d-f137-485c-b9f6-4cfa5a2d13a8 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 200 len: 1327 microversion: 2.1 time: 0.386621 Jun 18 22:31:45.099567 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2877/5734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:44 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 1327 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:45.596679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:45.597837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:45.601798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:45.604646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:45.624448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:45.624984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:45.626018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:45.626765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:45.720609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:45.727932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:45.728538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:45.736892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:45.737489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:45.738359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:45.739815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:45.957413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:45.968061 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-acd9c69f-845a-49c9-a2dc-d2c31404b8f8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1404 microversion: 2.1 time: 0.376016 Jun 18 22:31:45.974179 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2858/5735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:45 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1404 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:45.988311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:45.990633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:46.013069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.015000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.017377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.019949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.034551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:46.038603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:46.057245 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5076a05d-0447-4673-b0b9-881916295e96 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1313 microversion: 2.1 time: 0.335337 Jun 18 22:31:46.071309 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2878/5736] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:45 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:46.126494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:46.127543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:46.137443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.138167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.139756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.140456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.164851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] HTTP exception thrown: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Request method failure captured: Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 HTTP/1.1 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlD3C6VMzPXlpXa3bczJgP-VZ2Gvx9vI8F0nQq-_q2byXKQDXy0qNFHEIe9RS_Jylo3K5zYqzgEECFdYUBOBeBgCQIMQ8gMVDVy61tgrfl-XknUE5XdVLwgOggCRPaJjZetsWvrqOLtUn2MMVS06mtCVBoRR_kw9rCLKnqpNf-4SSss Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76301551c4574f299511a993dc871890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76301551c4574f299511a993dc871890", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 3f6133e6ab7745118bc629dd126189e8 Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'df9432d5-0027-49d6-ae4a-a44f8026e718'} Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:46.168203 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:46.172537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:46.182169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Returning 404 to user: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:46.185146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2f83770-fe1b-4243-9ce0-dcc60c02d734 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 404 len: 111 microversion: 2.1 time: 0.070420 Jun 18 22:31:46.186658 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2879/5737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:46 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:46.195369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-270859e3-b744-4c2a-a859-ba3c529b750d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '.version_select at 0x7fea06ed4700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:46.236079 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-270859e3-b744-4c2a-a859-ba3c529b750d tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131548835" status: 202 len: 0 microversion: 2.1 time: 0.044315 Jun 18 22:31:46.236674 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2880/5738] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131548835 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:31:46.299879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:46.308782 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37561b91-e862-4b1c-a927-9bd617ff0731 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1404 microversion: 2.1 time: 0.325542 Jun 18 22:31:46.309476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2859/5739] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:45 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1404 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:46.327008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-63862219"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:46.328186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:46.337543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.338408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.339303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.340033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.472672 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.api [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Attempting to quiesce instance before volume snapshot. Jun 18 22:31:46.530737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.api [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jun 18 22:31:46.622278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6719241-2450-4c57-9569-6470077a1b0e", "device": "/dev/sdb"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:46.623866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:46.637521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.638030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.647209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:46.647707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:46.660070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Creating snapshot from volume 2f117025-1ed5-4e5a-a29d-470d49e0c8c5. {{(pid=130903) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jun 18 22:31:47.410914 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dbacd13b-b807-45ae-b1c6-289647a7e414 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "POST /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792176 Jun 18 22:31:47.413084 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2860/5740] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:31:46 2022] POST /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:31:47.425019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-069375a0-dbb3-4e0c-9533-d03a68df116e req-38b72d19-ae88-454b-9c3b-d09d82181445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebb841b-32db-495b-8fea-bacf1539e29d", "name": "network-vif-plugged", "status": "completed", "tag": "bdfd1a0a-a11d-4eb2-8f3d-2ac76d385b5b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:47.455736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-069375a0-dbb3-4e0c-9533-d03a68df116e req-38b72d19-ae88-454b-9c3b-d09d82181445 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:47.456250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-069375a0-dbb3-4e0c-9533-d03a68df116e req-38b72d19-ae88-454b-9c3b-d09d82181445 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:47.474273 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-069375a0-dbb3-4e0c-9533-d03a68df116e req-38b72d19-ae88-454b-9c3b-d09d82181445 service nova] Creating event network-vif-plugged:bdfd1a0a-a11d-4eb2-8f3d-2ac76d385b5b for instance 7ebb841b-32db-495b-8fea-bacf1539e29d on nch2-master-1 Jun 18 22:31:47.485012 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-069375a0-dbb3-4e0c-9533-d03a68df116e req-38b72d19-ae88-454b-9c3b-d09d82181445 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070302 Jun 18 22:31:47.487307 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2861/5741] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:47.512313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:47.518556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:47.534865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:47.535330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:47.536146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:47.536603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:48.148143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:48.157877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e396a96-e080-4f82-968e-f777cd4563c2 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1313 microversion: 2.1 time: 0.668094 Jun 18 22:31:48.158767 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2862/5742] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:47 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:48.452204 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-97560a52-d193-4cfb-8441-6e5656afe217 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556/action" status: 202 len: 0 microversion: 2.1 time: 2.129920 Jun 18 22:31:48.453880 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2881/5743] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:31:46 2022] POST /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556/action => generated 0 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 22:31:48.983805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1504950028", "imageRef": "fe215809-4065-4d1f-a21a-44719cf44ba1", "flavorRef": "452", "networks": [{"uuid": "b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:49.073690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] validate_networks() for [('b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:31:49.188739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:49.189757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:49.211325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:49.213473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:49.216419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:49.219281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:49.614222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:49.647245 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cdc79790-6169-43c7-a18e-692bc0be844e tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1463 microversion: 2.1 time: 0.472631 Jun 18 22:31:49.647861 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2882/5744] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:49 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1463 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:49.667330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e6040aa-afe5-48b7-82e1-848690284862", "device": "/dev/sdb"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:49.671983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:49.680225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:49.681252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:49.685025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:49.685950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:50.012435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:31:50.014029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:31:50.014835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:31:50.016815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:31:50.017752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:31:50.029819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:50.030694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:50.031812 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:50.032815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:50.088484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:31:50.097849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:31:50.115557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:31:50.118270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e676424b-5606-4481-9caa-e4b865530bef',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:31:50.150518 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa56ca60-3c5f-4fa2-bc7a-6ac8ff9e8a1a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "POST /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488043 Jun 18 22:31:50.151618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2883/5745] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:31:49 2022] POST /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:50.300379 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e53379d1-fc2a-4cd8-be6d-5492906a4ad4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322037 Jun 18 22:31:50.302271 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2863/5746] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:31:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:31:50.313298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bab11e7c-2628-4f55-8e12-4c8e3eed8ed1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:50.315271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bab11e7c-2628-4f55-8e12-4c8e3eed8ed1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:50.457247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bab11e7c-2628-4f55-8e12-4c8e3eed8ed1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:50.464648 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bab11e7c-2628-4f55-8e12-4c8e3eed8ed1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1230 microversion: 2.1 time: 0.156267 Jun 18 22:31:50.481356 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2884/5747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:50 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1230 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:51.359564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:51.360935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:51.428362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:51.433894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:51.434844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:51.437531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:51.484437 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] HTTP exception thrown: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.490144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:51.493255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Request method failure captured: Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 HTTP/1.1 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlD3C6VMzPXlpXa3bczJgP-VZ2Gvx9vI8F0nQq-_q2byXKQDXy0qNFHEIe9RS_Jylo3K5zYqzgEECFdYUBOBeBgCQIMQ8gMVDVy61tgrfl-XknUE5XdVLwgOggCRPaJjZetsWvrqOLtUn2MMVS06mtCVBoRR_kw9rCLKnqpNf-4SSss Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76301551c4574f299511a993dc871890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76301551c4574f299511a993dc871890", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 3f6133e6ab7745118bc629dd126189e8 Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'df9432d5-0027-49d6-ae4a-a44f8026e718'} Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:51.493745 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Returning 404 to user: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-87a9ba33-7354-4276-be2e-f8d524bf41bd tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 404 len: 111 microversion: 2.1 time: 0.142212 Jun 18 22:31:51.498085 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2864/5748] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:31:51 2022] DELETE /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:51.510480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:51.513635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: df9432d5-0027-49d6-ae4a-a44f8026e718] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:51.518084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:51.518570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:51.536109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:51.536834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:51.538039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:51.540127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:51.541578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:51.541841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:51.554598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:31:51.580263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] HTTP exception thrown: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Request method failure captured: Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 HTTP/1.1 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlD3C6VMzPXlpXa3bczJgP-VZ2Gvx9vI8F0nQq-_q2byXKQDXy0qNFHEIe9RS_Jylo3K5zYqzgEECFdYUBOBeBgCQIMQ8gMVDVy61tgrfl-XknUE5XdVLwgOggCRPaJjZetsWvrqOLtUn2MMVS06mtCVBoRR_kw9rCLKnqpNf-4SSss Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76301551c4574f299511a993dc871890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76301551c4574f299511a993dc871890", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 3f6133e6ab7745118bc629dd126189e8 Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'df9432d5-0027-49d6-ae4a-a44f8026e718'} Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:51.582720 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. Jun 18 22:31:51.587334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:51.590883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Returning 404 to user: Instance df9432d5-0027-49d6-ae4a-a44f8026e718 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:51.593080 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-86dffbd6-d8ec-46e1-a93d-c5e1221c288c tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718" status: 404 len: 111 microversion: 2.1 time: 0.090006 Jun 18 22:31:51.595387 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2865/5749] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:51 2022] GET /compute/v2.1/servers/df9432d5-0027-49d6-ae4a-a44f8026e718 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:51.814935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:51.831168 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-913c5d8b-9f2b-4085-a156-be32b3df33a6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1226 microversion: 2.1 time: 0.341594 Jun 18 22:31:51.835819 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2885/5750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:51 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1226 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:31:52.851965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:52.854308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:52.872956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:52.873482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:52.876044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:52.876555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:53.077814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:53.089660 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a1a71b5-7a60-4c12-8e5e-0abd45c7cfd6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1300 microversion: 2.1 time: 0.244117 Jun 18 22:31:53.091432 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2866/5751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:52 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1300 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:53.324935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:53.325527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:53.336900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:53.338159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:53.343220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:53.343907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:53.390751 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] HTTP exception thrown: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Request method failure captured: Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 HTTP/1.1 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlD3C6VMzPXlpXa3bczJgP-VZ2Gvx9vI8F0nQq-_q2byXKQDXy0qNFHEIe9RS_Jylo3K5zYqzgEECFdYUBOBeBgCQIMQ8gMVDVy61tgrfl-XknUE5XdVLwgOggCRPaJjZetsWvrqOLtUn2MMVS06mtCVBoRR_kw9rCLKnqpNf-4SSss Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76301551c4574f299511a993dc871890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76301551c4574f299511a993dc871890", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 3f6133e6ab7745118bc629dd126189e8 Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd2a0ac3f-2e1b-423a-8476-d9deb8eec449'} Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:53.400704 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.405928 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.408496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Returning 404 to user: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:53.410493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ea311f0a-2215-4f7c-be16-0044023e51ce tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 404 len: 111 microversion: 2.1 time: 0.089545 Jun 18 22:31:53.414217 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2886/5752] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:31:53 2022] DELETE /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:53.421807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:53.422447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] [instance: d2a0ac3f-2e1b-423a-8476-d9deb8eec449] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:53.431698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:53.435178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:53.438841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:53.439556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:53.504416 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] HTTP exception thrown: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Request method failure captured: Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 HTTP/1.1 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlD3C6VMzPXlpXa3bczJgP-VZ2Gvx9vI8F0nQq-_q2byXKQDXy0qNFHEIe9RS_Jylo3K5zYqzgEECFdYUBOBeBgCQIMQ8gMVDVy61tgrfl-XknUE5XdVLwgOggCRPaJjZetsWvrqOLtUn2MMVS06mtCVBoRR_kw9rCLKnqpNf-4SSss Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/76301551c4574f299511a993dc871890"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/76301551c4574f299511a993dc871890"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_76301551c4574f299511a993dc871890", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 76301551c4574f299511a993dc871890 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223712319 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 3f6133e6ab7745118bc629dd126189e8 Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-AttachVolumeTestJSON-223712319-project Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd2a0ac3f-2e1b-423a-8476-d9deb8eec449'} Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:31:53.524430 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] Returning 404 to user: Instance d2a0ac3f-2e1b-423a-8476-d9deb8eec449 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:31:53.528923 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9de896f2-9a80-4bef-9ecf-f8a85ad2ad16 tempest-AttachVolumeTestJSON-223712319 tempest-AttachVolumeTestJSON-223712319-project] 10.222.0.30 "GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449" status: 404 len: 111 microversion: 2.1 time: 0.109314 Jun 18 22:31:53.533941 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2867/5753] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:53 2022] GET /compute/v2.1/servers/d2a0ac3f-2e1b-423a-8476-d9deb8eec449 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:31:54.107292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:54.108196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:54.121711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:54.122454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:54.124149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:54.127916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:54.591457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:54.623974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-563709cb-86a2-4bd7-b6bb-af7c794ba74d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1342 microversion: 2.1 time: 0.519267 Jun 18 22:31:54.626738 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2887/5754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:54 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1342 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:55.435073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-94fbf071-3d24-47eb-a53f-d1e951d1ba98 req-e3fe293a-1d09-47aa-a6e8-49e8cb4df1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d1a58d-12d0-4ae8-808b-84f83bfb9c6e", "tag": "75c78038-f331-4e26-afc8-71085c4ad1fb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:31:55.479180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-94fbf071-3d24-47eb-a53f-d1e951d1ba98 req-e3fe293a-1d09-47aa-a6e8-49e8cb4df1e5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:55.479894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-94fbf071-3d24-47eb-a53f-d1e951d1ba98 req-e3fe293a-1d09-47aa-a6e8-49e8cb4df1e5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:55.512788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-94fbf071-3d24-47eb-a53f-d1e951d1ba98 req-e3fe293a-1d09-47aa-a6e8-49e8cb4df1e5 service nova] Creating event network-changed:75c78038-f331-4e26-afc8-71085c4ad1fb for instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e on nch2-master-1 Jun 18 22:31:55.518610 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-94fbf071-3d24-47eb-a53f-d1e951d1ba98 req-e3fe293a-1d09-47aa-a6e8-49e8cb4df1e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087442 Jun 18 22:31:55.520018 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2868/5755] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:31:55.648984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:55.653381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:55.662351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:55.664762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:55.665844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:55.666616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:57.176626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:57.195357 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9671962b-5043-41bf-9d9a-d35bc7171d53 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1342 microversion: 2.1 time: 1.551387 Jun 18 22:31:57.196732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2888/5756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:55 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1342 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:58.217182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:58.218818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:58.237899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:58.244615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:58.246032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:58.246630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:58.906535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:31:58.924542 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a6e1339f-673f-4836-ae1b-19df88309674 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1342 microversion: 2.1 time: 0.712852 Jun 18 22:31:58.931100 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2869/5757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:58 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1342 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:31:59.951001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:31:59.951752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:31:59.967352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:59.967744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:31:59.969925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:31:59.973184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:00.285982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:00.303924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cf769b82-6222-42ce-823c-72da61d9b9cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1376 microversion: 2.1 time: 0.358782 Jun 18 22:32:00.314410 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2889/5758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:31:59 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1376 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:01.329377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:01.332740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:01.348617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:01.354026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:01.358808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:01.360767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:01.361626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:01.365612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:01.469879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:01.471165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:01.473319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:01.505482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:01.506173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:01.507206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:01.507819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:01.659913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lazy-loading 'services' on Instance uuid 7ebb841b-32db-495b-8fea-bacf1539e29d {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:32:01.762694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f9c6811-0d5a-402f-b013-0dc434c3f33a tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d/os-volume_attachments/0e6040aa-afe5-48b7-82e1-848690284862" status: 202 len: 0 microversion: 2.1 time: 0.296875 Jun 18 22:32:01.764088 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2890/5759] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:32:01 2022] DELETE /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d/os-volume_attachments/0e6040aa-afe5-48b7-82e1-848690284862 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:32:01.927695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:01.945812 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-77f055c6-a6e8-4d66-b813-a39b3ee9b131 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1376 microversion: 2.1 time: 0.626984 Jun 18 22:32:01.946101 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2870/5760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:01 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1376 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:02.907489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:02.908857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:02.917451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:02.918268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:02.919379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:02.919817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:02.951696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:32:02.962714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:02.963347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:02.974153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:02.974611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:02.975394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:02.975836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:03.134500 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eb020d72-a306-4c1f-9d2c-96c32f6f11fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 204 len: 0 microversion: 2.1 time: 0.230212 Jun 18 22:32:03.141074 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2891/5761] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:32:02 2022] DELETE /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:32:03.156134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:03.158270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:03.180833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:03.182457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:03.187758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:03.188508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:03.368011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:03.378171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b91838ad-2ee2-4a83-ae00-f7d510136873 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1376 microversion: 2.1 time: 0.419241 Jun 18 22:32:03.379212 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2871/5762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:02 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1376 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:32:03.580541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:03.591353 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-121a6e5b-0448-4eb6-bba8-04d4d4e3c261 tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1469 microversion: 2.1 time: 0.444338 Jun 18 22:32:03.599805 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2892/5763] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:03 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:04.396584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:04.397937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:04.411604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:04.416076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:04.417288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:04.419850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:04.467157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-47e5da3c-c0dc-46f8-a403-49770ba9707d req-102aa925-46a4-44af-90e3-19d2ad68ed7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d1a58d-12d0-4ae8-808b-84f83bfb9c6e", "name": "network-vif-plugged", "status": "completed", "tag": "75c78038-f331-4e26-afc8-71085c4ad1fb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:04.526688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-47e5da3c-c0dc-46f8-a403-49770ba9707d req-102aa925-46a4-44af-90e3-19d2ad68ed7a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:04.527346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-47e5da3c-c0dc-46f8-a403-49770ba9707d req-102aa925-46a4-44af-90e3-19d2ad68ed7a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:04.572244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-47e5da3c-c0dc-46f8-a403-49770ba9707d req-102aa925-46a4-44af-90e3-19d2ad68ed7a service nova] Creating event network-vif-plugged:75c78038-f331-4e26-afc8-71085c4ad1fb for instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e on nch2-master-1 Jun 18 22:32:04.595814 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-47e5da3c-c0dc-46f8-a403-49770ba9707d req-102aa925-46a4-44af-90e3-19d2ad68ed7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130061 Jun 18 22:32:04.599965 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2893/5764] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:04.623969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:04.628658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:04.653667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:04.654361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:04.655714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:04.656515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:05.019261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:05.032070 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9286ad1d-943b-44af-b966-be789bc751a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1376 microversion: 2.1 time: 0.638611 Jun 18 22:32:05.034062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2872/5765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:04 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1376 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:05.062757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:05.073611 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c016e284-ce75-47c8-9765-66206e5e5ccf tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1469 microversion: 2.1 time: 0.467343 Jun 18 22:32:05.074218 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2894/5766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:04 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:05.571607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-09d9c6ae-80c8-4098-a63a-6b43139e87f4 req-87609256-1dfc-4604-8b68-9a6f988ae467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ebb841b-32db-495b-8fea-bacf1539e29d", "name": "network-vif-deleted", "tag": "bdfd1a0a-a11d-4eb2-8f3d-2ac76d385b5b"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:05.582995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-09d9c6ae-80c8-4098-a63a-6b43139e87f4 req-87609256-1dfc-4604-8b68-9a6f988ae467 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:05.583433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-09d9c6ae-80c8-4098-a63a-6b43139e87f4 req-87609256-1dfc-4604-8b68-9a6f988ae467 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:05.603421 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-09d9c6ae-80c8-4098-a63a-6b43139e87f4 req-87609256-1dfc-4604-8b68-9a6f988ae467 service nova] Creating event network-vif-deleted:bdfd1a0a-a11d-4eb2-8f3d-2ac76d385b5b for instance 7ebb841b-32db-495b-8fea-bacf1539e29d on nch2-master-1 Jun 18 22:32:05.624878 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-09d9c6ae-80c8-4098-a63a-6b43139e87f4 req-87609256-1dfc-4604-8b68-9a6f988ae467 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057313 Jun 18 22:32:05.630518 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2873/5767] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:06.051017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:06.051650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:06.067550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:06.068352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:06.069733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:06.070953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:06.095545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:06.096553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:06.107937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:06.108646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:06.109943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:06.110545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:06.169222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:06.169783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:06.170332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lazy-loading 'fault' on Instance uuid 7ebb841b-32db-495b-8fea-bacf1539e29d {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:32:06.332690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4b5f6d69d1e4804923d47dd4d71d443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b4d0121cf24c619d4ad0f5af414dd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:06.354026 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-89fe185a-b486-4594-b54c-cfff5ec223fe tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 200 len: 1303 microversion: 2.1 time: 0.265698 Jun 18 22:32:06.355483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2874/5768] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:06 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 1303 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:06.424096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:06.435277 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73510733-cc70-4d67-ab8e-6f77beddea74 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1376 microversion: 2.1 time: 0.387967 Jun 18 22:32:06.436062 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2895/5769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:06 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1376 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:07.373293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:07.374797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] [instance: 7ebb841b-32db-495b-8fea-bacf1539e29d] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:07.384021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:07.385093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:07.386512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:07.387247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:07.409531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] HTTP exception thrown: Instance 7ebb841b-32db-495b-8fea-bacf1539e29d could not be found. Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Request method failure captured: Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d HTTP/1.1 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlJE6rSBYrpw1s3x5hqLVKnArtN91czU4rdL2PR79KYupJdz4kpxXjIQys0ceyiKy1t7po2cG5U_ztpxkNCq_nVY6X3HmXTsrNzcVFYiY8BmrKc5Tdiiet-zvOFvJgWgiYHQw83dCaBie4Ud5fC54O8ivufYRGKn-fbBXwr6_v-BwT0 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: f7b4d0121cf24c619d4ad0f5af414dd8 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesBackupsTest-624856523 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7b4d0121cf24c619d4ad0f5af414dd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7b4d0121cf24c619d4ad0f5af414dd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7b4d0121cf24c619d4ad0f5af414dd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7b4d0121cf24c619d4ad0f5af414dd8", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesBackupsTest-624856523 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: f7b4d0121cf24c619d4ad0f5af414dd8 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesBackupsTest-624856523 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesBackupsTest-624856523-project Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a4b5f6d69d1e4804923d47dd4d71d443 Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesBackupsTest-624856523-project Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7ebb841b-32db-495b-8fea-bacf1539e29d could not be found. Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7ebb841b-32db-495b-8fea-bacf1539e29d'} Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ebb841b-32db-495b-8fea-bacf1539e29d could not be found. Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ebb841b-32db-495b-8fea-bacf1539e29d could not be found. Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:07.412262 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ebb841b-32db-495b-8fea-bacf1539e29d could not be found. Jun 18 22:32:07.417107 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:07.418778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] Returning 404 to user: Instance 7ebb841b-32db-495b-8fea-bacf1539e29d could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:07.420088 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-06b55e66-2445-48de-b666-dbf55dba1ece tempest-VolumesBackupsTest-624856523 tempest-VolumesBackupsTest-624856523-project] 10.222.0.30 "GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d" status: 404 len: 111 microversion: 2.1 time: 0.052044 Jun 18 22:32:07.423928 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2875/5770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:07 2022] GET /compute/v2.1/servers/7ebb841b-32db-495b-8fea-bacf1539e29d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:07.455904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:07.457625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:07.474055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:07.474901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:07.477917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:07.478605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:07.847578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:07.867704 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0149b105-9f37-44a7-af99-659a9fb7e36d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1564 microversion: 2.1 time: 0.418512 Jun 18 22:32:07.868256 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2896/5771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:07 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1564 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:07.885869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:07.886526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:07.896837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:07.897406 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:07.904410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:07.906070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:08.198947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:08.228395 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2027377d-35a0-41d9-a9a0-bf96854fd02c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1564 microversion: 2.1 time: 0.343954 Jun 18 22:32:08.239673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2876/5772] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:07 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1564 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:32:08.330080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:08.330813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:08.338753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:08.345114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:08.346226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:08.346940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:08.380614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:32:08.506556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1fa3227d-5822-42c4-91f6-9aaf1311baee tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 204 len: 0 microversion: 2.1 time: 0.179165 Jun 18 22:32:08.507239 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2897/5773] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:32:08 2022] DELETE /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:32:08.516280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:08.524657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:08.537679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:08.539927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:08.540712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:08.541904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:08.542729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:08.861412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:08.871578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb4b25ee-03dc-4300-9d83-051ef6d78764 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1570 microversion: 2.1 time: 0.359683 Jun 18 22:32:08.882758 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2877/5774] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:08 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1570 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:09.893289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:09.894335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:09.909389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:09.909767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:09.910573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:09.913239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:10.218689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:10.260606 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1fef1d4-43ed-4a85-a7a8-074e3891e3cb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1570 microversion: 2.1 time: 0.371308 Jun 18 22:32:10.268174 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2898/5775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:09 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1570 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:11.285789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:11.287173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:11.304746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:11.309189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:11.316257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:11.317211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:11.544758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:11.567596 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a9ff0a47-5583-44cc-b4f9-7724dc915cb5 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1528 microversion: 2.1 time: 0.285039 Jun 18 22:32:11.568740 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2878/5776] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:11 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1528 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:11.725336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1bf095de-118f-4244-a562-3fc0a3711d2d req-7d49274a-06f1-4999-a21b-b06de79302f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d1a58d-12d0-4ae8-808b-84f83bfb9c6e", "name": "network-vif-deleted", "tag": "75c78038-f331-4e26-afc8-71085c4ad1fb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:11.759683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:11.770331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bf095de-118f-4244-a562-3fc0a3711d2d req-7d49274a-06f1-4999-a21b-b06de79302f7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:11.770801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bf095de-118f-4244-a562-3fc0a3711d2d req-7d49274a-06f1-4999-a21b-b06de79302f7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:11.787276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:11.821475 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1bf095de-118f-4244-a562-3fc0a3711d2d req-7d49274a-06f1-4999-a21b-b06de79302f7 service nova] Creating event network-vif-deleted:75c78038-f331-4e26-afc8-71085c4ad1fb for instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e on nch2-master-1 Jun 18 22:32:11.834415 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1bf095de-118f-4244-a562-3fc0a3711d2d req-7d49274a-06f1-4999-a21b-b06de79302f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.407584 Jun 18 22:32:11.835366 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2899/5777] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:12.591011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:12.591773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:12.611835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:12.612771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:12.616303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:12.619452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:12.676293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:12.728799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:12.729635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:12.730698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lazy-loading 'fault' on Instance uuid 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:32:12.992350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:13.009979 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-350114af-c930-470e-80ce-8817a6bdcc12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 200 len: 1320 microversion: 2.1 time: 0.426212 Jun 18 22:32:13.010558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2879/5778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:12 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 1320 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:14.035604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:14.037107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:14.063328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:14.063798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:14.073166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:14.074694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:14.111711 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e HTTP/1.1 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '82d1a58d-12d0-4ae8-808b-84f83bfb9c6e'} Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:14.116127 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:14.120721 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:14.123375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:14.125222 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5b711624-4b0a-453d-a191-49bcf93a3351 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 404 len: 111 microversion: 2.1 time: 0.101402 Jun 18 22:32:14.131339 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2900/5779] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:14 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:38.945645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=7 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:38.947560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:39.258017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5fee587-f772-4d5c-9277-90ef71ad5b7a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Action: 'create', calling method: .version_select at 0x7fea0726ec10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1315825765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLli6ED9O3pAICmmzJ1Gl/lqWp7V35n9e8GN40Ls+qTzJuTghSk1WItimen01usHl6CWQs5Ld9h4gvmBRwGNhjWihonphvJhzoavs5hmi/6QvcAkeFgimoTJluYfInf5A=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:39.299992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d5fee587-f772-4d5c-9277-90ef71ad5b7a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Getting quotas for project 1bf51848ad1c43ae997974ba2925ab4e. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:32:39.325313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d5fee587-f772-4d5c-9277-90ef71ad5b7a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Getting quotas for user f228d958acdb4d769a59f019e4d41d6c and project 1bf51848ad1c43ae997974ba2925ab4e. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:32:39.389136 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5fee587-f772-4d5c-9277-90ef71ad5b7a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.448777 Jun 18 22:32:39.389981 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2880/5780] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:32:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:32:41.351553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-24259662", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1315825765", "security_groups": [{"name": "tempest-secgroup-smoke-943636474"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f83a9717-0c32-416f-b97d-a73e928a23b1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:41.387648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:41.992987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] validate_networks() for [('f83a9717-0c32-416f-b97d-a73e928a23b1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:32:44.078699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Getting quotas for project 1bf51848ad1c43ae997974ba2925ab4e. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:32:44.094734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Getting quotas for user f228d958acdb4d769a59f019e4d41d6c and project 1bf51848ad1c43ae997974ba2925ab4e. Resources: dict_keys(['metadata_items']) {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:32:44.135210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:32:44.135836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:32:44.136888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:32:44.137917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:32:44.138741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:32:44.160514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:44.161393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:44.162425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:44.163081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:44.191192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Getting quotas for project 1bf51848ad1c43ae997974ba2925ab4e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:32:44.196963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Getting quotas for user f228d958acdb4d769a59f019e4d41d6c and project 1bf51848ad1c43ae997974ba2925ab4e. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:32:44.219791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:32:44.222957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:32:44.296725 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-106d3e73-f60d-4f80-8b7e-86a456323b7b tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.950731 Jun 18 22:32:44.299588 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2901/5781] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:32:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:32:44.310698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-64cab5db-3e68-40b4-b47c-39bb96f663ba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:44.312367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-64cab5db-3e68-40b4-b47c-39bb96f663ba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:44.456497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-64cab5db-3e68-40b4-b47c-39bb96f663ba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:44.472447 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-64cab5db-3e68-40b4-b47c-39bb96f663ba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1301 microversion: 2.1 time: 0.167406 Jun 18 22:32:44.473081 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2881/5782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:44 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:45.129236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:45.130694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:45.152106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:45.155069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:45.156253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:45.157771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:45.201628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:32:45.380969 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d3ab158-48c0-49d0-a535-f7231e04ec11 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 204 len: 0 microversion: 2.1 time: 0.263061 Jun 18 22:32:45.386795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2902/5783] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:32:45 2022] DELETE /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:32:45.396487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:45.397407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:45.421390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:45.424966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:45.426576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:45.433056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:45.493594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ceaae47e-dfbc-4e39-b09b-b6a33724e88f tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:45.494372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ceaae47e-dfbc-4e39-b09b-b6a33724e88f tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:45.686071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ceaae47e-dfbc-4e39-b09b-b6a33724e88f tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:45.693537 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ceaae47e-dfbc-4e39-b09b-b6a33724e88f tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1301 microversion: 2.1 time: 0.206867 Jun 18 22:32:45.698649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2903/5784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:45 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1301 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:45.870989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:45.894843 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eb0b6383-4616-4e91-96fb-087eed5c6b0a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1410 microversion: 2.1 time: 0.502565 Jun 18 22:32:45.896675 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2882/5785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:45 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1410 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:46.714912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:46.715614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:46.733109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:46.733913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:46.734956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:46.735436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:46.877487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:46.894094 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fb57b9a9-c2da-4751-8185-9a952cce1b95 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1359 microversion: 2.1 time: 0.180594 Jun 18 22:32:46.897472 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2904/5786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:46 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:46.913380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:46.914010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:46.929068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:46.929515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:46.930305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:46.930744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:47.257310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:47.297559 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c96e7f75-e1ad-4640-b614-12ab316d91b9 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1410 microversion: 2.1 time: 0.387627 Jun 18 22:32:47.304823 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2883/5787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:46 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1410 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:47.400762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Calling method '.version_select at 0x7fea19cbef70>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:47.401746 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:32:47.401746 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:32:47.403604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:47.404431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:47.443815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:47.446150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:47.466573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:47.467621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:47.475628 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9f257fa5-69f5-4fea-aa50-e23f770a09d4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1279387245-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.323673 Jun 18 22:32:47.477219 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2905/5788] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:32:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:47.914519 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:47.915351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:47.924591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:47.928273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:47.931569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:47.934378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:48.116716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7d036dd8-e7f6-493a-9bee-f0fb2d5b42a3 req-28f58bf1-0c1a-4263-bf29-5b305b043bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd42fcc6-8728-45b4-a297-d72326e41556", "name": "network-vif-deleted", "tag": "35fec24d-2604-4af1-8dc3-3efe457dd6a7"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:48.138236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7d036dd8-e7f6-493a-9bee-f0fb2d5b42a3 req-28f58bf1-0c1a-4263-bf29-5b305b043bb6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:48.138678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7d036dd8-e7f6-493a-9bee-f0fb2d5b42a3 req-28f58bf1-0c1a-4263-bf29-5b305b043bb6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:48.190169 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7d036dd8-e7f6-493a-9bee-f0fb2d5b42a3 req-28f58bf1-0c1a-4263-bf29-5b305b043bb6 service nova] Creating event network-vif-deleted:35fec24d-2604-4af1-8dc3-3efe457dd6a7 for instance dd42fcc6-8728-45b4-a297-d72326e41556 on nch1-master-1 Jun 18 22:32:48.211678 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7d036dd8-e7f6-493a-9bee-f0fb2d5b42a3 req-28f58bf1-0c1a-4263-bf29-5b305b043bb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096678 Jun 18 22:32:48.214313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2906/5789] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:32:48.247482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:48.256284 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d4f6018-0cd3-4349-ad66-069022f052cf tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.346210 Jun 18 22:32:48.267993 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2884/5790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:47 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:48.319238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:48.320756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:48.335637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:48.336363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:48.337376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:48.337985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:48.434608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:48.448585 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f7ec5e3a-823a-4c26-ac8c-db5d321d6448 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 200 len: 1201 microversion: 2.1 time: 0.134166 Jun 18 22:32:48.449324 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2907/5791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:48 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 1201 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:49.275604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:49.276258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:49.286138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:49.286785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:49.287733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:49.288675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:49.466474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:49.467746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:49.482807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:49.485661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:49.487261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:49.488366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:49.490217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:49.509132 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7e0bdfca-01ac-45f9-b39c-7a39576d86e5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.238584 Jun 18 22:32:49.509727 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2885/5792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:49 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:49.523945 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 HTTP/1.1 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'dd42fcc6-8728-45b4-a297-d72326e41556'} Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:49.525890 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1d26bacb-d7b1-46e2-8452-ce5aefb4495c tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 404 len: 111 microversion: 2.1 time: 0.065597 Jun 18 22:32:49.530525 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2908/5793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:49 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:50.295489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-02f0f4ae-c246-45bd-a4bc-4058ce930fc4 req-a9026cbd-c243-4446-92eb-c8cfa89ca5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2620ebeb-abd9-426e-9809-e6b47eb16073", "tag": "4cc74021-ded5-444b-a48e-c1cd16fd92fe"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:50.306047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-02f0f4ae-c246-45bd-a4bc-4058ce930fc4 req-a9026cbd-c243-4446-92eb-c8cfa89ca5b7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.306496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-02f0f4ae-c246-45bd-a4bc-4058ce930fc4 req-a9026cbd-c243-4446-92eb-c8cfa89ca5b7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.320209 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-02f0f4ae-c246-45bd-a4bc-4058ce930fc4 req-a9026cbd-c243-4446-92eb-c8cfa89ca5b7 service nova] Creating event network-changed:4cc74021-ded5-444b-a48e-c1cd16fd92fe for instance 2620ebeb-abd9-426e-9809-e6b47eb16073 on nch2-master-1 Jun 18 22:32:50.325868 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-02f0f4ae-c246-45bd-a4bc-4058ce930fc4 req-a9026cbd-c243-4446-92eb-c8cfa89ca5b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035541 Jun 18 22:32:50.327083 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2886/5794] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:50.526492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:50.527111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:50.534860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.535341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.536092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.536746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.642531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:50.643411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:50.649814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.650267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.651037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.651470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.671486 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e HTTP/1.1 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82d1a58d-12d0-4ae8-808b-84f83bfb9c6e'} Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:50.673266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ffbdc91-fcf4-4332-9871-54d85c21f55e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 404 len: 111 microversion: 2.1 time: 0.036781 Jun 18 22:32:50.678122 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2887/5795] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:32:50 2022] DELETE /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:32:50.684809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:50.686024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:50.694783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.694783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.696232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:50.697562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:50.714044 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e HTTP/1.1 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '82d1a58d-12d0-4ae8-808b-84f83bfb9c6e'} Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:50.715619 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 82d1a58d-12d0-4ae8-808b-84f83bfb9c6e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-338d4be5-575e-45b2-ba11-8fb0ba6e6499 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e" status: 404 len: 111 microversion: 2.1 time: 0.036419 Jun 18 22:32:50.719838 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2888/5796] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:50 2022] GET /compute/v2.1/servers/82d1a58d-12d0-4ae8-808b-84f83bfb9c6e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:50.933553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:50.944834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f195ba6-9bbe-4d07-b78e-02802592cb89 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.422497 Jun 18 22:32:50.945723 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2909/5797] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:50 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:32:51.440995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:51.445165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:51.460497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:51.461217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:51.462377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:51.462967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:51.488723 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 HTTP/1.1 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'dd42fcc6-8728-45b4-a297-d72326e41556'} Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:51.491438 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.496859 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.498450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:51.501952 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff4993f2-e9a5-4678-ba84-124f3bbb4b79 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 404 len: 111 microversion: 2.1 time: 0.072085 Jun 18 22:32:51.507231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2889/5798] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:32:51 2022] DELETE /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:51.511106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:51.511747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: dd42fcc6-8728-45b4-a297-d72326e41556] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:51.518885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:51.519356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:51.520160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:51.520617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:51.541246 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 HTTP/1.1 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'dd42fcc6-8728-45b4-a297-d72326e41556'} Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:32:51.543108 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance dd42fcc6-8728-45b4-a297-d72326e41556 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-20dd6e01-b718-4aae-94c8-1cacb255a39e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556" status: 404 len: 111 microversion: 2.1 time: 0.038457 Jun 18 22:32:51.551088 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2910/5799] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:51 2022] GET /compute/v2.1/servers/dd42fcc6-8728-45b4-a297-d72326e41556 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:32:51.628127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2a4c144-755a-4ea3-8125-c5a05d0da255 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: .version_select at 0x7fea071e6dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1425479607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyMfBCpUT9cGxOyKGYiKf2tlaG6AqGy21C6pMyLN9HzUpPtd3U1HYbqkNufHqNJ49dLYMxyELSU/f0RJobnkdVK0VoSgAasZLUmFPBF1k2tHDZMRviGU3i7A2dSzCWB+A=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:51.644605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f2a4c144-755a-4ea3-8125-c5a05d0da255 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:32:51.650936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f2a4c144-755a-4ea3-8125-c5a05d0da255 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:32:51.682731 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2a4c144-755a-4ea3-8125-c5a05d0da255 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.059533 Jun 18 22:32:51.690373 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2890/5800] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:32:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:51.963548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:51.965655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:51.973607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:51.974831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:51.975999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:51.976645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:52.274329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:52.290145 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-358089c9-3f1d-4477-807a-bd3c5a8f1b19 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.331725 Jun 18 22:32:52.290872 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2911/5801] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:51 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:53.309698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:53.311076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:53.319107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:53.319572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:53.320372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:53.320991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:53.781639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:53.791259 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6266b94c-3b45-4e20-b330-7245aba3eb77 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.487960 Jun 18 22:32:53.793700 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2891/5802] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:53 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:54.690589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:54.813959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:54.817571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:54.843497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:54.846454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:54.847545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:54.856376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:55.063742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b071dfeb-cf5a-41ec-9f7e-ead90dddbfd6 req-d46067b6-9665-4010-8349-d9c5f68f2efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2620ebeb-abd9-426e-9809-e6b47eb16073", "name": "network-vif-plugged", "status": "completed", "tag": "4cc74021-ded5-444b-a48e-c1cd16fd92fe"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:55.074605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b071dfeb-cf5a-41ec-9f7e-ead90dddbfd6 req-d46067b6-9665-4010-8349-d9c5f68f2efc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:55.075493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b071dfeb-cf5a-41ec-9f7e-ead90dddbfd6 req-d46067b6-9665-4010-8349-d9c5f68f2efc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:55.096244 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b071dfeb-cf5a-41ec-9f7e-ead90dddbfd6 req-d46067b6-9665-4010-8349-d9c5f68f2efc service nova] Creating event network-vif-plugged:4cc74021-ded5-444b-a48e-c1cd16fd92fe for instance 2620ebeb-abd9-426e-9809-e6b47eb16073 on nch2-master-1 Jun 18 22:32:55.104815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b071dfeb-cf5a-41ec-9f7e-ead90dddbfd6 req-d46067b6-9665-4010-8349-d9c5f68f2efc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.436394 Jun 18 22:32:55.106141 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2912/5803] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:32:55.171390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:55.185190 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b84becfc-9b3c-4dfa-b45e-f4faa0b8adba tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.379026 Jun 18 22:32:55.187118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2892/5804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:54 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:56.202504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:32:56.206679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:56.207432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:56.221479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:56.222377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:56.223568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:56.224374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:56.536899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:56.555595 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b62b945-5255-4112-a765-75b74970cff7 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1426 microversion: 2.1 time: 0.349659 Jun 18 22:32:56.557465 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2913/5805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:56 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1426 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:57.574588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:57.575342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:57.582578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:57.583447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:57.584230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:57.584681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:57.854044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-375240596", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1425479607", "security_groups": [{"name": "tempest-secgroup-smoke-1119156546"}], "block_device_mapping_v2": [{"uuid": "92eb6127-5f06-4961-a0f5-c7fb19e61c04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:32:57.888254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:57.900961 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-427240a2-de3e-42c1-a5d4-5aaac7a5fd64 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1605 microversion: 2.1 time: 0.330407 Jun 18 22:32:57.901708 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2893/5806] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:57 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1605 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:32:57.917150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:57.917770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:57.924085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:57.924525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:57.925507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:57.926093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:58.122929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] validate_networks() for [('b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:32:58.267687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:58.290433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2d14e11d-b8dc-44eb-907d-165d8dccc675 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1605 microversion: 2.1 time: 0.376727 Jun 18 22:32:58.305151 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2894/5807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:57 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1605 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:32:58.311215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:58.311849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:58.321016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:58.321499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:58.322389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:58.328405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:58.673007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:58.682469 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c64b862-7969-434e-845d-710a4287d7f5 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1605 microversion: 2.1 time: 0.376656 Jun 18 22:32:58.694251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2895/5808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:58 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1605 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:32:58.817454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:32:58.818108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:32:58.818746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:32:58.819320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:32:58.819916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:32:58.830945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:58.831948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:58.833177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:32:58.834119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:32:58.885630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:32:58.897372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:32:59.046777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:32:59.061570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92eb6127-5f06-4961-a0f5-c7fb19e61c04',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:32:59.266614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34518bf7-d4bf-4eb2-aec5-f2ba4b5ca2ed tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.416751 Jun 18 22:32:59.270033 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2914/5809] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:32:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:32:59.281285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ca8b7c8c-9d4f-40c3-bf05-70544656a9e3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:32:59.282247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ca8b7c8c-9d4f-40c3-bf05-70544656a9e3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:32:59.623421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ca8b7c8c-9d4f-40c3-bf05-70544656a9e3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:32:59.633783 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ca8b7c8c-9d4f-40c3-bf05-70544656a9e3 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1094 microversion: 2.1 time: 0.357406 Jun 18 22:32:59.637215 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2896/5810] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:32:59 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1094 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:00.658033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:00.659270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:00.677150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:00.678522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:00.679334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:00.680506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:00.844705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:00.858974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4125c14e-2a1a-4725-ad4b-c01ff0903e0b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1200 microversion: 2.1 time: 0.207520 Jun 18 22:33:00.871896 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2915/5811] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:00 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1200 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:01.879089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:01.880079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:01.901683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:01.902212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:01.908890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:01.909665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:02.160603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:02.176441 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c5c0cf0-5f94-42bb-b535-388cc065ad48 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1210 microversion: 2.1 time: 0.302922 Jun 18 22:33:02.180024 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2897/5812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:01 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1210 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:03.072581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a92b96c1-25af-4760-8c0a-30146ff4c4e4 req-3799d283-9376-4b40-bae4-fb3a0392929a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2620ebeb-abd9-426e-9809-e6b47eb16073", "tag": "4cc74021-ded5-444b-a48e-c1cd16fd92fe"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:03.096543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a92b96c1-25af-4760-8c0a-30146ff4c4e4 req-3799d283-9376-4b40-bae4-fb3a0392929a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:03.097016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a92b96c1-25af-4760-8c0a-30146ff4c4e4 req-3799d283-9376-4b40-bae4-fb3a0392929a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:03.124693 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a92b96c1-25af-4760-8c0a-30146ff4c4e4 req-3799d283-9376-4b40-bae4-fb3a0392929a service nova] Creating event network-changed:4cc74021-ded5-444b-a48e-c1cd16fd92fe for instance 2620ebeb-abd9-426e-9809-e6b47eb16073 on nch2-master-1 Jun 18 22:33:03.136156 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a92b96c1-25af-4760-8c0a-30146ff4c4e4 req-3799d283-9376-4b40-bae4-fb3a0392929a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067085 Jun 18 22:33:03.136896 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2916/5813] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:03.200416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:03.202167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:03.215972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:03.219862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:03.222846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:03.225220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:03.611485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:03.621405 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-68cc932b-8230-41ed-94d6-d7713a2c20a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.425451 Jun 18 22:33:03.622849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2898/5814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:03 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:04.651319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:04.659727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:04.673580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:04.674325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:04.676416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:04.677268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:05.079128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:05.094016 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-318d3a3a-c434-43bf-bb05-7a944494f720 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.457670 Jun 18 22:33:05.095128 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2917/5815] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:04 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:05.377235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9524f332-dd46-49f7-8c07-1557e64f67cd req-512f0094-8cea-49f8-ac8b-540b47c38541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f43ae76-2d85-45eb-8bc0-112036e81fcd", "tag": "3ea2141e-07a7-46b4-b873-0120f23d87c4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:05.413854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9524f332-dd46-49f7-8c07-1557e64f67cd req-512f0094-8cea-49f8-ac8b-540b47c38541 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:05.416927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9524f332-dd46-49f7-8c07-1557e64f67cd req-512f0094-8cea-49f8-ac8b-540b47c38541 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:05.455602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9524f332-dd46-49f7-8c07-1557e64f67cd req-512f0094-8cea-49f8-ac8b-540b47c38541 service nova] Creating event network-changed:3ea2141e-07a7-46b4-b873-0120f23d87c4 for instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd on nch1-master-1 Jun 18 22:33:05.468777 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9524f332-dd46-49f7-8c07-1557e64f67cd req-512f0094-8cea-49f8-ac8b-540b47c38541 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096733 Jun 18 22:33:05.472058 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2899/5816] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:06.111438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:06.112083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:06.123059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:06.124417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:06.142216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:06.146940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:06.460230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:06.468991 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae8112d4-6d86-42ba-8ff1-7feecccd2824 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.361605 Jun 18 22:33:06.470270 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2918/5817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:06 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:07.487901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:07.489459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:07.503814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:07.504863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:07.506088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:07.507178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:07.941255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:07.974274 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c96f7da-eeae-4909-ae22-7c39acc500ea tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.491342 Jun 18 22:33:07.985435 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2900/5818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:07 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:08.992673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:08.993431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:09.006101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:09.008150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:09.011525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:09.012552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:09.014625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:09.015789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:09.288671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:09.298109 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8696b999-da68-4736-b4a7-5e0ed5b63036 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.310549 Jun 18 22:33:09.307500 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2919/5819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:08 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:10.316854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:10.326859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:10.337972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:10.337972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:10.350251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:10.350735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:10.351561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:10.357206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:10.417525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=83 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:10.770735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:10.784474 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47d549cd-757f-4f16-bf70-35ae2b84c981 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.472732 Jun 18 22:33:10.787354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2901/5820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:10 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:11.808821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:11.809519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:11.823081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:11.825731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:11.826621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:11.827625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:11.828078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:11.835983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:12.156511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:12.165936 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d672e717-1069-4374-a894-5d1d187d1f62 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.366541 Jun 18 22:33:12.167642 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2920/5821] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:11 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:13.184322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:13.185123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:13.196777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:13.209638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:13.210748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:13.211347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:13.752963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:13.764437 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-674d0549-e5df-43ce-bbd9-d410a50a75a4 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.583897 Jun 18 22:33:13.773925 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2902/5822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:13 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:14.400821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b4e94e26-7fcf-4413-a824-37331c92625c req-1c6eb82f-13a7-4e13-9753-722076fd16d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f43ae76-2d85-45eb-8bc0-112036e81fcd", "name": "network-vif-plugged", "status": "completed", "tag": "3ea2141e-07a7-46b4-b873-0120f23d87c4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:14.410884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4e94e26-7fcf-4413-a824-37331c92625c req-1c6eb82f-13a7-4e13-9753-722076fd16d5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:14.411600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4e94e26-7fcf-4413-a824-37331c92625c req-1c6eb82f-13a7-4e13-9753-722076fd16d5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:14.423501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b4e94e26-7fcf-4413-a824-37331c92625c req-1c6eb82f-13a7-4e13-9753-722076fd16d5 service nova] Creating event network-vif-plugged:3ea2141e-07a7-46b4-b873-0120f23d87c4 for instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd on nch1-master-1 Jun 18 22:33:14.428974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b4e94e26-7fcf-4413-a824-37331c92625c req-1c6eb82f-13a7-4e13-9753-722076fd16d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Jun 18 22:33:14.430226 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2921/5823] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:14.784213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:14.785065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:14.799547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:14.808070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:14.809840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:14.810681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:15.076421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:15.092502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41968692-f850-43a8-821c-968ff7ebb94a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1266 microversion: 2.1 time: 0.312081 Jun 18 22:33:15.095290 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2903/5824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:14 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:33:16.112591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:16.114052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:16.121399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:16.126813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:16.128013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:16.128674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:16.391349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:16.411121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3076ca26-beb2-4036-bd57-2fb863900ed6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1453 microversion: 2.1 time: 0.302291 Jun 18 22:33:16.412774 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2922/5825] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:16 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1453 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:16.433223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:16.434859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:16.455906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:16.457852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:16.460428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:16.462213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:16.761595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:16.775410 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-85de1257-2fe7-42de-91a2-dfb76cfdd5d7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1453 microversion: 2.1 time: 0.346566 Jun 18 22:33:16.776195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2904/5826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:16 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1453 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:17.672909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a94fb290-a037-4b04-b6b9-fbab9859f9ab tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1749285220", "availability_zone": "foo_zone"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:17.713022 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:17.713022 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:33:17.720109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.aggregate [None req-a94fb290-a037-4b04-b6b9-fbab9859f9ab tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Generated uuid 94a8ccac-cbce-47cf-b0e4-08664eb770aa for aggregate {{(pid=130903) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 18 22:33:17.772227 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a94fb290-a037-4b04-b6b9-fbab9859f9ab tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.560459 Jun 18 22:33:17.773208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2923/5827] 10.222.0.30 () {60 vars in 1163 bytes} [Sat Jun 18 22:33:17 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:17.784077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c62f1ae2-57a1-42a8-ac44-9312a12e533a tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:17.785719 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:17.785719 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:33:17.827481 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c62f1ae2-57a1-42a8-ac44-9312a12e533a tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.047451 Jun 18 22:33:17.829466 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2905/5828] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:33:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:17.838913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e36b436f-6929-4050-b17f-ee3a6539f449 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:17.840211 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:17.840211 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:33:17.842237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e36b436f-6929-4050-b17f-ee3a6539f449 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:17.842728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e36b436f-6929-4050-b17f-ee3a6539f449 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:17.843515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e36b436f-6929-4050-b17f-ee3a6539f449 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:17.844348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e36b436f-6929-4050-b17f-ee3a6539f449 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:17.880624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e36b436f-6929-4050-b17f-ee3a6539f449 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045293 Jun 18 22:33:17.902819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b491ef70-8917-4334-90e0-77833ee8a84c tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:17.903955 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:17.903955 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:33:17.909635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2924/5829] 10.222.0.30 () {58 vars in 1175 bytes} [Sat Jun 18 22:33:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:17.919609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b491ef70-8917-4334-90e0-77833ee8a84c tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.029391 Jun 18 22:33:17.934148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8960bceb-7c74-4549-956e-2e7dbf7a57b6 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:17.941114 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:17.941114 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:33:17.943644 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2906/5830] 10.222.0.30 () {58 vars in 1142 bytes} [Sat Jun 18 22:33:17 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:17.951245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8960bceb-7c74-4549-956e-2e7dbf7a57b6 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:17.951983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8960bceb-7c74-4549-956e-2e7dbf7a57b6 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:18.525355 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8960bceb-7c74-4549-956e-2e7dbf7a57b6 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.596743 Jun 18 22:33:18.526399 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2925/5831] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:33:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:18.537597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87fd33ec-48f6-44f4-a033-32a7a81d9c3a tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:18.538631 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:18.538631 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:33:18.590754 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-87fd33ec-48f6-44f4-a033-32a7a81d9c3a tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.057559 Jun 18 22:33:18.591358 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2907/5832] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:33:18 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:18.603618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-723b61c7-a8e5-46e6-a235-f47956a38c17 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-92026388", "availability_zone": "foo_zone"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:18.714514 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:18.714514 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:33:18.841547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-723b61c7-a8e5-46e6-a235-f47956a38c17 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 340 microversion: 2.1 time: 0.236979 Jun 18 22:33:18.843153 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2926/5833] 10.222.0.30 () {60 vars in 1172 bytes} [Sat Jun 18 22:33:18 2022] PUT /compute/v2.1/os-aggregates/19 => generated 340 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:18.853650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec483d17-c947-4226-8d79-929a9cf69fbc tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:18.855622 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:18.855622 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:33:18.943147 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec483d17-c947-4226-8d79-929a9cf69fbc tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 354 microversion: 2.1 time: 0.093650 Jun 18 22:33:18.947484 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2908/5834] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:33:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:18.956304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f367f46c-3ad9-4089-ab8f-013a6a1fa281 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:18.957267 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:18.957267 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:33:18.971095 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f367f46c-3ad9-4089-ab8f-013a6a1fa281 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 354 microversion: 2.1 time: 0.018835 Jun 18 22:33:18.992802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d1fbcb8-0dbe-401c-a214-edbabf4c7248 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:18.995436 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:18.995436 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:33:18.997462 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2927/5835] 10.222.0.30 () {58 vars in 1151 bytes} [Sat Jun 18 22:33:18 2022] GET /compute/v2.1/os-aggregates/19 => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:19.038359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d1fbcb8-0dbe-401c-a214-edbabf4c7248 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:19.038821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d1fbcb8-0dbe-401c-a214-edbabf4c7248 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:19.420572 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d1fbcb8-0dbe-401c-a214-edbabf4c7248 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 339 microversion: 2.1 time: 0.437976 Jun 18 22:33:19.421245 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2909/5836] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Jun 18 22:33:18 2022] POST /compute/v2.1/os-aggregates/19/action => generated 339 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:19.432982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6608f847-56df-4420-97bd-a6161389d9a3 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:19.434059 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:33:19.434059 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:33:19.482706 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6608f847-56df-4420-97bd-a6161389d9a3 tempest-TestAggregatesBasicOps-1743817790 tempest-TestAggregatesBasicOps-1743817790-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.052807 Jun 18 22:33:19.485942 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2928/5837] 10.222.0.30 () {58 vars in 1154 bytes} [Sat Jun 18 22:33:19 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 18 22:33:21.226595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3462c82a-88b4-49be-904d-2859cde86c24 req-6e88e244-baf7-4ba0-bf59-1d4f6358ed19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f43ae76-2d85-45eb-8bc0-112036e81fcd", "tag": "3ea2141e-07a7-46b4-b873-0120f23d87c4"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:21.255320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3462c82a-88b4-49be-904d-2859cde86c24 req-6e88e244-baf7-4ba0-bf59-1d4f6358ed19 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:21.255825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3462c82a-88b4-49be-904d-2859cde86c24 req-6e88e244-baf7-4ba0-bf59-1d4f6358ed19 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:21.289274 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3462c82a-88b4-49be-904d-2859cde86c24 req-6e88e244-baf7-4ba0-bf59-1d4f6358ed19 service nova] Creating event network-changed:3ea2141e-07a7-46b4-b873-0120f23d87c4 for instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd on nch1-master-1 Jun 18 22:33:21.298654 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3462c82a-88b4-49be-904d-2859cde86c24 req-6e88e244-baf7-4ba0-bf59-1d4f6358ed19 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106633 Jun 18 22:33:21.300104 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2910/5838] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:33.363123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:33.366398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:33.378797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:33.380888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=19 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:33.382217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:33.396498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:33.398818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:33.401707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:33.402389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:33.495737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:33.497075 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:33.500654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:33.502457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=29 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:33.510665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:33.512205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:33.517574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:33.520350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:33.560230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lazy-loading 'services' on Instance uuid 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:33:33.565305 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e4721871-950b-45d5-9dbc-70f40a72acae tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.073783 Jun 18 22:33:33.570047 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2911/5839] 10.222.0.30 () {58 vars in 1292 bytes} [Sat Jun 18 22:33:33 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073/os-server-password => generated 116 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:33.697155 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a384995a-4930-47a3-ac05-1b3600214966 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8/os-volume_attachments/f6719241-2450-4c57-9569-6470077a1b0e" status: 202 len: 0 microversion: 2.1 time: 0.342326 Jun 18 22:33:33.699416 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2929/5840] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:33:33 2022] DELETE /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8/os-volume_attachments/f6719241-2450-4c57-9569-6470077a1b0e => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:33:34.909398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:34.911005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:34.936188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:34.936649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:34.937497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:34.937940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:34.984209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:33:35.112165 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a8caebb-7c2c-4ada-8ece-c75b4b18d067 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "DELETE /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 204 len: 0 microversion: 2.1 time: 0.208713 Jun 18 22:33:35.114573 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2912/5841] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:33:34 2022] DELETE /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:33:35.124632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:35.125559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:35.136940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:35.137443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:35.138256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:35.138709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:35.643109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:35.660609 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2d5209c5-5de8-4ba4-9b8d-aa4d3458a133 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1514 microversion: 2.1 time: 0.541249 Jun 18 22:33:35.662843 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2930/5842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:35 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1514 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:36.683147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:36.683904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:36.698059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:36.700780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:36.701975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:36.706448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:37.078284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:37.090118 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90010bd9-466e-4788-bcec-5f2c7453a7f4 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1514 microversion: 2.1 time: 0.411093 Jun 18 22:33:37.092816 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2913/5843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:36 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:37.098002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3b8ac209-e68a-438f-ac9a-0148519bc92f tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Action: 'create', calling method: .version_select at 0x7fea06ed41f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-816306085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOb/L6nyA26MZJye1h5wXsYlYYfdhaO0uT5Zs+vdkYz2HheOaxq9QSTcd1JoYHpviKvy/EjPXkisLQpqRfVjH4MjbHPIbw84gwxn+YFV/9L1xbaxp9BiJqLUYswuv5Vzzw=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:37.117326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-3b8ac209-e68a-438f-ac9a-0148519bc92f tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Getting quotas for project 521b75c65b1a4064befdab485a1dfec2. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:33:37.128783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-3b8ac209-e68a-438f-ac9a-0148519bc92f tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Getting quotas for user 259af49e467e4c4fbd01ae55251511e3 and project 521b75c65b1a4064befdab485a1dfec2. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:33:37.179373 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3b8ac209-e68a-438f-ac9a-0148519bc92f tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.423435 Jun 18 22:33:37.186692 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2931/5844] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:33:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:37.690687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0be7653b-7722-477a-b3e8-50237943984e req-f1fb6927-eb23-4873-88c6-a8292d4e5ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8", "name": "network-vif-deleted", "tag": "5e9f9ad9-6e05-484a-9521-04f0a1ff02a0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:37.701149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0be7653b-7722-477a-b3e8-50237943984e req-f1fb6927-eb23-4873-88c6-a8292d4e5ba4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:37.701964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0be7653b-7722-477a-b3e8-50237943984e req-f1fb6927-eb23-4873-88c6-a8292d4e5ba4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:37.717987 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0be7653b-7722-477a-b3e8-50237943984e req-f1fb6927-eb23-4873-88c6-a8292d4e5ba4 service nova] Creating event network-vif-deleted:5e9f9ad9-6e05-484a-9521-04f0a1ff02a0 for instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 on nch1-master-1 Jun 18 22:33:37.723987 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0be7653b-7722-477a-b3e8-50237943984e req-f1fb6927-eb23-4873-88c6-a8292d4e5ba4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041273 Jun 18 22:33:37.728567 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2914/5845] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:38.113323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:38.115302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:38.125825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:38.126693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:38.127839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:38.129006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:38.187614 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:38.188329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:38.189377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lazy-loading 'fault' on Instance uuid 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:33:38.285152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:38.296518 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77570b44-28cc-498b-a576-78ad3c6a3b76 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 200 len: 1308 microversion: 2.1 time: 0.190981 Jun 18 22:33:38.309659 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2932/5846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:38 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:39.320533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:39.322207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:39.348725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:39.358015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:39.359128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:39.359597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:39.392070 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] HTTP exception thrown: Instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 could not be found. Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Request method failure captured: Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 HTTP/1.1 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlIiKknYbptDYK2R7YMkKpJNQ8mqbWK80D2-FnY3iFaTLPadZFIIRBvS_kXYHZuRHL_QKEH4-tmMNHxP0ke_OSYqX9jvWt8H_5rwz8b0GcyQNq4j_ZHUD1ECZ6VfVF4tiu9IODcqu1AVahMR0ZGRLk9PW4U4YVJm1cqcufEsF2cikB8 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d65dfa8232fa458fb3c49822a1f4ede1 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1142548725 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d65dfa8232fa458fb3c49822a1f4ede1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d65dfa8232fa458fb3c49822a1f4ede1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d65dfa8232fa458fb3c49822a1f4ede1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d65dfa8232fa458fb3c49822a1f4ede1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesSnapshotTestJSON-1142548725 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d65dfa8232fa458fb3c49822a1f4ede1 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1142548725 Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesSnapshotTestJSON-1142548725-project Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 61121749f1aa4a2285c8f270abb74fdf Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesSnapshotTestJSON-1142548725-project Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 could not be found. Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8'} Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 could not be found. Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 could not be found. Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:33:39.394801 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 could not be found. Jun 18 22:33:39.399552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:33:39.403470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Returning 404 to user: Instance 47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:33:39.404882 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46fd53f7-891f-4d8d-ab1d-19ccb8c835bf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8" status: 404 len: 111 microversion: 2.1 time: 0.091775 Jun 18 22:33:39.406529 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2915/5847] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:39 2022] GET /compute/v2.1/servers/47ca5d12-db0e-4cfc-b557-d4c1ff42bcb8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:33:46.115728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1974267076", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "d82a492a-56cd-405c-a8fc-dccf065f949f"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:46.197371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] validate_networks() for [('d82a492a-56cd-405c-a8fc-dccf065f949f', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:33:47.143931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:47.487981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-280053686-access_point-713009721", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9b1bd76a-9cbf-43b0-a9bc-36ba934fb9b1"}], "key_name": "tempest-TestSecurityGroupsBasicOps-816306085", "security_groups": [{"name": "tempest-secgroup_access--141510933"}, {"name": "tempest-secgroup_general--1337128075"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:48.175963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:33:48.176599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:33:48.176956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:33:48.178264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:33:48.178264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:33:48.199161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:48.199630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:48.200441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:48.201237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:48.222460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Getting quotas for project d65dfa8232fa458fb3c49822a1f4ede1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:33:48.230710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Getting quotas for user 61121749f1aa4a2285c8f270abb74fdf and project d65dfa8232fa458fb3c49822a1f4ede1. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:33:48.243173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] validate_networks() for [('9b1bd76a-9cbf-43b0-a9bc-36ba934fb9b1', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:33:48.248504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:33:48.263981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:33:48.319799 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c9d41d5-80df-40e8-95b1-123553596a19 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.209061 Jun 18 22:33:48.321389 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2933/5848] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:33:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:33:48.331697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-829ad25b-3bfa-4c80-a137-77a52334dd92 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:48.333138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-829ad25b-3bfa-4c80-a137-77a52334dd92 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:48.462670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-829ad25b-3bfa-4c80-a137-77a52334dd92 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:48.476915 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-829ad25b-3bfa-4c80-a137-77a52334dd92 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1219 microversion: 2.1 time: 0.146519 Jun 18 22:33:48.478847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2934/5849] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:48 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:49.389904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:49.496407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:49.498281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:49.508491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:49.509724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:49.510824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:49.511837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:49.690993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:49.734207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-845f50d8-18ec-4cfe-b078-e1dffd4c1929 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1271 microversion: 2.1 time: 0.240740 Jun 18 22:33:49.736807 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2935/5850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:49 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:49.814073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:33:49.815360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:33:49.815951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:33:49.816526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:33:49.817017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:33:49.831593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:49.832197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:49.833161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:49.833700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:49.865766 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Getting quotas for project 521b75c65b1a4064befdab485a1dfec2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:33:49.873744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Getting quotas for user 259af49e467e4c4fbd01ae55251511e3 and project 521b75c65b1a4064befdab485a1dfec2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:33:49.892200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:33:49.894859 ncdv-master-1 devstack@n-api.service[130902]: WARNING nova.utils [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-280053686-access_point-713009721 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-280053686-acc Jun 18 22:33:49.895843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:33:49.978070 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e37799d-2be9-4a0a-bb50-9809577c3616 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.494268 Jun 18 22:33:49.979871 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2916/5851] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:33:47 2022] POST /compute/v2.1/servers => generated 457 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:33:49.991897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5da80001-d686-4720-b6d5-492e5af5b943 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:49.992535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5da80001-d686-4720-b6d5-492e5af5b943 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:50.208741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5da80001-d686-4720-b6d5-492e5af5b943 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:50.221175 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5da80001-d686-4720-b6d5-492e5af5b943 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1292 microversion: 2.1 time: 0.235323 Jun 18 22:33:50.226003 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2936/5852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:49 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1292 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:33:50.754592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:50.755845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:50.764265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:50.765191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:50.766437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:50.772666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:51.235633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:51.247506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:51.248287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:51.249510 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c72c4a79-74f0-4bd5-83e8-16ad76af81d2 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1319 microversion: 2.1 time: 0.500705 Jun 18 22:33:51.250346 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2917/5853] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:50 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:51.266788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:51.267620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:51.275048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:51.275918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:51.431810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:51.457787 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1bf70e05-7e25-4b5b-bd1f-45e9be67f69b tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1344 microversion: 2.1 time: 0.206523 Jun 18 22:33:51.459947 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2937/5854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:51 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1344 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:33:51.731810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-78ac6170-bb14-442a-bd4e-d6e09ed71002 req-5721e0c5-0c26-434d-932f-170bb74a419c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c409c8-1e27-45bf-bbfb-669de37846d4", "tag": "2bb8b779-f1de-4ab7-aea0-c26b7cd57501"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:51.746285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-78ac6170-bb14-442a-bd4e-d6e09ed71002 req-5721e0c5-0c26-434d-932f-170bb74a419c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:51.747411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-78ac6170-bb14-442a-bd4e-d6e09ed71002 req-5721e0c5-0c26-434d-932f-170bb74a419c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:51.764386 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-78ac6170-bb14-442a-bd4e-d6e09ed71002 req-5721e0c5-0c26-434d-932f-170bb74a419c service nova] Creating event network-changed:2bb8b779-f1de-4ab7-aea0-c26b7cd57501 for instance 31c409c8-1e27-45bf-bbfb-669de37846d4 on nch2-master-1 Jun 18 22:33:51.773753 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-78ac6170-bb14-442a-bd4e-d6e09ed71002 req-5721e0c5-0c26-434d-932f-170bb74a419c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051194 Jun 18 22:33:51.776714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2918/5855] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:33:52.269529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:52.270285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:52.284913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:52.285425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:52.286483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:52.286953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:52.496014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:52.498063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:52.520403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:52.521020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:52.522351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:52.523249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:53.462575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:53.469533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:53.487433 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-60a37ba7-1e85-4234-8328-d0053ea4b204 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 1.012562 Jun 18 22:33:53.488962 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2919/5856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:52 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:53.508854 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7e5862a8-0914-48fa-85c0-85a72fcbe0f0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1319 microversion: 2.1 time: 1.238501 Jun 18 22:33:53.510650 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2938/5857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:52 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1319 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:54.507331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:54.508561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:54.520957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:54.534216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:54.535527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:54.552163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:54.553359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:54.555507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:54.565056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:54.565851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:54.566834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:54.567454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:54.955782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:54.959095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:54.968553 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03315575-4899-4ab1-aee2-75b3803856cf tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1319 microversion: 2.1 time: 0.444578 Jun 18 22:33:54.969839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5f456c53-8e8f-4545-8311-c3b828d4cfbb tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.466084 Jun 18 22:33:54.972238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2939/5858] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:54 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:33:54.985785 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2920/5859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:54 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:55.132458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-20d301d7-74a5-4d30-b141-2035b8e0cc5f req-18085fb0-95ec-43b8-a8ab-a65703930320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7b0b2b-dd68-4b19-b530-770c8ddf18e2", "tag": "bba9ea2f-2bb9-417f-9114-22a7e8ce5571"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:55.151204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-20d301d7-74a5-4d30-b141-2035b8e0cc5f req-18085fb0-95ec-43b8-a8ab-a65703930320 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:55.152155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-20d301d7-74a5-4d30-b141-2035b8e0cc5f req-18085fb0-95ec-43b8-a8ab-a65703930320 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:55.172851 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-20d301d7-74a5-4d30-b141-2035b8e0cc5f req-18085fb0-95ec-43b8-a8ab-a65703930320 service nova] Creating event network-changed:bba9ea2f-2bb9-417f-9114-22a7e8ce5571 for instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 on nch1-master-1 Jun 18 22:33:55.181371 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-20d301d7-74a5-4d30-b141-2035b8e0cc5f req-18085fb0-95ec-43b8-a8ab-a65703930320 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065005 Jun 18 22:33:55.186620 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2940/5860] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:55.992732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:56.000550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:56.002674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:56.004717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:56.018054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:56.019019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:56.020087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:56.020699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:56.020957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:56.021719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:56.025172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:56.025889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:56.331657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:56.346916 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e54d5e7-a187-4e02-b792-8d5732c565ca tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1319 microversion: 2.1 time: 0.359093 Jun 18 22:33:56.347624 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2941/5861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:55 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:56.372301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:56.381258 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-66317d94-902d-4dba-b7c7-d68de01412f6 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.397481 Jun 18 22:33:56.391122 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2921/5862] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:55 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:57.368879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:57.376897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:57.389337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:57.390702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:57.391737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:57.392359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:57.423579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:57.426104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:57.452267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:57.462203 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:57.464644 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:57.465352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:57.948348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:57.962376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bd57206d-5aaa-43e7-840a-bffd3f92095e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.561710 Jun 18 22:33:57.963775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2922/5863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:57 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:58.000766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:58.017503 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d9ab57e9-4c0b-418c-8555-07224e2f1707 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1319 microversion: 2.1 time: 0.652375 Jun 18 22:33:58.018418 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2942/5864] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:57 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:33:58.759312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8a2c4db3-9a2f-463c-8001-0bd4659957f0 req-3a0e8c03-1422-4789-97fe-18614a25308c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c409c8-1e27-45bf-bbfb-669de37846d4", "name": "network-vif-plugged", "status": "completed", "tag": "2bb8b779-f1de-4ab7-aea0-c26b7cd57501"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:33:58.782745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8a2c4db3-9a2f-463c-8001-0bd4659957f0 req-3a0e8c03-1422-4789-97fe-18614a25308c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:58.784728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8a2c4db3-9a2f-463c-8001-0bd4659957f0 req-3a0e8c03-1422-4789-97fe-18614a25308c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:58.814641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8a2c4db3-9a2f-463c-8001-0bd4659957f0 req-3a0e8c03-1422-4789-97fe-18614a25308c service nova] Creating event network-vif-plugged:2bb8b779-f1de-4ab7-aea0-c26b7cd57501 for instance 31c409c8-1e27-45bf-bbfb-669de37846d4 on nch2-master-1 Jun 18 22:33:58.822263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8a2c4db3-9a2f-463c-8001-0bd4659957f0 req-3a0e8c03-1422-4789-97fe-18614a25308c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067189 Jun 18 22:33:58.823166 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2923/5865] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:33:58.982499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:58.983784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:58.986379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:33:58.993361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:58.994247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:58.995258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:58.995903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:59.039185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:33:59.040697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:33:59.056913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:59.060434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:59.061354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:33:59.064414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:33:59.421186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:59.433563 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d1367334-663d-4fa4-b4b6-5b8f6994bd01 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.455890 Jun 18 22:33:59.435579 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2943/5866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:58 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:33:59.444408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:33:59.454500 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7bfa3efb-1885-42cf-8e30-8ba3bf5b485b tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1319 microversion: 2.1 time: 0.422369 Jun 18 22:33:59.465105 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2924/5867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:33:59 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:00.453956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:00.455640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:00.463598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:00.465704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:00.466434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:00.475314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:00.475314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:00.480022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:00.482643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:00.488259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:00.489688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:00.495123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:00.496322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:00.501744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:00.504425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:00.864706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:00.870938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:00.882806 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f43fb18e-992b-4cce-b793-30bd9c44825c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.432953 Jun 18 22:34:00.883970 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2944/5868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:00 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:00.886787 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef6393bf-2b86-4882-9967-723cb9c759ec tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1508 microversion: 2.1 time: 0.415856 Jun 18 22:34:00.887818 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2925/5869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:00 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:00.904936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bb96dac-d22f-48b7-8475-af7c0c8e42d2", "device": "/dev/sdb"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:34:00.906313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:00.914449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:00.915206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:00.916196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:00.916690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:01.311635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5188449-0efb-49ad-a564-220154917bd7 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "POST /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410661 Jun 18 22:34:01.314430 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2945/5870] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:34:00 2022] POST /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:34:01.901193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:01.901828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:01.918055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:01.918494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:01.926738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:01.927439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:02.335794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:02.356949 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-451a264c-5fa5-4100-adbb-c6a51b3db373 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.457186 Jun 18 22:34:02.357756 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2926/5871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:01 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:03.376766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:03.377452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:03.390998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:03.391537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:03.392692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:03.397776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:03.405609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:03.724833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:03.749390 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-80f61ed1-7f54-477c-aa13-01e7ee004df2 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.376166 Jun 18 22:34:03.751213 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2946/5872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:03 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:04.771208 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:04.771980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:04.774978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:04.788361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:04.788742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:04.789914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:04.790521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:05.248121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:05.263493 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c51d224-6da9-4df9-9f92-0d4c3700eb06 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.496420 Jun 18 22:34:05.264113 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2927/5873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:04 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:06.084282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7d3de8e0-af9f-4bc4-be5a-cae4a7069fac req-f0064c73-457b-481b-b5b0-ce714c64aadc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7b0b2b-dd68-4b19-b530-770c8ddf18e2", "name": "network-vif-plugged", "status": "completed", "tag": "bba9ea2f-2bb9-417f-9114-22a7e8ce5571"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:34:06.099052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:34:06.104869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7d3de8e0-af9f-4bc4-be5a-cae4a7069fac req-f0064c73-457b-481b-b5b0-ce714c64aadc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:06.107712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7d3de8e0-af9f-4bc4-be5a-cae4a7069fac req-f0064c73-457b-481b-b5b0-ce714c64aadc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:06.140312 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7d3de8e0-af9f-4bc4-be5a-cae4a7069fac req-f0064c73-457b-481b-b5b0-ce714c64aadc service nova] Creating event network-vif-plugged:bba9ea2f-2bb9-417f-9114-22a7e8ce5571 for instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 on nch1-master-1 Jun 18 22:34:06.147817 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7d3de8e0-af9f-4bc4-be5a-cae4a7069fac req-f0064c73-457b-481b-b5b0-ce714c64aadc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067467 Jun 18 22:34:06.149088 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2947/5874] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:34:06.287106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:06.288619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:06.306889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:06.307597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:06.308908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:06.309470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:06.635624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:06.657795 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4bc9e96-3fb1-4fe1-8677-8fae2040c50d tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.376991 Jun 18 22:34:06.670223 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2928/5875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:06 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:07.682262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:07.683929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:07.699196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:07.702478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:07.704470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:07.706387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:08.009499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:08.017275 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c05941ba-8dfb-4d0a-b74f-44139bcc2b05 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1469 microversion: 2.1 time: 0.345413 Jun 18 22:34:08.026611 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2948/5876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:07 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:09.040599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:09.041236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:09.048127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:09.048608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:09.049387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:09.049847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:09.237339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:09.254205 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5634d6cd-3535-4613-bf93-679e70dfcbbd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1642 microversion: 2.1 time: 0.216382 Jun 18 22:34:09.257471 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2929/5877] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:09 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1642 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:09.276434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:09.277635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:09.288331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:09.288817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:09.289656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:09.290344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:09.491098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:34:09.502852 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed2648bc-c4bd-4125-bd40-28082a9fb6f5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1642 microversion: 2.1 time: 0.232073 Jun 18 22:34:09.504559 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2949/5878] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:09 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1642 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:09.522238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:34:09.522849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:34:09.529636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:09.530369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:09.531534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:09.532174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:10.017358 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-83c9db3b-01e1-475d-ad11-3bf048852d4b tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1793 microversion: 2.1 time: 0.498645 Jun 18 22:34:10.030893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2930/5879] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:34:09 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1793 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:34:14.408395 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b3dc200d-9051-40fd-90f7-6bc458d44620 req-2b3fe867-507c-4eb3-b113-4c2b833da2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7b0b2b-dd68-4b19-b530-770c8ddf18e2", "tag": "bba9ea2f-2bb9-417f-9114-22a7e8ce5571"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:34:14.431927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b3dc200d-9051-40fd-90f7-6bc458d44620 req-2b3fe867-507c-4eb3-b113-4c2b833da2c5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:34:14.434031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b3dc200d-9051-40fd-90f7-6bc458d44620 req-2b3fe867-507c-4eb3-b113-4c2b833da2c5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:34:14.463204 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b3dc200d-9051-40fd-90f7-6bc458d44620 req-2b3fe867-507c-4eb3-b113-4c2b833da2c5 service nova] Creating event network-changed:bba9ea2f-2bb9-417f-9114-22a7e8ce5571 for instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 on nch1-master-1 Jun 18 22:34:14.475006 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b3dc200d-9051-40fd-90f7-6bc458d44620 req-2b3fe867-507c-4eb3-b113-4c2b833da2c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070271 Jun 18 22:34:14.478973 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2950/5880] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:02.862578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1926186408", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "74219551-d801-49c1-adad-c268bdd84288"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:02.870733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=7 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:02.872114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=78 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:02.924291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] validate_networks() for [('74219551-d801-49c1-adad-c268bdd84288', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:35:03.688536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:35:03.689762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:35:03.690910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:35:03.691354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:35:03.691752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:35:03.703878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:03.704337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:03.705168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:03.705626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:03.726517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Getting quotas for project 6a4ac7afa8ff4ccda354f0ec7af80e9a. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:35:03.732736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Getting quotas for user e8139edfa85b439c818f8eb10e0e31b5 and project 6a4ac7afa8ff4ccda354f0ec7af80e9a. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:35:03.748884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:35:03.752147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:35:03.802972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9cdbba92-4640-41c5-978c-9fdca98c43bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944563 Jun 18 22:35:03.804354 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2931/5881] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:35:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:35:03.814011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:03.815501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=21 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:03.831033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c41c0a9-336f-4274-9bbc-a62866a0a6cd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:03.831799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c41c0a9-336f-4274-9bbc-a62866a0a6cd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:03.921815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c41c0a9-336f-4274-9bbc-a62866a0a6cd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:03.930144 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c41c0a9-336f-4274-9bbc-a62866a0a6cd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1214 microversion: 2.1 time: 0.118724 Jun 18 22:35:03.930743 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2951/5882] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:03 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:04.949932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:04.950586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:04.958197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:04.958658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:04.959529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:04.960004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:05.034175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:05.042814 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35de9029-32c2-4b34-aafc-ee0ac11005a4 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1284 microversion: 2.1 time: 0.098997 Jun 18 22:35:05.043408 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2932/5883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:04 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:06.060576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:06.062121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:06.070026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:06.070501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:06.071309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:06.072056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:06.288971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:06.300544 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5216e34-6b4d-4521-8560-3222df4a642f tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.244170 Jun 18 22:35:06.301867 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2952/5884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:06 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:06.772687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-fa20d840-fa37-40b4-ae8d-cf28efc5adc4 req-37215915-8e83-4c81-a5a0-c46ed9b268ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f6fb14-4f12-4f82-a038-aac51a00b5aa", "tag": "032cd984-7ba7-4934-9cde-4084d2e44484"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:06.790308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fa20d840-fa37-40b4-ae8d-cf28efc5adc4 req-37215915-8e83-4c81-a5a0-c46ed9b268ba service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:06.791345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fa20d840-fa37-40b4-ae8d-cf28efc5adc4 req-37215915-8e83-4c81-a5a0-c46ed9b268ba service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:06.809773 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-fa20d840-fa37-40b4-ae8d-cf28efc5adc4 req-37215915-8e83-4c81-a5a0-c46ed9b268ba service nova] Creating event network-changed:032cd984-7ba7-4934-9cde-4084d2e44484 for instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa on nch2-master-1 Jun 18 22:35:06.815872 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-fa20d840-fa37-40b4-ae8d-cf28efc5adc4 req-37215915-8e83-4c81-a5a0-c46ed9b268ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047447 Jun 18 22:35:06.816685 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2933/5885] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:07.330172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:07.338092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:07.357603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:07.358069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:07.358884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:07.359336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:07.566729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:07.580286 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-41bc3230-5eeb-4c8e-9c3c-501dda22d7d6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.255527 Jun 18 22:35:07.581845 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2953/5886] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:07 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:08.599478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:08.600177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:08.606884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:08.607350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:08.608124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:08.608600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:08.821390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:08.834313 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02772d5a-49a6-441e-9a2e-548a564ded4b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.239779 Jun 18 22:35:08.835729 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2934/5887] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:08 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:09.852067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:09.852912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:09.860208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:09.860752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:09.861649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:09.862805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:10.026007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:10.035724 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c5e9e02-123a-43dc-a453-a62aabe92857 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.187587 Jun 18 22:35:10.044905 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2954/5888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:09 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:11.054132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:11.055060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:11.063399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:11.063945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:11.065020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:11.065787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:11.278222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:11.287659 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f740505f-14aa-460c-a5ed-726229b95734 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.237840 Jun 18 22:35:11.288239 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2935/5889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:11 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:12.306369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:12.307581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:12.315398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:12.315865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:12.316663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:12.317136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:12.471259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:12.484249 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-674ca59d-560d-4616-b0d6-e999d5bef422 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.181404 Jun 18 22:35:12.485396 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2955/5890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:12 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:12.969999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8eab2ab1-7fc3-4425-9eee-8a44de89f93b req-af335a42-4c1e-44af-a55d-0aa58eec0881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f6fb14-4f12-4f82-a038-aac51a00b5aa", "name": "network-vif-plugged", "status": "completed", "tag": "032cd984-7ba7-4934-9cde-4084d2e44484"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:12.982496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8eab2ab1-7fc3-4425-9eee-8a44de89f93b req-af335a42-4c1e-44af-a55d-0aa58eec0881 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:12.983033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8eab2ab1-7fc3-4425-9eee-8a44de89f93b req-af335a42-4c1e-44af-a55d-0aa58eec0881 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:13.000487 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8eab2ab1-7fc3-4425-9eee-8a44de89f93b req-af335a42-4c1e-44af-a55d-0aa58eec0881 service nova] Creating event network-vif-plugged:032cd984-7ba7-4934-9cde-4084d2e44484 for instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa on nch2-master-1 Jun 18 22:35:13.006516 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8eab2ab1-7fc3-4425-9eee-8a44de89f93b req-af335a42-4c1e-44af-a55d-0aa58eec0881 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043890 Jun 18 22:35:13.007325 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2936/5891] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:13.501341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:13.502898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:13.512845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:13.513302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:13.514078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:13.515250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:13.663941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:13.671902 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e74f3317-0fd5-4d92-bc5c-077fa4db8d06 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1314 microversion: 2.1 time: 0.175022 Jun 18 22:35:13.672620 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2956/5892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:13 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:14.686547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:14.687790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:14.694848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:14.696145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:14.704946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:14.705439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:14.706430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:14.706954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:14.886461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:14.901877 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f45cf979-d03e-4ac2-bbac-0e578f1352bd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1499 microversion: 2.1 time: 0.216135 Jun 18 22:35:14.902681 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2937/5893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:14 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:15.342429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:15.343105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:15.346833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:15.352386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:15.353247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:15.354142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:15.354659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:15.383605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:35:15.474547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bb469fb-05f6-425d-9c33-f92b777e30d5 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 204 len: 0 microversion: 2.1 time: 0.135292 Jun 18 22:35:15.479397 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2957/5894] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:35:15 2022] DELETE /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:35:15.486606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:15.488678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:15.503856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:15.504371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:15.509348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:15.510043 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:15.692340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:15.701867 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44133143-49ca-4c40-8803-658b52d20ef6 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1505 microversion: 2.1 time: 0.221169 Jun 18 22:35:15.705432 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2938/5895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:15 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:16.720420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:16.721804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:16.728759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:16.729500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:16.731261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:16.731728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:16.882340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:16.891988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d3dfd514-6a03-4d6d-acc6-dd0eeababb15 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1505 microversion: 2.1 time: 0.175562 Jun 18 22:35:16.902376 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2958/5896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:16 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:17.675277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ce833a9b-5bfa-43fa-ac88-3344ba8f834e req-d21a710b-9575-4c76-b2bc-0a0f034375d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f6fb14-4f12-4f82-a038-aac51a00b5aa", "name": "network-vif-deleted", "tag": "032cd984-7ba7-4934-9cde-4084d2e44484"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:17.686886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ce833a9b-5bfa-43fa-ac88-3344ba8f834e req-d21a710b-9575-4c76-b2bc-0a0f034375d2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:17.687448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ce833a9b-5bfa-43fa-ac88-3344ba8f834e req-d21a710b-9575-4c76-b2bc-0a0f034375d2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:17.701357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ce833a9b-5bfa-43fa-ac88-3344ba8f834e req-d21a710b-9575-4c76-b2bc-0a0f034375d2 service nova] Creating event network-vif-deleted:032cd984-7ba7-4934-9cde-4084d2e44484 for instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa on nch2-master-1 Jun 18 22:35:17.706487 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ce833a9b-5bfa-43fa-ac88-3344ba8f834e req-d21a710b-9575-4c76-b2bc-0a0f034375d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035774 Jun 18 22:35:17.708092 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2939/5897] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:35:17.910437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:17.911148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:17.924042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:17.924517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:17.925355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:17.925818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:17.963351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:17.963859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:17.964475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lazy-loading 'fault' on Instance uuid 89f6fb14-4f12-4f82-a038-aac51a00b5aa {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:35:18.007667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:18.024626 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5fa4705-93b4-4124-b3bc-3e9990c6d8c2 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 200 len: 1304 microversion: 2.1 time: 0.118901 Jun 18 22:35:18.025926 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2959/5898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:17 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:19.045393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:19.046081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: 89f6fb14-4f12-4f82-a038-aac51a00b5aa] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:19.053866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:19.054320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:19.055135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:19.055675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:19.070789 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] HTTP exception thrown: Instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa could not be found. Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Request method failure captured: Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa HTTP/1.1 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlMVrxZGn91lf4mW-QpVm2L5_59BhB4cb-SRNro31V6Z43_aV1EWExDMkHjZdEAi2ZBcoU2mHRFfmWvp6sK8e4GJ8Nv8cZnr3Z8XG8Bv3QeXrg_uXw02rGnh20xnFhBf_ttLxkVEYlKdd4X6HsAgE6TPyzFyECELVl7HQ-1F9_H_dFo Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6a4ac7afa8ff4ccda354f0ec7af80e9a Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesActionsTest-612307831 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6a4ac7afa8ff4ccda354f0ec7af80e9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6a4ac7afa8ff4ccda354f0ec7af80e9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6a4ac7afa8ff4ccda354f0ec7af80e9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6a4ac7afa8ff4ccda354f0ec7af80e9a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesActionsTest-612307831 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6a4ac7afa8ff4ccda354f0ec7af80e9a Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesActionsTest-612307831 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesActionsTest-612307831-project Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: e8139edfa85b439c818f8eb10e0e31b5 Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesActionsTest-612307831-project Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa could not be found. Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '89f6fb14-4f12-4f82-a038-aac51a00b5aa'} Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa could not be found. Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa could not be found. Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:19.072559 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa could not be found. Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Returning 404 to user: Instance 89f6fb14-4f12-4f82-a038-aac51a00b5aa could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cb6afd99-7f45-4401-be73-73a6ff3ecc99 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa" status: 404 len: 111 microversion: 2.1 time: 0.034056 Jun 18 22:35:19.088177 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2940/5899] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:19 2022] GET /compute/v2.1/servers/89f6fb14-4f12-4f82-a038-aac51a00b5aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:35:19.129628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-114877177", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "74219551-d801-49c1-adad-c268bdd84288"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:19.185764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] validate_networks() for [('74219551-d801-49c1-adad-c268bdd84288', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:35:19.951206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:35:19.951712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:35:19.952278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:35:19.952778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:35:19.953423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:35:19.965442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:19.965909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:19.966747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:19.967202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:19.987666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Getting quotas for project 6a4ac7afa8ff4ccda354f0ec7af80e9a. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:35:19.994367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Getting quotas for user e8139edfa85b439c818f8eb10e0e31b5 and project 6a4ac7afa8ff4ccda354f0ec7af80e9a. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:35:20.008992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:35:20.012575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:35:20.079332 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f500d70b-12eb-47fb-9d51-5a159472f76a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953756 Jun 18 22:35:20.080438 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2960/5900] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:35:20.093363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f16db225-f20a-44fd-a720-21c49e7d54a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:20.097271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f16db225-f20a-44fd-a720-21c49e7d54a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:20.166673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f16db225-f20a-44fd-a720-21c49e7d54a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:20.182740 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f16db225-f20a-44fd-a720-21c49e7d54a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1213 microversion: 2.1 time: 0.095052 Jun 18 22:35:20.193874 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2941/5901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:20 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:21.203507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:21.205605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:21.218800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:21.220203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:21.222001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:21.224012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:21.344813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:21.359541 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af4d5fdd-d1c2-4cbf-afda-fd033ab721ae tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1273 microversion: 2.1 time: 0.162604 Jun 18 22:35:21.360786 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2961/5902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:21 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:22.389523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:22.390839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:22.399484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:22.400964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:22.402317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:22.402950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:22.709217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:22.732768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ffd2890-b531-4c56-89c0-74fd3c99cdfd tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.358299 Jun 18 22:35:22.734385 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2942/5903] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:22 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:23.753756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:23.754540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:23.770536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:23.770993 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:23.771830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:23.772498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:24.122371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:24.156453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ad4b0282-326a-499e-8a9a-c53bf66a95fa tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.405785 Jun 18 22:35:24.168037 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2962/5904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:23 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:24.622084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f6191a49-5485-486f-a936-a743bb33935b req-b33eda6b-893c-49e0-aa55-763b83f4ce38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab524abb-6ddb-4dc8-8251-2e3ea1dec891", "tag": "73398b9d-0f0f-465d-88d6-fd537f95bae9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:24.640884 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f6191a49-5485-486f-a936-a743bb33935b req-b33eda6b-893c-49e0-aa55-763b83f4ce38 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:24.642012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f6191a49-5485-486f-a936-a743bb33935b req-b33eda6b-893c-49e0-aa55-763b83f4ce38 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:24.671069 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f6191a49-5485-486f-a936-a743bb33935b req-b33eda6b-893c-49e0-aa55-763b83f4ce38 service nova] Creating event network-changed:73398b9d-0f0f-465d-88d6-fd537f95bae9 for instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 on nch2-master-1 Jun 18 22:35:24.677432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f6191a49-5485-486f-a936-a743bb33935b req-b33eda6b-893c-49e0-aa55-763b83f4ce38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062801 Jun 18 22:35:24.679490 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2943/5905] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:25.204984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:25.212508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:25.230138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:25.234151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:25.235429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:25.236136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:25.814290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:25.838620 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2485d2b-e39d-4fb0-b857-52db834725ca tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.654982 Jun 18 22:35:25.851571 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2963/5906] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:25 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:26.813733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1144281950", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "30046582-a9c1-4768-8512-b514808bda76"}], "key_name": "tempest-TestSecurityGroupsBasicOps-816306085", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4a7b0b2b-dd68-4b19-b530-770c8ddf18e2"]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:26.857546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:26.858911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:26.866803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:26.867501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:26.868491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:26.869159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:26.892750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] validate_networks() for [('30046582-a9c1-4768-8512-b514808bda76', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:35:27.387968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:27.397495 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67fbc8b5-28a6-42f0-983f-4c8985852bb7 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.545117 Jun 18 22:35:27.412686 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2964/5907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:26 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:27.661447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:35:27.663756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:35:27.664706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:35:27.666059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:35:27.666665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:35:27.679866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:27.681964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:27.682809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:27.683253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:27.707178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Getting quotas for project 521b75c65b1a4064befdab485a1dfec2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:35:27.733079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Getting quotas for user 259af49e467e4c4fbd01ae55251511e3 and project 521b75c65b1a4064befdab485a1dfec2. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:35:27.795315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:35:27.805020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:35:27.906751 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46b4d61a-4c42-4bba-b375-511c23678781 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.097633 Jun 18 22:35:27.908802 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2944/5908] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:35:26 2022] POST /compute/v2.1/servers => generated 361 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:35:27.918944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc4f271e-1d0e-4f61-8a76-18e6c4cc1ad1 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:27.920414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fc4f271e-1d0e-4f61-8a76-18e6c4cc1ad1 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:28.032659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fc4f271e-1d0e-4f61-8a76-18e6c4cc1ad1 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:28.043481 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fc4f271e-1d0e-4f61-8a76-18e6c4cc1ad1 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1241 microversion: 2.1 time: 0.128604 Jun 18 22:35:28.045282 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2965/5909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:27 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:28.416318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:28.417223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:28.431277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:28.431841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:28.432924 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:28.433240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:28.680322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:28.702737 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23569b05-f5f5-45d8-a80f-0583e5cbdc9a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.290699 Jun 18 22:35:28.707394 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2945/5910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:28 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:29.066249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:29.067623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:29.093922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:29.096753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:29.106989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:29.108023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:29.206358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:29.226087 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b2c3ccf2-5f2a-42fc-9cb3-6ac80c2f380e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1293 microversion: 2.1 time: 0.164197 Jun 18 22:35:29.226959 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2966/5911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:29 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1293 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:29.723800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:29.724429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:29.739541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:29.742407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:29.744856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:29.747521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:29.943523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:29.952506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c1c5afd-e81a-4761-832d-aeb2ec98b94b tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.234702 Jun 18 22:35:29.953123 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2946/5912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:29 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:30.244412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:30.246152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:30.252871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:30.258609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:30.259442 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:30.260648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:30.261391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:30.384696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:30.393242 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f5e9221-77ca-4e07-94e8-dab9f02dc718 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.153505 Jun 18 22:35:30.401490 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2967/5913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:30 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:30.969949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:30.970585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:30.991073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:30.991687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:30.992872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:30.993428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:31.275245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:31.289154 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-640f2701-3815-4015-9202-9752373d9b61 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.322673 Jun 18 22:35:31.291074 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2947/5914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:30 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:31.418609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:31.419342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:31.432504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:31.432971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:31.434341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:31.435163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:31.487677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:31.530538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6a5ffb27-1ffa-4c3c-bb4e-86f985430048 req-8a495554-6245-4f6d-a7d2-9c991133057d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab524abb-6ddb-4dc8-8251-2e3ea1dec891", "name": "network-vif-plugged", "status": "completed", "tag": "73398b9d-0f0f-465d-88d6-fd537f95bae9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:31.548177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6a5ffb27-1ffa-4c3c-bb4e-86f985430048 req-8a495554-6245-4f6d-a7d2-9c991133057d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:31.548728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6a5ffb27-1ffa-4c3c-bb4e-86f985430048 req-8a495554-6245-4f6d-a7d2-9c991133057d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:31.579346 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6a5ffb27-1ffa-4c3c-bb4e-86f985430048 req-8a495554-6245-4f6d-a7d2-9c991133057d service nova] Creating event network-vif-plugged:73398b9d-0f0f-465d-88d6-fd537f95bae9 for instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 on nch2-master-1 Jun 18 22:35:31.589747 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6a5ffb27-1ffa-4c3c-bb4e-86f985430048 req-8a495554-6245-4f6d-a7d2-9c991133057d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061296 Jun 18 22:35:31.592839 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2948/5915] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:35:31.770116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:31.791181 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1cb3d8ac-cb35-4609-b146-6bb6d30c4523 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.376394 Jun 18 22:35:31.794226 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2968/5916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:31 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:32.122164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-601d0b4f-428a-474c-ae26-48e2d4d86e01 req-2a8c4e0d-1462-4734-b711-cfda2f56c7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1335526-960d-4217-b6f8-0d5c91e964de", "tag": "bb35b068-9b53-4867-8357-354c9d25ddf9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:32.157601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-601d0b4f-428a-474c-ae26-48e2d4d86e01 req-2a8c4e0d-1462-4734-b711-cfda2f56c7b6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:32.158628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-601d0b4f-428a-474c-ae26-48e2d4d86e01 req-2a8c4e0d-1462-4734-b711-cfda2f56c7b6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:32.179903 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-601d0b4f-428a-474c-ae26-48e2d4d86e01 req-2a8c4e0d-1462-4734-b711-cfda2f56c7b6 service nova] Creating event network-changed:bb35b068-9b53-4867-8357-354c9d25ddf9 for instance d1335526-960d-4217-b6f8-0d5c91e964de on nch2-master-1 Jun 18 22:35:32.187501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-601d0b4f-428a-474c-ae26-48e2d4d86e01 req-2a8c4e0d-1462-4734-b711-cfda2f56c7b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070817 Jun 18 22:35:32.189246 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2949/5917] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:32.312259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:32.313749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:32.331953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:32.332724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:32.333611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:32.334068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:32.524843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:32.536368 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60deb902-fd98-439d-8129-890d84143ee1 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1313 microversion: 2.1 time: 0.232099 Jun 18 22:35:32.537109 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2969/5918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:32 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:32.812335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:32.813265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:32.821238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:32.821880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:32.822989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:32.823763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:32.935750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:32.939600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=77 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:32.947807 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f1e56592-4477-4479-bee9-41d9c7cc5a96 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.140441 Jun 18 22:35:32.948699 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2950/5919] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:32 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:33.555549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:33.556158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:33.562789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:33.563481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:33.564579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:33.565219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:33.736872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:33.746329 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd3aa291-f3d1-4a50-ba5a-01e0bd1bc953 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1497 microversion: 2.1 time: 0.195812 Jun 18 22:35:33.746943 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2970/5920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:33 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:33.965493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:33.965956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:33.968660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:33.975742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:33.976194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:33.977479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:33.977479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.096515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:34.106145 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e8a3bc6f-80ab-4311-a013-7b0e006719bc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.144690 Jun 18 22:35:34.106991 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2951/5921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:33 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:34.286743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:34.287695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:34.291472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:34.295997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.296748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.297946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.298562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.329974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:35:34.416471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:34.417140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:34.426555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.427077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.428501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.428838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.460600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:35:34.471314 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-08b61e06-1000-42ed-b923-803d9a64233a tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 204 len: 0 microversion: 2.1 time: 0.188167 Jun 18 22:35:34.471924 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2971/5922] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:35:34 2022] DELETE /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:35:34.485668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:34.486687 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:34.503979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.504501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.505458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.505912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.602046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a6aacb4-ad08-494d-99ae-af96843d3460 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 204 len: 0 microversion: 2.1 time: 0.189209 Jun 18 22:35:34.602562 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2952/5923] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:35:34 2022] DELETE /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:35:34.612887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:34.613826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:34.623070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.623523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.624527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:34.624967 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:34.979404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:34.987439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bca84fe7-3015-45f8-bb36-35028d7644a8 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1503 microversion: 2.1 time: 0.506165 Jun 18 22:35:34.997657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2972/5924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:34 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:34.998003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:35.010805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-26c284f0-b9c5-4013-b805-62f4423abe36 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1577 microversion: 2.1 time: 0.402545 Jun 18 22:35:35.011591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2953/5925] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:34 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1577 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:35.123740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:35.124830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:35.131465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:35.132040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:35.133084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:35.133600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:35.238892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:35.247592 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a84da89-7c5b-4b53-8624-272a90edadfc tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.127769 Jun 18 22:35:35.249088 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2973/5926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:35 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:36.004972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:36.005646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:36.013509 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:36.013966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:36.014792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:36.015228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:36.211129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:36.220127 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37cea14a-f65a-4dcd-ba63-c62e4469bb1c tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1503 microversion: 2.1 time: 0.219141 Jun 18 22:35:36.221989 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2954/5927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:35 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:36.268140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:36.268905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:36.275528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:36.276294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:36.277615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:36.278413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:36.309356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:36.310656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:36.321275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:36.322060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:36.323084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:36.323546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:36.386865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:36.394902 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-94729d4b-8d1a-489d-a402-9ce6a96166cd tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.133087 Jun 18 22:35:36.395617 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2955/5928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:36 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:36.478310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:36.486220 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-18139eb9-c967-4363-925c-bda0322726e0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1577 microversion: 2.1 time: 0.461589 Jun 18 22:35:36.486811 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2974/5929] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:36 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1577 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:37.238674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:37.239451 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:37.247553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.248023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.248818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.249372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.321645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8139edfa85b439c818f8eb10e0e31b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4ac7afa8ff4ccda354f0ec7af80e9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:37.329850 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-44fcb19d-3627-45dd-886f-3da32d125d60 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 200 len: 1461 microversion: 2.1 time: 0.095247 Jun 18 22:35:37.330404 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2956/5930] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:37 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 1461 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:37.413131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:37.414512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:37.421892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.422352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.423512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.423964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.505563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:37.506632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:37.514650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.515560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.516620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.517586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.526796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:37.535005 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d2e2674-3194-419b-a6c0-524a7e245040 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.126724 Jun 18 22:35:37.536184 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2975/5931] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:37 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:37.666133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:37.674556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c0773626-9087-42a0-a0cf-c307a04f47e1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1577 microversion: 2.1 time: 0.174450 Jun 18 22:35:37.675364 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2957/5932] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:37 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:37.751960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6ef24fa4-ab2b-4ddb-8a91-9b8bca186cd3 req-5a4693d0-94f2-4094-b39a-5a0e91b505ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab524abb-6ddb-4dc8-8251-2e3ea1dec891", "name": "network-vif-deleted", "tag": "73398b9d-0f0f-465d-88d6-fd537f95bae9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:37.760883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6ef24fa4-ab2b-4ddb-8a91-9b8bca186cd3 req-5a4693d0-94f2-4094-b39a-5a0e91b505ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:37.761474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6ef24fa4-ab2b-4ddb-8a91-9b8bca186cd3 req-5a4693d0-94f2-4094-b39a-5a0e91b505ad service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:37.782901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6ef24fa4-ab2b-4ddb-8a91-9b8bca186cd3 req-5a4693d0-94f2-4094-b39a-5a0e91b505ad service nova] Creating event network-vif-deleted:73398b9d-0f0f-465d-88d6-fd537f95bae9 for instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 on nch2-master-1 Jun 18 22:35:37.789158 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6ef24fa4-ab2b-4ddb-8a91-9b8bca186cd3 req-5a4693d0-94f2-4094-b39a-5a0e91b505ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041503 Jun 18 22:35:37.790371 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2976/5933] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:38.348450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:38.349190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] [instance: ab524abb-6ddb-4dc8-8251-2e3ea1dec891] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:38.354608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:38.355469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:38.367032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.367747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.368732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.369398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.392282 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] HTTP exception thrown: Instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 could not be found. Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Request method failure captured: Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 HTTP/1.1 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlMVrxZGn91lf4mW-QpVm2L5_59BhB4cb-SRNro31V6Z43_aV1EWExDMkHjZdEAi2ZBcoU2mHRFfmWvp6sK8e4GJ8Nv8cZnr3Z8XG8Bv3QeXrg_uXw02rGnh20xnFhBf_ttLxkVEYlKdd4X6HsAgE6TPyzFyECELVl7HQ-1F9_H_dFo Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 6a4ac7afa8ff4ccda354f0ec7af80e9a Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesActionsTest-612307831 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6a4ac7afa8ff4ccda354f0ec7af80e9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6a4ac7afa8ff4ccda354f0ec7af80e9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6a4ac7afa8ff4ccda354f0ec7af80e9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6a4ac7afa8ff4ccda354f0ec7af80e9a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesActionsTest-612307831 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 6a4ac7afa8ff4ccda354f0ec7af80e9a Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesActionsTest-612307831 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesActionsTest-612307831-project Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: e8139edfa85b439c818f8eb10e0e31b5 Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesActionsTest-612307831-project Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 could not be found. Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'ab524abb-6ddb-4dc8-8251-2e3ea1dec891'} Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 could not be found. Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 could not be found. Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:38.394421 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 could not be found. Jun 18 22:35:38.400073 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:38.401534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] Returning 404 to user: Instance ab524abb-6ddb-4dc8-8251-2e3ea1dec891 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:35:38.402602 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b38e361-14df-436a-a9a1-060e367b6253 tempest-VolumesActionsTest-612307831 tempest-VolumesActionsTest-612307831-project] 10.222.0.30 "GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891" status: 404 len: 111 microversion: 2.1 time: 0.058229 Jun 18 22:35:38.403670 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2958/5934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:38 2022] GET /compute/v2.1/servers/ab524abb-6ddb-4dc8-8251-2e3ea1dec891 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:35:38.560835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:38.566077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:38.568308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:38.580560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.582232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.583229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.583855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.692179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:38.692820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:38.704978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.705460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.706286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.706725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.737710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:38.749722 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3e5add95-62c4-4f97-9841-c7ac1e14e602 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.199271 Jun 18 22:35:38.759494 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2977/5935] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:38 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:38.776775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:38.777420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:38.777975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lazy-loading 'fault' on Instance uuid 1f43ae76-2d85-45eb-8bc0-112036e81fcd {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:35:38.838529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:38.866312 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e9939d4f-9c59-4ca0-8b69-38c4cd9ebcfe tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 200 len: 1230 microversion: 2.1 time: 0.178331 Jun 18 22:35:38.867886 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2959/5936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:38 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 1230 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:39.647170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-60bd9333-0853-4232-9a88-450dcaa4db39 req-d7edb302-28bb-455a-8cbd-9709e7b782f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1335526-960d-4217-b6f8-0d5c91e964de", "name": "network-vif-plugged", "status": "completed", "tag": "bb35b068-9b53-4867-8357-354c9d25ddf9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:39.670600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-60bd9333-0853-4232-9a88-450dcaa4db39 req-d7edb302-28bb-455a-8cbd-9709e7b782f2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:39.671180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-60bd9333-0853-4232-9a88-450dcaa4db39 req-d7edb302-28bb-455a-8cbd-9709e7b782f2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:39.692938 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-60bd9333-0853-4232-9a88-450dcaa4db39 req-d7edb302-28bb-455a-8cbd-9709e7b782f2 service nova] Creating event network-vif-plugged:bb35b068-9b53-4867-8357-354c9d25ddf9 for instance d1335526-960d-4217-b6f8-0d5c91e964de on nch2-master-1 Jun 18 22:35:39.700434 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-60bd9333-0853-4232-9a88-450dcaa4db39 req-d7edb302-28bb-455a-8cbd-9709e7b782f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059968 Jun 18 22:35:39.704133 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2978/5937] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:39.767290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:39.767918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:39.784806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:39.795221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:39.799734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:39.800658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:39.858008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-61460c04-61d6-4e28-832d-9ab48511839f req-83d551dd-344d-48d2-9af1-40eedeef9f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f43ae76-2d85-45eb-8bc0-112036e81fcd", "name": "network-vif-deleted", "tag": "3ea2141e-07a7-46b4-b873-0120f23d87c4"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:39.875820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61460c04-61d6-4e28-832d-9ab48511839f req-83d551dd-344d-48d2-9af1-40eedeef9f51 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:39.876802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61460c04-61d6-4e28-832d-9ab48511839f req-83d551dd-344d-48d2-9af1-40eedeef9f51 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:39.889994 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-61460c04-61d6-4e28-832d-9ab48511839f req-83d551dd-344d-48d2-9af1-40eedeef9f51 service nova] Creating event network-vif-deleted:3ea2141e-07a7-46b4-b873-0120f23d87c4 for instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd on nch1-master-1 Jun 18 22:35:39.895952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-61460c04-61d6-4e28-832d-9ab48511839f req-83d551dd-344d-48d2-9af1-40eedeef9f51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050078 Jun 18 22:35:39.897323 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2979/5938] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:35:39.904408 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:39.906156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:39.915322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:39.916317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:39.917421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:39.917981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:39.935198 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd HTTP/1.1 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1f43ae76-2d85-45eb-8bc0-112036e81fcd'} Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:39.938151 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:35:39.943742 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:39.947324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:35:39.948655 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88398098-ffce-49aa-ac8c-96f4f743fed0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 404 len: 111 microversion: 2.1 time: 0.049809 Jun 18 22:35:39.949879 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2980/5939] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:39 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:35:40.033446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:40.051607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-719019488", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1425479607", "security_groups": [{"name": "tempest-secgroup-smoke-1119156546"}], "block_device_mapping_v2": [{"uuid": "92eb6127-5f06-4961-a0f5-c7fb19e61c04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:40.060653 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2eaa9e2c-fde3-4754-8d03-c1f4a88e267e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1299 microversion: 2.1 time: 0.297512 Jun 18 22:35:40.068651 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2960/5940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:39 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:40.287711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] validate_networks() for [('b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:35:41.030533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:35:41.031678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:35:41.032371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:35:41.032954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:35:41.033588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:35:41.044582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.045314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.046468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.047145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.066441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:35:41.072405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:35:41.084953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:41.086911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:41.099611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.100380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.101475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.102116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.174594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:35:41.176775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92eb6127-5f06-4961-a0f5-c7fb19e61c04',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:35:41.215833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:41.231339 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1dc404e9-3fba-4634-98ec-c55cfcb09a2e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1471 microversion: 2.1 time: 0.150296 Jun 18 22:35:41.241303 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2961/5941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:41 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:41.249163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:41.249771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:41.261108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.266137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.267383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.268045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.391973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:41.404428 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eea18682-439f-400a-8a1a-109531033419 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.359904 Jun 18 22:35:41.411649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2981/5942] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:35:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:35:41.417638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ad0250f-2832-440e-97a6-97973fcffd95 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:41.418494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ad0250f-2832-440e-97a6-97973fcffd95 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:41.419310 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6b684a9-3ea3-4dae-9e17-bc8d6b166a85 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1471 microversion: 2.1 time: 0.174490 Jun 18 22:35:41.423508 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2962/5943] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:41 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:41.444273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:41.444982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:41.456533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.457746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.459092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.459493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.569092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ad0250f-2832-440e-97a6-97973fcffd95 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:41.579209 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ad0250f-2832-440e-97a6-97973fcffd95 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1094 microversion: 2.1 time: 0.166023 Jun 18 22:35:41.579773 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2982/5944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:41 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1094 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:41.697971 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a05b320-c368-4165-b965-8e9f3e8058e0 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1622 microversion: 2.1 time: 0.258959 Jun 18 22:35:41.700244 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2963/5945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:41 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1622 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:41.702819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:41.703354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:41.715912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.716807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.718697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.718960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.740354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:41.742651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:41.767311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.775604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.776872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:41.778982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:41.915409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lazy-loading 'services' on Instance uuid 31c409c8-1e27-45bf-bbfb-669de37846d4 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:35:42.107375 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d9ec840-5b72-48af-9fb6-a90f0d9024e0 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "DELETE /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4/os-volume_attachments/0bb96dac-d22f-48b7-8475-af7c0c8e42d2" status: 202 len: 0 microversion: 2.1 time: 0.413084 Jun 18 22:35:42.108707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2983/5946] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:35:41 2022] DELETE /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4/os-volume_attachments/0bb96dac-d22f-48b7-8475-af7c0c8e42d2 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:35:42.425321 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9195cdce-dbc1-4710-ae27-8b78950f7650 tempest-TestSecurityGroupsBasicOps-583669075 tempest-TestSecurityGroupsBasicOps-583669075-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1912 microversion: 2.1 time: 0.700315 Jun 18 22:35:42.427729 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2964/5947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:41 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1912 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:42.572422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:42.574956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:42.595568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:42.595936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:42.598136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:42.599062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:42.602124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:42.602593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:42.621190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:42.622036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:42.623133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:42.623781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:42.661064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:35:42.745347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:42.760557 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0801d0f5-2a7d-4a45-8f5a-47acf2762a08 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1192 microversion: 2.1 time: 0.168512 Jun 18 22:35:42.774203 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2965/5948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:42 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1192 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:42.821635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67c72723-9dc6-4b86-b41d-19517b7e20d5 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 204 len: 0 microversion: 2.1 time: 0.260317 Jun 18 22:35:42.822802 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2984/5949] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:35:42 2022] DELETE /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:35:42.850975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:42.866706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:42.887052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:42.888025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:42.901617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:42.906622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:42.923563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:43.120536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:43.129100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e0eb661-0038-4e19-b490-fc2207dd52ba tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1477 microversion: 2.1 time: 0.301871 Jun 18 22:35:43.130067 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2966/5950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:42 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:43.780529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:43.781281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:43.803533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:43.804344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:43.805346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:43.806011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:43.811562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:43.996210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:44.011637 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-43ba6189-f20c-4b39-b7db-39d472b86aa6 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1210 microversion: 2.1 time: 0.228464 Jun 18 22:35:44.012324 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2985/5951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:43 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:44.152285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:44.153556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:44.174116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:44.179890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:44.181300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:44.182471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:44.457581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:44.484549 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc6efc74-9cef-409f-ab06-abea234401a8 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1477 microversion: 2.1 time: 0.335196 Jun 18 22:35:44.487741 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2967/5952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:44 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:44.551174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:44.551998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:44.567141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:44.567617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:44.568488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:44.568960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:44.599549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:35:44.727149 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fc7a7eae-f6ee-4b7c-a25d-8461b55ee3d6 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "DELETE /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 204 len: 0 microversion: 2.1 time: 0.179530 Jun 18 22:35:44.737741 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2986/5953] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:35:44 2022] DELETE /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:35:44.746551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:44.747166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:44.758513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:44.759802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:44.762773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:44.765799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:44.933276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:44.942507 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-91c73cb7-f659-4808-893d-4aab6fa82004 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1514 microversion: 2.1 time: 0.199992 Jun 18 22:35:44.943591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2968/5954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:44 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:45.032460 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:45.035257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:45.050322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.053559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:45.054684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.056787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:45.503528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:45.504130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:45.520191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.526232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:45.530334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.534614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:45.560748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:45.578818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-15c5f195-6c1d-48ce-8cce-37dfa2875883 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1278 microversion: 2.1 time: 0.551044 Jun 18 22:35:45.591728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2987/5955] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:45 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1278 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:45.698660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0d5f06e9-9dec-4f32-9c33-83016e7bc97a req-3980d8ce-3c60-480e-afc9-38bdd72a2764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1335526-960d-4217-b6f8-0d5c91e964de", "name": "network-vif-deleted", "tag": "bb35b068-9b53-4867-8357-354c9d25ddf9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:45.722086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d5f06e9-9dec-4f32-9c33-83016e7bc97a req-3980d8ce-3c60-480e-afc9-38bdd72a2764 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.723536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d5f06e9-9dec-4f32-9c33-83016e7bc97a req-3980d8ce-3c60-480e-afc9-38bdd72a2764 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:45.771596 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0d5f06e9-9dec-4f32-9c33-83016e7bc97a req-3980d8ce-3c60-480e-afc9-38bdd72a2764 service nova] Creating event network-vif-deleted:bb35b068-9b53-4867-8357-354c9d25ddf9 for instance d1335526-960d-4217-b6f8-0d5c91e964de on nch2-master-1 Jun 18 22:35:45.787700 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0d5f06e9-9dec-4f32-9c33-83016e7bc97a req-3980d8ce-3c60-480e-afc9-38bdd72a2764 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092565 Jun 18 22:35:45.790129 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2988/5956] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:45.906196 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:45.917649 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37a857db-50b4-4bb3-9c5e-a9acad99746c tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 200 len: 1477 microversion: 2.1 time: 0.418231 Jun 18 22:35:45.921844 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2969/5957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:45 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:45.962700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:45.963852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:45.975140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.975601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:45.977193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:45.978184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:46.387630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:46.399572 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-14910da1-8ba0-4a18-abcd-7f71bb2c6761 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1514 microversion: 2.1 time: 0.443274 Jun 18 22:35:46.411748 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2989/5958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:45 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1514 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:46.598667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:46.599215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:46.614675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:46.615142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:46.617454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:46.617907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:46.853708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:46.862644 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b000394-dbc0-48b6-b9fb-96dd7da9bb12 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.269783 Jun 18 22:35:46.863857 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2970/5959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:46 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:46.942271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:46.943078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: d1335526-960d-4217-b6f8-0d5c91e964de] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:46.977836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:46.980124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:46.982777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:46.983361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:47.053408 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] HTTP exception thrown: Instance d1335526-960d-4217-b6f8-0d5c91e964de could not be found. Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Request method failure captured: Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de HTTP/1.1 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlK_z3aeZ-MLlQyUhhfi-qKvyw5GWBTO26_3mobGIMRW96s8sTTz3UUEiAfVhnj2X0XWlvy_Z4OCzf5VgeZ9hX3vYC6EuT_yni4h-Jc86BKD-Xeavlpi_vFZ8eLB9_LSE-LD_bp8Zy2Ff-o18bkEqoMqJM-SVWkTF5WnrXRjLisUYrA Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 521b75c65b1a4064befdab485a1dfec2 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-280053686 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/521b75c65b1a4064befdab485a1dfec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/521b75c65b1a4064befdab485a1dfec2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/521b75c65b1a4064befdab485a1dfec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_521b75c65b1a4064befdab485a1dfec2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestSecurityGroupsBasicOps-280053686 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 521b75c65b1a4064befdab485a1dfec2 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-280053686 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestSecurityGroupsBasicOps-280053686-project Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 259af49e467e4c4fbd01ae55251511e3 Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestSecurityGroupsBasicOps-280053686-project Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance d1335526-960d-4217-b6f8-0d5c91e964de could not be found. Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd1335526-960d-4217-b6f8-0d5c91e964de'} Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1335526-960d-4217-b6f8-0d5c91e964de could not be found. Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1335526-960d-4217-b6f8-0d5c91e964de could not be found. Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:47.055624 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1335526-960d-4217-b6f8-0d5c91e964de could not be found. Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:35:47.061447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Returning 404 to user: Instance d1335526-960d-4217-b6f8-0d5c91e964de could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:35:47.073876 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7152f73-4e9a-476e-981a-9d459c95d468 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de" status: 404 len: 111 microversion: 2.1 time: 0.137047 Jun 18 22:35:47.078291 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2990/5960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:46 2022] GET /compute/v2.1/servers/d1335526-960d-4217-b6f8-0d5c91e964de => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:35:47.418348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:47.419542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:47.431800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:47.432657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:47.435399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:47.436115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:47.556303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:47.571069 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ba06626-aeec-4847-bd7f-cf920e9180c9 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1472 microversion: 2.1 time: 0.157097 Jun 18 22:35:47.572316 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2971/5961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:47 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:35:47.880205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:47.881187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:47.906999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:47.908525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:47.910327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:47.911182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:48.069886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b0964c76-ccf4-44ff-8d65-dce1478d72f3 req-bc57f5b8-9d0d-4fb3-9733-b3ed0ca2bdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c409c8-1e27-45bf-bbfb-669de37846d4", "name": "network-vif-deleted", "tag": "2bb8b779-f1de-4ab7-aea0-c26b7cd57501"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:48.125018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b0964c76-ccf4-44ff-8d65-dce1478d72f3 req-bc57f5b8-9d0d-4fb3-9733-b3ed0ca2bdc5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:48.126288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b0964c76-ccf4-44ff-8d65-dce1478d72f3 req-bc57f5b8-9d0d-4fb3-9733-b3ed0ca2bdc5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:48.166663 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b0964c76-ccf4-44ff-8d65-dce1478d72f3 req-bc57f5b8-9d0d-4fb3-9733-b3ed0ca2bdc5 service nova] Creating event network-vif-deleted:2bb8b779-f1de-4ab7-aea0-c26b7cd57501 for instance 31c409c8-1e27-45bf-bbfb-669de37846d4 on nch2-master-1 Jun 18 22:35:48.182630 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b0964c76-ccf4-44ff-8d65-dce1478d72f3 req-bc57f5b8-9d0d-4fb3-9733-b3ed0ca2bdc5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116340 Jun 18 22:35:48.186481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2972/5962] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:35:48.217713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:48.226388 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d4ed32df-fc65-495b-a79b-12085df5d113 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.350100 Jun 18 22:35:48.226981 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2991/5963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:47 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:48.590172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:48.591720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:48.617062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:48.617909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:48.625934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:48.626845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:48.732632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:48.739431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:48.740144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lazy-loading 'fault' on Instance uuid 31c409c8-1e27-45bf-bbfb-669de37846d4 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:35:48.846521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61121749f1aa4a2285c8f270abb74fdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd65dfa8232fa458fb3c49822a1f4ede1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:48.854869 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d1bed268-cf74-4870-9f4b-57c830238dd3 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 200 len: 1309 microversion: 2.1 time: 0.270033 Jun 18 22:35:48.855467 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2973/5964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:48 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:49.243339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:49.243984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:49.256524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:49.258028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:49.259235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:49.262277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:49.493282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:49.523176 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d427993c-4439-49ff-a4e9-e8fb3eba0710 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.281447 Jun 18 22:35:49.532244 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2992/5965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:49 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:49.874368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:49.876842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] [instance: 31c409c8-1e27-45bf-bbfb-669de37846d4] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:49.891798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:49.893088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:49.895047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:49.898577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:49.936887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] HTTP exception thrown: Instance 31c409c8-1e27-45bf-bbfb-669de37846d4 could not be found. Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Request method failure captured: Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 HTTP/1.1 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlIiKknYbptDYK2R7YMkKpJNQ8mqbWK80D2-FnY3iFaTLPadZFIIRBvS_kXYHZuRHL_QKEH4-tmMNHxP0ke_OSYqX9jvWt8H_5rwz8b0GcyQNq4j_ZHUD1ECZ6VfVF4tiu9IODcqu1AVahMR0ZGRLk9PW4U4YVJm1cqcufEsF2cikB8 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: d65dfa8232fa458fb3c49822a1f4ede1 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1142548725 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d65dfa8232fa458fb3c49822a1f4ede1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d65dfa8232fa458fb3c49822a1f4ede1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d65dfa8232fa458fb3c49822a1f4ede1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d65dfa8232fa458fb3c49822a1f4ede1", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-VolumesSnapshotTestJSON-1142548725 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: d65dfa8232fa458fb3c49822a1f4ede1 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1142548725 Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-VolumesSnapshotTestJSON-1142548725-project Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 61121749f1aa4a2285c8f270abb74fdf Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-VolumesSnapshotTestJSON-1142548725-project Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 31c409c8-1e27-45bf-bbfb-669de37846d4 could not be found. Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '31c409c8-1e27-45bf-bbfb-669de37846d4'} Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c409c8-1e27-45bf-bbfb-669de37846d4 could not be found. Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c409c8-1e27-45bf-bbfb-669de37846d4 could not be found. Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:35:49.943324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c409c8-1e27-45bf-bbfb-669de37846d4 could not be found. Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:35:49.949164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] Returning 404 to user: Instance 31c409c8-1e27-45bf-bbfb-669de37846d4 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:35:49.950782 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a84e9cdb-7aea-4d34-b85f-af0462da8d33 tempest-VolumesSnapshotTestJSON-1142548725 tempest-VolumesSnapshotTestJSON-1142548725-project] 10.222.0.30 "GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4" status: 404 len: 111 microversion: 2.1 time: 0.081321 Jun 18 22:35:49.952521 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2974/5966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:49 2022] GET /compute/v2.1/servers/31c409c8-1e27-45bf-bbfb-669de37846d4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:35:50.288327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-60c9348e-551a-4125-847c-c2978ce2f402 req-766be2d0-14c9-4d3e-a024-14718510b895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77896cb0-0c4c-4118-b8d1-3532cce6b2a3", "tag": "f7217799-4e9e-4146-b11e-8732fe42e744"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:50.326300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-60c9348e-551a-4125-847c-c2978ce2f402 req-766be2d0-14c9-4d3e-a024-14718510b895 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:50.327526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-60c9348e-551a-4125-847c-c2978ce2f402 req-766be2d0-14c9-4d3e-a024-14718510b895 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:50.373383 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-60c9348e-551a-4125-847c-c2978ce2f402 req-766be2d0-14c9-4d3e-a024-14718510b895 service nova] Creating event network-changed:f7217799-4e9e-4146-b11e-8732fe42e744 for instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 on nch1-master-1 Jun 18 22:35:50.392737 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-60c9348e-551a-4125-847c-c2978ce2f402 req-766be2d0-14c9-4d3e-a024-14718510b895 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109029 Jun 18 22:35:50.397175 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2993/5967] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:50.544557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:50.545371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:50.570779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:50.574868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:50.577098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:50.578177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:50.856985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:50.879531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fb1ce121-2a3e-42a4-99a1-04af9d59094e tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.342337 Jun 18 22:35:50.888931 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2975/5968] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:50 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:51.904837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:51.905845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:51.908113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:51.916155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:51.923819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:51.924342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:51.925255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:51.933807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:52.564867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:52.610507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7751ec7c-e94b-4680-b1c7-4aac9d6d8fde tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.707715 Jun 18 22:35:52.624765 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2994/5969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:51 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:53.632739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:53.633523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:53.647742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:53.647891 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:53.654650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:53.655219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:53.893834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:53.903461 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08f13664-0314-45a9-9661-8d6c797f6a04 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.276211 Jun 18 22:35:53.909180 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2976/5970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:53 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:54.929081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:54.929913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:54.959164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:54.960121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:54.965632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:54.966849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:55.388101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:55.406756 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-12799be0-54cc-483f-8f3a-612b3832ab64 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.481540 Jun 18 22:35:55.419027 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2995/5971] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:54 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:56.134009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:56.134708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:56.143412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.145553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:56.146543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.153663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:56.274448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:35:56.559901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3e837c93-7175-4e18-ae60-e8ff1d9c0f4e tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 204 len: 0 microversion: 2.1 time: 0.429559 Jun 18 22:35:56.561803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2996/5972] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:35:56 2022] DELETE /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:35:56.566587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b9e60392-5d2b-4db0-beee-d9aa8213c889 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: .version_select at 0x7fea071d6ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2090336258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0RWk5n7ICpZNQHRGN3h4MrRPo+e8oHw4/HRVP+Wlb0y7l58b4OCCZXRB6jnLMKu1n1dVFAa3W7PvAe9SfCBnqDlfVyk0rlzX7DfoM1BzULJigxAxEuCmSQ/3aUpokD/g=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:56.583548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3b8e4579-9138-4f22-830b-63aaebdbf514 req-129de884-ee3d-4b39-9b24-3b1eab4b2a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7b0b2b-dd68-4b19-b530-770c8ddf18e2", "tag": "bba9ea2f-2bb9-417f-9114-22a7e8ce5571"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:56.597106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3b8e4579-9138-4f22-830b-63aaebdbf514 req-129de884-ee3d-4b39-9b24-3b1eab4b2a9d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.598508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3b8e4579-9138-4f22-830b-63aaebdbf514 req-129de884-ee3d-4b39-9b24-3b1eab4b2a9d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:56.649574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b9e60392-5d2b-4db0-beee-d9aa8213c889 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:35:56.659259 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3b8e4579-9138-4f22-830b-63aaebdbf514 req-129de884-ee3d-4b39-9b24-3b1eab4b2a9d service nova] Creating event network-changed:bba9ea2f-2bb9-417f-9114-22a7e8ce5571 for instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 on nch1-master-1 Jun 18 22:35:56.666532 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3b8e4579-9138-4f22-830b-63aaebdbf514 req-129de884-ee3d-4b39-9b24-3b1eab4b2a9d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102495 Jun 18 22:35:56.668257 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2997/5973] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:56.670547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-b9e60392-5d2b-4db0-beee-d9aa8213c889 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:35:56.679766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:56.681692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:56.690409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.691571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:56.693274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.693973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:56.715271 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9e60392-5d2b-4db0-beee-d9aa8213c889 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:35:56.925307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:56.935121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e685c407-6f12-41ba-bed0-974f513049c8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.262758 Jun 18 22:35:56.935731 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2998/5974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:56 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:56.948780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:56.950054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:56.960199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.961693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:56.962865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:56.963576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:57.271766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:57.283861 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-21d24fe3-3100-420f-a775-3743eeb93f59 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1767 microversion: 2.1 time: 0.346720 Jun 18 22:35:57.285471 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 2999/5975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:56 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1767 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:57.291031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-604e36cd-c61c-44b9-801e-0c930a8fe481 req-3af1be5c-753d-4681-96d7-4d5b9b5cacfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77896cb0-0c4c-4118-b8d1-3532cce6b2a3", "name": "network-vif-plugged", "status": "completed", "tag": "f7217799-4e9e-4146-b11e-8732fe42e744"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:57.295607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:57.306099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-604e36cd-c61c-44b9-801e-0c930a8fe481 req-3af1be5c-753d-4681-96d7-4d5b9b5cacfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:57.306801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-604e36cd-c61c-44b9-801e-0c930a8fe481 req-3af1be5c-753d-4681-96d7-4d5b9b5cacfd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:57.323652 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-604e36cd-c61c-44b9-801e-0c930a8fe481 req-3af1be5c-753d-4681-96d7-4d5b9b5cacfd service nova] Creating event network-vif-plugged:f7217799-4e9e-4146-b11e-8732fe42e744 for instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 on nch1-master-1 Jun 18 22:35:57.330811 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-604e36cd-c61c-44b9-801e-0c930a8fe481 req-3af1be5c-753d-4681-96d7-4d5b9b5cacfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043571 Jun 18 22:35:57.331768 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3000/5976] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:57.735054 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9e60392-5d2b-4db0-beee-d9aa8213c889 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41444. Jun 18 22:35:57.759808 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b9e60392-5d2b-4db0-beee-d9aa8213c889 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.648990 Jun 18 22:35:57.760436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2977/5977] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:35:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:57.953335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:57.954677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:57.963266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:57.964372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:57.965915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:57.981729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:58.275242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:58.279933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:35:58.287987 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4f7ab523-af8c-4287-ba8a-7820de79ea4a tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.339659 Jun 18 22:35:58.299880 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3001/5978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:57 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:58.314293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:58.315902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:58.328228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:58.329192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:58.332653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:58.334925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:58.540697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:58.552057 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08d750a5-91dd-42b7-ac89-b75c4514ad61 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1767 microversion: 2.1 time: 0.249935 Jun 18 22:35:58.565646 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2978/5979] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:58 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1767 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:59.307370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:59.308782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:59.329098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:59.331072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:59.333718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:59.334465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:59.586341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:35:59.587783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:35:59.606791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:59.607335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:59.608466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:59.616479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:59.636963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:59.645905 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-192b5734-34bc-4ef2-ae15-84a2c5b86267 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1266 microversion: 2.1 time: 0.343873 Jun 18 22:35:59.649516 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3002/5980] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:59 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:35:59.654464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-19156a1d-5b14-4d06-966f-d374923b6e4b req-d3807663-0bbf-499d-8d2a-30ce48a23198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7b0b2b-dd68-4b19-b530-770c8ddf18e2", "name": "network-vif-deleted", "tag": "bba9ea2f-2bb9-417f-9114-22a7e8ce5571"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:35:59.667999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-19156a1d-5b14-4d06-966f-d374923b6e4b req-d3807663-0bbf-499d-8d2a-30ce48a23198 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:35:59.668772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-19156a1d-5b14-4d06-966f-d374923b6e4b req-d3807663-0bbf-499d-8d2a-30ce48a23198 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:35:59.701375 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-19156a1d-5b14-4d06-966f-d374923b6e4b req-d3807663-0bbf-499d-8d2a-30ce48a23198 service nova] Creating event network-vif-deleted:bba9ea2f-2bb9-417f-9114-22a7e8ce5571 for instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 on nch1-master-1 Jun 18 22:35:59.713614 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-19156a1d-5b14-4d06-966f-d374923b6e4b req-d3807663-0bbf-499d-8d2a-30ce48a23198 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062322 Jun 18 22:35:59.715506 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3003/5981] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:35:59.738362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259af49e467e4c4fbd01ae55251511e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '521b75c65b1a4064befdab485a1dfec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:35:59.767327 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2b5b90bd-0e6d-4f51-8672-a41cfb66b041 tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 200 len: 1529 microversion: 2.1 time: 0.188786 Jun 18 22:35:59.768210 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2979/5982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:35:59 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 1529 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:00.668300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:00.670562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:00.683906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:00.684763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:00.685707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:00.686394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:00.785890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:00.786914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] [instance: 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:00.820276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:00.824244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:00.829383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:00.830744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:00.867797 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] HTTP exception thrown: Instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 could not be found. Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Request method failure captured: Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 HTTP/1.1 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlK_z3aeZ-MLlQyUhhfi-qKvyw5GWBTO26_3mobGIMRW96s8sTTz3UUEiAfVhnj2X0XWlvy_Z4OCzf5VgeZ9hX3vYC6EuT_yni4h-Jc86BKD-Xeavlpi_vFZ8eLB9_LSE-LD_bp8Zy2Ff-o18bkEqoMqJM-SVWkTF5WnrXRjLisUYrA Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 521b75c65b1a4064befdab485a1dfec2 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-280053686 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/521b75c65b1a4064befdab485a1dfec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/521b75c65b1a4064befdab485a1dfec2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/521b75c65b1a4064befdab485a1dfec2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_521b75c65b1a4064befdab485a1dfec2", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestSecurityGroupsBasicOps-280053686 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 521b75c65b1a4064befdab485a1dfec2 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-280053686 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestSecurityGroupsBasicOps-280053686-project Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 259af49e467e4c4fbd01ae55251511e3 Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestSecurityGroupsBasicOps-280053686-project Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 could not be found. Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '4a7b0b2b-dd68-4b19-b530-770c8ddf18e2'} Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 could not be found. Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 could not be found. Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:36:00.878816 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 could not be found. Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Returning 404 to user: Instance 4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d9062e83-359a-478a-9ef3-f24d3633d1ca tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2" status: 404 len: 111 microversion: 2.1 time: 0.102873 Jun 18 22:36:00.884677 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2980/5983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:00 2022] GET /compute/v2.1/servers/4a7b0b2b-dd68-4b19-b530-770c8ddf18e2 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:36:00.944928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:00.953791 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ff8168bf-932a-462e-83c4-d343f318e83d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1454 microversion: 2.1 time: 0.291631 Jun 18 22:36:00.955187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3004/5984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:00 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1454 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:00.971795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:00.972421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:00.986974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:00.987434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:00.988226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:00.988664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:01.356253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:01.375085 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5e084fd8-9f10-4205-90dc-7b065f0ab370 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1454 microversion: 2.1 time: 0.407048 Jun 18 22:36:01.375791 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2981/5985] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:00 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1454 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:05.052514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-245f9fac-b8f9-4163-8117-4e7943f220c8 req-dadf0b12-d02a-4ff8-a14f-d4fc09d55a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77896cb0-0c4c-4118-b8d1-3532cce6b2a3", "tag": "f7217799-4e9e-4146-b11e-8732fe42e744"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:05.077849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-245f9fac-b8f9-4163-8117-4e7943f220c8 req-dadf0b12-d02a-4ff8-a14f-d4fc09d55a14 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:05.078791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-245f9fac-b8f9-4163-8117-4e7943f220c8 req-dadf0b12-d02a-4ff8-a14f-d4fc09d55a14 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:05.121468 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-245f9fac-b8f9-4163-8117-4e7943f220c8 req-dadf0b12-d02a-4ff8-a14f-d4fc09d55a14 service nova] Creating event network-changed:f7217799-4e9e-4146-b11e-8732fe42e744 for instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 on nch1-master-1 Jun 18 22:36:05.134535 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-245f9fac-b8f9-4163-8117-4e7943f220c8 req-dadf0b12-d02a-4ff8-a14f-d4fc09d55a14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268651 Jun 18 22:36:05.150725 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3005/5986] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:11.058501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4123cfce-6a1f-4fe8-acf7-e8855ff821fe tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] Calling method '.version_select at 0x7fea0721b8b0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:11.062231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:11.067278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:11.098543 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4123cfce-6a1f-4fe8-acf7-e8855ff821fe tempest-TestSecurityGroupsBasicOps-280053686 tempest-TestSecurityGroupsBasicOps-280053686-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-816306085" status: 202 len: 0 microversion: 2.1 time: 0.048921 Jun 18 22:36:11.099665 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2982/5987] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-816306085 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:36:12.021668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-464681969", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e6e6fd66-098e-4828-a581-5912a56ca3bd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2090336258", "security_groups": [{"name": "tempest-secgroup-smoke-435856935"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:12.203224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] validate_networks() for [('e6e6fd66-098e-4828-a581-5912a56ca3bd', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:36:13.497633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:36:13.498115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:36:13.498602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:36:13.499167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:36:13.500086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:36:13.528368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:13.529544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:13.530716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:13.531606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:13.559409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:36:13.566600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:36:13.585590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:36:13.588668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:36:13.713877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-32291876-7345-4e01-a496-53808ec52cf8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.697987 Jun 18 22:36:13.715707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3006/5988] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:36:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:36:13.731730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-74fd9081-1356-4955-b348-3d693c25a45b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:13.732802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-74fd9081-1356-4955-b348-3d693c25a45b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:13.745441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=79 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:13.884321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-74fd9081-1356-4955-b348-3d693c25a45b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:13.893020 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-74fd9081-1356-4955-b348-3d693c25a45b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1266 microversion: 2.1 time: 0.170345 Jun 18 22:36:13.894118 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2983/5989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:13 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:14.913026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:14.913766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:14.965281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:14.967955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:14.968965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:14.971068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:15.151380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:15.165536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7552636d-3e7a-4030-aebe-a0de88bf965f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1262 microversion: 2.1 time: 0.258669 Jun 18 22:36:15.168965 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3007/5990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:14 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1262 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:16.195520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:16.198863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:16.234389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:16.239512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:16.241622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:16.258668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:16.442664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:16.451734 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b41bb1f-ff18-4e0b-8ec1-96517a298764 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1324 microversion: 2.1 time: 0.269012 Jun 18 22:36:16.452348 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2984/5991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:16 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:17.473683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:17.474981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:17.491121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:17.495015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:17.497228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:17.499784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:17.831547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:17.841546 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83971d89-e9d3-4455-abb6-f1c6a3ed307a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1391 microversion: 2.1 time: 0.373744 Jun 18 22:36:17.842909 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3008/5992] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:17 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1391 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:18.072950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-33c5dcc4-6303-40ff-a29c-97fd11226b56 req-7c51d9b1-b44e-40ef-bac6-56f648ec2140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:18.092078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-33c5dcc4-6303-40ff-a29c-97fd11226b56 req-7c51d9b1-b44e-40ef-bac6-56f648ec2140 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:18.093092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-33c5dcc4-6303-40ff-a29c-97fd11226b56 req-7c51d9b1-b44e-40ef-bac6-56f648ec2140 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:18.112554 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-33c5dcc4-6303-40ff-a29c-97fd11226b56 req-7c51d9b1-b44e-40ef-bac6-56f648ec2140 service nova] Creating event network-changed:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch2-master-1 Jun 18 22:36:18.119668 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-33c5dcc4-6303-40ff-a29c-97fd11226b56 req-7c51d9b1-b44e-40ef-bac6-56f648ec2140 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062068 Jun 18 22:36:18.122887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2985/5993] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:18.860123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:18.861548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:18.869945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:18.870522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:18.871428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:18.871986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:19.043976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:19.052361 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-221ed540-07a8-4776-b505-0232645ea2fc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1391 microversion: 2.1 time: 0.196851 Jun 18 22:36:19.052949 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3009/5994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:18 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:36:20.070930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:20.071716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:20.084740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:20.085472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:20.086508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:20.087114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:20.399859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:20.409088 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-459bf480-664a-462c-917b-e790d1194392 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1391 microversion: 2.1 time: 0.342508 Jun 18 22:36:20.410490 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2986/5995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:20 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:21.427461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:21.428179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:21.435932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:21.436436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:21.437660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:21.438117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:22.362367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:22.377255 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d64544c-c056-49c8-a543-0938832f7841 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1391 microversion: 2.1 time: 0.950449 Jun 18 22:36:22.377255 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3010/5996] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:21 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1391 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:23.395523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:23.396910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:23.405960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:23.406411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:23.407191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:23.407682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:23.522935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c384a492-8a7d-4a56-8ef9-c7c9c502e092 req-f74f485e-a705-4e16-83c9-6cdc090fc96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "name": "network-vif-plugged", "status": "completed", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:23.549548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:23.553104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c384a492-8a7d-4a56-8ef9-c7c9c502e092 req-f74f485e-a705-4e16-83c9-6cdc090fc96a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:23.553784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c384a492-8a7d-4a56-8ef9-c7c9c502e092 req-f74f485e-a705-4e16-83c9-6cdc090fc96a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:23.579931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:23.592441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c384a492-8a7d-4a56-8ef9-c7c9c502e092 req-f74f485e-a705-4e16-83c9-6cdc090fc96a service nova] Creating event network-vif-plugged:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch2-master-1 Jun 18 22:36:23.602396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c384a492-8a7d-4a56-8ef9-c7c9c502e092 req-f74f485e-a705-4e16-83c9-6cdc090fc96a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094872 Jun 18 22:36:23.603420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3011/5997] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:23.889282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:23.978137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:23.986715 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6d6765f9-1b33-440e-bf63-53eb0a131f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1391 microversion: 2.1 time: 0.596353 Jun 18 22:36:23.994671 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2987/5998] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:23 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1391 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:25.011564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:25.012915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:25.025786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:25.026610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:25.027910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:25.028379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:25.224209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:25.234207 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5cd850b4-3cc9-4cfe-ae60-a3b0e87e1c3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1563 microversion: 2.1 time: 0.227451 Jun 18 22:36:25.234818 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3012/5999] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:25 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:25.256824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:25.257601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:25.267484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:25.267999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:25.268839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:25.269569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:25.480783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:25.521309 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-79d50cb9-d7db-4463-b45a-fe4300cc0961 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1563 microversion: 2.1 time: 0.269165 Jun 18 22:36:25.522326 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2988/6000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:25 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1563 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:30.171068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:30.171623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-884e9602-9db1-4671-aa3f-05b4e813cc22 req-b03721ec-8069-4c54-b307-40ed4a02e54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:30.173143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:30.180031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:30.206319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-884e9602-9db1-4671-aa3f-05b4e813cc22 req-b03721ec-8069-4c54-b307-40ed4a02e54e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:30.206781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-884e9602-9db1-4671-aa3f-05b4e813cc22 req-b03721ec-8069-4c54-b307-40ed4a02e54e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:30.208303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:30.208869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:30.216131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:30.220662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:30.241950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=51 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:30.253124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-884e9602-9db1-4671-aa3f-05b4e813cc22 req-b03721ec-8069-4c54-b307-40ed4a02e54e service nova] Creating event network-changed:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch2-master-1 Jun 18 22:36:30.260572 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-884e9602-9db1-4671-aa3f-05b4e813cc22 req-b03721ec-8069-4c54-b307-40ed4a02e54e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093772 Jun 18 22:36:30.262204 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2989/6001] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:30.429115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:30.438196 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b5055dfe-e06c-4dc5-8428-f44edd18d20e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1563 microversion: 2.1 time: 0.278336 Jun 18 22:36:30.438860 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3013/6002] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:30 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1563 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:34.472890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-769e49ff-0f16-4f20-bf2d-a27062f17a04 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:34.474054 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:36:34.474054 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:36:34.475214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-769e49ff-0f16-4f20-bf2d-a27062f17a04 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:34.475821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-769e49ff-0f16-4f20-bf2d-a27062f17a04 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:34.476643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-769e49ff-0f16-4f20-bf2d-a27062f17a04 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:34.477139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-769e49ff-0f16-4f20-bf2d-a27062f17a04 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:34.503894 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-769e49ff-0f16-4f20-bf2d-a27062f17a04 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.391829 Jun 18 22:36:34.505082 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2990/6003] 10.222.0.30 () {58 vars in 1184 bytes} [Sat Jun 18 22:36:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:34.627890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1794825557", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "cfd51719-3891-4148-a008-ba274d9cc675"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:34.695128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] validate_networks() for [('cfd51719-3891-4148-a008-ba274d9cc675', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:36:35.144592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:36:35.145062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:36:35.145601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:36:35.146366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:36:35.146810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:36:35.160317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:35.160863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:35.162166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:35.163291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:35.182550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Getting quotas for project ca621b1e751c47918695e53f52145438. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:36:35.189446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Getting quotas for user ea832a701f7a4b5d9091c89f2829c0ea and project ca621b1e751c47918695e53f52145438. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:36:35.215342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:36:35.218537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:36:35.280167 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37085877-c14e-4ab6-8836-d3acf372d2e3 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656151 Jun 18 22:36:35.281474 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3014/6004] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:36:35.292301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-31ace8cc-4696-4dea-9fe2-996dfb10310f tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:35.293586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-31ace8cc-4696-4dea-9fe2-996dfb10310f tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:35.432424 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-31ace8cc-4696-4dea-9fe2-996dfb10310f tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1329 microversion: 2.1 time: 0.144895 Jun 18 22:36:35.433046 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2991/6005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:35 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1329 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:36.455495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:36.457016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:36.475852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:36.481617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:36.482644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:36.483349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:36.623927 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3af96c0-7096-43d2-987e-8d4f94f6dfb4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1424 microversion: 2.1 time: 0.177790 Jun 18 22:36:36.634489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3015/6006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:36 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1424 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:37.642022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:37.642718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:37.651565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:37.652270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:37.653492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:37.654074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:37.956060 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4dbe623-3acf-41ec-aa0c-d3d3af81de37 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.314887 Jun 18 22:36:37.957494 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2992/6007] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:37 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:38.034791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-64737844-1f57-44eb-a688-d63a60686b1c req-9a90af39-0307-418e-b578-b348e711b321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765de862-9044-4cc2-bf54-595764f83b09", "tag": "207e35f2-adc1-4be7-bf97-e8f5bf12cf74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:38.055749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-64737844-1f57-44eb-a688-d63a60686b1c req-9a90af39-0307-418e-b578-b348e711b321 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:38.057233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-64737844-1f57-44eb-a688-d63a60686b1c req-9a90af39-0307-418e-b578-b348e711b321 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:38.086830 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-64737844-1f57-44eb-a688-d63a60686b1c req-9a90af39-0307-418e-b578-b348e711b321 service nova] Creating event network-changed:207e35f2-adc1-4be7-bf97-e8f5bf12cf74 for instance 765de862-9044-4cc2-bf54-595764f83b09 on nch1-master-1 Jun 18 22:36:38.101260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-64737844-1f57-44eb-a688-d63a60686b1c req-9a90af39-0307-418e-b578-b348e711b321 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091079 Jun 18 22:36:38.102243 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3016/6008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:38.977424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:38.978070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:38.985638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:38.986080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:38.986856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:38.987284 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:39.124933 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ddaeb51a-2cde-4c59-9cc6-c25a3d1c7dd8 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.151976 Jun 18 22:36:39.125676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2993/6009] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:38 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:40.143351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:40.144258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:40.152117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:40.152584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:40.153400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:40.153848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:40.300361 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e794fa7f-4a63-480f-bb5b-e8d9549c91ad tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.161082 Jun 18 22:36:40.301328 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3017/6010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:40 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:41.318575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:41.320662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:41.330349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:41.330894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:41.332276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:41.332945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:41.473590 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f0ae8b82-9730-4d52-8411-8f97b7a7fb45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.159227 Jun 18 22:36:41.474229 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2994/6011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:41 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:42.492166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:42.493697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:42.504230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:42.504956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:42.505811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:42.506449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:42.657671 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3585597f-86bf-4c5e-9b6f-010c0ed861c0 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.170342 Jun 18 22:36:42.658201 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3018/6012] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:42 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:43.674431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:43.675344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:43.683064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:43.683518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:43.684283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:43.684905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:43.811234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=53 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:43.816958 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-130b6981-c385-49a4-9426-1ba7566a880b tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.147161 Jun 18 22:36:43.817659 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2995/6013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:43 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:44.557156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7301c9cd-d952-4288-ab04-2f0638af1f56 req-214a40b0-0d52-472f-bc4d-9f5f07e23d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765de862-9044-4cc2-bf54-595764f83b09", "name": "network-vif-plugged", "status": "completed", "tag": "207e35f2-adc1-4be7-bf97-e8f5bf12cf74"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:44.570855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7301c9cd-d952-4288-ab04-2f0638af1f56 req-214a40b0-0d52-472f-bc4d-9f5f07e23d36 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:44.571407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7301c9cd-d952-4288-ab04-2f0638af1f56 req-214a40b0-0d52-472f-bc4d-9f5f07e23d36 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:44.587270 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7301c9cd-d952-4288-ab04-2f0638af1f56 req-214a40b0-0d52-472f-bc4d-9f5f07e23d36 service nova] Creating event network-vif-plugged:207e35f2-adc1-4be7-bf97-e8f5bf12cf74 for instance 765de862-9044-4cc2-bf54-595764f83b09 on nch1-master-1 Jun 18 22:36:44.594016 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7301c9cd-d952-4288-ab04-2f0638af1f56 req-214a40b0-0d52-472f-bc4d-9f5f07e23d36 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041843 Jun 18 22:36:44.594739 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3019/6014] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:44.836523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:44.837489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:44.840122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:44.842232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:44.850061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:44.850515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:44.851287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:44.851730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:44.986904 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c599cd62-792d-4b34-adb1-f5d016a5dc45 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1464 microversion: 2.1 time: 0.155928 Jun 18 22:36:44.987470 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2996/6015] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:44 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:46.006500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:46.007227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:46.012411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:46.013551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:46.021399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:46.021901 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:46.022792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:46.023274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:46.151280 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8cb1e12b-6bf9-4785-8cc0-e3677046b520 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1650 microversion: 2.1 time: 0.145864 Jun 18 22:36:46.151863 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3020/6016] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:46 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1650 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:46.167427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:46.168051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:46.170030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:46.177342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:46.177803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:46.178591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:46.179039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:46.323403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05d96fac-5861-47de-8092-bc3eba47a116 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1650 microversion: 2.1 time: 0.159698 Jun 18 22:36:46.323986 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2997/6017] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:46 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1650 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:46.339253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:46.339900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:46.346124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:46.346611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:46.347389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:46.347972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:46.474575 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f47e8cf3-e599-4562-8cd7-ef67e7d11eb2 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1650 microversion: 2.1 time: 0.139062 Jun 18 22:36:46.475123 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3021/6018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:46 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1650 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:46.589726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-865521786", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "cfd51719-3891-4148-a008-ba274d9cc675"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:46.649602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] validate_networks() for [('cfd51719-3891-4148-a008-ba274d9cc675', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:36:47.443279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:36:47.443794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:36:47.444166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:36:47.444584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:36:47.445053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:36:47.454294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:47.454745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:47.455538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:47.455971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:47.473749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Getting quotas for project ca621b1e751c47918695e53f52145438. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:36:47.478910 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Getting quotas for user ea832a701f7a4b5d9091c89f2829c0ea and project ca621b1e751c47918695e53f52145438. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:36:47.491397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:36:47.493809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:36:47.547395 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65b539c3-7609-4271-a2fe-f647e88d7667 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961447 Jun 18 22:36:47.548284 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2998/6019] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:36:47.558710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c49ebc4-0a79-49ba-b9ba-393bee4a652e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:47.559335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6c49ebc4-0a79-49ba-b9ba-393bee4a652e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:47.624304 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6c49ebc4-0a79-49ba-b9ba-393bee4a652e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1328 microversion: 2.1 time: 0.069434 Jun 18 22:36:47.625011 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3022/6020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:47 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1328 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:48.642620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:48.643361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:48.653478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:48.653923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:48.654702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:48.655133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:48.724155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4cb6fbd7-471c-4309-ad6c-a7b7c75561aa tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1421 microversion: 2.1 time: 0.086280 Jun 18 22:36:48.724758 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 2999/6021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:48 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:49.723525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a085e62f-3833-4843-a185-01b4930f0394 req-08d4905d-649c-4ed0-bddd-3f84e77fafb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e432ab01-0dbc-44af-899e-511a822ad70c", "tag": "3dab4d71-4ee2-445a-b992-f50be09caf30"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:49.741093 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:49.741723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:49.758372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:49.758900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:49.759734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:49.760204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:49.765840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a085e62f-3833-4843-a185-01b4930f0394 req-08d4905d-649c-4ed0-bddd-3f84e77fafb5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:49.766256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a085e62f-3833-4843-a185-01b4930f0394 req-08d4905d-649c-4ed0-bddd-3f84e77fafb5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:49.790399 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a085e62f-3833-4843-a185-01b4930f0394 req-08d4905d-649c-4ed0-bddd-3f84e77fafb5 service nova] Creating event network-changed:3dab4d71-4ee2-445a-b992-f50be09caf30 for instance e432ab01-0dbc-44af-899e-511a822ad70c on nch2-master-1 Jun 18 22:36:49.798469 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a085e62f-3833-4843-a185-01b4930f0394 req-08d4905d-649c-4ed0-bddd-3f84e77fafb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078275 Jun 18 22:36:49.799150 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3023/6022] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:49.912981 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2ca57e3-f666-42fe-b1da-210b30029f39 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1463 microversion: 2.1 time: 0.175891 Jun 18 22:36:49.913625 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3000/6023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:49 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:36:50.004436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:50.005559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:50.012235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:50.012698 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:50.013517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:50.013963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:50.065559 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0edf154e-d606-4147-8b2b-be1b2d591b04 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action" status: 200 len: 24569 microversion: 2.1 time: 0.065363 Jun 18 22:36:50.072450 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3024/6024] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:36:49 2022] POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action => generated 24569 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:36:50.930430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:50.931044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:50.938313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:50.938770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:50.939570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:50.940016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:51.077954 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-184d842c-d658-45f9-922e-ec18a24cbf3a tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1463 microversion: 2.1 time: 0.151324 Jun 18 22:36:51.078540 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3001/6025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:50 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1463 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:52.100256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:52.101492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:52.113743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:52.114522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:52.115930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:52.116387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:52.250060 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7055b6de-1fc9-42b1-b7f8-541903737425 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1463 microversion: 2.1 time: 0.156886 Jun 18 22:36:52.250640 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3025/6026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:52 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1463 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:53.269416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:53.270038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:53.278972 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:53.279678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:53.280651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:53.281206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:53.427929 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a4696ae0-a314-4335-ba21-d5ea4fd5dd5d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1463 microversion: 2.1 time: 0.163398 Jun 18 22:36:53.438482 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3002/6027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:53 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:54.447517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:54.448119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:54.456041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:54.456517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:54.457370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:54.457816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:54.604624 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3fec004f-1b33-4a32-b090-3affd4763ad9 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1463 microversion: 2.1 time: 0.162295 Jun 18 22:36:54.605250 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3026/6028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:54 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:55.373133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-25dda6e7-7515-4b18-ab2c-d9909647d5d5 req-f5694862-a3b7-4db2-90f5-e1429c7fb8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432ab01-0dbc-44af-899e-511a822ad70c", "name": "network-vif-plugged", "status": "completed", "tag": "3dab4d71-4ee2-445a-b992-f50be09caf30"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:55.383523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-25dda6e7-7515-4b18-ab2c-d9909647d5d5 req-f5694862-a3b7-4db2-90f5-e1429c7fb8c7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:55.384051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-25dda6e7-7515-4b18-ab2c-d9909647d5d5 req-f5694862-a3b7-4db2-90f5-e1429c7fb8c7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:55.397080 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-25dda6e7-7515-4b18-ab2c-d9909647d5d5 req-f5694862-a3b7-4db2-90f5-e1429c7fb8c7 service nova] Creating event network-vif-plugged:3dab4d71-4ee2-445a-b992-f50be09caf30 for instance e432ab01-0dbc-44af-899e-511a822ad70c on nch2-master-1 Jun 18 22:36:55.402432 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-25dda6e7-7515-4b18-ab2c-d9909647d5d5 req-f5694862-a3b7-4db2-90f5-e1429c7fb8c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033685 Jun 18 22:36:55.403182 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3003/6029] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:55.622146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:55.622677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:55.630086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:55.630546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:55.631322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:55.631771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:55.772537 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7815dc3d-a515-4edd-beb3-302a685f3c98 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1463 microversion: 2.1 time: 0.154324 Jun 18 22:36:55.773393 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3027/6030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:55 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1463 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:56.398916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:56.399553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:56.406405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.406866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.407643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.408086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.661564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-61b38f2f-4767-4b87-bbd1-ef236690e7ae tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1832 microversion: 2.1 time: 0.267683 Jun 18 22:36:56.662173 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3004/6031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:56 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1832 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:56.685426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:56.686134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:56.695138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.696080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.697248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.697761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.791535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:56.792161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:56.798870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.799318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.800099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.800883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.847203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:56.855515 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b8d96a5-5de4-4bdf-9735-68010b8edd3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1681 microversion: 2.1 time: 0.174966 Jun 18 22:36:56.856420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3028/6032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:56 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:56.952243 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bde67086-18ab-4dad-b4bb-fc7312b51fc1 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1649 microversion: 2.1 time: 0.164328 Jun 18 22:36:56.953091 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3005/6033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:56 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1649 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:36:56.962633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:56.963710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:56.969591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:56.970444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:56.970610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.971168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.972052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.972510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.978285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.978988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:56.979801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:56.980238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.029699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c1434b81-2ea6-4bd6-8edf-ca12afeeb243 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action" status: 200 len: 32639 microversion: 2.1 time: 0.070616 Jun 18 22:36:57.030649 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3029/6034] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:36:56 2022] POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:36:57.122093 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-861ac279-bc33-4245-92cf-f49b41b8d86c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1649 microversion: 2.1 time: 0.156248 Jun 18 22:36:57.122562 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3006/6035] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:56 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:57.138697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:57.139466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:57.147418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.147907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.148747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.149245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.267031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:57.267787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:57.275440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.275880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.276806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.277373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.303108 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b5d6f1a-51ac-4cc7-ad7a-ad4b212f0b09 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1649 microversion: 2.1 time: 0.168806 Jun 18 22:36:57.303825 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3030/6036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:57 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1649 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:57.321237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:57.321830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:57.323242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8701ca4ee934249b5071bf8c8069d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f16bccc6b4dcbac155f125226ca8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:57.323859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] flavor_id is None. Assuming migration. {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 18 22:36:57.324300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:36:57.329282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.329854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.330846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.331513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.359261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:36:57.442561 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f95a7cd3-ada5-4c9f-bc8d-bf68401d423e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 204 len: 0 microversion: 2.1 time: 0.125092 Jun 18 22:36:57.443274 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3031/6037] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:36:57 2022] DELETE /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:36:57.454560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:57.455333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:57.462251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.463553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.464141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.464576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.469274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:57.482936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:57.485717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:57.592968 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a5e15399-cf55-4525-adc4-2eab95f826cf tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action" status: 202 len: 0 microversion: 2.1 time: 0.330869 Jun 18 22:36:57.593775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3007/6038] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:36:57 2022] POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:36:57.603051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:57.603928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:57.616602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.617113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.618006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:57.618492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:57.620549 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7ec2c7c1-08cc-444f-8043-67ae547207cc tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1655 microversion: 2.1 time: 0.172268 Jun 18 22:36:57.630552 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3032/6039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:57 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:36:57.770249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:57.778460 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a2635a2-5494-4a04-9d78-09fb868df027 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1690 microversion: 2.1 time: 0.179816 Jun 18 22:36:57.779388 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3008/6040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:57 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:36:58.639823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:58.640413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:58.642353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:36:58.650342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:58.650801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:58.651924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:58.652379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:58.798752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:58.800434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:58.810098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:58.810554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:58.811532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:58.811959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:58.814234 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6d91ad24-477a-4292-b62e-12c90a599191 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1655 microversion: 2.1 time: 0.178200 Jun 18 22:36:58.817123 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3033/6041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:58 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1655 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:58.965574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:36:58.974368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-13562797-581a-4200-b30c-e578cf40d819 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1690 microversion: 2.1 time: 0.180598 Jun 18 22:36:58.975054 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3009/6042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:58 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:36:59.351666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-025f01e1-ec78-41d1-9699-dcb844832e94 req-91d53f25-8fc3-4b55-aa4a-d5125d8027ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432ab01-0dbc-44af-899e-511a822ad70c", "name": "network-vif-deleted", "tag": "3dab4d71-4ee2-445a-b992-f50be09caf30"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:36:59.362193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-025f01e1-ec78-41d1-9699-dcb844832e94 req-91d53f25-8fc3-4b55-aa4a-d5125d8027ee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:59.362909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-025f01e1-ec78-41d1-9699-dcb844832e94 req-91d53f25-8fc3-4b55-aa4a-d5125d8027ee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:59.379172 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-025f01e1-ec78-41d1-9699-dcb844832e94 req-91d53f25-8fc3-4b55-aa4a-d5125d8027ee service nova] Creating event network-vif-deleted:3dab4d71-4ee2-445a-b992-f50be09caf30 for instance e432ab01-0dbc-44af-899e-511a822ad70c on nch2-master-1 Jun 18 22:36:59.389359 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-025f01e1-ec78-41d1-9699-dcb844832e94 req-91d53f25-8fc3-4b55-aa4a-d5125d8027ee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040695 Jun 18 22:36:59.391237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3034/6043] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:36:59.831854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:59.832600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:36:59.840726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:59.841229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:59.842025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:59.842720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:59.877563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:36:59.878051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:36:59.878546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lazy-loading 'fault' on Instance uuid e432ab01-0dbc-44af-899e-511a822ad70c {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:36:59.933519 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f8aa8a3f-9c7d-4af9-a969-54784bcca043 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 200 len: 1453 microversion: 2.1 time: 0.105333 Jun 18 22:36:59.934114 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3010/6044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:59 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:36:59.994506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:36:59.995142 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:00.001746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:00.002204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:00.003018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:00.003468 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:00.155370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:00.165540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-085be0ec-1a94-444b-ae85-978077415249 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1690 microversion: 2.1 time: 0.175920 Jun 18 22:37:00.166475 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3035/6045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:36:59 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:00.954332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:00.955048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: e432ab01-0dbc-44af-899e-511a822ad70c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:00.963951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:00.964491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:00.965452 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:00.965947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:00.985594 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] HTTP exception thrown: Instance e432ab01-0dbc-44af-899e-511a822ad70c could not be found. Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Request method failure captured: Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c HTTP/1.1 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlNxtTXAVZoE-YnjQeyJu5yAOQWKna0wyoqDmPmMAMca8qZkKWbFMTnwcst6NsjZG8Gj8oX_H2hC6-4txUQdM_aZC60bLHFrBo9UJNf5jnb9fv2Jpj7pb_26GGyOE4YKMFECz4lnHuZaU50WBAPVGOuFkVC4kFQrYNE7b1n8VCJMYm0 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: ca621b1e751c47918695e53f52145438 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestServerMultinode-1988199090 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca621b1e751c47918695e53f52145438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca621b1e751c47918695e53f52145438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca621b1e751c47918695e53f52145438"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca621b1e751c47918695e53f52145438", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestServerMultinode-1988199090 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: ca621b1e751c47918695e53f52145438 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestServerMultinode-1988199090 Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestServerMultinode-1988199090-project-admin Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: ea832a701f7a4b5d9091c89f2829c0ea Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestServerMultinode-1988199090-project-admin Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance e432ab01-0dbc-44af-899e-511a822ad70c could not be found. Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e432ab01-0dbc-44af-899e-511a822ad70c'} Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e432ab01-0dbc-44af-899e-511a822ad70c could not be found. Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e432ab01-0dbc-44af-899e-511a822ad70c could not be found. Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:00.987269 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e432ab01-0dbc-44af-899e-511a822ad70c could not be found. Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Returning 404 to user: Instance e432ab01-0dbc-44af-899e-511a822ad70c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b20355d-2004-4c3c-913c-1c9fcd5b8f7e tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c" status: 404 len: 111 microversion: 2.1 time: 0.040303 Jun 18 22:37:00.990821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3011/6046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:00 2022] GET /compute/v2.1/servers/e432ab01-0dbc-44af-899e-511a822ad70c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:37:00.997945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:00.998905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:01.001833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:01.007759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:01.008347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:01.008991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:01.009469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:01.037195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:37:01.116916 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc428085-afb8-4bcf-9751-08174daaf158 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 204 len: 0 microversion: 2.1 time: 0.122897 Jun 18 22:37:01.117619 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3036/6047] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:37:00 2022] DELETE /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:37:01.126335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:01.126957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:01.133637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:01.134091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:01.134898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:01.135335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:01.150597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:01.190527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:01.191266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:01.200194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:01.200702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:01.201586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:01.202098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:01.304757 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d88d60c7-5dd8-4722-a0a6-f0e179c3519c tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1656 microversion: 2.1 time: 0.182140 Jun 18 22:37:01.305284 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3012/6048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:01 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:01.359119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:01.370505 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7bbeee25-58cb-402c-8227-ef02f99b8765 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.184252 Jun 18 22:37:01.371332 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3037/6049] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:01 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:37:02.322221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:02.322767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:02.330402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:02.330859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:02.331631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:02.332068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:02.388511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:02.389384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:02.396954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:02.397451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:02.398236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:02.398681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:02.494380 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f70c1bb1-d210-4329-a853-cf34e9cd4953 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1656 microversion: 2.1 time: 0.175934 Jun 18 22:37:02.497219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3013/6050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:02 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1656 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:02.553174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:02.561251 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9d26303-a589-4195-b9b0-ab49518ddd47 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.176741 Jun 18 22:37:02.561838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3038/6051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:02 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:03.223475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8f09ef3b-d58c-41fd-84ac-ff850702abae req-0a47bfbb-3fd2-486e-b21c-8783e28dbf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765de862-9044-4cc2-bf54-595764f83b09", "name": "network-vif-deleted", "tag": "207e35f2-adc1-4be7-bf97-e8f5bf12cf74"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:03.233080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8f09ef3b-d58c-41fd-84ac-ff850702abae req-0a47bfbb-3fd2-486e-b21c-8783e28dbf54 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:03.233559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8f09ef3b-d58c-41fd-84ac-ff850702abae req-0a47bfbb-3fd2-486e-b21c-8783e28dbf54 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:03.245299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8f09ef3b-d58c-41fd-84ac-ff850702abae req-0a47bfbb-3fd2-486e-b21c-8783e28dbf54 service nova] Creating event network-vif-deleted:207e35f2-adc1-4be7-bf97-e8f5bf12cf74 for instance 765de862-9044-4cc2-bf54-595764f83b09 on nch1-master-1 Jun 18 22:37:03.251458 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8f09ef3b-d58c-41fd-84ac-ff850702abae req-0a47bfbb-3fd2-486e-b21c-8783e28dbf54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031231 Jun 18 22:37:03.252138 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3014/6052] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:37:03.515431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:03.516072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:03.523263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:03.523726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:03.524505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:03.524948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:03.560089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:03.560526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:03.561011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lazy-loading 'fault' on Instance uuid 765de862-9044-4cc2-bf54-595764f83b09 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:37:03.584777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:03.585716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:03.594600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:03.595106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:03.596062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:03.596523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:03.615569 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a06d2f3d-def9-4ed9-937f-c87f5775ff9d tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 200 len: 1454 microversion: 2.1 time: 0.106219 Jun 18 22:37:03.625462 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3039/6053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:03 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:03.742719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:03.752394 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88e851fc-fa92-474c-ac1a-ca546f218885 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.172660 Jun 18 22:37:03.752971 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3015/6054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:03 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:04.636823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:04.637955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] [instance: 765de862-9044-4cc2-bf54-595764f83b09] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:04.652404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:04.653237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:04.654548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:04.655279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:04.669483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] HTTP exception thrown: Instance 765de862-9044-4cc2-bf54-595764f83b09 could not be found. Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Request method failure captured: Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 HTTP/1.1 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlNxtTXAVZoE-YnjQeyJu5yAOQWKna0wyoqDmPmMAMca8qZkKWbFMTnwcst6NsjZG8Gj8oX_H2hC6-4txUQdM_aZC60bLHFrBo9UJNf5jnb9fv2Jpj7pb_26GGyOE4YKMFECz4lnHuZaU50WBAPVGOuFkVC4kFQrYNE7b1n8VCJMYm0 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: ca621b1e751c47918695e53f52145438 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestServerMultinode-1988199090 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca621b1e751c47918695e53f52145438"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca621b1e751c47918695e53f52145438"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca621b1e751c47918695e53f52145438"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca621b1e751c47918695e53f52145438", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestServerMultinode-1988199090 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: ca621b1e751c47918695e53f52145438 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestServerMultinode-1988199090 Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestServerMultinode-1988199090-project-admin Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: ea832a701f7a4b5d9091c89f2829c0ea Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestServerMultinode-1988199090-project-admin Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 765de862-9044-4cc2-bf54-595764f83b09 could not be found. Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '765de862-9044-4cc2-bf54-595764f83b09'} Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765de862-9044-4cc2-bf54-595764f83b09 could not be found. Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765de862-9044-4cc2-bf54-595764f83b09 could not be found. Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:04.671266 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765de862-9044-4cc2-bf54-595764f83b09 could not be found. Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] Returning 404 to user: Instance 765de862-9044-4cc2-bf54-595764f83b09 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f405ac8f-d042-4a00-ad46-9255679541b4 tempest-TestServerMultinode-1988199090 tempest-TestServerMultinode-1988199090-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09" status: 404 len: 111 microversion: 2.1 time: 0.042359 Jun 18 22:37:04.675598 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3040/6055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:04 2022] GET /compute/v2.1/servers/765de862-9044-4cc2-bf54-595764f83b09 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:37:04.769704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:04.770291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:04.777847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:04.778381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:04.779255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:04.779761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:04.921872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:04.930027 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df807201-9a1e-4c26-96d6-43489eec8d27 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.164378 Jun 18 22:37:04.930606 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3016/6056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:04 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:05.947816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:05.948448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:05.955592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:05.956093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:05.957092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:05.957559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:06.102701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:06.111219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f75c40d-e66c-4445-ac7e-1b9852700a4b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.167579 Jun 18 22:37:06.112254 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3041/6057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:05 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:07.129933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:07.131387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:07.141630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:07.142057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:07.143211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:07.143930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:07.399660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:07.409023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ebaf0774-995a-4cce-a2af-7f488caf0a6d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.284427 Jun 18 22:37:07.409762 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3017/6058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:07 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:08.428020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:08.428762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:08.436884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:08.437512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:08.438489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:08.438946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:08.669331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:08.678441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a2eef4b8-7b97-45f3-81ba-72d70524dd29 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.255473 Jun 18 22:37:08.679101 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3042/6059] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:08 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:09.698873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:09.700420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:09.709076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:09.709805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:09.710981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:09.711575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:10.150094 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:10.161053 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba1ceced-90dc-420c-9a96-a348a11acc08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.468434 Jun 18 22:37:10.173513 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3018/6060] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:09 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:11.181649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:11.182309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:11.190001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:11.190470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:11.191280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:11.191745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:11.405783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:11.414188 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5409e7c7-b786-4f61-948c-f7822919ff45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1695 microversion: 2.1 time: 0.236638 Jun 18 22:37:11.424358 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3043/6061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:11 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1695 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:12.431702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:12.432370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:12.440062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:12.440635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:12.441561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:12.442062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:12.644328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:12.652585 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d230f80a-dbe1-44af-b302-8b15aac8e3b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1694 microversion: 2.1 time: 0.224813 Jun 18 22:37:12.653505 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3019/6062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:12 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:13.240504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d17ebdba-08fd-456e-a309-e2bd8c35bada req-4a999467-8198-49d4-9773-1da709a3dcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:13.251135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d17ebdba-08fd-456e-a309-e2bd8c35bada req-4a999467-8198-49d4-9773-1da709a3dcc5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:13.251617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d17ebdba-08fd-456e-a309-e2bd8c35bada req-4a999467-8198-49d4-9773-1da709a3dcc5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:13.275280 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d17ebdba-08fd-456e-a309-e2bd8c35bada req-4a999467-8198-49d4-9773-1da709a3dcc5 service nova] Creating event network-vif-unplugged:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch1-master-1 Jun 18 22:37:13.286112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-d17ebdba-08fd-456e-a309-e2bd8c35bada req-4a999467-8198-49d4-9773-1da709a3dcc5 service nova] Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:37:13.304301 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d17ebdba-08fd-456e-a309-e2bd8c35bada req-4a999467-8198-49d4-9773-1da709a3dcc5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.363045 Jun 18 22:37:13.304932 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3044/6063] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:37:13.671158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:13.671781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:13.679542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:13.680252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:13.681057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:13.681649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:13.829645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:13.837678 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-008b7744-f151-485e-ad14-d87ec2dda8c0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1694 microversion: 2.1 time: 0.170665 Jun 18 22:37:13.838274 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3020/6064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:13 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:14.861923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:14.863101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:14.873970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:14.874749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:14.875837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:14.876292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:15.015713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:15.023662 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5cb78c9-7369-464c-a752-6eb29e4e9f3c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1692 microversion: 2.1 time: 0.170686 Jun 18 22:37:15.024270 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3045/6065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:14 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:15.343653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c350b566-9bc0-4634-bd30-4769718132ed req-2072d04c-aeea-4f51-a0fd-536a32ac3156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:15.351074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:15.360537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c350b566-9bc0-4634-bd30-4769718132ed req-2072d04c-aeea-4f51-a0fd-536a32ac3156 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:15.360990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c350b566-9bc0-4634-bd30-4769718132ed req-2072d04c-aeea-4f51-a0fd-536a32ac3156 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:15.374453 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c350b566-9bc0-4634-bd30-4769718132ed req-2072d04c-aeea-4f51-a0fd-536a32ac3156 service nova] Creating event network-changed:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch1-master-1 Jun 18 22:37:15.380788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-c350b566-9bc0-4634-bd30-4769718132ed req-2072d04c-aeea-4f51-a0fd-536a32ac3156 service nova] Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:37:15.392275 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c350b566-9bc0-4634-bd30-4769718132ed req-2072d04c-aeea-4f51-a0fd-536a32ac3156 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055159 Jun 18 22:37:15.392881 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3021/6066] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:37:16.045080 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:16.046041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:16.055110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:16.055575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:16.056367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:16.056817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:16.202659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:16.211120 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-526b8d98-4580-41a1-a6ed-ba04e2c04b98 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1692 microversion: 2.1 time: 0.171780 Jun 18 22:37:16.211713 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3046/6067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:16 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:17.234388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:17.235565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:17.246490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:17.247244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:17.248508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:17.249278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:17.406526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:17.418334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e3a3277f-95bd-4073-a28f-1ae11e3492f7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1689 microversion: 2.1 time: 0.192359 Jun 18 22:37:17.419146 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3022/6068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:17 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:17.436456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:17.436978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:17.444202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:17.444663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:17.445472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:17.445919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:17.487004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:17.507692 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-023ca6b8-57ac-47f5-b576-bd121fb6f3f8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action" status: 204 len: 0 microversion: 2.1 time: 0.075056 Jun 18 22:37:17.508331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3047/6069] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:37:17 2022] POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:37:17.517522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:17.518139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:17.524886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:17.525369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:17.526156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:17.526604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:17.661107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:17.668964 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45d38d12-85cc-4ead-8602-80fc462bdb35 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1689 microversion: 2.1 time: 0.155817 Jun 18 22:37:17.669561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3023/6070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:17 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:18.688775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:18.689639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:18.696617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:18.697301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:18.698143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:18.698679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:18.850097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:18.858051 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-31dc4efd-6eff-4836-855f-83ab6811dba2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1681 microversion: 2.1 time: 0.175274 Jun 18 22:37:18.858626 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3048/6071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:18 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:20.656252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-575b25e0-896f-45ff-9c6f-ac30af4bb404 req-cf4907e2-83e2-446a-9c75-2081b5afae4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "name": "network-vif-plugged", "status": "completed", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:20.665574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-575b25e0-896f-45ff-9c6f-ac30af4bb404 req-cf4907e2-83e2-446a-9c75-2081b5afae4b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:20.666006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-575b25e0-896f-45ff-9c6f-ac30af4bb404 req-cf4907e2-83e2-446a-9c75-2081b5afae4b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:20.677936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-575b25e0-896f-45ff-9c6f-ac30af4bb404 req-cf4907e2-83e2-446a-9c75-2081b5afae4b service nova] Creating event network-vif-plugged:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch1-master-1 Jun 18 22:37:20.682848 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-575b25e0-896f-45ff-9c6f-ac30af4bb404 req-cf4907e2-83e2-446a-9c75-2081b5afae4b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030495 Jun 18 22:37:20.683439 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3024/6072] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:37:37.207401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:37.208114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:37.212061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:37.212957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:37.222624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:37.223067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:37.223957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:37.224406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:37.252187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:37:37.334849 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-058d3275-a4d5-4a53-97eb-6d7da0984b9a tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 204 len: 0 microversion: 2.1 time: 0.133604 Jun 18 22:37:37.335533 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3049/6073] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:37:37 2022] DELETE /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:37:37.342254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=7 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:37.343018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=65 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:37.347258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:37.347970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:37.355077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:37.355527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:37.356285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:37.356720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:37.495701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:37.504775 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f75636f-d708-4533-b6bd-26d5344ba8b0 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1730 microversion: 2.1 time: 0.164586 Jun 18 22:37:37.505488 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3025/6074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:37 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:38.527545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:38.528722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:38.540615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:38.541461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:38.542812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:38.543569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:38.688731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:38.696773 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-774e9b8d-667b-489d-be9a-2fcf011316c3 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1730 microversion: 2.1 time: 0.176470 Jun 18 22:37:38.697392 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3050/6075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:38 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:39.593833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0457a3b8-2121-42af-9aea-52beddd37f0a req-a7afec57-ee10-43dd-9f22-f5043cc6ff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2620ebeb-abd9-426e-9809-e6b47eb16073", "name": "network-vif-deleted", "tag": "4cc74021-ded5-444b-a48e-c1cd16fd92fe"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:39.603606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0457a3b8-2121-42af-9aea-52beddd37f0a req-a7afec57-ee10-43dd-9f22-f5043cc6ff4f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:39.604142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0457a3b8-2121-42af-9aea-52beddd37f0a req-a7afec57-ee10-43dd-9f22-f5043cc6ff4f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:39.616364 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0457a3b8-2121-42af-9aea-52beddd37f0a req-a7afec57-ee10-43dd-9f22-f5043cc6ff4f service nova] Creating event network-vif-deleted:4cc74021-ded5-444b-a48e-c1cd16fd92fe for instance 2620ebeb-abd9-426e-9809-e6b47eb16073 on nch2-master-1 Jun 18 22:37:39.621788 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0457a3b8-2121-42af-9aea-52beddd37f0a req-a7afec57-ee10-43dd-9f22-f5043cc6ff4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031860 Jun 18 22:37:39.623017 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3026/6076] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:37:39.859386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:39.860028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:39.866282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:39.866738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:39.867519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:39.867964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:39.900599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:39.901196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:39.901592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lazy-loading 'fault' on Instance uuid 2620ebeb-abd9-426e-9809-e6b47eb16073 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:37:39.945745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f228d958acdb4d769a59f019e4d41d6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf51848ad1c43ae997974ba2925ab4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:39.954997 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e306d7a9-434e-4078-b2eb-70f30a14b5a1 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 200 len: 1387 microversion: 2.1 time: 0.244655 Jun 18 22:37:39.955592 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3051/6077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:39 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 1387 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:40.974986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:40.975693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:40.982887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:40.983367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:40.984132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:40.984567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:40.998229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] HTTP exception thrown: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Request method failure captured: Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 HTTP/1.1 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlJ6Cr4jBcxxBDbZt6TeTcMCx69r99f_oY8iCrINk2D7gLEExmQmXza6npdCdP50NlLZ9h8QFw_rUpx-HWS1deKN3t7gI3tQMTC_ekFuZOSnYeJQ-OB8o0F9nQEIns8ESvF0WChdjV9Ob5kNjhdCnpuS4bFWiEtMhtlYY1ZzoYYkK8c Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1bf51848ad1c43ae997974ba2925ab4e Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1bf51848ad1c43ae997974ba2925ab4e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1bf51848ad1c43ae997974ba2925ab4e Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestServerBasicOps-1483857553-project Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: f228d958acdb4d769a59f019e4d41d6c Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestServerBasicOps-1483857553-project Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2620ebeb-abd9-426e-9809-e6b47eb16073'} Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:40.999863 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Returning 404 to user: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dc7d029e-0daf-496e-b308-e597f0699f74 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 404 len: 111 microversion: 2.1 time: 0.032224 Jun 18 22:37:41.004487 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3027/6078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:40 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:37:41.466593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:41.467239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:41.474517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:41.474988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:41.475774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:41.476232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:41.493335 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] HTTP exception thrown: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Request method failure captured: Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 HTTP/1.1 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlJ6Cr4jBcxxBDbZt6TeTcMCx69r99f_oY8iCrINk2D7gLEExmQmXza6npdCdP50NlLZ9h8QFw_rUpx-HWS1deKN3t7gI3tQMTC_ekFuZOSnYeJQ-OB8o0F9nQEIns8ESvF0WChdjV9Ob5kNjhdCnpuS4bFWiEtMhtlYY1ZzoYYkK8c Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 1bf51848ad1c43ae997974ba2925ab4e Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1bf51848ad1c43ae997974ba2925ab4e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 1bf51848ad1c43ae997974ba2925ab4e Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestServerBasicOps-1483857553-project Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: f228d958acdb4d769a59f019e4d41d6c Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestServerBasicOps-1483857553-project Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2620ebeb-abd9-426e-9809-e6b47eb16073'} Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:37:41.495051 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Returning 404 to user: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-947d367b-ade9-4483-8f63-e88b49be5fb2 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 404 len: 111 microversion: 2.1 time: 0.034086 Jun 18 22:37:41.498845 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3052/6079] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:37:41 2022] DELETE /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:37:41.508342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:41.509261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] [instance: 2620ebeb-abd9-426e-9809-e6b47eb16073] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:41.518336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:41.518801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:41.519580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:41.520025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:41.533828 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] HTTP exception thrown: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Request method failure captured: Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 HTTP/1.1 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlJ6Cr4jBcxxBDbZt6TeTcMCx69r99f_oY8iCrINk2D7gLEExmQmXza6npdCdP50NlLZ9h8QFw_rUpx-HWS1deKN3t7gI3tQMTC_ekFuZOSnYeJQ-OB8o0F9nQEIns8ESvF0WChdjV9Ob5kNjhdCnpuS4bFWiEtMhtlYY1ZzoYYkK8c Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 1bf51848ad1c43ae997974ba2925ab4e Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1bf51848ad1c43ae997974ba2925ab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1bf51848ad1c43ae997974ba2925ab4e", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 1bf51848ad1c43ae997974ba2925ab4e Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestServerBasicOps-1483857553 Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestServerBasicOps-1483857553-project Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: f228d958acdb4d769a59f019e4d41d6c Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestServerBasicOps-1483857553-project Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2620ebeb-abd9-426e-9809-e6b47eb16073'} Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:37:41.535433 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Returning 404 to user: Instance 2620ebeb-abd9-426e-9809-e6b47eb16073 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fac13255-ac61-4c2f-8e0f-970a59a137a6 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073" status: 404 len: 111 microversion: 2.1 time: 0.034738 Jun 18 22:37:41.540658 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3028/6080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:41 2022] GET /compute/v2.1/servers/2620ebeb-abd9-426e-9809-e6b47eb16073 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:37:41.721393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0b8b36f9-92bb-42c1-8e87-1074655c6df8 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] Calling method '.version_select at 0x7fea078a7940>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:41.743466 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0b8b36f9-92bb-42c1-8e87-1074655c6df8 tempest-TestServerBasicOps-1483857553 tempest-TestServerBasicOps-1483857553-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1315825765" status: 202 len: 0 microversion: 2.1 time: 0.025962 Jun 18 22:37:41.744300 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3053/6081] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 22:37:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1315825765 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:37:51.116414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:51.117430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:51.124761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:51.125242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:51.126011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:51.126443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:51.177176 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-313aafb1-1778-4a68-bdee-b1b3d4611de6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action" status: 200 len: 24580 microversion: 2.1 time: 0.067048 Jun 18 22:37:51.177746 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3029/6082] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:37:51 2022] POST /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e/action => generated 24580 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:37:55.611394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1881175729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1425479607", "security_groups": [{"name": "tempest-secgroup-smoke-1119156546"}], "block_device_mapping_v2": [{"uuid": "81059721-112c-4cd1-a6b2-1e2725e20fb5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:55.621345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:55.622006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:37:55.734049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] validate_networks() for [('b311ae34-3f0b-41a5-a3ac-ed8735a3e5e1', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:37:56.232106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:37:56.232810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:37:56.233578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:37:56.234140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:37:56.234768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:37:56.247192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:56.247618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:56.248483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:56.248936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:56.266825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:37:56.272946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Getting quotas for user 406628da7a8140fd83200ffc90e71198 and project 2d7a59e0743a480c9af66dea984113c6. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:37:56.332513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:37:56.334694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81059721-112c-4cd1-a6b2-1e2725e20fb5',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:37:56.472340 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ba3dbdb2-931b-4d97-9630-b008fc0bec01 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864867 Jun 18 22:37:56.472990 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3054/6083] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:37:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:37:56.483850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba7e69ee-3b75-4c96-b46c-c2868132b37b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:56.484507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba7e69ee-3b75-4c96-b46c-c2868132b37b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:56.543320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba7e69ee-3b75-4c96-b46c-c2868132b37b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:56.552467 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba7e69ee-3b75-4c96-b46c-c2868132b37b tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1095 microversion: 2.1 time: 0.072766 Jun 18 22:37:56.553305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3030/6084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:56 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:57.570982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:57.571715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:57.579224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:57.579997 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:57.581158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:57.581660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:57.648578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:57.657459 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-11736934-ea2f-4752-a775-b9a2752a9edd tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1211 microversion: 2.1 time: 0.091484 Jun 18 22:37:57.658037 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3055/6085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:57 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:58.675220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:58.676021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:58.683588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:58.684164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:58.685116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:58.685675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:58.837940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:37:58.846098 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-967473ee-e385-475f-a2c6-11bed95caf46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1279 microversion: 2.1 time: 0.175126 Jun 18 22:37:58.847007 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3031/6086] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:58 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:37:59.184884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-144d5431-be2a-41c7-bd35-bfe09f66eff6 req-c49409ac-441b-45ae-bde5-9c4bd4394869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62485bd2-559c-4d24-9290-b39fd3b44a25", "tag": "6e182200-6208-42f9-809a-edbf81df2f01"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:37:59.207970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-144d5431-be2a-41c7-bd35-bfe09f66eff6 req-c49409ac-441b-45ae-bde5-9c4bd4394869 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:59.208399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-144d5431-be2a-41c7-bd35-bfe09f66eff6 req-c49409ac-441b-45ae-bde5-9c4bd4394869 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:59.222596 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-144d5431-be2a-41c7-bd35-bfe09f66eff6 req-c49409ac-441b-45ae-bde5-9c4bd4394869 service nova] Creating event network-changed:6e182200-6208-42f9-809a-edbf81df2f01 for instance 62485bd2-559c-4d24-9290-b39fd3b44a25 on nch2-master-1 Jun 18 22:37:59.227797 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-144d5431-be2a-41c7-bd35-bfe09f66eff6 req-c49409ac-441b-45ae-bde5-9c4bd4394869 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047349 Jun 18 22:37:59.228637 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3056/6087] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:37:59.863125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:37:59.863761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:37:59.871795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:59.872248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:37:59.872989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:37:59.873743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:00.008244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:00.019898 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-949a4961-f98a-47bb-8615-fa4be3b59490 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.160408 Jun 18 22:38:00.020647 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3032/6088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:37:59 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:01.044160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:01.045231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:01.053129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:01.053590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:01.054390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:01.054844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:01.210351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:01.221295 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10ba9b0a-2d1f-40fd-b3be-2f3bf9d11960 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.185405 Jun 18 22:38:01.222150 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3057/6089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:01 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:02.244262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:02.245021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:02.255598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:02.256130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:02.257086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:02.257636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:02.401606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:02.409463 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-45ea6f4c-3781-4765-82bf-b24c87a3fc1d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.171931 Jun 18 22:38:02.410072 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3033/6090] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:02 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:03.431419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:03.432347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:03.444184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:03.444948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:03.446321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:03.447125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:03.585779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:03.593699 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0ef66f76-2424-4aaa-8851-9dc4c267259f tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.169463 Jun 18 22:38:03.594308 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3058/6091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:03 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:04.615147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:04.616160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:04.624799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:04.625290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:04.626060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:04.626497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:04.770445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:04.778685 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-baaa7a75-0638-4c8f-83ee-07dc42bf0fc7 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.170201 Jun 18 22:38:04.779283 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3034/6092] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:04 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:05.804277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:05.804901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:05.812135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:05.812590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:05.813390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:05.813823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:05.864613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dab3231b-40ea-435f-99f4-d8b345db92f8 req-6ad3ec04-1a5e-44c0-aaee-ac5ad9849afc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62485bd2-559c-4d24-9290-b39fd3b44a25", "name": "network-vif-plugged", "status": "completed", "tag": "6e182200-6208-42f9-809a-edbf81df2f01"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:05.873013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dab3231b-40ea-435f-99f4-d8b345db92f8 req-6ad3ec04-1a5e-44c0-aaee-ac5ad9849afc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:05.873605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dab3231b-40ea-435f-99f4-d8b345db92f8 req-6ad3ec04-1a5e-44c0-aaee-ac5ad9849afc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:05.884765 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dab3231b-40ea-435f-99f4-d8b345db92f8 req-6ad3ec04-1a5e-44c0-aaee-ac5ad9849afc service nova] Creating event network-vif-plugged:6e182200-6208-42f9-809a-edbf81df2f01 for instance 62485bd2-559c-4d24-9290-b39fd3b44a25 on nch2-master-1 Jun 18 22:38:05.889853 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dab3231b-40ea-435f-99f4-d8b345db92f8 req-6ad3ec04-1a5e-44c0-aaee-ac5ad9849afc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164650 Jun 18 22:38:05.890446 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3059/6093] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:05.948042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:05.955926 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-20334861-3789-48b8-94ba-8c6878a487f1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.163769 Jun 18 22:38:05.956494 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3035/6094] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:05 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:06.970971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:06.972364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:06.977663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:06.978388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:06.986736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:06.987198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:06.987984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:06.988432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:07.136816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:07.148487 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ac83231-33d5-467d-bee1-c5f37ad7d782 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1267 microversion: 2.1 time: 0.178698 Jun 18 22:38:07.149101 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3060/6095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:06 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:07.392479 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:07.393443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:07.400097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:07.401930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=25 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:07.407872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:07.408341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:07.409152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:07.409582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:07.412328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=47 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:07.552762 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8e16619c-8458-4a4d-87b8-12c7091dfd8f tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1832 microversion: 2.1 time: 0.165918 Jun 18 22:38:07.553433 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3036/6096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:07 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1832 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:08.170084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:08.170699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:08.178905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.179383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.180188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.180646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.320068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:08.328038 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b95c4513-be95-4cee-ae57-2b12ba2a5b46 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1455 microversion: 2.1 time: 0.162312 Jun 18 22:38:08.328634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3061/6097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:08 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:08.344533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:08.345231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:08.351486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.351938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.352719 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.353205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.454345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:08.454871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:08.461112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.461745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.462860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.463381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.489507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:38:08.500648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:08.508589 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-63320e84-c3db-4df2-a02e-e61d945ccac0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1455 microversion: 2.1 time: 0.168002 Jun 18 22:38:08.509209 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3037/6098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:08 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:38:08.514061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-38e5c577-4a3b-4d8c-876f-26994b5b832e req-48a4a113-8837-4732-9de5-e66f2c760eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:08.522800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38e5c577-4a3b-4d8c-876f-26994b5b832e req-48a4a113-8837-4732-9de5-e66f2c760eee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.523409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38e5c577-4a3b-4d8c-876f-26994b5b832e req-48a4a113-8837-4732-9de5-e66f2c760eee service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.540762 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-38e5c577-4a3b-4d8c-876f-26994b5b832e req-48a4a113-8837-4732-9de5-e66f2c760eee service nova] Creating event network-changed:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch1-master-1 Jun 18 22:38:08.548396 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-38e5c577-4a3b-4d8c-876f-26994b5b832e req-48a4a113-8837-4732-9de5-e66f2c760eee service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037525 Jun 18 22:38:08.549857 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3038/6099] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:08.603238 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd9a75f3-209f-45c8-99bc-4cfb2b696ed0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 204 len: 0 microversion: 2.1 time: 0.151591 Jun 18 22:38:08.605148 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3062/6100] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:38:08 2022] DELETE /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:38:08.615279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:08.616522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:08.627811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.628356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.629239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:08.629946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:08.779295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:08.787194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7cd913e2-0cbe-48a2-9960-5fff6895c308 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1687 microversion: 2.1 time: 0.177307 Jun 18 22:38:08.789081 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3039/6101] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:08 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:09.806430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:09.807319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:09.815001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:09.815501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:09.816296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:09.816802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:09.965516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:09.973578 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b5cfb7c-d3cf-4cd9-a908-c365af2d23a7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1687 microversion: 2.1 time: 0.171453 Jun 18 22:38:09.974156 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3063/6102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:09 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:10.991499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:10.992726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:11.000015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:11.000501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:11.001320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:11.001768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:11.145221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:11.154783 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b89d4278-7020-405a-a383-e6aa509b5715 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 200 len: 1569 microversion: 2.1 time: 0.167446 Jun 18 22:38:11.164298 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3040/6103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:10 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:11.184340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0d0ee6ac-1b07-4ec3-b836-9a97deb991f2 req-2dd83428-1363-456b-916a-f1582c87a26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62485bd2-559c-4d24-9290-b39fd3b44a25", "tag": "6e182200-6208-42f9-809a-edbf81df2f01"}, {"server_uuid": "d7356f3e-e8e4-44c9-9a81-c6d3685e223e", "name": "network-vif-deleted", "tag": "1e1432e4-0a9b-4326-be92-07e9344baedc"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:11.195237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d0ee6ac-1b07-4ec3-b836-9a97deb991f2 req-2dd83428-1363-456b-916a-f1582c87a26c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:11.195704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d0ee6ac-1b07-4ec3-b836-9a97deb991f2 req-2dd83428-1363-456b-916a-f1582c87a26c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:11.211157 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0d0ee6ac-1b07-4ec3-b836-9a97deb991f2 req-2dd83428-1363-456b-916a-f1582c87a26c service nova] Creating event network-changed:6e182200-6208-42f9-809a-edbf81df2f01 for instance 62485bd2-559c-4d24-9290-b39fd3b44a25 on nch2-master-1 Jun 18 22:38:11.211961 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0d0ee6ac-1b07-4ec3-b836-9a97deb991f2 req-2dd83428-1363-456b-916a-f1582c87a26c service nova] Creating event network-vif-deleted:1e1432e4-0a9b-4326-be92-07e9344baedc for instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e on nch1-master-1 Jun 18 22:38:11.220501 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0d0ee6ac-1b07-4ec3-b836-9a97deb991f2 req-2dd83428-1363-456b-916a-f1582c87a26c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040204 Jun 18 22:38:11.221146 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3064/6104] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:12.172668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:12.173448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: d7356f3e-e8e4-44c9-9a81-c6d3685e223e] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:12.181887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:12.182363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:12.183340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:12.183779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:12.202474 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] HTTP exception thrown: Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e could not be found. Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Request method failure captured: Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e HTTP/1.1 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlNK8kBbJlOrOviubSLMuJzQnk_R8C6z0pQt_xqItqZ5xvK1KTyKwLEjZimOuX84aZbR2EK_ASTrQnR4s5fWBZjZYqmM6qLf5DYpzT4CJa9bvhJxdVD_ZCtDzGIpRXSLmgqPKNV2PzmnEzo6nhSrv33rPmRWzkNU-xTrxteIFycCu_0 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91c64dd112fa4f7c89b2f07494e6be49", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: f1b184b4aef04efc8996eff7af43dadb Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e could not be found. Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd7356f3e-e8e4-44c9-9a81-c6d3685e223e'} Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e could not be found. Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e could not be found. Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:38:12.204184 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e could not be found. Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Returning 404 to user: Instance d7356f3e-e8e4-44c9-9a81-c6d3685e223e could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-50582b21-f6de-43d5-9b2c-d47ef30c4ddd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e" status: 404 len: 111 microversion: 2.1 time: 0.037743 Jun 18 22:38:12.208224 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3041/6105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:12 2022] GET /compute/v2.1/servers/d7356f3e-e8e4-44c9-9a81-c6d3685e223e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:38:15.772048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62f3b783-4d26-49f1-874c-37ba3da2f9a8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '.version_select at 0x7fea19bd5700>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:15.792470 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62f3b783-4d26-49f1-874c-37ba3da2f9a8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2090336258" status: 202 len: 0 microversion: 2.1 time: 0.026734 Jun 18 22:38:15.792890 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3065/6106] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Jun 18 22:38:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2090336258 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:38:15.823460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-82a597b5-3d39-4084-a93f-97226f91b7d8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: .version_select at 0x7fea19dac670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1498876109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvh4o51v27GMWsuSnH1sHSvYO0BqX0mHAfAwcpIkM/23kSzVn3NIGcoEHHGdMjUSD7Leb2BKBeTK2MjQZ6KtpFJcFA2S8fGGwW2fJd0iSbTGsjL4CFhoQERs18T24ju0g=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:15.839298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-82a597b5-3d39-4084-a93f-97226f91b7d8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:38:15.845556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-82a597b5-3d39-4084-a93f-97226f91b7d8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:38:15.871569 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-82a597b5-3d39-4084-a93f-97226f91b7d8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052106 Jun 18 22:38:15.872176 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3042/6107] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:38:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:21.628156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:21.635167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-471598676", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "08969fdc-ad8a-46d7-82af-0a25c3da580c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1498876109", "security_groups": [{"name": "tempest-secgroup-smoke-2039114452"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:21.762176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] validate_networks() for [('08969fdc-ad8a-46d7-82af-0a25c3da580c', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:38:22.180718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:38:22.181369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:38:22.181925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:38:22.182359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:38:22.182788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:38:22.192160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:22.192624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:22.193481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:22.193933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:22.211833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:38:22.217500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:38:22.231070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:38:22.233510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:38:22.282480 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34a5902e-342e-4621-a748-7e3fcb57b1d5 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656262 Jun 18 22:38:22.283491 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3066/6108] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:38:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:38:22.292506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=27 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:22.299703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92d55b1c-428c-4239-a33e-a33f52c4310a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:22.307671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92d55b1c-428c-4239-a33e-a33f52c4310a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:22.378127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92d55b1c-428c-4239-a33e-a33f52c4310a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:22.387477 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92d55b1c-428c-4239-a33e-a33f52c4310a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1266 microversion: 2.1 time: 0.097279 Jun 18 22:38:22.388062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3043/6109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:22 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:23.406459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:23.408108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:23.419754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:23.420705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:23.421929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:23.422791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:23.512694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:23.521381 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-76434f1d-3e06-447d-b770-2d2427e4a3e6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1324 microversion: 2.1 time: 0.120695 Jun 18 22:38:23.523477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3067/6110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:23 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1324 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:24.540831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:24.542286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:24.549354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:24.551527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:24.552645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:24.553134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:24.759409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:24.768998 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc5c5b1f-3406-4c1e-854d-65912b02b2bd tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.232222 Jun 18 22:38:24.779897 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3044/6111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:24 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:24.993611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-541f452b-2a2d-4f35-ba90-738feec78c00 req-3725589f-e96f-49fb-b16b-44535e0a37fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:25.007095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-541f452b-2a2d-4f35-ba90-738feec78c00 req-3725589f-e96f-49fb-b16b-44535e0a37fc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:25.008206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-541f452b-2a2d-4f35-ba90-738feec78c00 req-3725589f-e96f-49fb-b16b-44535e0a37fc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:25.031932 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-541f452b-2a2d-4f35-ba90-738feec78c00 req-3725589f-e96f-49fb-b16b-44535e0a37fc service nova] Creating event network-changed:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:38:25.042675 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-541f452b-2a2d-4f35-ba90-738feec78c00 req-3725589f-e96f-49fb-b16b-44535e0a37fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054161 Jun 18 22:38:25.043302 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3068/6112] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:25.786728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:25.787687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:25.796488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:25.796961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:25.797908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:25.798354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:25.982068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:25.990438 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6aaae6fb-c878-4f23-b8f8-26320acc4aa2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.208052 Jun 18 22:38:25.991059 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3045/6113] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:25 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:27.008435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:27.009272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:27.011504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:27.017403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:27.017876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:27.018679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:27.019135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:27.161436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:27.169522 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-76234a23-e5a1-4afe-bf7d-ebefa1a78227 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.166287 Jun 18 22:38:27.170715 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3069/6114] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:27 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:28.196224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:28.197308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:28.205689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:28.206156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:28.206939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:28.207383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:28.348073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:28.356197 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0caacbf3-d36e-475e-ba1a-6df023b7406c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.166721 Jun 18 22:38:28.356776 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3046/6115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:28 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:29.375921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:29.376819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:29.384427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:29.384897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:29.385758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:29.386202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:29.524644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:29.532567 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b5c203e-f0e5-47fc-8555-f56d86e2843f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.162430 Jun 18 22:38:29.533092 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3070/6116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:29 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:30.553002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:30.553917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:30.563709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:30.564161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:30.564931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:30.565396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:30.714828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:30.724445 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18cfac2d-4540-4e99-b6c8-87af0cda8a53 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.177444 Jun 18 22:38:30.725065 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3047/6117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:30 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:30.972203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3f34651b-dcb1-43c1-9bc4-6e44c31bd9be req-bf558da9-9205-4eda-ad4c-1d8367f0a218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "name": "network-vif-plugged", "status": "completed", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:30.981745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3f34651b-dcb1-43c1-9bc4-6e44c31bd9be req-bf558da9-9205-4eda-ad4c-1d8367f0a218 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:30.982206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3f34651b-dcb1-43c1-9bc4-6e44c31bd9be req-bf558da9-9205-4eda-ad4c-1d8367f0a218 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:30.994743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3f34651b-dcb1-43c1-9bc4-6e44c31bd9be req-bf558da9-9205-4eda-ad4c-1d8367f0a218 service nova] Creating event network-vif-plugged:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:38:31.000038 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3f34651b-dcb1-43c1-9bc4-6e44c31bd9be req-bf558da9-9205-4eda-ad4c-1d8367f0a218 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031688 Jun 18 22:38:31.000871 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3071/6118] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:31.743018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:31.743685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:31.751880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:31.752350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:31.753178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:31.753629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:31.895584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:31.903279 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-459bb6de-e5dc-4180-82d3-1e3cb53ff0f4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1392 microversion: 2.1 time: 0.164662 Jun 18 22:38:31.912994 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3048/6119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:31 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:32.918284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:32.919239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:32.923506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:32.924117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:32.931851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:32.932331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:32.933144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:32.933592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:33.088027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:33.096125 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f892e404-fb56-45b2-abde-c7a3ea4959b2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1563 microversion: 2.1 time: 0.179831 Jun 18 22:38:33.098879 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3072/6120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:32 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:38:33.113634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:33.114670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:33.116786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:38:33.123478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:33.124028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:33.124813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:33.125338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:33.272151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:33.280430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-219db1f2-ffdf-4f05-96d4-55ae6ed0fac6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1563 microversion: 2.1 time: 0.170855 Jun 18 22:38:33.281375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3049/6121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:33 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:38:35.378024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:38:35.379508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:38:35.381518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6997289f-7a3e-4e5e-9f9b-2b1e79d94d07 req-c521a117-ad99-4090-a5c5-68533b366a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:38:35.387386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:35.387848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:35.388647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:35.389277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:35.394097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6997289f-7a3e-4e5e-9f9b-2b1e79d94d07 req-c521a117-ad99-4090-a5c5-68533b366a3d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:38:35.394554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6997289f-7a3e-4e5e-9f9b-2b1e79d94d07 req-c521a117-ad99-4090-a5c5-68533b366a3d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:38:35.408440 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6997289f-7a3e-4e5e-9f9b-2b1e79d94d07 req-c521a117-ad99-4090-a5c5-68533b366a3d service nova] Creating event network-changed:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:38:35.414776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6997289f-7a3e-4e5e-9f9b-2b1e79d94d07 req-c521a117-ad99-4090-a5c5-68533b366a3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037361 Jun 18 22:38:35.416046 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3050/6122] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:38:35.541999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:38:35.555561 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1c5b5b0a-6a74-4e8e-83da-04566604a053 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1563 microversion: 2.1 time: 0.181671 Jun 18 22:38:35.566994 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3073/6123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:38:35 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:06.873236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:06.873970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=38 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:06.878655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:06.879686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:06.887720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:06.888173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:06.888952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:06.889416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:06.941566 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65465c71-8893-4ac6-895a-b19387f06a37 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action" status: 200 len: 24569 microversion: 2.1 time: 0.070293 Jun 18 22:39:06.942216 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3051/6124] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:39:06 2022] POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action => generated 24569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:39:34.938420 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:39:34.939449 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 22:39:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:39:37.385862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=9 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:37.387092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=36 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:37.393412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:37.394352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:37.405522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:37.406298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:37.407593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:37.408342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:37.552210 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5a8013b6-68b2-4b9e-a982-ae5f929a41d0 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1833 microversion: 2.1 time: 0.169733 Jun 18 22:39:37.553202 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3074/6125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:37 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1833 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:37.570881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:37.571617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:37.574136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:37.574760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:37.581321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:37.581772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:37.582532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:37.582969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:37.726779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:37.738089 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ceb2be2d-f643-49d9-8dcc-d11ae6b7e86f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1682 microversion: 2.1 time: 0.171869 Jun 18 22:39:37.738834 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3052/6126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:37 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:37.837422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:37.838432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:37.844851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:37.845409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:37.846197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:37.846656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:37.895837 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bbd0e66-1e77-4b87-b4e3-b1dfa5b58ca3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action" status: 200 len: 32632 microversion: 2.1 time: 0.062414 Jun 18 22:39:37.896589 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3075/6127] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:39:37 2022] POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action => generated 32632 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:39:38.093951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:38.094701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:38.103369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:38.103827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:38.104598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:38.105054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:38.135982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8701ca4ee934249b5071bf8c8069d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f16bccc6b4dcbac155f125226ca8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:38.136569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] flavor_id is None. Assuming migration. {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 18 22:39:38.137016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:39:38.261206 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ac59ea55-1537-4de2-a65b-58c2f55b47f4 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action" status: 202 len: 0 microversion: 2.1 time: 0.172781 Jun 18 22:39:38.261809 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3053/6128] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:39:38 2022] POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:39:38.270621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:38.271431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:38.278792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:38.279252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:38.280062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:38.280798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:38.453145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:38.462255 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55626d4d-0a03-4f1c-82d2-0a7b69dc2b0c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1691 microversion: 2.1 time: 0.195887 Jun 18 22:39:38.463014 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3076/6129] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:38 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1691 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:39.481459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:39.482042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:39.490995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:39.491554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:39.492343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:39.492790 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:39.648925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:39.656930 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1aa660e3-ca9a-44f2-9426-4b144d2d601d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1691 microversion: 2.1 time: 0.180557 Jun 18 22:39:39.658102 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3054/6130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:39 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:40.678573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:40.679172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:40.690471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:40.690935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:40.691731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:40.692182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:40.823431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:40.831543 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e2c51ec8-7ac0-4701-9ed1-4b3ed23be913 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.159417 Jun 18 22:39:40.832135 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3077/6131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:40 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:41.853445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:41.854465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:41.866309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:41.867069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:41.868397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:41.869137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:42.016130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:42.025820 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14e332b4-2460-4f90-b656-0dfacc877143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.179196 Jun 18 22:39:42.026397 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3055/6132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:41 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:43.046982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:43.048425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:43.057567 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:43.058348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:43.059182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:43.059637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:43.204293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:43.212780 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-568f44e1-22cb-45d5-b4c7-0b886affdf79 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.172382 Jun 18 22:39:43.213352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3078/6133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:43 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:44.230927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:44.231539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:44.239215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:44.239662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:44.240423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:44.240852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:44.389423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:44.398243 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b6be9cc1-acb0-4b3a-9de2-c05d52854b76 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.171263 Jun 18 22:39:44.398865 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3056/6134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:44 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:45.420454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:45.421008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:45.430929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:45.431406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:45.432196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:45.432648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:45.574658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:45.583233 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a33bbf2b-5b85-48a6-b79c-11a2a7775474 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.168912 Jun 18 22:39:45.583847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3079/6135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:45 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:46.603522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:46.604130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:46.611683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:46.612135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:46.612921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:46.613396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:46.759008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:46.767036 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80eadfef-a30b-46ef-97d3-f9f89d90956e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.168343 Jun 18 22:39:46.767611 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3057/6136] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:46 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:47.787006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:47.788125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:47.795465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:47.795924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:47.796705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:47.797182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:47.940075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:47.948212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-57d18e7f-31d6-4592-ba6a-ec7a6f815b6e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.166269 Jun 18 22:39:47.948788 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3080/6137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:47 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:48.970555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:48.971585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:48.983087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:48.983844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:48.985187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:48.985933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:49.126646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:49.138915 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2bd2795f-6cfb-402b-92d9-d00748cf1a1a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.175034 Jun 18 22:39:49.139655 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3058/6138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:48 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:50.158711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:50.159320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:50.167390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.167860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.168668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.169164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.312840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:50.320959 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4a3b9396-0de7-4b44-a045-3f40ffa77029 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.168166 Jun 18 22:39:50.321596 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3081/6139] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:50 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:50.676669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:50.677237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:50.685346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.686042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.686313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7057fb1f-98b3-45ae-a866-a2928e5ecece req-7c3a6105-f04b-4e4c-815b-c9b319999ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62485bd2-559c-4d24-9290-b39fd3b44a25", "tag": "6e182200-6208-42f9-809a-edbf81df2f01"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:50.686835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.687305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.694893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7057fb1f-98b3-45ae-a866-a2928e5ecece req-7c3a6105-f04b-4e4c-815b-c9b319999ba4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.695557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7057fb1f-98b3-45ae-a866-a2928e5ecece req-7c3a6105-f04b-4e4c-815b-c9b319999ba4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.707981 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7057fb1f-98b3-45ae-a866-a2928e5ecece req-7c3a6105-f04b-4e4c-815b-c9b319999ba4 service nova] Creating event network-changed:6e182200-6208-42f9-809a-edbf81df2f01 for instance 62485bd2-559c-4d24-9290-b39fd3b44a25 on nch2-master-1 Jun 18 22:39:50.713592 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7057fb1f-98b3-45ae-a866-a2928e5ecece req-7c3a6105-f04b-4e4c-815b-c9b319999ba4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031322 Jun 18 22:39:50.714179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3082/6140] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:39:50.714324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:39:50.799763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3a4012fe-efa5-4210-bf8e-4e532c526757 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 204 len: 0 microversion: 2.1 time: 0.126787 Jun 18 22:39:50.800925 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3059/6141] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:39:50 2022] DELETE /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:39:50.811877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:50.812959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:50.821606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.822340 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.823155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:50.823615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:50.970931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:50.978889 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16106dc0-3691-4951-8abb-e08d6a5f6dc2 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1579 microversion: 2.1 time: 0.172829 Jun 18 22:39:50.979449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3083/6142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:50 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1579 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:51.339291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:51.340037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:51.346660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:51.347122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:51.347904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:51.348417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:51.490575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:51.499500 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-953d5a84-b106-4773-97e1-a297688b6cf0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1696 microversion: 2.1 time: 0.164603 Jun 18 22:39:51.500212 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3060/6143] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:51 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:51.996240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:51.996840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:52.004240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:52.005156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:52.005639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:52.006560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:52.145122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:52.153320 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5f9d0efe-bcc4-4f17-88eb-0e01e810c612 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1579 microversion: 2.1 time: 0.161037 Jun 18 22:39:52.163927 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3084/6144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:51 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:52.517566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:52.518177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:52.526303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:52.526771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:52.527575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:52.528020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:52.675334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:52.684533 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4c24fa60-140d-48ec-9ac6-76b8d8b38782 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1695 microversion: 2.1 time: 0.170602 Jun 18 22:39:52.685257 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3061/6145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:52 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:53.170517 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:53.171184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:53.178742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:53.179334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:53.180153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:53.180665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:53.236047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-32b34ba5-8206-49c9-a2b6-ca9a867db2a8 req-f20db1b4-daae-4489-92f8-7aac4ba59b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "name": "network-vif-unplugged", "status": "completed", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:53.250592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-32b34ba5-8206-49c9-a2b6-ca9a867db2a8 req-f20db1b4-daae-4489-92f8-7aac4ba59b8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:53.253371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-32b34ba5-8206-49c9-a2b6-ca9a867db2a8 req-f20db1b4-daae-4489-92f8-7aac4ba59b8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:53.275229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-32b34ba5-8206-49c9-a2b6-ca9a867db2a8 req-f20db1b4-daae-4489-92f8-7aac4ba59b8d service nova] Creating event network-vif-unplugged:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch2-master-1 Jun 18 22:39:53.280994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-32b34ba5-8206-49c9-a2b6-ca9a867db2a8 req-f20db1b4-daae-4489-92f8-7aac4ba59b8d service nova] Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:39:53.298671 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-32b34ba5-8206-49c9-a2b6-ca9a867db2a8 req-f20db1b4-daae-4489-92f8-7aac4ba59b8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066550 Jun 18 22:39:53.299850 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3062/6146] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:39:53.357364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:53.365924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-72a6fa79-af81-4370-856c-a20105c95cdb tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 200 len: 1461 microversion: 2.1 time: 0.199522 Jun 18 22:39:53.367162 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3085/6147] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:53 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 1461 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:53.704323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:53.705301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:53.715516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:53.715971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:53.716751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:53.717223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:53.871981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:53.881301 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08782b68-66ff-4dbe-a27a-d34aa581abab tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1695 microversion: 2.1 time: 0.182081 Jun 18 22:39:53.882291 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3063/6148] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:53 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:54.385377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:54.386022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 62485bd2-559c-4d24-9290-b39fd3b44a25] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:54.393590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:54.394062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:54.394867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:54.395324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:54.409674 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 62485bd2-559c-4d24-9290-b39fd3b44a25 could not be found. Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 HTTP/1.1 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 62485bd2-559c-4d24-9290-b39fd3b44a25 could not be found. Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '62485bd2-559c-4d24-9290-b39fd3b44a25'} Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62485bd2-559c-4d24-9290-b39fd3b44a25 could not be found. Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62485bd2-559c-4d24-9290-b39fd3b44a25 could not be found. Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:39:54.412804 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62485bd2-559c-4d24-9290-b39fd3b44a25 could not be found. Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 62485bd2-559c-4d24-9290-b39fd3b44a25 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-474aa406-9c9f-4100-b028-566edd7f136d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25" status: 404 len: 111 microversion: 2.1 time: 0.034411 Jun 18 22:39:54.417275 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3086/6149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:54 2022] GET /compute/v2.1/servers/62485bd2-559c-4d24-9290-b39fd3b44a25 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:39:54.899508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:54.900229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:54.907467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:54.908003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:54.908858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:54.909332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:55.046925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:55.054754 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5dcdcf61-09a2-4ebb-b5b0-072d56d33f26 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1693 microversion: 2.1 time: 0.159394 Jun 18 22:39:55.055359 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3064/6150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:54 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:55.322237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62485bd2-559c-4d24-9290-b39fd3b44a25", "name": "network-vif-deleted", "tag": "6e182200-6208-42f9-809a-edbf81df2f01"}, {"name": "network-changed", "server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:55.331727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:55.332186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:55.345751 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] Creating event network-vif-deleted:6e182200-6208-42f9-809a-edbf81df2f01 for instance 62485bd2-559c-4d24-9290-b39fd3b44a25 on nch2-master-1 Jun 18 22:39:55.346278 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] Creating event network-changed:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch2-master-1 Jun 18 22:39:55.352078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:39:55.364671 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-08027dd2-8c02-4120-bb0b-2742ab785c8e req-88a466e2-173f-43a0-a480-718acdf7b09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046897 Jun 18 22:39:55.365299 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3087/6151] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:39:56.073846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:56.074553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:56.082262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:56.082716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:56.083680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:56.084341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:56.103991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:39:56.232746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:56.240718 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-620a3338-4bcd-4eaa-8952-5c965a146c9e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1690 microversion: 2.1 time: 0.171592 Jun 18 22:39:56.241375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3065/6152] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:56 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:56.260319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:39:56.260949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:56.275741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:56.276211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:56.277015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:56.278025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:56.400776 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb2f37c3-097f-401e-86e1-e1db9ce5162c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action" status: 202 len: 0 microversion: 2.1 time: 0.146722 Jun 18 22:39:56.401480 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3088/6153] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:39:56 2022] POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:39:56.409713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:56.410366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:56.417183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:56.417655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:56.418574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:56.419014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:56.557069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:56.565548 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-693c6396-9a47-48d4-a29b-7c507a567f40 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.159605 Jun 18 22:39:56.566130 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3066/6154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:56 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:57.588381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:57.589602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:57.604715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:57.605214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:57.606192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:57.606648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:57.758599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:57.766478 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65b963b1-9f46-4541-a33c-bd46e97be02a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.185328 Jun 18 22:39:57.767038 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3089/6155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:57 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:58.783897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:58.784520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:58.791813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:58.792267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:58.793090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:58.793529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:58.939270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:39:58.947429 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-279a3e01-1db8-4a64-9a2b-45fefd09b51f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.167611 Jun 18 22:39:58.948004 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3067/6156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:58 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:39:59.965936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:39:59.966570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:39:59.974692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:59.974692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:39:59.975067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:39:59.975519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:00.020620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-4d326b4e-5bec-4c9b-81c8-1cd13eeb2825 req-55e3ceb3-b0a2-4032-8c86-243ee4dec740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:00.041221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4d326b4e-5bec-4c9b-81c8-1cd13eeb2825 req-55e3ceb3-b0a2-4032-8c86-243ee4dec740 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:00.041909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-4d326b4e-5bec-4c9b-81c8-1cd13eeb2825 req-55e3ceb3-b0a2-4032-8c86-243ee4dec740 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:00.081990 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-4d326b4e-5bec-4c9b-81c8-1cd13eeb2825 req-55e3ceb3-b0a2-4032-8c86-243ee4dec740 service nova] Creating event network-changed:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:40:00.089152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-4d326b4e-5bec-4c9b-81c8-1cd13eeb2825 req-55e3ceb3-b0a2-4032-8c86-243ee4dec740 service nova] Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:40:00.110596 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-4d326b4e-5bec-4c9b-81c8-1cd13eeb2825 req-55e3ceb3-b0a2-4032-8c86-243ee4dec740 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094854 Jun 18 22:40:00.111780 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3068/6157] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:40:00.149594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:00.152164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:00.162908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59004371-2432-48fb-9923-b596bb25f4f3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.201319 Jun 18 22:40:00.163535 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3090/6158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:39:59 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:40:01.185889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:01.186657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:01.195019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:01.195585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:01.196544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:01.197137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:01.344837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:01.354865 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-540cb488-e260-4e42-9c39-0d17871c2911 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.176576 Jun 18 22:40:01.355451 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3069/6159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:01 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:02.380971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:02.381958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:02.390642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:02.391115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:02.391949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:02.393273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:02.530967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:02.543497 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5c914f4d-5145-4402-a6ff-3b0157a5f1a4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.168734 Jun 18 22:40:02.544238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3091/6160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:02 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:03.565311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:03.566024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:03.573688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:03.574129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:03.574918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:03.575352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:03.741134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:03.749804 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0ce40134-e664-4ca8-8d99-1d5a975ec720 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1689 microversion: 2.1 time: 0.191206 Jun 18 22:40:03.750598 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3070/6161] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:03 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:04.771994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:04.773068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:04.780867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:04.781365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:04.782165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:04.782616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:04.915703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:04.923581 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d79cb04a-4a52-4717-a0e1-0ae56f572f1d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1682 microversion: 2.1 time: 0.158197 Jun 18 22:40:04.924152 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3092/6162] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:04 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:07.447020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ea9fcc65-ac6e-4472-8db8-d8bf8ed1f5c3 req-72249b0b-63e7-46e9-a56c-a7c238d4fa6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "name": "network-vif-plugged", "status": "completed", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:07.456958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea9fcc65-ac6e-4472-8db8-d8bf8ed1f5c3 req-72249b0b-63e7-46e9-a56c-a7c238d4fa6e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:07.457532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea9fcc65-ac6e-4472-8db8-d8bf8ed1f5c3 req-72249b0b-63e7-46e9-a56c-a7c238d4fa6e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:07.469619 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ea9fcc65-ac6e-4472-8db8-d8bf8ed1f5c3 req-72249b0b-63e7-46e9-a56c-a7c238d4fa6e service nova] Creating event network-vif-plugged:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:40:07.474713 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ea9fcc65-ac6e-4472-8db8-d8bf8ed1f5c3 req-72249b0b-63e7-46e9-a56c-a7c238d4fa6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031418 Jun 18 22:40:07.475300 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3071/6163] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:40:27.855264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:27.855948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:27.856317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=32 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:27.857356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:27.860330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=42 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:27.860638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e45b1ef4-423d-412c-9e8f-b7ef15748eac req-02aa15c1-d833-45f8-9f7c-6db71a91219a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77896cb0-0c4c-4118-b8d1-3532cce6b2a3", "tag": "f7217799-4e9e-4146-b11e-8732fe42e744"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:27.861327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=13 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:27.868864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:27.869929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:27.870843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:27.871133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e45b1ef4-423d-412c-9e8f-b7ef15748eac req-02aa15c1-d833-45f8-9f7c-6db71a91219a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:27.871589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e45b1ef4-423d-412c-9e8f-b7ef15748eac req-02aa15c1-d833-45f8-9f7c-6db71a91219a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:27.871750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:27.883563 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e45b1ef4-423d-412c-9e8f-b7ef15748eac req-02aa15c1-d833-45f8-9f7c-6db71a91219a service nova] Creating event network-changed:f7217799-4e9e-4146-b11e-8732fe42e744 for instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 on nch1-master-1 Jun 18 22:40:27.889598 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e45b1ef4-423d-412c-9e8f-b7ef15748eac req-02aa15c1-d833-45f8-9f7c-6db71a91219a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036213 Jun 18 22:40:27.890279 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3072/6164] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:40:27.900392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:40:27.989793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e216042f-6d02-44ba-962a-fc1e9284a6ca tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 204 len: 0 microversion: 2.1 time: 0.138521 Jun 18 22:40:27.990630 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3093/6165] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:40:27 2022] DELETE /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:40:28.001082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:28.002069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:28.009779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:28.010785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:28.011738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:28.012322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:28.165472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:28.173582 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-085fbdab-b3a9-4271-8084-8b79a3d68fc1 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1578 microversion: 2.1 time: 0.177541 Jun 18 22:40:28.174175 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3073/6166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:27 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:29.192371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:29.193140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:29.202254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:29.202590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:29.203382 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:29.203833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:29.343503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:29.351607 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f14dd84-703b-4508-9333-a806f7405dd8 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1578 microversion: 2.1 time: 0.163671 Jun 18 22:40:29.352245 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3094/6167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:29 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:30.128767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-be2ce4cc-10fa-4e7f-8969-b8aef635bccc req-6dd1324f-7cc0-4fda-a7d7-0a2ad2f74111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77896cb0-0c4c-4118-b8d1-3532cce6b2a3", "name": "network-vif-deleted", "tag": "f7217799-4e9e-4146-b11e-8732fe42e744"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:30.139862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-be2ce4cc-10fa-4e7f-8969-b8aef635bccc req-6dd1324f-7cc0-4fda-a7d7-0a2ad2f74111 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:30.140393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-be2ce4cc-10fa-4e7f-8969-b8aef635bccc req-6dd1324f-7cc0-4fda-a7d7-0a2ad2f74111 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:30.152964 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-be2ce4cc-10fa-4e7f-8969-b8aef635bccc req-6dd1324f-7cc0-4fda-a7d7-0a2ad2f74111 service nova] Creating event network-vif-deleted:f7217799-4e9e-4146-b11e-8732fe42e744 for instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 on nch1-master-1 Jun 18 22:40:30.159195 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-be2ce4cc-10fa-4e7f-8969-b8aef635bccc req-6dd1324f-7cc0-4fda-a7d7-0a2ad2f74111 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Jun 18 22:40:30.159848 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3074/6168] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:40:30.369333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:30.369892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:30.376883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:30.377398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:30.378177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:30.378630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:30.410505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:30.410981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:30.411454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lazy-loading 'fault' on Instance uuid 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:40:30.457757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '406628da7a8140fd83200ffc90e71198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d7a59e0743a480c9af66dea984113c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:30.466124 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7604cafd-ab4a-4d0a-94e5-e55358464b3d tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 200 len: 1230 microversion: 2.1 time: 0.100950 Jun 18 22:40:30.466714 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3095/6169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:30 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:31.484573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:31.485330 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 77896cb0-0c4c-4118-b8d1-3532cce6b2a3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:31.495018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:31.495494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:31.496306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:31.496792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:31.511229 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 could not be found. Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 HTTP/1.1 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 could not be found. Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '77896cb0-0c4c-4118-b8d1-3532cce6b2a3'} Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 could not be found. Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 could not be found. Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:31.512876 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 could not be found. Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 77896cb0-0c4c-4118-b8d1-3532cce6b2a3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd63f346-deae-44b3-a68b-919766f62ea0 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3" status: 404 len: 111 microversion: 2.1 time: 0.034405 Jun 18 22:40:31.517092 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3075/6170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:31 2022] GET /compute/v2.1/servers/77896cb0-0c4c-4118-b8d1-3532cce6b2a3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:40:31.962165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:31.962692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:31.971234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:31.971701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:31.972489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:31.972966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:31.991521 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd HTTP/1.1 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '1f43ae76-2d85-45eb-8bc0-112036e81fcd'} Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:40:31.993410 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f024fa99-f084-4cad-9050-0e6c8657efab tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 404 len: 111 microversion: 2.1 time: 0.036794 Jun 18 22:40:31.997083 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3096/6171] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:40:31 2022] DELETE /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:40:32.006745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:32.007744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [instance: 1f43ae76-2d85-45eb-8bc0-112036e81fcd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:32.017273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:32.017953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:32.019091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:32.019753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:32.038194 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] HTTP exception thrown: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Request method failure captured: Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd HTTP/1.1 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlH1ihpH8k7aXO78DDGVZK9vM7VxaA1ftS9MvAy5jWf1RyPW434QiP5_i6Nc7IutNjnhD48d3aEofkNmttSoLnGm43VKrkG_hNL1BzoKmMV5kGTxOC1YuNY_LiXU2PDrT1xgncTBj6dk9j5HntryqugbQqQL89guhh-kUF9UvT2s-e4 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2d7a59e0743a480c9af66dea984113c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2d7a59e0743a480c9af66dea984113c6", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 2d7a59e0743a480c9af66dea984113c6 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestVolumeBootPattern-2084543740 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 406628da7a8140fd83200ffc90e71198 Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestVolumeBootPattern-2084543740-project Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '1f43ae76-2d85-45eb-8bc0-112036e81fcd'} Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:32.039817 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Returning 404 to user: Instance 1f43ae76-2d85-45eb-8bc0-112036e81fcd could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5dfce298-8ce6-4640-b4ef-862e98fc6f77 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd" status: 404 len: 111 microversion: 2.1 time: 0.041157 Jun 18 22:40:32.043401 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3076/6172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:31 2022] GET /compute/v2.1/servers/1f43ae76-2d85-45eb-8bc0-112036e81fcd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:40:34.406626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e48f04f9-e0ba-4f07-bef5-5f4d8496cb88 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] Calling method '.version_select at 0x7fea149479d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:34.410279 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e48f04f9-e0ba-4f07-bef5-5f4d8496cb88 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [e535473b-932d-4a87-8d12-06cfe1bb4552] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:40:35.420845 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [None req-e48f04f9-e0ba-4f07-bef5-5f4d8496cb88 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] [e535473b-932d-4a87-8d12-06cfe1bb4552] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43722. Jun 18 22:40:35.448292 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e48f04f9-e0ba-4f07-bef5-5f4d8496cb88 tempest-TestVolumeBootPattern-2084543740 tempest-TestVolumeBootPattern-2084543740-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1425479607" status: 202 len: 0 microversion: 2.1 time: 1.045689 Jun 18 22:40:35.448878 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3097/6173] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:40:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1425479607 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:40:37.165687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:37.166637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:37.174146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:37.174616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:37.175385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:37.175825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:37.229751 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-436e8687-3e9e-47ed-b5db-a4879eafde80 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action" status: 200 len: 63064 microversion: 2.1 time: 0.067682 Jun 18 22:40:37.230614 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3077/6174] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:40:37 2022] POST /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982/action => generated 63064 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:40:53.626204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:53.627394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:53.633495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:53.634537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:53.643314 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:53.643772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:53.644545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:53.644990 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:53.781100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e282d23-d26d-4390-b16b-936d0abf9b21 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1833 microversion: 2.1 time: 0.158288 Jun 18 22:40:53.781821 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3098/6175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:53 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1833 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:54.694064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f76da3a3-62c9-404c-a082-9b1c315d9a2b req-76d82b33-36f7-4bde-b387-5e0b790890fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:54.702224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:54.703435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:54.704867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f76da3a3-62c9-404c-a082-9b1c315d9a2b req-76d82b33-36f7-4bde-b387-5e0b790890fc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:54.705368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f76da3a3-62c9-404c-a082-9b1c315d9a2b req-76d82b33-36f7-4bde-b387-5e0b790890fc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:54.707739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=12 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:54.708738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=18 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:40:54.712854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:54.713774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:54.714602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:54.715047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:54.718385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f76da3a3-62c9-404c-a082-9b1c315d9a2b req-76d82b33-36f7-4bde-b387-5e0b790890fc service nova] Creating event network-changed:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:40:54.724858 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f76da3a3-62c9-404c-a082-9b1c315d9a2b req-76d82b33-36f7-4bde-b387-5e0b790890fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034416 Jun 18 22:40:54.725863 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3099/6176] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:40:54.747808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:40:54.842043 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6084cfc3-ec02-4f27-9629-ceb998571735 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 204 len: 0 microversion: 2.1 time: 0.154590 Jun 18 22:40:54.842694 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3078/6177] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:40:54 2022] DELETE /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:40:54.852245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:54.853122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:54.859979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:54.860547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:54.861453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:54.861975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:55.003740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:55.012236 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d2755c09-2443-4552-b7f2-34808dcaeb9f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1688 microversion: 2.1 time: 0.164432 Jun 18 22:40:55.012845 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3100/6178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:54 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:56.031974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:56.033481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:56.042612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:56.043077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:56.043867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:56.044305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:56.182204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:56.190653 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-410ce1e6-38d9-4855-ad39-6f81b016efd2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1688 microversion: 2.1 time: 0.163576 Jun 18 22:40:56.191233 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3079/6179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:56 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:57.208847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:57.209489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:57.217352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:57.217818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:57.218615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:57.219060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:57.284542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:40:57.293667 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-89d8e231-9e82-49a2-8cb8-600490ae8177 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 200 len: 1501 microversion: 2.1 time: 0.088899 Jun 18 22:40:57.295002 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3101/6180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:57 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 1501 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:40:57.363470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-e7aa7fa1-8e56-4589-b0cd-e2f1056a3ca1 req-33ec931c-b600-4e7c-9ef5-33af974f088d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f46fa12-ead0-4c19-a192-9d87442ec982", "name": "network-vif-deleted", "tag": "10200844-b397-47c2-b911-ce65ccaf4563"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:40:57.373326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e7aa7fa1-8e56-4589-b0cd-e2f1056a3ca1 req-33ec931c-b600-4e7c-9ef5-33af974f088d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:57.373785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-e7aa7fa1-8e56-4589-b0cd-e2f1056a3ca1 req-33ec931c-b600-4e7c-9ef5-33af974f088d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:57.386183 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-e7aa7fa1-8e56-4589-b0cd-e2f1056a3ca1 req-33ec931c-b600-4e7c-9ef5-33af974f088d service nova] Creating event network-vif-deleted:10200844-b397-47c2-b911-ce65ccaf4563 for instance 0f46fa12-ead0-4c19-a192-9d87442ec982 on nch1-master-1 Jun 18 22:40:57.391321 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-e7aa7fa1-8e56-4589-b0cd-e2f1056a3ca1 req-33ec931c-b600-4e7c-9ef5-33af974f088d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031705 Jun 18 22:40:57.392293 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3080/6181] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:40:58.316803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:40:58.317381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: 0f46fa12-ead0-4c19-a192-9d87442ec982] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:40:58.327601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:58.328236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:58.329451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:40:58.330029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:40:58.346425 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] HTTP exception thrown: Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 could not be found. Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Request method failure captured: Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 HTTP/1.1 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlNK8kBbJlOrOviubSLMuJzQnk_R8C6z0pQt_xqItqZ5xvK1KTyKwLEjZimOuX84aZbR2EK_ASTrQnR4s5fWBZjZYqmM6qLf5DYpzT4CJa9bvhJxdVD_ZCtDzGIpRXSLmgqPKNV2PzmnEzo6nhSrv33rPmRWzkNU-xTrxteIFycCu_0 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91c64dd112fa4f7c89b2f07494e6be49", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: f1b184b4aef04efc8996eff7af43dadb Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 could not be found. Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0f46fa12-ead0-4c19-a192-9d87442ec982'} Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 could not be found. Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 could not be found. Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:40:58.348155 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 could not be found. Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Returning 404 to user: Instance 0f46fa12-ead0-4c19-a192-9d87442ec982 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09946bc0-8343-459d-851e-76753a70cd00 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982" status: 404 len: 111 microversion: 2.1 time: 0.039769 Jun 18 22:40:58.352022 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3102/6182] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:40:58 2022] GET /compute/v2.1/servers/0f46fa12-ead0-4c19-a192-9d87442ec982 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:41:01.348111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9ceea8c5-6c69-4acb-b8de-f740ad8e8f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '.version_select at 0x7fea1438b550>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:01.351297 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ceea8c5-6c69-4acb-b8de-f740ad8e8f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:41:02.363874 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ceea8c5-6c69-4acb-b8de-f740ad8e8f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43832. Jun 18 22:41:02.391834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9ceea8c5-6c69-4acb-b8de-f740ad8e8f5c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1498876109" status: 202 len: 0 microversion: 2.1 time: 1.049159 Jun 18 22:41:02.392428 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3081/6183] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Jun 18 22:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1498876109 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:41:02.428722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-73064ad0-5c47-435b-bd5e-779cf88a7bc9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: .version_select at 0x7fea1416ad30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-438909636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUtiUsXQDLwxnwcToahBnsu8tNGZDz3813mIh084Em5HhT9oOD8yiA4BUWYDVsjJ4tfTu4VRhOAzYWyIj0EzNg5UkNtR0W4EBRJs9q7eZm4AGnwI8Xiis+DAOci688knA=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:02.446399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-73064ad0-5c47-435b-bd5e-779cf88a7bc9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:41:02.451858 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-73064ad0-5c47-435b-bd5e-779cf88a7bc9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:41:02.479770 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-73064ad0-5c47-435b-bd5e-779cf88a7bc9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.055182 Jun 18 22:41:02.480460 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3103/6184] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:41:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:41:08.240505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-522794360", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "36a1e4b5-6cb4-4711-bd2e-d206b7ac14f6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-438909636", "security_groups": [{"name": "tempest-secgroup-smoke-1062786235"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:08.271217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:08.380543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] validate_networks() for [('36a1e4b5-6cb4-4711-bd2e-d206b7ac14f6', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:41:08.812446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:41:08.812883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:41:08.813970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:41:08.814397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:41:08.815194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:41:08.827224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:08.827760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:08.828673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:08.829151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:08.850909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:41:08.859376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:41:08.875653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:41:08.878364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:41:08.942978 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-698d4616-08cf-4c32-a11b-b86b7e535143 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.706301 Jun 18 22:41:08.943653 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3082/6185] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:41:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:41:08.952308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=22 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:08.958514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd5aa4d8-7ae3-437c-a5ec-70a252db2e56 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:08.959321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd5aa4d8-7ae3-437c-a5ec-70a252db2e56 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:09.050234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bd5aa4d8-7ae3-437c-a5ec-70a252db2e56 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:09.059215 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd5aa4d8-7ae3-437c-a5ec-70a252db2e56 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1265 microversion: 2.1 time: 0.108790 Jun 18 22:41:09.060466 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3104/6186] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:08 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:10.079168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:10.079904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:10.094679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:10.095304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:10.096371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:10.096919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:10.182869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:10.192646 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7a5bc62-d79b-46a0-9b5e-7980b0ff4147 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1269 microversion: 2.1 time: 0.119800 Jun 18 22:41:10.193088 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3083/6187] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:10 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:11.210437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:11.211070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:11.220097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:11.220749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:11.221664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:11.222297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:11.299887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:11.309507 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64dc4651-abb0-4cc4-b733-89730d99d109 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1323 microversion: 2.1 time: 0.102958 Jun 18 22:41:11.310105 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3105/6188] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:11 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1323 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:12.327776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:12.328560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:12.341948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:12.342656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:12.345526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:12.345903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:12.486462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:12.497193 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-42bfe085-5378-427c-abe3-efdb1feff5ee tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.173167 Jun 18 22:41:12.509762 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3084/6189] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:12 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:12.743434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0b1e8a0f-b084-4901-9f53-ceaf9f08e55f req-838159d5-ffb9-4ea6-85d5-4e4ad036bd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:12.752914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0b1e8a0f-b084-4901-9f53-ceaf9f08e55f req-838159d5-ffb9-4ea6-85d5-4e4ad036bd42 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:12.753328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0b1e8a0f-b084-4901-9f53-ceaf9f08e55f req-838159d5-ffb9-4ea6-85d5-4e4ad036bd42 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:12.769190 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0b1e8a0f-b084-4901-9f53-ceaf9f08e55f req-838159d5-ffb9-4ea6-85d5-4e4ad036bd42 service nova] Creating event network-changed:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch2-master-1 Jun 18 22:41:12.774043 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0b1e8a0f-b084-4901-9f53-ceaf9f08e55f req-838159d5-ffb9-4ea6-85d5-4e4ad036bd42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035580 Jun 18 22:41:12.774947 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3106/6190] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:41:13.521730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:13.522909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:13.533069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:13.533561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:13.534340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:13.534779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:13.673180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:13.681306 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b27aba3-300c-4a87-b98c-0592ed685535 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.165725 Jun 18 22:41:13.681880 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3085/6191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:13 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:14.429819 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:41:14.430578 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 22:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:41:14.702631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:14.703230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:14.710116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:14.710577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:14.711369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:14.711813 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:14.856630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:14.868026 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bcd3ee42-5579-4650-a1f3-9eb96da457af tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.171774 Jun 18 22:41:14.868869 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3107/6192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:14 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:15.891440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:15.892238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:15.900420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:15.900929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:15.901827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:15.902317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:16.041340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:16.049279 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aeda8fbe-212f-47be-8ad1-be246d260c51 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.164249 Jun 18 22:41:16.049849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3086/6193] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:15 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:17.066941 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:17.067577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:17.074775 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:17.075282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:17.076083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:17.076536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:17.213762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:17.221758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9dd399d0-cc45-4f8e-92d6-5038f7bb1ba1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.159531 Jun 18 22:41:17.222344 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3108/6194] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:17 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:18.240886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:18.241545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:18.249187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:18.249662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:18.250469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:18.250929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:18.390220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:18.398251 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a0df6e47-f99b-4ba2-966d-0412cf9df098 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.161839 Jun 18 22:41:18.398928 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3087/6195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:18 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:18.692394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ace3fac5-0e80-4a72-a29f-1d30c5b46b65 req-392c7a0e-e3b4-460c-bd2e-d0f0dcc04489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "name": "network-vif-plugged", "status": "completed", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:18.702204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ace3fac5-0e80-4a72-a29f-1d30c5b46b65 req-392c7a0e-e3b4-460c-bd2e-d0f0dcc04489 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:18.702862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ace3fac5-0e80-4a72-a29f-1d30c5b46b65 req-392c7a0e-e3b4-460c-bd2e-d0f0dcc04489 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:18.715412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ace3fac5-0e80-4a72-a29f-1d30c5b46b65 req-392c7a0e-e3b4-460c-bd2e-d0f0dcc04489 service nova] Creating event network-vif-plugged:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch2-master-1 Jun 18 22:41:18.720663 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ace3fac5-0e80-4a72-a29f-1d30c5b46b65 req-392c7a0e-e3b4-460c-bd2e-d0f0dcc04489 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032883 Jun 18 22:41:18.721329 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3109/6196] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:41:19.416799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:19.417689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:19.419989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:19.420788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:19.428843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:19.429375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:19.430264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:19.430748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:19.568108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:19.579573 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ccba76d-c6f7-4d9f-a023-5b7e5b75e632 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1391 microversion: 2.1 time: 0.167231 Jun 18 22:41:19.580343 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3088/6197] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:19 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:20.604462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:20.613462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:20.614809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:20.623022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:20.623491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:20.624324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:20.624776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:20.770153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:20.782221 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c257bd70-c6fa-4233-8b8f-de06e20ad747 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1563 microversion: 2.1 time: 0.180168 Jun 18 22:41:20.783017 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3110/6198] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:20 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:20.799041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:20.799649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:20.807198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:20.807693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:20.808439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:20.808901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:20.950911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:20.958759 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e77eca4b-cba0-4d4c-9f72-7543583f9f25 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1563 microversion: 2.1 time: 0.163728 Jun 18 22:41:20.959321 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3089/6199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:20 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:22.597238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:22.597891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:22.605944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-259e2e4f-04c1-403e-a285-fe3c285081dd req-5e5d498f-4b21-4fac-b55a-933c86fe73b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:22.609306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:22.609774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:22.610593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:22.611058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:22.615472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-259e2e4f-04c1-403e-a285-fe3c285081dd req-5e5d498f-4b21-4fac-b55a-933c86fe73b7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:22.615691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-259e2e4f-04c1-403e-a285-fe3c285081dd req-5e5d498f-4b21-4fac-b55a-933c86fe73b7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:22.627760 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-259e2e4f-04c1-403e-a285-fe3c285081dd req-5e5d498f-4b21-4fac-b55a-933c86fe73b7 service nova] Creating event network-changed:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch2-master-1 Jun 18 22:41:22.633385 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-259e2e4f-04c1-403e-a285-fe3c285081dd req-5e5d498f-4b21-4fac-b55a-933c86fe73b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030953 Jun 18 22:41:22.634467 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3090/6200] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:41:22.973618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:22.981875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bad73739-86f6-4cbd-abaa-0f36bd024a97 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1563 microversion: 2.1 time: 0.388492 Jun 18 22:41:22.982738 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3111/6201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:22 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1563 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:44.264939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:44.265744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=46 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:44.271086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:44.272344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:44.281996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:44.282459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:44.283231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:44.283671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:44.341082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6d9a3c9-91f5-4b07-83ce-6c1b7b6a7b8e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action" status: 200 len: 24575 microversion: 2.1 time: 0.078727 Jun 18 22:41:44.341622 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3091/6202] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:41:44 2022] POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action => generated 24575 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:41:55.385439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:55.386028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:55.388099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:55.388778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=34 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:55.395167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:55.395666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:55.396458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:55.396912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:55.545897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:55.554675 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-623a3e19-e4fa-4de0-a214-8d617a4ec08b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1681 microversion: 2.1 time: 0.173647 Jun 18 22:41:55.555276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3112/6203] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:55 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:55.651951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:55.652895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:55.655677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:55.656332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=4 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:41:55.662527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:55.662980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:55.663758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:55.664194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:55.716450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8aa1b4d4-4edc-4efc-b68f-4fc1a254fd08 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action" status: 200 len: 32654 microversion: 2.1 time: 0.069342 Jun 18 22:41:55.717077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3092/6204] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:41:55 2022] POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action => generated 32654 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:41:55.884651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:55.885337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:55.892105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:55.892575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:55.893401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:55.893836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:56.028599 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e7908206-498b-45ec-bdd1-9a307d0d65d5 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1832 microversion: 2.1 time: 0.148151 Jun 18 22:41:56.029219 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3113/6205] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:55 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1832 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:56.053932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:56.055169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:56.062755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:56.063211 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:56.063983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:56.064419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:56.091045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lazy-loading 'flavor' on Instance uuid f41f3bf0-52d3-4248-b655-f2c46f376afe {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:41:56.103407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Going to try to live migrate instance to another host {{(pid=130902) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 18 22:41:57.458217 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6211b234-6959-4db1-92f0-51287364dc9e tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action" status: 202 len: 0 microversion: 2.1 time: 1.408582 Jun 18 22:41:57.458902 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3093/6206] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:41:56 2022] POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action => generated 0 bytes in 1410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:41:57.468276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:57.468910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:57.476386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:57.476883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:57.477685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:57.478140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:57.625177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:57.633260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83e5baf7-39a5-4c14-b595-c64424e911e7 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.168936 Jun 18 22:41:57.633906 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3114/6207] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:57 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:58.510863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ea6d0910-2dd5-4718-afe9-24e3298f686c req-6bdb635a-04c5-45f8-9daa-73a5b6ccbf06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "name": "network-vif-unplugged", "status": "completed", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:41:58.520917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea6d0910-2dd5-4718-afe9-24e3298f686c req-6bdb635a-04c5-45f8-9daa-73a5b6ccbf06 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:58.521388 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea6d0910-2dd5-4718-afe9-24e3298f686c req-6bdb635a-04c5-45f8-9daa-73a5b6ccbf06 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:58.532658 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ea6d0910-2dd5-4718-afe9-24e3298f686c req-6bdb635a-04c5-45f8-9daa-73a5b6ccbf06 service nova] Creating event network-vif-unplugged:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch2-master-1 Jun 18 22:41:58.537853 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ea6d0910-2dd5-4718-afe9-24e3298f686c req-6bdb635a-04c5-45f8-9daa-73a5b6ccbf06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031828 Jun 18 22:41:58.538488 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3094/6208] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:41:58.651416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:58.652646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:58.660210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:58.660674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:58.661514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:58.661971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:58.811678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:41:58.830010 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a3e2eab4-a30d-4c5c-b8c1-37b92222faf6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.182682 Jun 18 22:41:58.830611 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3115/6209] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:58 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:41:59.854059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:41:59.855035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:41:59.865907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:59.866572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:41:59.867343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:41:59.867786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:00.073903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:00.086450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d52fdd8c-3f7b-4254-82d4-2c8ddd65382b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.241072 Jun 18 22:42:00.087330 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3095/6210] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:41:59 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:00.557026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3db149af-4506-49f7-8049-0df930bc4fe4 req-e8b31f72-6b1e-4f1c-9a7a-29f7f2c2aa7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:00.567521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3db149af-4506-49f7-8049-0df930bc4fe4 req-e8b31f72-6b1e-4f1c-9a7a-29f7f2c2aa7c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:00.568421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3db149af-4506-49f7-8049-0df930bc4fe4 req-e8b31f72-6b1e-4f1c-9a7a-29f7f2c2aa7c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:00.581429 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3db149af-4506-49f7-8049-0df930bc4fe4 req-e8b31f72-6b1e-4f1c-9a7a-29f7f2c2aa7c service nova] Creating event network-changed:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch2-master-1 Jun 18 22:42:00.587700 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3db149af-4506-49f7-8049-0df930bc4fe4 req-e8b31f72-6b1e-4f1c-9a7a-29f7f2c2aa7c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034992 Jun 18 22:42:00.588361 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3116/6211] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:01.112050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:01.112677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:01.120231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:01.120659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:01.121494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:01.121944 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:01.259574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:01.267452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d606453b-dfbf-42a3-a390-433953d8cc45 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.159694 Jun 18 22:42:01.268029 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3096/6212] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:01 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:02.290432 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:02.291615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:02.306834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:02.307225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:02.308050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:02.308529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:02.456646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:02.464593 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-21e0c5c1-38a4-47f8-b63f-62e1b1fe9ced tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.181984 Jun 18 22:42:02.465166 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3117/6213] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:02 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:03.486634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:03.487666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:03.496549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:03.497000 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:03.497788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:03.498225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:03.641400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:03.649708 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-468fc73f-f48d-4f41-b303-153d89b64338 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.169694 Jun 18 22:42:03.650231 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3097/6214] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:03 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:04.670397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:04.671433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:04.684036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:04.684889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:04.686280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:04.687159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:04.834321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:04.842369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-95836396-326e-413f-a13b-ab33aacf3759 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.178722 Jun 18 22:42:04.842954 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3118/6215] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:04 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:05.862457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:05.863291 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:05.871914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:05.872365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:05.873201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:05.873638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:06.010348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:06.021306 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-14d8b24f-afa7-48fc-bd7d-55d1acb5fbe0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.164508 Jun 18 22:42:06.022058 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3098/6216] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:05 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:07.040077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:07.040691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:07.048495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:07.049695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:07.050685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:07.051149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:07.187948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:07.196484 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5328267f-b5c2-4b04-b0e7-13e5f5ac274f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.160794 Jun 18 22:42:07.197068 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3119/6217] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:07 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:07.414963 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f6810914-2734-4221-b310-bd1bbaa81322 req-674b7880-5925-42a1-9ddf-e83038db6860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "name": "network-vif-unplugged", "status": "completed", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:07.425449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f6810914-2734-4221-b310-bd1bbaa81322 req-674b7880-5925-42a1-9ddf-e83038db6860 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:07.426001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f6810914-2734-4221-b310-bd1bbaa81322 req-674b7880-5925-42a1-9ddf-e83038db6860 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:07.438796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f6810914-2734-4221-b310-bd1bbaa81322 req-674b7880-5925-42a1-9ddf-e83038db6860 service nova] Creating event network-vif-unplugged:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch2-master-1 Jun 18 22:42:07.444292 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f6810914-2734-4221-b310-bd1bbaa81322 req-674b7880-5925-42a1-9ddf-e83038db6860 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033381 Jun 18 22:42:07.444936 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3099/6218] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:08.214561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:08.215168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:08.222735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:08.223226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:08.224017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:08.224695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:08.366063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:08.374043 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9cceada9-cc2e-49cf-b316-b3de8797dc89 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1691 microversion: 2.1 time: 0.163828 Jun 18 22:42:08.374600 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3120/6219] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:08 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:09.398417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:09.399457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:09.406870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:09.407323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:09.408132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:09.408570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:09.561521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:09.572983 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a095b1ab-93d8-4f9f-84a7-8289d1e81962 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1681 microversion: 2.1 time: 0.183212 Jun 18 22:42:09.573629 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3100/6220] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:09 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:09.589882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:09.590578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:09.598261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:09.598732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:09.599607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:09.600274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:09.739157 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d543f438-c806-4718-b035-daf6ff298f49 tempest-TestNetworkAdvancedServerOps-1485112971 tempest-TestNetworkAdvancedServerOps-1485112971-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1832 microversion: 2.1 time: 0.153097 Jun 18 22:42:09.739706 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3121/6221] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:09 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1832 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:09.756734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:09.757377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:09.763772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:09.764223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:09.764987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:09.765456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:09.907713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:09.918556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bb4d4cd8-a820-4e4c-864b-66a1613b7c67 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1681 microversion: 2.1 time: 0.165713 Jun 18 22:42:09.919146 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3101/6222] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:09 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:10.014443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:10.015422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:10.022017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:10.022518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:10.023285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:10.023766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:10.074157 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fbfb1e29-6e2c-4a36-baac-d72b2a15f077 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action" status: 200 len: 38612 microversion: 2.1 time: 0.063545 Jun 18 22:42:10.074776 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3122/6223] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:42:10 2022] POST /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe/action => generated 38612 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:42:11.089277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:11.090419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:11.098154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:11.098624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:11.099499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:11.099934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:11.131883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:42:11.166827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-4e8a1188-a034-43cd-945a-c47c9b757a05 req-94f58915-8559-435c-bee2-db29108da558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:11.176934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4e8a1188-a034-43cd-945a-c47c9b757a05 req-94f58915-8559-435c-bee2-db29108da558 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:11.177744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-4e8a1188-a034-43cd-945a-c47c9b757a05 req-94f58915-8559-435c-bee2-db29108da558 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:11.188723 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-4e8a1188-a034-43cd-945a-c47c9b757a05 req-94f58915-8559-435c-bee2-db29108da558 service nova] Creating event network-changed:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch1-master-1 Jun 18 22:42:11.194439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-4e8a1188-a034-43cd-945a-c47c9b757a05 req-94f58915-8559-435c-bee2-db29108da558 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106865 Jun 18 22:42:11.195137 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3123/6224] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:11.218153 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41e72e23-57c8-4ab6-9037-d452ce2a236a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 204 len: 0 microversion: 2.1 time: 0.132813 Jun 18 22:42:11.219103 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3102/6225] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:42:11 2022] DELETE /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:42:11.237309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:11.238701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:11.245419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:11.245988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:11.247048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:11.247564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:11.399860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:11.408685 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7c407732-5e56-47be-984d-7b830c540e19 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1687 microversion: 2.1 time: 0.176142 Jun 18 22:42:11.409420 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3124/6226] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:11 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:12.428262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:12.429709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:12.437658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:12.438105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:12.438901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:12.439366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:12.579917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:12.589549 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3010f6ab-a6fb-4dc1-bb31-44b30fbfda7c tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 200 len: 1569 microversion: 2.1 time: 0.165582 Jun 18 22:42:12.590352 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3103/6227] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:12 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:12.677251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-bcd0769b-6fc3-40dd-a72e-4118db57bda9 req-12194597-f307-4051-9891-4a96eab619a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f41f3bf0-52d3-4248-b655-f2c46f376afe", "name": "network-vif-deleted", "tag": "9f59cf1c-b2f3-43f1-9f63-962d820602ab"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:12.687047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bcd0769b-6fc3-40dd-a72e-4118db57bda9 req-12194597-f307-4051-9891-4a96eab619a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:12.687583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-bcd0769b-6fc3-40dd-a72e-4118db57bda9 req-12194597-f307-4051-9891-4a96eab619a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:12.701249 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-bcd0769b-6fc3-40dd-a72e-4118db57bda9 req-12194597-f307-4051-9891-4a96eab619a0 service nova] Creating event network-vif-deleted:9f59cf1c-b2f3-43f1-9f63-962d820602ab for instance f41f3bf0-52d3-4248-b655-f2c46f376afe on nch1-master-1 Jun 18 22:42:12.706214 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-bcd0769b-6fc3-40dd-a72e-4118db57bda9 req-12194597-f307-4051-9891-4a96eab619a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Jun 18 22:42:12.706803 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3125/6228] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:13.608484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:13.609182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: f41f3bf0-52d3-4248-b655-f2c46f376afe] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:13.617356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:13.617899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:13.618696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:13.619182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:13.634370 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] HTTP exception thrown: Instance f41f3bf0-52d3-4248-b655-f2c46f376afe could not be found. Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Request method failure captured: Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe HTTP/1.1 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlNK8kBbJlOrOviubSLMuJzQnk_R8C6z0pQt_xqItqZ5xvK1KTyKwLEjZimOuX84aZbR2EK_ASTrQnR4s5fWBZjZYqmM6qLf5DYpzT4CJa9bvhJxdVD_ZCtDzGIpRXSLmgqPKNV2PzmnEzo6nhSrv33rPmRWzkNU-xTrxteIFycCu_0 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91c64dd112fa4f7c89b2f07494e6be49", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: f1b184b4aef04efc8996eff7af43dadb Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance f41f3bf0-52d3-4248-b655-f2c46f376afe could not be found. Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'f41f3bf0-52d3-4248-b655-f2c46f376afe'} Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f41f3bf0-52d3-4248-b655-f2c46f376afe could not be found. Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f41f3bf0-52d3-4248-b655-f2c46f376afe could not be found. Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:42:13.636215 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f41f3bf0-52d3-4248-b655-f2c46f376afe could not be found. Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Returning 404 to user: Instance f41f3bf0-52d3-4248-b655-f2c46f376afe could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd0fb9af-c63c-48a9-8251-5250ab6c4f0a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe" status: 404 len: 111 microversion: 2.1 time: 0.033613 Jun 18 22:42:13.640397 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3104/6229] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:13 2022] GET /compute/v2.1/servers/f41f3bf0-52d3-4248-b655-f2c46f376afe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:42:17.011505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d232f3b6-b44c-4a3d-ae31-77ef0082fa66 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '.version_select at 0x7fea078a3550>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:17.037618 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d232f3b6-b44c-4a3d-ae31-77ef0082fa66 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-438909636" status: 202 len: 0 microversion: 2.1 time: 0.033131 Jun 18 22:42:17.038292 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3126/6230] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Jun 18 22:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-438909636 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:42:17.062633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f56e59b5-e7aa-497f-9e0a-c2744b5fef46 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: .version_select at 0x7fea14531820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-470523361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdW2w7TCicJ5aemMi17j5dOK9RUL34yLeE2BoKQsNt/r6d/QbCn/OAFfcusSFsl6L9SbQbb4lf+6g73cOoSficxxjynh7dK0zaZW5rfRJR9bFtyuRxnG+XP/evUe9zNOA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:17.078217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f56e59b5-e7aa-497f-9e0a-c2744b5fef46 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:42:17.084219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f56e59b5-e7aa-497f-9e0a-c2744b5fef46 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:42:17.109275 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f56e59b5-e7aa-497f-9e0a-c2744b5fef46 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051184 Jun 18 22:42:17.109853 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3105/6231] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:42:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:42:22.803447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=70 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:22.807923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-17399007", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "5eb855fa-8df5-41ae-be2e-6a65b4daf128"}], "key_name": "tempest-TestNetworkAdvancedServerOps-470523361", "security_groups": [{"name": "tempest-secgroup-smoke-1969513800"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:22.953155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] validate_networks() for [('5eb855fa-8df5-41ae-be2e-6a65b4daf128', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:42:23.390193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:42:23.390700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:42:23.391225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:42:23.391617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:42:23.392393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:42:23.405352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:23.405827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:23.407389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:23.408180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:23.427256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:42:23.433809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Getting quotas for user f1b184b4aef04efc8996eff7af43dadb and project 91c64dd112fa4f7c89b2f07494e6be49. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:42:23.457833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:42:23.460610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:42:23.516902 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-db91ff35-91b6-414c-8d88-1231727d9ff0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715359 Jun 18 22:42:23.518338 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3127/6232] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:42:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:42:23.529476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-01e1c101-d11e-4629-920c-177904905a36 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:23.530050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-01e1c101-d11e-4629-920c-177904905a36 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:23.599672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-01e1c101-d11e-4629-920c-177904905a36 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:23.609979 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-01e1c101-d11e-4629-920c-177904905a36 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1264 microversion: 2.1 time: 0.085410 Jun 18 22:42:23.611406 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3106/6233] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:23 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1264 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:24.632459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:24.634634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:24.647251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:24.647789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:24.648869 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:24.649425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:24.724959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:24.734541 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-402cf528-7be1-452b-add9-c07d977c8fe3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1322 microversion: 2.1 time: 0.110686 Jun 18 22:42:24.735499 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3128/6234] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:24 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1322 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:25.755802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:25.756984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:25.768935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:25.771829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:25.777008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:25.777492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:25.778294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:25.779793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:25.949887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:25.963582 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-02ebcf20-6283-4542-83bd-9790a3fdf959 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1390 microversion: 2.1 time: 0.215032 Jun 18 22:42:25.973110 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3107/6235] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:25 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1390 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:26.221531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6ed726dc-9b34-489a-8b59-31511ecd61b4 req-44188497-bed1-4108-86ea-11aea401132e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad15e81-5032-4319-9bd5-91245b67fb26", "tag": "bbd4ec39-97ab-4b60-9e3e-c7873c135d2f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:26.225572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:26.233248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6ed726dc-9b34-489a-8b59-31511ecd61b4 req-44188497-bed1-4108-86ea-11aea401132e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:26.233684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6ed726dc-9b34-489a-8b59-31511ecd61b4 req-44188497-bed1-4108-86ea-11aea401132e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:26.251212 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6ed726dc-9b34-489a-8b59-31511ecd61b4 req-44188497-bed1-4108-86ea-11aea401132e service nova] Creating event network-changed:bbd4ec39-97ab-4b60-9e3e-c7873c135d2f for instance dad15e81-5032-4319-9bd5-91245b67fb26 on nch2-master-1 Jun 18 22:42:26.256511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6ed726dc-9b34-489a-8b59-31511ecd61b4 req-44188497-bed1-4108-86ea-11aea401132e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183689 Jun 18 22:42:26.257546 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3129/6236] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:26.981699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:26.982374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:26.991195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:26.991730 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:26.992571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:26.993084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:27.138954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:27.147028 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c64e2fea-b0ed-4f5d-a258-2315024b4477 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1390 microversion: 2.1 time: 0.170214 Jun 18 22:42:27.147614 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3108/6237] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:26 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:28.168180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:28.169781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:28.178385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:28.179006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:28.180136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:28.180739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:28.323040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:28.335099 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e9df8440-2c83-4f36-9272-abf4605dac0e tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1390 microversion: 2.1 time: 0.173772 Jun 18 22:42:28.335922 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3130/6238] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:28 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:29.352371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:29.353020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:29.360594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:29.361069 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:29.361863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:29.362306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:29.495247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:29.503155 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-48d77a85-db6a-40f0-aa83-bd6a47caa2e3 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1390 microversion: 2.1 time: 0.155011 Jun 18 22:42:29.503736 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3109/6239] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:29 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:30.522638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:30.523232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:30.531734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:30.532202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:30.532985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:30.533543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:30.677676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:30.685789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-faf3d79a-4572-4ccf-99fe-46267cff6978 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1390 microversion: 2.1 time: 0.169169 Jun 18 22:42:30.686377 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3131/6240] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:30 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:31.041700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6c1c77c1-ae31-4601-b6fb-bb711137fd51 req-1331c856-8e7c-4b94-bb37-9f73281e844b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad15e81-5032-4319-9bd5-91245b67fb26", "name": "network-vif-plugged", "status": "completed", "tag": "bbd4ec39-97ab-4b60-9e3e-c7873c135d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:31.051352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6c1c77c1-ae31-4601-b6fb-bb711137fd51 req-1331c856-8e7c-4b94-bb37-9f73281e844b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:31.051821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6c1c77c1-ae31-4601-b6fb-bb711137fd51 req-1331c856-8e7c-4b94-bb37-9f73281e844b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:31.066850 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6c1c77c1-ae31-4601-b6fb-bb711137fd51 req-1331c856-8e7c-4b94-bb37-9f73281e844b service nova] Creating event network-vif-plugged:bbd4ec39-97ab-4b60-9e3e-c7873c135d2f for instance dad15e81-5032-4319-9bd5-91245b67fb26 on nch2-master-1 Jun 18 22:42:31.072306 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6c1c77c1-ae31-4601-b6fb-bb711137fd51 req-1331c856-8e7c-4b94-bb37-9f73281e844b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034449 Jun 18 22:42:31.072965 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3110/6241] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:31.707853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:31.708917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:31.720769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:31.721598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:31.722895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:31.723647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:31.860870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:31.868722 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93e727fd-ca21-402b-b422-d3bf08caee9b tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1390 microversion: 2.1 time: 0.167574 Jun 18 22:42:31.869337 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3132/6242] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:31 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:32.887222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:32.887937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:32.894664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:32.895145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:32.895952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:32.896380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:33.033476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:33.041350 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec23f11b-f32d-4b93-8908-d936fe01a18d tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1562 microversion: 2.1 time: 0.159301 Jun 18 22:42:33.041934 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3111/6243] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:32 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:33.058061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:33.058709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:33.065947 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:33.066410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:33.067187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:33.067633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:33.207831 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:33.219265 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-317faf39-149f-4d1d-a4e9-e67c4abbcccc tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1562 microversion: 2.1 time: 0.164834 Jun 18 22:42:33.220037 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3133/6244] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:33 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:42:35.195760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:42:35.196389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:35.198143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-57177894-321a-4cbc-9433-4649a57eb69f req-7c4fba67-a87d-40dd-b56a-8300eb3025bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad15e81-5032-4319-9bd5-91245b67fb26", "tag": "bbd4ec39-97ab-4b60-9e3e-c7873c135d2f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:35.199384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:35.203760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:35.204499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:35.205796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:35.206264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:35.207050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:35.208076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:35.211467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-57177894-321a-4cbc-9433-4649a57eb69f req-7c4fba67-a87d-40dd-b56a-8300eb3025bd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:35.212162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-57177894-321a-4cbc-9433-4649a57eb69f req-7c4fba67-a87d-40dd-b56a-8300eb3025bd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:35.225771 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-57177894-321a-4cbc-9433-4649a57eb69f req-7c4fba67-a87d-40dd-b56a-8300eb3025bd service nova] Creating event network-changed:bbd4ec39-97ab-4b60-9e3e-c7873c135d2f for instance dad15e81-5032-4319-9bd5-91245b67fb26 on nch2-master-1 Jun 18 22:42:35.231456 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-57177894-321a-4cbc-9433-4649a57eb69f req-7c4fba67-a87d-40dd-b56a-8300eb3025bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037851 Jun 18 22:42:35.232753 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3134/6245] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:42:35.360087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:42:35.370665 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05e0d227-5668-4bfc-94cb-0061f3487354 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1562 microversion: 2.1 time: 0.179230 Jun 18 22:42:35.371331 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3112/6246] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:42:35 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:42:57.709981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=11 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:57.710787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=36 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:42:57.715694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:42:57.716918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:42:57.724354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:57.724814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:57.725646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:42:57.726088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:42:57.779536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-14d7ac26-6646-459a-a345-4e3919218908 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26/action" status: 200 len: 24573 microversion: 2.1 time: 0.071318 Jun 18 22:42:57.780140 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3135/6247] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:42:57 2022] POST /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:43:04.191348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:43:04.193837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:04.199836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=11 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:04.200854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=32 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:04.207444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:04.207982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:04.208835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:04.209301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:04.305998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:43:04.306429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:43:04.307102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:43:04.307553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:43:04.308147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:43:04.370366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:04.376720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:04.377219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:04.378009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:04.378513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:04.405505 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-492a6224-b835-4e6e-a96b-ae8f918131c6 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26/action" status: 202 len: 1136 microversion: 2.1 time: 0.220792 Jun 18 22:43:04.406163 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3113/6248] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:43:04 2022] POST /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26/action => generated 1136 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 18 22:43:04.421164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:04.421887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:04.429883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:04.430332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:04.431110 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:04.431572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:04.573762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:04.586135 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7026119e-6018-4902-aed4-4ff437d3b1e1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.168974 Jun 18 22:43:04.590557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3136/6249] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:04 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:05.609881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:05.610647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:05.618395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:05.618846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:05.619627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:05.620066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:05.752808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:05.760924 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f2d889b1-b706-44e6-a5de-556a394201ad tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.155091 Jun 18 22:43:05.761535 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3114/6250] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:05 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:06.785474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:06.786092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:06.793867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:06.794329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:06.795131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:06.795577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:06.941621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:06.949935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b49d420e-f24e-490f-aa55-8ee7da5d1583 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.172068 Jun 18 22:43:06.950519 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3137/6251] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:06 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:07.968592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:07.969258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:07.979055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:07.979753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:07.981023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:07.981669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:08.129105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:08.137967 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-779c736c-01e0-4f3c-941d-88523e8e780a tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.173800 Jun 18 22:43:08.138556 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3115/6252] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:07 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:09.159352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:09.160362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:09.168812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:09.169308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:09.170102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:09.170552 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:09.309020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:09.320305 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4d6f3a65-7df4-4bfe-ae9f-30a479b68d01 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.167681 Jun 18 22:43:09.321059 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3138/6253] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:09 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:10.343447 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:10.343992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:10.351718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:10.352173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:10.352942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:10.353422 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:10.501622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:10.509538 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-47041cb4-9a0b-4a02-840e-61d2df3b74e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.170133 Jun 18 22:43:10.510339 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3116/6254] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:10 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:11.532133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:11.533209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:11.545246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:11.546034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:11.547594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:11.548345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:11.682438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:11.691023 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c725482f-f160-413d-90ec-0600546691e8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.165988 Jun 18 22:43:11.691586 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3139/6255] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:11 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:12.713793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:12.714738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:12.726792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:12.727242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:12.728023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:12.728457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:12.863624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:12.871470 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-48fc81dd-95be-4624-8035-5f8d040ff9c1 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.164326 Jun 18 22:43:12.872057 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3117/6256] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:12 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:13.889602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:13.890213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:13.897822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:13.898290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:13.899078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:13.899527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:14.045276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:14.053117 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c883762-97c7-4aaa-a873-c95631ef18b0 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.167521 Jun 18 22:43:14.053729 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3140/6257] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:13 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:15.071355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:15.072013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:15.080024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:15.080473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:15.081282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:15.081724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:15.225183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:15.233443 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ff906f00-3b18-4b13-896e-83157152d101 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.166124 Jun 18 22:43:15.234019 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3118/6258] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:15 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:16.251151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:16.251821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:16.261343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:16.262159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:16.263013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:16.263464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:16.411585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:16.420129 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bdea20a2-afe7-4295-8f94-7c6978072ff4 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1690 microversion: 2.1 time: 0.173502 Jun 18 22:43:16.420716 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3141/6259] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:16 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:17.442983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:17.443952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:17.453583 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:17.454037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:17.454808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:17.455245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:17.592052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:17.604078 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a48d62b2-d5fe-4438-bb71-8d1935cf6f6f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1696 microversion: 2.1 time: 0.167848 Jun 18 22:43:17.604709 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3119/6260] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:17 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:18.627457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:18.628064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:18.638030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:18.638620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:18.639744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:18.640370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:18.785636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:18.793728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c1d8aa87-fa91-47aa-a40e-487bc36ba626 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1696 microversion: 2.1 time: 0.173217 Jun 18 22:43:18.794333 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3142/6261] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:18 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:43:19.812074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:19.812679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:19.820443 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:19.820896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:19.821700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:19.822140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:19.957760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:19.965786 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1ace9c0-5825-4b26-b6b6-f5bce86a5422 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1681 microversion: 2.1 time: 0.157733 Jun 18 22:43:19.966341 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3120/6262] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:19 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:21.363538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f78e5d24-a54d-4bb3-99b1-d199657732a9 req-661bac98-838f-4dec-ae7b-6f617492c1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad15e81-5032-4319-9bd5-91245b67fb26", "name": "network-vif-plugged", "status": "completed", "tag": "bbd4ec39-97ab-4b60-9e3e-c7873c135d2f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:43:21.371700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f78e5d24-a54d-4bb3-99b1-d199657732a9 req-661bac98-838f-4dec-ae7b-6f617492c1b8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:21.372147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f78e5d24-a54d-4bb3-99b1-d199657732a9 req-661bac98-838f-4dec-ae7b-6f617492c1b8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:21.383142 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f78e5d24-a54d-4bb3-99b1-d199657732a9 req-661bac98-838f-4dec-ae7b-6f617492c1b8 service nova] Creating event network-vif-plugged:bbd4ec39-97ab-4b60-9e3e-c7873c135d2f for instance dad15e81-5032-4319-9bd5-91245b67fb26 on nch2-master-1 Jun 18 22:43:21.388588 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f78e5d24-a54d-4bb3-99b1-d199657732a9 req-661bac98-838f-4dec-ae7b-6f617492c1b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100980 Jun 18 22:43:21.389371 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3143/6263] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:43:44.217260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:43:44.218287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:44.220866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=20 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:44.224914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:44.232178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:44.232696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:44.233515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:44.233951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:44.285501 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4f9ed41-2606-4523-8b89-8a4839a75fd9 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "POST /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26/action" status: 200 len: 24571 microversion: 2.1 time: 0.072487 Jun 18 22:43:44.286139 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3121/6264] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:43:44 2022] POST /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:43:51.526781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-146900ce-7e38-4089-acc7-01f5bc2935f0 req-faa26393-ee5d-431e-83f4-0203a85e9038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dad15e81-5032-4319-9bd5-91245b67fb26", "tag": "bbd4ec39-97ab-4b60-9e3e-c7873c135d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:43:51.531095 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:51.531707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:51.534316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=18 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:51.534965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=48 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:43:51.544642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:51.545132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:51.545966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:51.546420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:51.553828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-146900ce-7e38-4089-acc7-01f5bc2935f0 req-faa26393-ee5d-431e-83f4-0203a85e9038 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:51.554292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-146900ce-7e38-4089-acc7-01f5bc2935f0 req-faa26393-ee5d-431e-83f4-0203a85e9038 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:51.570073 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-146900ce-7e38-4089-acc7-01f5bc2935f0 req-faa26393-ee5d-431e-83f4-0203a85e9038 service nova] Creating event network-changed:bbd4ec39-97ab-4b60-9e3e-c7873c135d2f for instance dad15e81-5032-4319-9bd5-91245b67fb26 on nch2-master-1 Jun 18 22:43:51.576046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-146900ce-7e38-4089-acc7-01f5bc2935f0 req-faa26393-ee5d-431e-83f4-0203a85e9038 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053425 Jun 18 22:43:51.576738 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3122/6265] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:43:51.583908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:43:51.668115 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a9c6104a-85a9-4cf0-9387-908e32230a0f tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 204 len: 0 microversion: 2.1 time: 0.148754 Jun 18 22:43:51.671862 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3144/6266] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:43:51 2022] DELETE /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:43:51.679065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:51.679765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:51.686750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:51.687213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:51.688070 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:51.688541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:51.832721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:51.840793 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-694473c1-c1ee-4957-9f29-4f28568e3827 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1687 microversion: 2.1 time: 0.167014 Jun 18 22:43:51.841408 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3123/6267] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:51 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:52.862299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:52.863296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:52.871662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:52.872228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:52.873078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:52.873544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:53.013253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:53.021298 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-635af1e9-0739-4ee0-a562-85a0f3571aa8 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1687 microversion: 2.1 time: 0.165427 Jun 18 22:43:53.022065 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3145/6268] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:52 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:53.623172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1fdd6c32-27ad-4a1e-a868-1c0874327745 req-bdc94af3-28eb-458e-8c2f-f419704dc2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dad15e81-5032-4319-9bd5-91245b67fb26", "name": "network-vif-deleted", "tag": "bbd4ec39-97ab-4b60-9e3e-c7873c135d2f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:43:53.632514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1fdd6c32-27ad-4a1e-a868-1c0874327745 req-bdc94af3-28eb-458e-8c2f-f419704dc2d0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:53.632960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1fdd6c32-27ad-4a1e-a868-1c0874327745 req-bdc94af3-28eb-458e-8c2f-f419704dc2d0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:53.644876 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1fdd6c32-27ad-4a1e-a868-1c0874327745 req-bdc94af3-28eb-458e-8c2f-f419704dc2d0 service nova] Creating event network-vif-deleted:bbd4ec39-97ab-4b60-9e3e-c7873c135d2f for instance dad15e81-5032-4319-9bd5-91245b67fb26 on nch2-master-1 Jun 18 22:43:53.650374 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1fdd6c32-27ad-4a1e-a868-1c0874327745 req-bdc94af3-28eb-458e-8c2f-f419704dc2d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030915 Jun 18 22:43:53.651045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3124/6269] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:43:54.039760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:54.040454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:54.048987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:54.049571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:54.050496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:54.051192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:54.089205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:54.089907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:54.090378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lazy-loading 'fault' on Instance uuid dad15e81-5032-4319-9bd5-91245b67fb26 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:43:54.136848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1b184b4aef04efc8996eff7af43dadb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c64dd112fa4f7c89b2f07494e6be49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:43:54.144178 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3247abcc-744f-4b0f-a8c2-e128fe0a1822 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 200 len: 1354 microversion: 2.1 time: 0.108743 Jun 18 22:43:54.144701 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3146/6270] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:54 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 1354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:43:55.168759 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:55.169544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] [instance: dad15e81-5032-4319-9bd5-91245b67fb26] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:43:55.176959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:55.177495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:55.178344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:43:55.178827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:43:55.194121 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] HTTP exception thrown: Instance dad15e81-5032-4319-9bd5-91245b67fb26 could not be found. Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Request method failure captured: Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 HTTP/1.1 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlNK8kBbJlOrOviubSLMuJzQnk_R8C6z0pQt_xqItqZ5xvK1KTyKwLEjZimOuX84aZbR2EK_ASTrQnR4s5fWBZjZYqmM6qLf5DYpzT4CJa9bvhJxdVD_ZCtDzGIpRXSLmgqPKNV2PzmnEzo6nhSrv33rPmRWzkNU-xTrxteIFycCu_0 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91c64dd112fa4f7c89b2f07494e6be49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91c64dd112fa4f7c89b2f07494e6be49", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 91c64dd112fa4f7c89b2f07494e6be49 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-52675202 Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: f1b184b4aef04efc8996eff7af43dadb Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkAdvancedServerOps-52675202-project Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance dad15e81-5032-4319-9bd5-91245b67fb26 could not be found. Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'dad15e81-5032-4319-9bd5-91245b67fb26'} Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dad15e81-5032-4319-9bd5-91245b67fb26 could not be found. Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dad15e81-5032-4319-9bd5-91245b67fb26 could not be found. Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:43:55.195918 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dad15e81-5032-4319-9bd5-91245b67fb26 could not be found. Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Returning 404 to user: Instance dad15e81-5032-4319-9bd5-91245b67fb26 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ca2a499-8dc1-465e-84f7-2478b67b4cf2 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26" status: 404 len: 111 microversion: 2.1 time: 0.036889 Jun 18 22:43:55.201023 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3125/6271] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:43:55 2022] GET /compute/v2.1/servers/dad15e81-5032-4319-9bd5-91245b67fb26 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:43:58.513480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-68958526-260a-476d-b1ab-2cbd18405072 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] Calling method '.version_select at 0x7fea14039310>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:43:58.534662 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-68958526-260a-476d-b1ab-2cbd18405072 tempest-TestNetworkAdvancedServerOps-52675202 tempest-TestNetworkAdvancedServerOps-52675202-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-470523361" status: 202 len: 0 microversion: 2.1 time: 0.025410 Jun 18 22:43:58.535262 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3147/6272] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Jun 18 22:43:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-470523361 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:44:11.363013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=10 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:11.363755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:11.482651 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1631393991", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:11.540666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] validate_networks() for None {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:44:11.835002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:44:11.835431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:44:11.835906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:44:11.836340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:44:11.836760 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:44:11.846157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:11.846619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:11.847470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:11.847912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:11.865341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Getting quotas for project 0e27446df2b84c9a9515d5774e39440d. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:44:11.870786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Getting quotas for user 4efe3ef96bb4427dbf23b5236da9689c and project 0e27446df2b84c9a9515d5774e39440d. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:44:11.884215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:44:11.886527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:44:11.935932 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4345346-ffb4-450c-b976-9063942fe185 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578635 Jun 18 22:44:11.936589 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3126/6273] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:44:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:44:11.947660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-badd90e5-9f66-468c-b158-b20abc8d9035 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:11.948275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-badd90e5-9f66-468c-b158-b20abc8d9035 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:11.951942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:11.952647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:12.012149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-badd90e5-9f66-468c-b158-b20abc8d9035 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:12.019719 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-badd90e5-9f66-468c-b158-b20abc8d9035 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1222 microversion: 2.1 time: 0.076194 Jun 18 22:44:12.020399 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3148/6274] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:11 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:13.040632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:13.041301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:13.049231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:13.049942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:13.050767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:13.051209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:13.114953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:13.123371 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f190ec66-f16b-4521-aba8-680e42a84a8d tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1282 microversion: 2.1 time: 0.087343 Jun 18 22:44:13.123967 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3127/6275] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:13 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:14.140218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:14.141130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:14.149136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:14.149550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:14.150332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:14.151659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:14.293794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:14.302004 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d9a8cc63-5d19-49b2-9df1-c057b1b8f177 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1322 microversion: 2.1 time: 0.165807 Jun 18 22:44:14.302677 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3149/6276] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:14 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:14.557224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f8787688-70cc-4ec7-84ef-6894114197ff req-f5c656c6-8728-4a35-8e7e-d877581783c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7388216-64fd-43a1-9481-64afb5899f8b", "tag": "df59f95b-9426-408d-a269-9299f8d167da"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:14.577428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f8787688-70cc-4ec7-84ef-6894114197ff req-f5c656c6-8728-4a35-8e7e-d877581783c7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:14.577880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f8787688-70cc-4ec7-84ef-6894114197ff req-f5c656c6-8728-4a35-8e7e-d877581783c7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:14.590365 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f8787688-70cc-4ec7-84ef-6894114197ff req-f5c656c6-8728-4a35-8e7e-d877581783c7 service nova] Creating event network-changed:df59f95b-9426-408d-a269-9299f8d167da for instance d7388216-64fd-43a1-9481-64afb5899f8b on nch2-master-1 Jun 18 22:44:14.598643 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f8787688-70cc-4ec7-84ef-6894114197ff req-f5c656c6-8728-4a35-8e7e-d877581783c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045985 Jun 18 22:44:14.599687 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3128/6277] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:15.322719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:15.323346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:15.332341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:15.332884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:15.333837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:15.334362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:15.468919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:15.477215 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-518dc4b5-15b8-4d18-a893-4173997a0537 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1322 microversion: 2.1 time: 0.159751 Jun 18 22:44:15.477806 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3150/6278] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:15 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:16.500340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:16.501502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:16.512401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:16.513210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:16.514434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:16.515200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:16.661425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:16.673722 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cd44c674-791b-4a12-bb5d-2c90a642187a tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1322 microversion: 2.1 time: 0.182065 Jun 18 22:44:16.674615 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3129/6279] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:16 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:17.694096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:17.695828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:17.704776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:17.705268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:17.706066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:17.706518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:17.852160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:17.866159 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-146e59a9-9f54-4019-9da2-09bbc2db1ebe tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1322 microversion: 2.1 time: 0.177871 Jun 18 22:44:17.866772 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3151/6280] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:17 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:18.888003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:18.889096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:18.898431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:18.898882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:18.899666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:18.900117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:19.052848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:19.064174 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-70df7c1e-acf3-48a3-abbc-f0d11e8ed171 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1322 microversion: 2.1 time: 0.183087 Jun 18 22:44:19.064941 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3130/6281] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:18 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:19.620615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6edebc61-2e08-4804-955a-6d2f78833228 req-773834e7-b574-4f3b-a9e8-e4a39bfefe59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7388216-64fd-43a1-9481-64afb5899f8b", "name": "network-vif-plugged", "status": "completed", "tag": "df59f95b-9426-408d-a269-9299f8d167da"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:19.630788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6edebc61-2e08-4804-955a-6d2f78833228 req-773834e7-b574-4f3b-a9e8-e4a39bfefe59 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:19.631349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6edebc61-2e08-4804-955a-6d2f78833228 req-773834e7-b574-4f3b-a9e8-e4a39bfefe59 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:19.643086 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6edebc61-2e08-4804-955a-6d2f78833228 req-773834e7-b574-4f3b-a9e8-e4a39bfefe59 service nova] Creating event network-vif-plugged:df59f95b-9426-408d-a269-9299f8d167da for instance d7388216-64fd-43a1-9481-64afb5899f8b on nch2-master-1 Jun 18 22:44:19.648120 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6edebc61-2e08-4804-955a-6d2f78833228 req-773834e7-b574-4f3b-a9e8-e4a39bfefe59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 Jun 18 22:44:19.648920 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3152/6282] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:44:20.082304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:20.082929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:20.090737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:20.091190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:20.091953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:20.092391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:20.233791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:20.241925 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-495a79b1-13d4-4deb-90cd-2f6aeddec212 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1322 microversion: 2.1 time: 0.163653 Jun 18 22:44:20.242533 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3131/6283] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:20 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:21.265628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:21.266832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:21.277676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:21.278467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:21.279771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:21.280546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:21.419309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:21.431524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5ac6e859-43a7-47ce-a509-4631fe8e43c8 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1472 microversion: 2.1 time: 0.174348 Jun 18 22:44:21.432338 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3153/6284] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:21 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:21.505397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-46e561e1-8e0c-407b-8611-d88e3ae18bba tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Calling method '.version_select at 0x7fea19bfee50>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:21.574449 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-46e561e1-8e0c-407b-8611-d88e3ae18bba tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/739e5921b831469c96d0d09fb2bf2f91" status: 200 len: 371 microversion: 2.1 time: 0.125142 Jun 18 22:44:21.575000 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3132/6285] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:44:21 2022] GET /compute/v2.1/os-quota-sets/739e5921b831469c96d0d09fb2bf2f91 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:21.585930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-520e20f6-5e5f-4f96-aa9c-7e85f7f9235d tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1494687606", "id": 1974202062, "os-flavor-access:is_public": "True"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:21.587559 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:44:21.587559 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:44:21.604064 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-520e20f6-5e5f-4f96-aa9c-7e85f7f9235d tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021997 Jun 18 22:44:21.607685 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3154/6286] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:44:21 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:21.615555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1974202062"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:21.616604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:21.623071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:21.623528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:21.624294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:21.624731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:21.819485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a7b3d7c775424fa1934a3823f13407ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5921b831469c96d0d09fb2bf2f91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:21.826837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1494687606 {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:44:21.833488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:21.833969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:21.834783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:21.835225 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:21.856516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Getting quotas for project 0e27446df2b84c9a9515d5774e39440d. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:44:21.861983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Getting quotas for user 4efe3ef96bb4427dbf23b5236da9689c and project 0e27446df2b84c9a9515d5774e39440d. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:44:21.874637 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.api [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] ram quota exceeded for 739e5921b831469c96d0d09fb2bf2f91, tried to resize instance. Jun 18 22:44:21.875183 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Request method failure captured: Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b/action HTTP/1.1 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 39 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlU7fRvGHMMitg7xSj2f7NeCL186Nx7aM98X8zuCE1xDpTo9RF5wBbnxuyHDUZF01D7Uafs8oRh_OiVN_BRjWyy-OySqYNivlYokYfvOTpfH9K_qLgBvtt2ITLu51Y2Kvk7csmDEMMXOa-sirWHwAIoURwbuGYsoNJ5HS2Oru7wD3zs Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 739e5921b831469c96d0d09fb2bf2f91 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1956461198 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Role: admin,member,reader Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: admin,member,reader Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/739e5921b831469c96d0d09fb2bf2f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/739e5921b831469c96d0d09fb2bf2f91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/739e5921b831469c96d0d09fb2bf2f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_739e5921b831469c96d0d09fb2bf2f91", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1956461198 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 739e5921b831469c96d0d09fb2bf2f91 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1956461198 Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAdminNegativeTestJSON-1956461198-project-admin Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: a7b3d7c775424fa1934a3823f13407ca Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1956461198-project-admin Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: {"resize": {"flavorRef": "1974202062"}} Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd7388216-64fd-43a1-9481-64afb5899f8b', 'body': {'resize': {'flavorRef': '1974202062'}}} Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:44:21.877374 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58acc471-fce0-42c2-bc9d-8b4c8c12dbd3 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b/action" status: 403 len: 118 microversion: 2.1 time: 0.267246 Jun 18 22:44:21.881722 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3133/6287] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:44:21 2022] POST /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b/action => generated 118 bytes in 268 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:44:21.888042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-729e407c-215c-48f2-9e46-4cb68a2cedbf tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:21.888799 ncdv-master-1 devstack@n-api.service[130903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:44:21.888799 ncdv-master-1 devstack@n-api.service[130903]: warnings.warn(msg) Jun 18 22:44:21.907818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-729e407c-215c-48f2-9e46-4cb68a2cedbf tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1974202062" status: 202 len: 0 microversion: 2.1 time: 0.023438 Jun 18 22:44:21.908396 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3155/6288] 10.222.0.30 () {58 vars in 1160 bytes} [Sat Jun 18 22:44:21 2022] DELETE /compute/v2.1/flavors/1974202062 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:44:21.916360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4df6c409-b87a-4231-ade6-4d710c3e1c60 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:21.935192 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4df6c409-b87a-4231-ade6-4d710c3e1c60 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022560 Jun 18 22:44:21.935880 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3134/6289] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:44:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:21.952980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-509dc115-5d8a-497b-84ff-7be899d4a938 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Calling method '.version_select at 0x7fea078a71f0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:22.016729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:22.036757 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-509dc115-5d8a-497b-84ff-7be899d4a938 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/739e5921b831469c96d0d09fb2bf2f91" status: 200 len: 371 microversion: 2.1 time: 0.087845 Jun 18 22:44:22.037366 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3156/6290] 10.222.0.30 () {58 vars in 1241 bytes} [Sat Jun 18 22:44:21 2022] GET /compute/v2.1/os-quota-sets/739e5921b831469c96d0d09fb2bf2f91 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:22.047626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a3835da-e51e-4d11-a5fa-6c114a745922 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-196483445", "id": 787807892, "os-flavor-access:is_public": "True"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:22.049262 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:44:22.049262 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:44:22.066274 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a3835da-e51e-4d11-a5fa-6c114a745922 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022395 Jun 18 22:44:22.066833 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3135/6291] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:44:22 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:22.080356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "787807892"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:22.081912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:22.090900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.091430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.092259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.092745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.238525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a7b3d7c775424fa1934a3823f13407ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '739e5921b831469c96d0d09fb2bf2f91', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:22.245450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-196483445 {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:44:22.252212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.252680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.253547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.254004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.277426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Getting quotas for project 0e27446df2b84c9a9515d5774e39440d. Resources: {'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:44:22.282772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Getting quotas for user 4efe3ef96bb4427dbf23b5236da9689c and project 0e27446df2b84c9a9515d5774e39440d. Resources: {'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:44:22.300988 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.api [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] cores quota exceeded for 739e5921b831469c96d0d09fb2bf2f91, tried to resize instance. Jun 18 22:44:22.301846 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Request method failure captured: Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b/action HTTP/1.1 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 38 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlU7fRvGHMMitg7xSj2f7NeCL186Nx7aM98X8zuCE1xDpTo9RF5wBbnxuyHDUZF01D7Uafs8oRh_OiVN_BRjWyy-OySqYNivlYokYfvOTpfH9K_qLgBvtt2ITLu51Y2Kvk7csmDEMMXOa-sirWHwAIoURwbuGYsoNJ5HS2Oru7wD3zs Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 739e5921b831469c96d0d09fb2bf2f91 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1956461198 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Role: admin,member,reader Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: admin,member,reader Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/739e5921b831469c96d0d09fb2bf2f91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/739e5921b831469c96d0d09fb2bf2f91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/739e5921b831469c96d0d09fb2bf2f91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_739e5921b831469c96d0d09fb2bf2f91", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1956461198 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 739e5921b831469c96d0d09fb2bf2f91 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1956461198 Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersAdminNegativeTestJSON-1956461198-project-admin Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: a7b3d7c775424fa1934a3823f13407ca Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1956461198-project-admin Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: {"resize": {"flavorRef": "787807892"}} Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'd7388216-64fd-43a1-9481-64afb5899f8b', 'body': {'resize': {'flavorRef': '787807892'}}} Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:44:22.303610 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-53065187-bdf7-4c97-af97-e83e668829b9 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b/action" status: 403 len: 113 microversion: 2.1 time: 0.231076 Jun 18 22:44:22.307785 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3157/6292] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:44:22 2022] POST /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b/action => generated 113 bytes in 233 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:44:22.316300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-efae4f01-6b24-4bbc-8440-37052cedc791 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:22.317006 ncdv-master-1 devstack@n-api.service[130902]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 18 22:44:22.317006 ncdv-master-1 devstack@n-api.service[130902]: warnings.warn(msg) Jun 18 22:44:22.336148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-efae4f01-6b24-4bbc-8440-37052cedc791 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/787807892" status: 202 len: 0 microversion: 2.1 time: 0.025078 Jun 18 22:44:22.336693 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3136/6293] 10.222.0.30 () {58 vars in 1157 bytes} [Sat Jun 18 22:44:22 2022] DELETE /compute/v2.1/flavors/787807892 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:44:22.347815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a417210f-387f-4a22-abff-bce25e612c64 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:22.369272 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a417210f-387f-4a22-abff-bce25e612c64 tempest-ServersAdminNegativeTestJSON-1956461198 tempest-ServersAdminNegativeTestJSON-1956461198-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027473 Jun 18 22:44:22.369805 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3158/6294] 10.222.0.30 () {58 vars in 1145 bytes} [Sat Jun 18 22:44:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:22.386390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:22.386922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:22.393276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.393739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.394538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.394982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.420772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:44:22.500232 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ad11604a-16e6-48f3-9fce-1053d8f49c47 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 204 len: 0 microversion: 2.1 time: 0.117678 Jun 18 22:44:22.500839 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3137/6295] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:44:22 2022] DELETE /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:44:22.509273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:22.509912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:22.516179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.516646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.517470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:22.517933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:22.655661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:22.663921 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-797c4db3-31a8-4de8-91d2-6ebb44889489 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1478 microversion: 2.1 time: 0.158679 Jun 18 22:44:22.664781 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3159/6296] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:22 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:23.681814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:23.682530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:23.693932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:23.694397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:23.695253 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:23.695666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:23.827405 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4efe3ef96bb4427dbf23b5236da9689c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e27446df2b84c9a9515d5774e39440d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:23.836317 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d55a0c3c-95ab-49fa-9b3a-a2bed78b1647 tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 200 len: 1478 microversion: 2.1 time: 0.159154 Jun 18 22:44:23.837126 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3138/6297] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:23 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:24.229866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-86e3ebea-d0bc-48f5-b4e3-9d991c184a2b req-a591dd70-b4e4-42ea-9c73-72c277f43440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7388216-64fd-43a1-9481-64afb5899f8b", "name": "network-vif-deleted", "tag": "df59f95b-9426-408d-a269-9299f8d167da"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:24.243672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-86e3ebea-d0bc-48f5-b4e3-9d991c184a2b req-a591dd70-b4e4-42ea-9c73-72c277f43440 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:24.244192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-86e3ebea-d0bc-48f5-b4e3-9d991c184a2b req-a591dd70-b4e4-42ea-9c73-72c277f43440 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:24.257630 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-86e3ebea-d0bc-48f5-b4e3-9d991c184a2b req-a591dd70-b4e4-42ea-9c73-72c277f43440 service nova] Creating event network-vif-deleted:df59f95b-9426-408d-a269-9299f8d167da for instance d7388216-64fd-43a1-9481-64afb5899f8b on nch2-master-1 Jun 18 22:44:24.263154 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-86e3ebea-d0bc-48f5-b4e3-9d991c184a2b req-a591dd70-b4e4-42ea-9c73-72c277f43440 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037207 Jun 18 22:44:24.263794 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3160/6298] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:24.856521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:24.857862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] [instance: d7388216-64fd-43a1-9481-64afb5899f8b] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:24.868022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:24.868487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:24.869306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:24.869752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:24.883996 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] HTTP exception thrown: Instance d7388216-64fd-43a1-9481-64afb5899f8b could not be found. Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Request method failure captured: Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b HTTP/1.1 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlU6eAJGk9hSsBFN3Qn43e1tlUIYAG71q2E_iBNfCTyNjB_h27yophyxHBYfnOXy-tjwJ2vzY8DaovTjugUPKlXUHJ4nHrEMU6xiCj6rilbHn1K36AMbF0dg33ubuywABWG2zCCzvQ0qbLrB_-hjqqyPZX74mcrq9Pi66kJCaKen8MQ Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 0e27446df2b84c9a9515d5774e39440d Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1157254486 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e27446df2b84c9a9515d5774e39440d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e27446df2b84c9a9515d5774e39440d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e27446df2b84c9a9515d5774e39440d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e27446df2b84c9a9515d5774e39440d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1157254486 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 0e27446df2b84c9a9515d5774e39440d Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1157254486 Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersAdminNegativeTestJSON-1157254486-project Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 4efe3ef96bb4427dbf23b5236da9689c Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1157254486-project Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance d7388216-64fd-43a1-9481-64afb5899f8b could not be found. Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'd7388216-64fd-43a1-9481-64afb5899f8b'} Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7388216-64fd-43a1-9481-64afb5899f8b could not be found. Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7388216-64fd-43a1-9481-64afb5899f8b could not be found. Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:24.885734 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7388216-64fd-43a1-9481-64afb5899f8b could not be found. Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] Returning 404 to user: Instance d7388216-64fd-43a1-9481-64afb5899f8b could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db2bb6a1-45f6-4178-8abd-fcf7b9dfbcac tempest-ServersAdminNegativeTestJSON-1157254486 tempest-ServersAdminNegativeTestJSON-1157254486-project] 10.222.0.30 "GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b" status: 404 len: 111 microversion: 2.1 time: 0.036974 Jun 18 22:44:24.889612 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3139/6299] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:24 2022] GET /compute/v2.1/servers/d7388216-64fd-43a1-9481-64afb5899f8b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:44:31.252031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-693702382", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "f6847fca-f2ef-4d48-bbf6-de9441c26b70"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:31.304936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] validate_networks() for [('f6847fca-f2ef-4d48-bbf6-de9441c26b70', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:44:31.719730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:44:31.720173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:44:31.720695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:44:31.721153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:44:31.721610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:44:31.731526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:31.732026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:31.732893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:31.733464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:31.751352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Getting quotas for project bd65fe93bda9470493efe3e6a02ac71d. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:44:31.756937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Getting quotas for user 9c987bdff390488a8a130f3ccdd46fda and project bd65fe93bda9470493efe3e6a02ac71d. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:44:31.770520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:44:31.773105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:44:31.821001 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dbf1efa7-d7cc-40f8-b0e3-80844a0790de tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693984 Jun 18 22:44:31.829056 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3161/6300] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:44:31.836520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21a24768-0c5c-4492-af48-3d56c053f654 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:31.837640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21a24768-0c5c-4492-af48-3d56c053f654 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:31.840722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:31.847641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=5 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:31.909803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21a24768-0c5c-4492-af48-3d56c053f654 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:31.917529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21a24768-0c5c-4492-af48-3d56c053f654 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1214 microversion: 2.1 time: 0.089064 Jun 18 22:44:31.918136 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3140/6301] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:31 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:32.934032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dc7bb652-908d-4968-afc8-52b7aa25a680 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:32.934773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dc7bb652-908d-4968-afc8-52b7aa25a680 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:32.995950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dc7bb652-908d-4968-afc8-52b7aa25a680 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:33.003886 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dc7bb652-908d-4968-afc8-52b7aa25a680 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1214 microversion: 2.1 time: 0.073447 Jun 18 22:44:33.009211 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3162/6302] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:32 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:34.037314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:34.038017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:34.049155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:34.050037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:34.052148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:34.052823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:34.158145 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:34.172315 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c5a4c84-fd26-424f-91d9-f3986667ac1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1272 microversion: 2.1 time: 0.150938 Jun 18 22:44:34.173156 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3141/6303] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:34 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:35.191515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:35.193388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:35.204558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:35.205061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:35.206016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:35.206471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:35.368265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:35.377343 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e753d16f-b0dd-45a9-aa38-1ab4fc73ce1d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1314 microversion: 2.1 time: 0.190726 Jun 18 22:44:35.388020 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3163/6304] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:35 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:35.414038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-315add3e-33f0-4dcf-9440-cb9083075297 req-30591131-f0d8-4cd0-9f1b-bd608fa1789e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2458ae00-07ae-4635-a56d-adce83f7751a", "tag": "5410f458-8988-45b3-b5f4-88357971acf9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:35.440750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-315add3e-33f0-4dcf-9440-cb9083075297 req-30591131-f0d8-4cd0-9f1b-bd608fa1789e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:35.445108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-315add3e-33f0-4dcf-9440-cb9083075297 req-30591131-f0d8-4cd0-9f1b-bd608fa1789e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:35.458844 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-315add3e-33f0-4dcf-9440-cb9083075297 req-30591131-f0d8-4cd0-9f1b-bd608fa1789e service nova] Creating event network-changed:5410f458-8988-45b3-b5f4-88357971acf9 for instance 2458ae00-07ae-4635-a56d-adce83f7751a on nch2-master-1 Jun 18 22:44:35.464308 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-315add3e-33f0-4dcf-9440-cb9083075297 req-30591131-f0d8-4cd0-9f1b-bd608fa1789e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055182 Jun 18 22:44:35.464926 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3142/6305] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:36.394974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:36.395768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:36.402189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:36.402652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:36.403464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:36.403899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:36.541773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:36.549781 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6647c49-518e-48ca-ac19-d436478f5119 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1314 microversion: 2.1 time: 0.159198 Jun 18 22:44:36.550278 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3164/6306] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:36 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:37.568408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:37.569189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:37.576565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:37.577019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:37.577861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:37.578303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:37.711918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:37.719867 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d39654b-bb97-4187-9648-e2e22780ee24 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1314 microversion: 2.1 time: 0.156764 Jun 18 22:44:37.720730 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3143/6307] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:37 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:38.742052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:38.743094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:38.757655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:38.759074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:38.760940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:38.761805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:38.897006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:38.904870 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-07e2d86f-39bb-4830-bc4d-d97962c2be89 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1314 microversion: 2.1 time: 0.169449 Jun 18 22:44:38.905454 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3165/6308] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:38 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:39.693805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b3215da1-c634-46ed-a42c-241f1c4eee4e req-53a27893-05a1-4528-9e45-8d9af9a9e2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2458ae00-07ae-4635-a56d-adce83f7751a", "name": "network-vif-plugged", "status": "completed", "tag": "5410f458-8988-45b3-b5f4-88357971acf9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:39.703808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b3215da1-c634-46ed-a42c-241f1c4eee4e req-53a27893-05a1-4528-9e45-8d9af9a9e2e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:39.704368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b3215da1-c634-46ed-a42c-241f1c4eee4e req-53a27893-05a1-4528-9e45-8d9af9a9e2e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:39.715913 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b3215da1-c634-46ed-a42c-241f1c4eee4e req-53a27893-05a1-4528-9e45-8d9af9a9e2e9 service nova] Creating event network-vif-plugged:5410f458-8988-45b3-b5f4-88357971acf9 for instance 2458ae00-07ae-4635-a56d-adce83f7751a on nch2-master-1 Jun 18 22:44:39.720950 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b3215da1-c634-46ed-a42c-241f1c4eee4e req-53a27893-05a1-4528-9e45-8d9af9a9e2e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031560 Jun 18 22:44:39.721745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3144/6309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:44:39.928434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:39.929055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:39.938239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:39.938703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:39.939509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:39.939938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:40.081431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:40.089273 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9e405f2f-375b-493c-be48-a447de5418e2 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1314 microversion: 2.1 time: 0.166794 Jun 18 22:44:40.089855 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3166/6310] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:39 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:41.112941 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:41.114176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:41.123916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:41.124367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:41.125241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:41.125681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:41.269932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:41.278171 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5b060cff-b43e-435b-90f9-599465734268 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1500 microversion: 2.1 time: 0.173867 Jun 18 22:44:41.278748 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3145/6311] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:41 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:41.294771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:44:41.295848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:41.303341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:41.303815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:41.304642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:41.305135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:41.333700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:41.339830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Old instance type m1.heat2, new instance type m1.heat {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:44:41.346236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:44:41.346690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:44:41.347181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:44:41.347609 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:44:41.348044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:44:41.415035 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c8657b49-a1ae-4d68-9f8f-095d0445a6c4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "POST /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a/action" status: 202 len: 0 microversion: 2.1 time: 0.124215 Jun 18 22:44:41.418988 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3167/6312] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:44:41 2022] POST /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:44:41.426975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:41.427792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:41.429976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:41.435476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:41.436001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:41.436844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:41.437290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:41.442195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:41.585445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:41.593135 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d4eca52-a9bf-4a6c-9e7d-e6ba4f34b2f9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1509 microversion: 2.1 time: 0.170046 Jun 18 22:44:41.594332 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3146/6313] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:41 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:42.608706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:42.615818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:42.616777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:42.619500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:42.626329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:42.626791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:42.627578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:42.628045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:42.632838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:42.771578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:42.779704 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7656e9a8-a677-448a-9b21-b861e8d692d9 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1509 microversion: 2.1 time: 0.172155 Jun 18 22:44:42.780292 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3168/6314] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:42 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:43.798588 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:43.799220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:43.801340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:43.808171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:43.808650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:43.809507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:43.809971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:43.949992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:43.958478 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-04bbf1fc-c0ae-47a7-ba11-19f1a7bf1962 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.164075 Jun 18 22:44:43.959032 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3147/6315] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:43 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:44.984120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:44.985247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:44.988253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:44:44.998252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:44.998711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:44.999494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:44.999940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:45.136832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:45.144747 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef174c99-b586-4959-92f2-c836a12ba256 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.167983 Jun 18 22:44:45.145370 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3169/6316] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:44 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:46.166209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:46.167235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:46.175251 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:46.175702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:46.176474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:46.176914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:46.313793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:46.322289 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-903c158f-d436-4fb9-8e96-a1ab0418ead4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.162642 Jun 18 22:44:46.322869 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3148/6317] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:46 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:47.343111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:47.343670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:47.351059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:47.351525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:47.352302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:47.352746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:47.484846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:47.493345 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9272a629-90ec-4823-822e-e02c2d296289 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.156026 Jun 18 22:44:47.493903 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3170/6318] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:47 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:48.510874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:48.511539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:48.519190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:48.519957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:48.520477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:48.520913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:48.659335 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:48.667356 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-39289e5b-6a6a-4019-853e-16239d3e0f1f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.160583 Jun 18 22:44:48.667929 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3149/6319] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:48 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:49.688789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:49.689725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:49.699259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:49.699874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:49.700892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:49.701882 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:49.847341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:49.855311 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bb63e15b-379c-4b9e-9cd6-622c26875a39 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.172977 Jun 18 22:44:49.855888 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3171/6320] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:49 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:50.872676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:50.873305 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:50.880881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:50.881442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:50.882212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:50.882630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:51.014948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:51.023087 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a021b576-1d1a-4a00-b2be-dc2bfa249895 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.154408 Jun 18 22:44:51.023667 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3150/6321] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:50 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:52.041352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:52.042055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:52.049958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:52.050469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:52.051492 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:52.051983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:52.191579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:52.201257 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-47a0151c-9bc9-4ff2-a7dc-4181c22eae91 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.164227 Jun 18 22:44:52.202419 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3172/6322] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:52 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:53.222977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:53.223918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:53.236114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:53.236586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:53.237383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:53.237817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:53.375230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:53.383967 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2cff0ad8-6223-4f11-a52b-128ae6dbb57d tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.167752 Jun 18 22:44:53.384525 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3151/6323] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:53 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:54.405291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:54.406335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:54.418348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:54.419124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:54.420426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:54.421229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:54.567237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:54.575040 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2387321a-cceb-4732-9844-5a4f633b9a80 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.176335 Jun 18 22:44:54.575591 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3173/6324] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:54 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:55.593347 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:55.594088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:55.601462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:55.601916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:55.602689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:55.603135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:55.742723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:55.753498 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d65dc43a-1621-4531-96b3-1f014ea00ad7 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.164207 Jun 18 22:44:55.754107 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3152/6325] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:55 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:56.775170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:56.776201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:56.787985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:56.788758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:56.790100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:56.790855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:56.927341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:56.939583 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dba51b96-f95c-46fd-b847-2e45fff04261 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.170726 Jun 18 22:44:56.940304 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3174/6326] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:56 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:57.960852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:57.961469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:57.971762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:57.972215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:57.973063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:57.973472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:58.112103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:58.124059 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52e5e706-069b-4069-ae2d-c66d17bb2599 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.169267 Jun 18 22:44:58.124804 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3153/6327] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:57 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:44:59.144848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:44:59.145474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:44:59.155070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:59.155646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:59.156437 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:44:59.156889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:44:59.298134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:44:59.309471 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8bec23c7-618c-48b4-8e9d-1fa8a32fbf2a tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.169909 Jun 18 22:44:59.310205 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3175/6328] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:44:59 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:00.328047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:00.328673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:00.335979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:00.337175 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:00.337987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:00.338445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:00.480868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:00.489050 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-87846ddb-9ddb-4d2d-93ef-011efe1cbd14 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.165369 Jun 18 22:45:00.489638 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3154/6329] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:00 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:01.511323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:01.512312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:01.524551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:01.525407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:01.526703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:01.527458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:01.666191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:01.678758 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-db85302f-ee63-4624-b847-824ecd3e1a99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.173899 Jun 18 22:45:01.679535 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3176/6330] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:01 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:02.704708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:02.705604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:02.712869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:02.713354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:02.714124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:02.714590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:02.851439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:02.859920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b18dff30-20bf-4e31-8f78-7d5780643e46 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.162339 Jun 18 22:45:02.860505 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3155/6331] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:02 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:03.881798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:03.882879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:03.894647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:03.895407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:03.896678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:03.897466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:04.043727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:04.052030 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af5ff339-4732-4bd9-b244-ef471463389e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.177216 Jun 18 22:45:04.052617 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3177/6332] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:03 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:05.069554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:05.070184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:05.078159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:05.078619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:05.079401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:05.079836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:05.230875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:05.239018 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b8eccf8-0fe8-43c6-a5f5-f73ee8c644b4 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.173420 Jun 18 22:45:05.239602 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3156/6333] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:05 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:06.260971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:06.261918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:06.273533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:06.274320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:06.275601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:06.276321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:06.416765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:06.427045 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-70a04afe-aec3-46be-8b2b-949565fab74e tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.173044 Jun 18 22:45:06.427641 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3178/6334] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:06 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:07.448522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:07.449488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:07.459655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:07.460112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:07.460936 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:07.461410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:07.599174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:07.607071 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55c962f3-bb24-4ad8-aa8e-0019947f686b tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.165406 Jun 18 22:45:07.607656 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3157/6335] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:07 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:08.628405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:08.629978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:08.643430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:08.643902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:08.644699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:08.645178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:08.785522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:08.795836 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-af4edc77-e154-4e84-940b-b9dd3118df99 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.174082 Jun 18 22:45:08.796451 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3179/6336] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:08 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:09.817499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:09.818630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:09.826262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:09.826722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:09.827925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:09.828426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:09.970650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:09.978970 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da0ee374-ad14-430b-9dff-49bc33a1f031 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1514 microversion: 2.1 time: 0.168710 Jun 18 22:45:09.979558 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3158/6337] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:09 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:10.748973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-f7ed976a-12d4-45e9-9152-5fe06403a81e req-79943cd9-41ab-46ee-8916-5549cdf94fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2458ae00-07ae-4635-a56d-adce83f7751a", "name": "network-vif-unplugged", "status": "completed", "tag": "5410f458-8988-45b3-b5f4-88357971acf9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:10.759738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f7ed976a-12d4-45e9-9152-5fe06403a81e req-79943cd9-41ab-46ee-8916-5549cdf94fdb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:10.760274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-f7ed976a-12d4-45e9-9152-5fe06403a81e req-79943cd9-41ab-46ee-8916-5549cdf94fdb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:10.773427 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-f7ed976a-12d4-45e9-9152-5fe06403a81e req-79943cd9-41ab-46ee-8916-5549cdf94fdb service nova] Creating event network-vif-unplugged:5410f458-8988-45b3-b5f4-88357971acf9 for instance 2458ae00-07ae-4635-a56d-adce83f7751a on nch1-master-1 Jun 18 22:45:10.779097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-f7ed976a-12d4-45e9-9152-5fe06403a81e req-79943cd9-41ab-46ee-8916-5549cdf94fdb service nova] Instance 2458ae00-07ae-4635-a56d-adce83f7751a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:45:10.790141 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-f7ed976a-12d4-45e9-9152-5fe06403a81e req-79943cd9-41ab-46ee-8916-5549cdf94fdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044946 Jun 18 22:45:10.790758 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3180/6338] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:45:10.996195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:10.996824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:11.004435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:11.004893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:11.005718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:11.006167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:11.172246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:11.182336 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee7fb8a2-6762-47e8-8883-163475a86848 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1513 microversion: 2.1 time: 0.190356 Jun 18 22:45:11.183007 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3159/6339] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:10 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:12.205112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:12.206295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:12.215645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:12.216088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:12.216871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:12.217354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:12.358894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:12.367125 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab8f3ffb-23b2-415d-a79e-e70b41bb5f42 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1511 microversion: 2.1 time: 0.169770 Jun 18 22:45:12.367728 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3181/6340] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:12 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:12.811412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-cf711ecd-21f2-4d66-a5fe-d797c74e4376 req-b2d13e4a-1b03-449e-8e25-b1bf745c6c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2458ae00-07ae-4635-a56d-adce83f7751a", "tag": "5410f458-8988-45b3-b5f4-88357971acf9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:12.817290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=28 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:12.825804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cf711ecd-21f2-4d66-a5fe-d797c74e4376 req-b2d13e4a-1b03-449e-8e25-b1bf745c6c3f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:12.826242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-cf711ecd-21f2-4d66-a5fe-d797c74e4376 req-b2d13e4a-1b03-449e-8e25-b1bf745c6c3f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:12.829226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=84 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:12.839840 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-cf711ecd-21f2-4d66-a5fe-d797c74e4376 req-b2d13e4a-1b03-449e-8e25-b1bf745c6c3f service nova] Creating event network-changed:5410f458-8988-45b3-b5f4-88357971acf9 for instance 2458ae00-07ae-4635-a56d-adce83f7751a on nch1-master-1 Jun 18 22:45:12.845756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-cf711ecd-21f2-4d66-a5fe-d797c74e4376 req-b2d13e4a-1b03-449e-8e25-b1bf745c6c3f service nova] Instance 2458ae00-07ae-4635-a56d-adce83f7751a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:45:12.856816 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-cf711ecd-21f2-4d66-a5fe-d797c74e4376 req-b2d13e4a-1b03-449e-8e25-b1bf745c6c3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051782 Jun 18 22:45:12.857489 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3160/6341] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:45:13.386033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:13.386693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:13.389647 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=28 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:13.395203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:13.395659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:13.396568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:13.396867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:13.399745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=82 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:13.536857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:13.548408 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03f75d51-0d26-452e-96af-f3f638e9d8f6 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1511 microversion: 2.1 time: 0.167130 Jun 18 22:45:13.549190 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3182/6342] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:13 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:14.567223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:14.568582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:14.575062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:14.575529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:14.576285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:14.576720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:14.716041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:14.724298 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-587e04b7-8294-4622-9a85-aabe76584fdd tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1508 microversion: 2.1 time: 0.162443 Jun 18 22:45:14.724961 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3161/6343] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:14 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:14.740888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:14.741471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:14.748586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:14.749313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:14.750113 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:14.750572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:14.776772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:45:14.831191 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.compute.api [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Found an unconfirmed migration during delete, id: 16, status: finished Jun 18 22:45:16.174743 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-511776f5-93e4-49c7-b220-7111c7478e8f tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 204 len: 0 microversion: 2.1 time: 1.437430 Jun 18 22:45:16.176235 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3183/6344] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:45:14 2022] DELETE /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 0 bytes in 1440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:45:16.184656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:16.185326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:16.192566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:16.193019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:16.193819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:16.194265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:16.355121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:16.363102 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9411b514-c980-438c-914a-e53100f87237 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1500 microversion: 2.1 time: 0.182399 Jun 18 22:45:16.363652 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3162/6345] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:16 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1500 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:16.728367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-548d104d-4930-4749-9d9c-2e6c80aebfad req-750f8a76-b290-4f35-aaf8-d8aa171af740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2458ae00-07ae-4635-a56d-adce83f7751a", "name": "network-vif-plugged", "status": "completed", "tag": "5410f458-8988-45b3-b5f4-88357971acf9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:16.737812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-548d104d-4930-4749-9d9c-2e6c80aebfad req-750f8a76-b290-4f35-aaf8-d8aa171af740 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:16.738274 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-548d104d-4930-4749-9d9c-2e6c80aebfad req-750f8a76-b290-4f35-aaf8-d8aa171af740 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:16.750403 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-548d104d-4930-4749-9d9c-2e6c80aebfad req-750f8a76-b290-4f35-aaf8-d8aa171af740 service nova] Creating event network-vif-plugged:5410f458-8988-45b3-b5f4-88357971acf9 for instance 2458ae00-07ae-4635-a56d-adce83f7751a on nch1-master-1 Jun 18 22:45:16.755572 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-548d104d-4930-4749-9d9c-2e6c80aebfad req-750f8a76-b290-4f35-aaf8-d8aa171af740 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031528 Jun 18 22:45:16.756331 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3184/6346] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:45:17.380878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:17.381845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:17.388857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:17.389337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:17.390127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:17.390538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:17.522282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c987bdff390488a8a130f3ccdd46fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd65fe93bda9470493efe3e6a02ac71d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:17.530166 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a4ec0b1-fbe2-49d5-a69a-727b8092e115 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 200 len: 1500 microversion: 2.1 time: 0.153586 Jun 18 22:45:17.530731 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3163/6347] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:17 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:18.295616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8fbe6da6-bfec-493e-8819-78d440f2506d req-3be1d0c6-c645-46ae-88f7-164cd64a5c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2458ae00-07ae-4635-a56d-adce83f7751a", "name": "network-vif-deleted", "tag": "5410f458-8988-45b3-b5f4-88357971acf9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:18.305175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8fbe6da6-bfec-493e-8819-78d440f2506d req-3be1d0c6-c645-46ae-88f7-164cd64a5c2d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.305742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8fbe6da6-bfec-493e-8819-78d440f2506d req-3be1d0c6-c645-46ae-88f7-164cd64a5c2d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.317634 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8fbe6da6-bfec-493e-8819-78d440f2506d req-3be1d0c6-c645-46ae-88f7-164cd64a5c2d service nova] Creating event network-vif-deleted:5410f458-8988-45b3-b5f4-88357971acf9 for instance 2458ae00-07ae-4635-a56d-adce83f7751a on nch1-master-1 Jun 18 22:45:18.322815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8fbe6da6-bfec-493e-8819-78d440f2506d req-3be1d0c6-c645-46ae-88f7-164cd64a5c2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 Jun 18 22:45:18.323417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3185/6348] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:45:18.547635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:18.548179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:18.555457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.555912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.556702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.557173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.571795 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] HTTP exception thrown: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Request method failure captured: Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a HTTP/1.1 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlVOKsRSIsU7fhDf78j-8jVXz2ezpXe17bkReOXOt-tWXyDHfSi40rdw7XgGlWj2-5AlzKq_u6L_pC7hhJavJhzwtsJQG0-_LOR5b3b39CfgtJqMv7NQ5JkB4FEIT41kRZOzZ702G302cuhLik7i_-wsWUZMX3mCEmlZjG3au6SxwHc Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: bd65fe93bda9470493efe3e6a02ac71d Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd65fe93bda9470493efe3e6a02ac71d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: bd65fe93bda9470493efe3e6a02ac71d Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-59705828-project Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 9c987bdff390488a8a130f3ccdd46fda Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-59705828-project Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2458ae00-07ae-4635-a56d-adce83f7751a'} Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:45:18.573555 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Returning 404 to user: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2bbbcb4d-76ae-4333-9830-5cda428b1cbe tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 404 len: 111 microversion: 2.1 time: 0.031427 Jun 18 22:45:18.578160 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3164/6349] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:18 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:45:18.591020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:18.591721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:18.598954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.599420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.600217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.600671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.615140 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] HTTP exception thrown: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Request method failure captured: Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a HTTP/1.1 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlVOKsRSIsU7fhDf78j-8jVXz2ezpXe17bkReOXOt-tWXyDHfSi40rdw7XgGlWj2-5AlzKq_u6L_pC7hhJavJhzwtsJQG0-_LOR5b3b39CfgtJqMv7NQ5JkB4FEIT41kRZOzZ702G302cuhLik7i_-wsWUZMX3mCEmlZjG3au6SxwHc Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: bd65fe93bda9470493efe3e6a02ac71d Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd65fe93bda9470493efe3e6a02ac71d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: bd65fe93bda9470493efe3e6a02ac71d Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-DeleteServersTestJSON-59705828-project Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 9c987bdff390488a8a130f3ccdd46fda Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-DeleteServersTestJSON-59705828-project Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2458ae00-07ae-4635-a56d-adce83f7751a'} Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:45:18.617008 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Returning 404 to user: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:45:18.621447 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1019073-76df-4e4a-8af4-e248167df9a3 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 404 len: 111 microversion: 2.1 time: 0.032006 Jun 18 22:45:18.622501 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3186/6350] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:45:18 2022] DELETE /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:45:18.627978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:18.628598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] [instance: 2458ae00-07ae-4635-a56d-adce83f7751a] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:18.635785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.636200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.637067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:18.637557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:18.657329 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] HTTP exception thrown: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Request method failure captured: Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a HTTP/1.1 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlVOKsRSIsU7fhDf78j-8jVXz2ezpXe17bkReOXOt-tWXyDHfSi40rdw7XgGlWj2-5AlzKq_u6L_pC7hhJavJhzwtsJQG0-_LOR5b3b39CfgtJqMv7NQ5JkB4FEIT41kRZOzZ702G302cuhLik7i_-wsWUZMX3mCEmlZjG3au6SxwHc Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: bd65fe93bda9470493efe3e6a02ac71d Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd65fe93bda9470493efe3e6a02ac71d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd65fe93bda9470493efe3e6a02ac71d", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: bd65fe93bda9470493efe3e6a02ac71d Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-DeleteServersTestJSON-59705828 Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-DeleteServersTestJSON-59705828-project Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 9c987bdff390488a8a130f3ccdd46fda Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-DeleteServersTestJSON-59705828-project Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '2458ae00-07ae-4635-a56d-adce83f7751a'} Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:45:18.658970 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] Returning 404 to user: Instance 2458ae00-07ae-4635-a56d-adce83f7751a could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da62d266-58d5-48cb-b261-548fb0204e56 tempest-DeleteServersTestJSON-59705828 tempest-DeleteServersTestJSON-59705828-project] 10.222.0.30 "GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a" status: 404 len: 111 microversion: 2.1 time: 0.036485 Jun 18 22:45:18.663360 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3165/6351] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:18 2022] GET /compute/v2.1/servers/2458ae00-07ae-4635-a56d-adce83f7751a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:45:27.553501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1910734055", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a3f3cd7c-392d-4c0a-bc83-a362bbb360da"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:27.607357 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] validate_networks() for [('a3f3cd7c-392d-4c0a-bc83-a362bbb360da', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:45:27.995584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:45:27.996030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:45:27.996524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:45:27.996949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:45:27.997501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:45:28.007533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:28.008157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:28.008987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:28.009481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:28.028365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Getting quotas for project 08e42cd4b04a45a89ca54f832b312a68. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:45:28.034505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Getting quotas for user d511accdb1fe499691157d0580dc3f04 and project 08e42cd4b04a45a89ca54f832b312a68. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:45:28.048036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:45:28.050446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:45:28.099459 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-594ce061-4f2e-4e46-8cb9-fa9ac58917eb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670687 Jun 18 22:45:28.100138 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3187/6352] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:45:28.110463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5179d646-a61a-4eb2-813b-0edb8ab3a532 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:28.111088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5179d646-a61a-4eb2-813b-0edb8ab3a532 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:28.164508 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5179d646-a61a-4eb2-813b-0edb8ab3a532 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:28.173467 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5179d646-a61a-4eb2-813b-0edb8ab3a532 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1218 microversion: 2.1 time: 0.067025 Jun 18 22:45:28.174076 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3166/6353] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:28 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:29.192590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:29.193973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:29.201799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:29.202262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:29.203415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:29.203846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:29.275658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:29.284211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10fd9890-d1d6-48d0-93be-286d5056997a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1276 microversion: 2.1 time: 0.096459 Jun 18 22:45:29.284813 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3188/6354] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:29 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:30.304153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:30.305587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:30.314419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=25 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:30.325553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:30.327223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:30.328903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:30.329531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:30.605733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:30.616575 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19f20097-a7ec-4f5e-8fbe-272338da86fb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.317283 Jun 18 22:45:30.617436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3167/6355] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:30 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:30.674140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-518994f6-b79b-41b1-9bf6-c521c8424931 req-7cd5e310-c95a-4f89-af1a-a32932878e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a48ca3b-a419-4e21-bf55-00a3c4eb01db", "tag": "f3868f9a-c106-4704-b9a0-f7b772b69f18"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:30.694429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-518994f6-b79b-41b1-9bf6-c521c8424931 req-7cd5e310-c95a-4f89-af1a-a32932878e17 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:30.695217 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-518994f6-b79b-41b1-9bf6-c521c8424931 req-7cd5e310-c95a-4f89-af1a-a32932878e17 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:30.717702 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-518994f6-b79b-41b1-9bf6-c521c8424931 req-7cd5e310-c95a-4f89-af1a-a32932878e17 service nova] Creating event network-changed:f3868f9a-c106-4704-b9a0-f7b772b69f18 for instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db on nch1-master-1 Jun 18 22:45:30.733844 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-518994f6-b79b-41b1-9bf6-c521c8424931 req-7cd5e310-c95a-4f89-af1a-a32932878e17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064338 Jun 18 22:45:30.735784 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3189/6356] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:45:31.638526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:31.639555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:31.651329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:31.652054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:31.653357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:31.654077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:31.793584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:31.801468 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3d5c3d82-525b-40d5-ad1c-578e82da7bcd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.170045 Jun 18 22:45:31.802045 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3168/6357] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:31 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:32.824417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:32.825680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:32.834940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:32.835406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:32.836181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:32.836629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:32.972230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:32.983827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-64349675-ab3e-4005-ab34-ef397545c026 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.167692 Jun 18 22:45:32.984604 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3190/6358] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:32 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:34.004180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:34.005024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:34.012567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:34.013200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:34.014068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:34.014627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:34.149018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:34.160556 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6a839351-29fa-466b-a9de-baa04af6a8fe tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.162342 Jun 18 22:45:34.161353 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3169/6359] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:33 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:35.179360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:35.180164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:35.187025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:35.187592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:35.188404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:35.188854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:35.320365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:35.328069 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b1753e82-0aaa-4d76-b3be-a897691b98c1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.154488 Jun 18 22:45:35.329049 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3191/6360] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:35 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:36.348727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:36.349554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:36.357577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:36.358036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:36.358828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:36.359282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:36.500387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:36.508117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-85791b8b-1549-435f-8ddb-5f45b772d326 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.165057 Jun 18 22:45:36.508692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3170/6361] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:36 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:36.820945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-6dc9f5d7-0c1e-4d65-a6f8-7f8d5e3a9a4a req-8c107ee7-f724-4754-a4e9-1ac94c1e4d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a48ca3b-a419-4e21-bf55-00a3c4eb01db", "name": "network-vif-plugged", "status": "completed", "tag": "f3868f9a-c106-4704-b9a0-f7b772b69f18"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:36.831081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6dc9f5d7-0c1e-4d65-a6f8-7f8d5e3a9a4a req-8c107ee7-f724-4754-a4e9-1ac94c1e4d0e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:36.832249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-6dc9f5d7-0c1e-4d65-a6f8-7f8d5e3a9a4a req-8c107ee7-f724-4754-a4e9-1ac94c1e4d0e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:36.843735 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-6dc9f5d7-0c1e-4d65-a6f8-7f8d5e3a9a4a req-8c107ee7-f724-4754-a4e9-1ac94c1e4d0e service nova] Creating event network-vif-plugged:f3868f9a-c106-4704-b9a0-f7b772b69f18 for instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db on nch1-master-1 Jun 18 22:45:36.848946 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-6dc9f5d7-0c1e-4d65-a6f8-7f8d5e3a9a4a req-8c107ee7-f724-4754-a4e9-1ac94c1e4d0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Jun 18 22:45:36.849582 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3192/6362] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:45:37.529571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:37.530621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:37.539685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:37.540163 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:37.540931 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:37.541444 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:37.673898 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:37.682147 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c5ac7798-3563-4c81-8a4f-75cd0cee666d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1318 microversion: 2.1 time: 0.159297 Jun 18 22:45:37.682728 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3171/6363] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:37 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:38.699999 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:38.700746 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:38.704002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:38.704762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:38.711164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:38.711601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:38.712386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:38.712853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:38.855067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:38.863075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ab450cce-c291-41ec-8721-410013822ad8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1508 microversion: 2.1 time: 0.167350 Jun 18 22:45:38.863654 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3193/6364] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:38 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:38.879428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:38.880059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:38.882228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:38.888789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:38.889321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:38.890135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:38.890566 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.029348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:39.039001 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-899e2974-00d1-4bac-be0e-5ad93fda1dcc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1508 microversion: 2.1 time: 0.163612 Jun 18 22:45:39.039623 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3172/6365] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:38 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:39.055150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:39.056348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:39.071619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.072074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.072871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.073354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.138258 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-49eb4bbd-6fea-4b66-bb9e-11e41687f137 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "PUT /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1080 microversion: 2.1 time: 0.086941 Jun 18 22:45:39.138877 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3194/6366] 10.222.0.30 () {60 vars in 1255 bytes} [Sat Jun 18 22:45:39 2022] PUT /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1080 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:39.153021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:39.153685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:39.160398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.160823 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.161634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.162082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.305011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:39.312817 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a9eb6d9-c3c2-480b-815e-684a18aa7ee1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1506 microversion: 2.1 time: 0.163701 Jun 18 22:45:39.313442 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3173/6367] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:39 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:39.330027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:39.330656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:39.337180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.337644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.338480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.338850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.474052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:39.481748 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a5af7ba6-f875-463a-89cb-184ee823b205 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1506 microversion: 2.1 time: 0.156106 Jun 18 22:45:39.482298 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3195/6368] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:39 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:39.498603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:45:39.499616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:39.505998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.506478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.507337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.507807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.583785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:39.590137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Old instance type m1.heat2, new instance type m1.heat {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:45:39.597024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:45:39.597483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:45:39.597960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:45:39.598370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:45:39.598782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:45:39.714286 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe61b95d-f944-4b5d-ba4d-5cab77cbec2a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db/action" status: 202 len: 0 microversion: 2.1 time: 0.219783 Jun 18 22:45:39.715059 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3174/6369] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:45:39 2022] POST /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:45:39.723372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:39.724083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:39.731163 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.731628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.732406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:39.732856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:39.884256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:39.892390 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-39b5f218-da2e-4c4b-8f53-7c42a00d46bf tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1517 microversion: 2.1 time: 0.173090 Jun 18 22:45:39.892966 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3196/6370] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:39 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:40.913490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:40.914056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:40.926144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:40.926594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:40.927495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:40.927796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:41.072487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:41.080906 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d6e3e6a-bace-46d0-aaa9-7f13b9ef3a20 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1517 microversion: 2.1 time: 0.173910 Jun 18 22:45:41.081665 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3175/6371] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:40 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:42.100678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:42.101620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:42.111946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:42.112605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:42.113768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:42.114425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:42.255439 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:42.263178 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d61b24e-5cce-486c-b255-9653efc25d46 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.168291 Jun 18 22:45:42.263761 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3197/6372] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:42 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:43.280957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:43.281626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:43.284782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=38 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:43.291487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:43.291912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:43.292772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:43.293303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:43.452244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:43.460998 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3445d119-8e7f-4230-9f29-41f8cf52f20a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.184515 Jun 18 22:45:43.461945 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3176/6373] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:43 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:44.482477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:44.483505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:44.487932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:44.497286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:44.498051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:44.499329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:44.500072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:44.505062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:44.640597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:44.648830 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb1c2373-7f9f-4222-ba5b-920fffb84a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.173042 Jun 18 22:45:44.649441 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3198/6374] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:44 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:45.666311 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:45.666917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:45.674242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:45.674700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:45.675501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:45.675990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:45.814267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:45.822329 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e13d95e-eb4f-4a01-8c9e-c7078d76ebc3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.160019 Jun 18 22:45:45.822882 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3177/6375] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:45 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:46.843850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:46.844843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:46.853434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:46.853895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:46.854675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:46.855119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:46.987475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:46.995688 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7730e92c-4515-425d-b5b8-45bb8d613a9d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.158593 Jun 18 22:45:46.996262 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3199/6376] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:46 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:48.017117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:48.018065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:48.030263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:48.030973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:48.032264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:48.032992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:48.178138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:48.189106 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aecea5bb-df4b-44e6-b7f7-da13c7211d31 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.178349 Jun 18 22:45:48.189897 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3178/6377] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:48 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:49.209668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:49.210362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:49.219409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:49.219950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:49.220861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:49.221424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:49.361331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:49.369660 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a42f3b0f-75e6-4b6f-9c4c-69c4f0fad47d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.166114 Jun 18 22:45:49.370234 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3200/6378] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:49 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:50.394110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:50.394676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:50.408089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:50.408537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:50.409377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:50.410018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:50.548099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:50.555864 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-11a6fc0a-94b3-4810-ac59-c6f5c866075b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.167637 Jun 18 22:45:50.556444 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3179/6379] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:50 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:51.576705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:51.577774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:51.587079 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:51.587551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:51.588345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:51.588800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:51.747277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:51.755122 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-98ccd5dc-8304-492c-b27e-d45af15cc094 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.184927 Jun 18 22:45:51.755702 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3201/6380] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:51 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:52.772440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:52.773052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:52.780573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:52.781054 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:52.781832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:52.782266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:52.920725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:52.930393 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c5cac2ba-fb56-4f91-8d60-3d308bb4056f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.161959 Jun 18 22:45:52.930965 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3180/6381] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:52 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:53.951787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:53.952749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:53.962285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:53.962755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:53.963540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:53.963991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:54.106398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:54.125397 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-51e24e68-22c9-4732-bdcb-ea45b8be0cb0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.180136 Jun 18 22:45:54.126071 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3202/6382] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:53 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:55.145808 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:55.146421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:55.153666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:55.154117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:55.154886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:55.155318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:55.287141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:55.295176 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ddd0c6e-dca9-42ce-98ed-d2ba12b401c6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.154335 Jun 18 22:45:55.295639 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3181/6383] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:55 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:56.317861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:56.318572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:56.328342 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:56.329015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:56.330412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:56.330978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:56.472913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:56.484186 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7ecdb3b-6257-4c11-9c7d-a23220edb2fd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.172469 Jun 18 22:45:56.485089 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3203/6384] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:56 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:57.508003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:57.509006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:57.520524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:57.520979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:57.521783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:57.522231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:57.526340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:45:57.679850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:57.687852 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97fc70a3-5f01-4a26-9d37-4bd3f5c432f9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.186507 Jun 18 22:45:57.688435 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3182/6385] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:57 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:58.708863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:58.710002 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:58.721690 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:58.722461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:58.723467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:58.723913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:58.870238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:45:58.882192 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-00a871de-37f7-47c8-953b-aa161e918c4a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.179966 Jun 18 22:45:58.882948 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3204/6386] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:58 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:45:59.903842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:45:59.904483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:45:59.911968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:59.912415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:45:59.913219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:45:59.913654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:00.052955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:00.061062 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23c82db2-7bcb-419f-8307-0da0ee5b12d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.161213 Jun 18 22:46:00.061647 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3183/6387] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:45:59 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:01.078902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:01.079888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:01.087960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:01.088429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:01.089253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:01.089688 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:01.223878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:01.231879 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-63acb246-959b-48db-bdd9-9a44ce82ebc4 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.156992 Jun 18 22:46:01.232464 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3205/6388] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:01 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:02.253149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:02.254198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:02.266264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:02.267015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:02.268273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:02.268998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:02.403609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:02.411316 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c0ec5d32-9fe1-4b97-8140-1500b66cd6cd tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.164681 Jun 18 22:46:02.411892 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3184/6389] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:02 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:03.433093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:03.433982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:03.445210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:03.445678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:03.446464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:03.446919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:03.578759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:03.591287 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f260613-6d81-4f21-9095-0d94e4d61c2f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.164738 Jun 18 22:46:03.592211 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3206/6390] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:03 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:04.617106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:04.617653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:04.625498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:04.625978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:04.626788 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:04.627249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:04.769428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:04.777332 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d83b747-01e3-4a98-a995-9e7adf7cfca8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.166385 Jun 18 22:46:04.777914 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3185/6391] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:04 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:05.799270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:05.800295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:05.811486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:05.812251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:05.813601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:05.814351 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:05.966570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:05.976437 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-43dec328-a6fb-49c1-894a-fde0f33aebee tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.184125 Jun 18 22:46:05.977058 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3207/6392] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:05 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:06.994010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:06.994621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:07.002230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:07.002687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:07.003466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:07.003912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:07.137829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:07.145568 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a2db9a29-d5bb-48fe-9b2c-574bf1ea0874 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.155670 Jun 18 22:46:07.146152 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3186/6393] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:06 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:08.171178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:08.172218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:08.184124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:08.184888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:08.186262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:08.187008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:08.325885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:08.334748 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1e44d3bd-b651-42d6-bfab-6194b476147d tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1522 microversion: 2.1 time: 0.170327 Jun 18 22:46:08.337089 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3208/6394] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:08 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:09.011995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0deb3988-60af-457c-aa65-0870346823d7 req-45c1792e-81b3-4ced-8a11-77cc71e5ee80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a48ca3b-a419-4e21-bf55-00a3c4eb01db", "name": "network-vif-unplugged", "status": "completed", "tag": "f3868f9a-c106-4704-b9a0-f7b772b69f18"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:09.021439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0deb3988-60af-457c-aa65-0870346823d7 req-45c1792e-81b3-4ced-8a11-77cc71e5ee80 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:09.021802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0deb3988-60af-457c-aa65-0870346823d7 req-45c1792e-81b3-4ced-8a11-77cc71e5ee80 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:09.036091 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0deb3988-60af-457c-aa65-0870346823d7 req-45c1792e-81b3-4ced-8a11-77cc71e5ee80 service nova] Creating event network-vif-unplugged:f3868f9a-c106-4704-b9a0-f7b772b69f18 for instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db on nch2-master-1 Jun 18 22:46:09.043344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-0deb3988-60af-457c-aa65-0870346823d7 req-45c1792e-81b3-4ced-8a11-77cc71e5ee80 service nova] Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:46:09.054626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0deb3988-60af-457c-aa65-0870346823d7 req-45c1792e-81b3-4ced-8a11-77cc71e5ee80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046691 Jun 18 22:46:09.055246 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3187/6395] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:09.352105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:09.352866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:09.360808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:09.361417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:09.362426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:09.362899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:09.504873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:09.513433 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8be5e1d0-cc57-42d5-82fe-712033f0ed1c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1521 microversion: 2.1 time: 0.165500 Jun 18 22:46:09.514193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3209/6396] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:09 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:10.536928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:10.538136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:10.548984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:10.549804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:10.551074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:10.551820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:10.685153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:10.692920 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0f33f04d-bef0-4f6f-9cad-1e333b3ca4f5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1519 microversion: 2.1 time: 0.164809 Jun 18 22:46:10.693530 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3188/6397] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:10 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:11.072707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d3787216-76d1-4e38-af14-4341b64e05ac req-46c53c64-41e1-4522-a19f-6988560ad235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a48ca3b-a419-4e21-bf55-00a3c4eb01db", "tag": "f3868f9a-c106-4704-b9a0-f7b772b69f18"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:11.082470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d3787216-76d1-4e38-af14-4341b64e05ac req-46c53c64-41e1-4522-a19f-6988560ad235 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.082931 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d3787216-76d1-4e38-af14-4341b64e05ac req-46c53c64-41e1-4522-a19f-6988560ad235 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:11.095402 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d3787216-76d1-4e38-af14-4341b64e05ac req-46c53c64-41e1-4522-a19f-6988560ad235 service nova] Creating event network-changed:f3868f9a-c106-4704-b9a0-f7b772b69f18 for instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db on nch2-master-1 Jun 18 22:46:11.101277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-d3787216-76d1-4e38-af14-4341b64e05ac req-46c53c64-41e1-4522-a19f-6988560ad235 service nova] Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:46:11.112185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d3787216-76d1-4e38-af14-4341b64e05ac req-46c53c64-41e1-4522-a19f-6988560ad235 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043386 Jun 18 22:46:11.112770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3210/6398] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:11.710446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:11.711044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:11.718873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.719372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:11.720090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.720530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:11.864625 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:11.872564 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec62c1aa-3176-4c76-8dad-2b8956f523a0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1516 microversion: 2.1 time: 0.165984 Jun 18 22:46:11.873174 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3189/6399] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:11 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:11.890213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:11.890930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:11.897669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.898187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:11.899152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.899592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:11.960791 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2fc46b26-6ba2-4ab3-99ec-2c56b6fa89db tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db/action" status: 204 len: 0 microversion: 2.1 time: 0.074767 Jun 18 22:46:11.961486 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3211/6400] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:46:11 2022] POST /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:46:11.970078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:11.970927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:11.977573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.978025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:11.978815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:11.979398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:12.115119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:12.124626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-197aad59-d1f6-44f2-8951-125147592373 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1516 microversion: 2.1 time: 0.158665 Jun 18 22:46:12.125468 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3190/6401] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:11 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:13.144493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:13.145271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:13.152714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:13.153243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:13.154039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:13.154491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:13.300212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:13.308208 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7db07535-9895-467e-85c1-f95f8c14a5fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1508 microversion: 2.1 time: 0.169681 Jun 18 22:46:13.308783 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3212/6402] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:13 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:13.328906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:13.329561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:13.332889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=30 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:13.338801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:13.339256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:13.340140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:13.340579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:13.474456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:13.482403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db1baa72-3079-44e6-a096-35a6af51d857 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1508 microversion: 2.1 time: 0.158113 Jun 18 22:46:13.483375 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3191/6403] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:13 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:13.502574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-510c505d-3260-4b05-ad80-9f4fef2378e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'create', calling method: .version_select at 0x7fea0784aee0>, body: {"keypair": {"name": "tempest-keypair-1588991573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDX68aB+bvTXjM9g/5QZj6ATALUm6/qEdZe4IlIG9dgFepLC/GQz8QhxetO5BLGpnVUhuxmrT7HL1N5ns37aW8mWrJLO2S/EFK15JCuWOrzcKW1JvMoMZ1nJBFSj6SYzQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:13.521499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-510c505d-3260-4b05-ad80-9f4fef2378e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Getting quotas for project 08e42cd4b04a45a89ca54f832b312a68. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:46:13.527794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-510c505d-3260-4b05-ad80-9f4fef2378e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Getting quotas for user d511accdb1fe499691157d0580dc3f04 and project 08e42cd4b04a45a89ca54f832b312a68. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:46:13.556908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-510c505d-3260-4b05-ad80-9f4fef2378e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058641 Jun 18 22:46:13.557476 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3213/6404] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:46:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:14.254964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7e387d10-45ab-433d-82ab-4ad9329944b1 req-fbfddfcf-4b49-4c2c-ac60-cbc38dafabbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a48ca3b-a419-4e21-bf55-00a3c4eb01db", "name": "network-vif-plugged", "status": "completed", "tag": "f3868f9a-c106-4704-b9a0-f7b772b69f18"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:14.264468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7e387d10-45ab-433d-82ab-4ad9329944b1 req-fbfddfcf-4b49-4c2c-ac60-cbc38dafabbf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:14.265064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7e387d10-45ab-433d-82ab-4ad9329944b1 req-fbfddfcf-4b49-4c2c-ac60-cbc38dafabbf service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:14.277333 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7e387d10-45ab-433d-82ab-4ad9329944b1 req-fbfddfcf-4b49-4c2c-ac60-cbc38dafabbf service nova] Creating event network-vif-plugged:f3868f9a-c106-4704-b9a0-f7b772b69f18 for instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db on nch2-master-1 Jun 18 22:46:14.282839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7e387d10-45ab-433d-82ab-4ad9329944b1 req-fbfddfcf-4b49-4c2c-ac60-cbc38dafabbf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Jun 18 22:46:14.283646 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3192/6405] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:14.795572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:14.796203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:14.798266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:14.804471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:14.804935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:14.805738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:14.806189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:14.809513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:14.956820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:14.968136 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f1e96ff5-e936-47ab-b3ab-50b084e33a0b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 200 len: 1508 microversion: 2.1 time: 0.177066 Jun 18 22:46:14.968889 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3214/6406] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:14 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:14.987828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:14.988380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:14.997437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:14.998052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:14.999277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:14.999864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:15.033591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:46:15.112550 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e88e919-ae27-4694-aca3-ad1fe4b329e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 204 len: 0 microversion: 2.1 time: 0.129483 Jun 18 22:46:15.113153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3193/6407] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:46:14 2022] DELETE /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:46:15.167214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1204661604", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "a3f3cd7c-392d-4c0a-bc83-a362bbb360da"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:15.222774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] validate_networks() for [('a3f3cd7c-392d-4c0a-bc83-a362bbb360da', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:46:15.623930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:46:15.624398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:46:15.624885 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:46:15.625338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:46:15.625767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:46:15.636472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:15.636938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:15.637844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:15.638296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:15.655855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Getting quotas for project 08e42cd4b04a45a89ca54f832b312a68. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:46:15.661707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Getting quotas for user d511accdb1fe499691157d0580dc3f04 and project 08e42cd4b04a45a89ca54f832b312a68. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:46:15.675093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:46:15.677425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:46:15.723987 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0f920986-cc7c-491f-972c-8d55d18afcd5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561103 Jun 18 22:46:15.724812 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3215/6408] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:46:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:46:15.735402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ead10326-61e2-4ac4-b6f6-cac8065e4ca6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:15.736109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ead10326-61e2-4ac4-b6f6-cac8065e4ca6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:15.790620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ead10326-61e2-4ac4-b6f6-cac8065e4ca6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:15.797603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ead10326-61e2-4ac4-b6f6-cac8065e4ca6 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1218 microversion: 2.1 time: 0.066430 Jun 18 22:46:15.798187 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3194/6409] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:15 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:16.815891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:16.817368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:16.824488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:16.825304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:16.826318 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:16.826987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:16.892877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:16.900777 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2f3e5156-84b4-4ad1-92b8-00e0723ec1e5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1288 microversion: 2.1 time: 0.089815 Jun 18 22:46:16.909215 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3216/6410] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:16 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:17.322395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-be0e6adc-bd4a-49df-99cc-3d5c66b43408 req-0e098373-f1a6-4435-8410-a539faf72f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a48ca3b-a419-4e21-bf55-00a3c4eb01db", "name": "network-vif-deleted", "tag": "f3868f9a-c106-4704-b9a0-f7b772b69f18"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:17.337439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-be0e6adc-bd4a-49df-99cc-3d5c66b43408 req-0e098373-f1a6-4435-8410-a539faf72f06 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:17.337887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-be0e6adc-bd4a-49df-99cc-3d5c66b43408 req-0e098373-f1a6-4435-8410-a539faf72f06 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:17.365199 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-be0e6adc-bd4a-49df-99cc-3d5c66b43408 req-0e098373-f1a6-4435-8410-a539faf72f06 service nova] Creating event network-vif-deleted:f3868f9a-c106-4704-b9a0-f7b772b69f18 for instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db on nch2-master-1 Jun 18 22:46:17.377508 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-be0e6adc-bd4a-49df-99cc-3d5c66b43408 req-0e098373-f1a6-4435-8410-a539faf72f06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059174 Jun 18 22:46:17.378703 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3195/6411] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:17.918463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:17.919230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:17.926363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:17.926836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:17.927623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:17.928073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:18.073381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:18.083385 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d32c3a7a-b0a5-481c-b15d-64965c2018e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1318 microversion: 2.1 time: 0.169268 Jun 18 22:46:18.084605 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3217/6412] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:17 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:19.104342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:19.105021 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:19.112264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:19.112723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:19.113549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:19.113996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:19.247624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:19.262412 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-370c2e7a-bfa9-4456-96c5-05d93c540c5b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1318 microversion: 2.1 time: 0.164561 Jun 18 22:46:19.262969 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3196/6413] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:19 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:19.399731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b644ad52-2abd-442f-a722-5bfff9fdf908 req-b9d91e75-6162-4772-869c-ab587dd57035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786aa4dc-53c8-46ff-ad14-94afdfe71f08", "tag": "e15a813f-82e4-472b-b7db-674ed4853240"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:19.414323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b644ad52-2abd-442f-a722-5bfff9fdf908 req-b9d91e75-6162-4772-869c-ab587dd57035 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:19.414791 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b644ad52-2abd-442f-a722-5bfff9fdf908 req-b9d91e75-6162-4772-869c-ab587dd57035 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:19.426496 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b644ad52-2abd-442f-a722-5bfff9fdf908 req-b9d91e75-6162-4772-869c-ab587dd57035 service nova] Creating event network-changed:e15a813f-82e4-472b-b7db-674ed4853240 for instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 on nch2-master-1 Jun 18 22:46:19.431513 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b644ad52-2abd-442f-a722-5bfff9fdf908 req-b9d91e75-6162-4772-869c-ab587dd57035 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038173 Jun 18 22:46:19.432085 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3218/6414] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:20.279387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:20.279928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:20.287666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:20.288153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:20.289112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:20.289737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:20.435036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:20.443163 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3694932-812c-4c1f-b021-035485a198e2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1318 microversion: 2.1 time: 0.167837 Jun 18 22:46:20.443801 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3197/6415] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:20 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:21.467856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:21.469083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:21.478272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:21.478740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:21.479555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:21.480007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:21.611581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:21.619333 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d5143c1-5bde-48c1-bc40-25f665637ff8 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1318 microversion: 2.1 time: 0.160288 Jun 18 22:46:21.619917 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3219/6416] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:21 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:22.315598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1e3cdf16-6524-4ffb-95d9-99f6bb3c3eaa req-4721ae0f-70e3-469c-b94e-191d13d4a2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786aa4dc-53c8-46ff-ad14-94afdfe71f08", "name": "network-vif-plugged", "status": "completed", "tag": "e15a813f-82e4-472b-b7db-674ed4853240"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:22.325137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1e3cdf16-6524-4ffb-95d9-99f6bb3c3eaa req-4721ae0f-70e3-469c-b94e-191d13d4a2d1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:22.325567 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1e3cdf16-6524-4ffb-95d9-99f6bb3c3eaa req-4721ae0f-70e3-469c-b94e-191d13d4a2d1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:22.338085 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1e3cdf16-6524-4ffb-95d9-99f6bb3c3eaa req-4721ae0f-70e3-469c-b94e-191d13d4a2d1 service nova] Creating event network-vif-plugged:e15a813f-82e4-472b-b7db-674ed4853240 for instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 on nch2-master-1 Jun 18 22:46:22.343290 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1e3cdf16-6524-4ffb-95d9-99f6bb3c3eaa req-4721ae0f-70e3-469c-b94e-191d13d4a2d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Jun 18 22:46:22.344126 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3198/6417] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:22.640261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:22.641101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:22.652251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:22.652726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:22.653550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:22.654027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:22.852548 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:22.860316 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bcc6571-ebf8-4035-a10a-b25a895a352f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1318 microversion: 2.1 time: 0.226944 Jun 18 22:46:22.860894 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3220/6418] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:22 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:23.890677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:23.891800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:23.903118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:23.903847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:23.905105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:23.905917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.049738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:24.058587 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c3052489-1eee-47db-8860-9c3ba5bd9ee3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1508 microversion: 2.1 time: 0.176855 Jun 18 22:46:24.059229 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3199/6419] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:23 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:24.075930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:24.076597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:24.084884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:24.085411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.086191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:24.086637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.221330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:24.229167 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-62e8aa68-76cf-416e-b9c2-f97d6f02c444 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1508 microversion: 2.1 time: 0.157876 Jun 18 22:46:24.229733 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3221/6420] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:24 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:24.245204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:24.246220 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:24.252560 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:24.253057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.253835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:24.254272 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.273704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:24.283528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:24.290011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Old instance type m1.heat2, new instance type m1.heat {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:46:24.296670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:46:24.297125 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:46:24.297615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:46:24.298024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:46:24.298438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:46:24.366784 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b968b751-3352-46f9-a4ab-fc7a65142a0f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08/action" status: 202 len: 0 microversion: 2.1 time: 0.125601 Jun 18 22:46:24.367673 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3200/6421] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:46:24 2022] POST /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:46:24.376983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:24.377697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:24.383893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:24.384356 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.385177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:24.385627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:24.519656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:24.527551 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d5afaee-f3e9-42e9-979c-4c4315cd9916 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1515 microversion: 2.1 time: 0.154794 Jun 18 22:46:24.528136 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3222/6422] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:24 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:46:25.546807 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:25.547448 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:25.554690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:25.556421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:25.557895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:25.558424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:25.695318 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:25.703334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b71813a-45e0-4628-8e0c-967435c7ebf2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1515 microversion: 2.1 time: 0.162672 Jun 18 22:46:25.713603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3201/6423] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:25 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:26.721562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:26.723012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:26.729543 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:26.730174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:26.737286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:26.737779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:26.738571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:26.739022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:26.878483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:26.886338 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-01c166a7-38be-4e32-9db7-9f66aa6901d7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.167865 Jun 18 22:46:26.886919 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3223/6424] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:26 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:27.908082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:27.909148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:27.912132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:27.922793 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:27.923526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:27.924768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:27.925537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:28.062952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:28.070749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9bfb6d7d-be2f-4fce-be73-55c65e0d8b17 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.169448 Jun 18 22:46:28.071322 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3202/6425] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:27 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:29.088889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:29.089564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:29.097177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:29.097646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:29.098427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:29.098877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:29.238603 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:29.246865 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fc613379-3e62-4b1b-8e47-cb9a91b21633 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.161985 Jun 18 22:46:29.247446 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3224/6426] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:29 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:30.265843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:30.266459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:30.274429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:30.274899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:30.275706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:30.276161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:30.410698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:30.418456 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30b04aa0-ce4f-4bf4-8e9c-d2cf7788b214 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.157258 Jun 18 22:46:30.419062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3203/6427] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:30 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:31.439786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:31.440345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:31.451596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:31.452268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:31.453463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:31.454083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:31.593613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:31.604562 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ab00896-ea7d-4e8d-ae43-2514131151a1 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.171066 Jun 18 22:46:31.605261 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3225/6428] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:31 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:32.626249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:32.627183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:32.638391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:32.638851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:32.639628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:32.640066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:32.795484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:32.803616 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-25abc557-a019-4ffb-a36f-45ac1542a0fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.184119 Jun 18 22:46:32.804196 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3204/6429] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:32 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:33.824410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:33.825464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:33.838005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:33.838783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:33.840186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:33.840843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:33.973391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:33.981107 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dfa6196a-71a3-4f4e-bafa-551f942008c2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.163032 Jun 18 22:46:33.981684 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3226/6430] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:33 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:34.999182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:34.999751 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:35.007362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:35.007814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:35.008597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:35.009062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:35.147516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:35.159571 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6b05a4be-9502-4ee6-8ef6-27e31fbe0744 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.164760 Jun 18 22:46:35.160349 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3205/6431] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:34 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:36.184337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:36.185397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:36.196916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:36.197762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:36.199056 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:36.199803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:36.329820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:36.338462 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b30b8732-890e-4283-8c82-21ac9ff8af0e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.160655 Jun 18 22:46:36.339045 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3227/6432] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:36 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:37.359138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:37.359726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:37.367156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:37.367604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:37.368371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:37.368806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:37.522964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:37.533780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d4de2cf-2b7e-44fe-affe-02738ec8df07 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.180698 Jun 18 22:46:37.534561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3206/6433] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:37 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:38.558023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:38.558974 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:38.567263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:38.567720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:38.568497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:38.568945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:38.698763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:38.707192 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7824765-e2e9-423c-889f-de6733a2c7c5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.155365 Jun 18 22:46:38.707775 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3228/6434] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:38 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:39.728188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:39.729189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:39.738750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:39.739234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:39.740010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:39.740473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:39.876670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:39.886140 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a536dcf-991e-4091-8794-1fb9833514fc tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.164531 Jun 18 22:46:39.886718 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3207/6435] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:39 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:40.907402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:40.907978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:40.915364 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:40.915824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:40.916592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:40.917077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:41.055402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:41.067045 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-10bc2d7d-0a9a-4427-8185-d51e3415603e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.165515 Jun 18 22:46:41.067685 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3229/6436] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:40 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:42.084348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:42.084992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:42.092453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:42.092904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:42.093704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:42.094138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:42.225985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:42.233839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21d9d96e-e048-4012-bb44-2c69597d56e3 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.153793 Jun 18 22:46:42.234422 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3208/6437] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:42 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:43.255456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:43.256691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:43.268618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:43.269464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:43.270763 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:43.271534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:43.425419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:43.436526 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-65591dba-7090-466a-a384-1aa667f715e0 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.187550 Jun 18 22:46:43.437320 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3230/6438] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:43 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:44.459753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:44.460356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:44.463207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:44.469337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:44.469796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:44.470579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:44.471022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:44.617737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:44.625745 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c6701526-8505-46bb-ad05-ac274b2830bb tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.170465 Jun 18 22:46:44.626315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3209/6439] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:44 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:45.647466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:45.648501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:45.652992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:45.662359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:45.663124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:45.664413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:45.665204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:45.670933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=94 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:45.815355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:45.827211 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-baecd185-89a3-49c5-8af3-4ca748ea4ad7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.186340 Jun 18 22:46:45.828022 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3231/6440] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:45 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:46.845569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:46.846182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:46.853925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:46.854327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:46.855136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:46.855507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:46.992177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:47.000277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bdc627f-4df1-4ed5-9f15-99d708d33308 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.158819 Jun 18 22:46:47.000919 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3210/6441] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:46 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:48.022176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:48.023312 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:48.035332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:48.036098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:48.037451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:48.038205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:48.170661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:48.179049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a8a75fa-62c5-4e43-94b4-308e97a8f510 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.163538 Jun 18 22:46:48.179635 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3232/6442] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:48 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:49.198357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:49.199323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:49.210998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:49.211683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:49.212887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:49.213577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:49.351517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:49.359721 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d880a696-e2f3-44fb-b494-5488ea6e36e9 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.167526 Jun 18 22:46:49.360369 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3211/6443] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:49 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:50.376215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:50.376850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:50.384497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:50.384970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:50.385803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:50.386260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:50.522769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:50.532662 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3cc1fb1-0a45-457c-aecb-422f4f63938a tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.160478 Jun 18 22:46:50.533286 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3233/6444] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:50 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:51.554180 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:51.555119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:51.566670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:51.567417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:51.568678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:51.569470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:51.713010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:51.723663 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-96c2094d-eb52-491f-971b-ecd86fe9a456 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.176253 Jun 18 22:46:51.724287 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3212/6445] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:51 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:52.743458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:52.744311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:52.754411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:52.754944 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:52.755826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:52.756282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:52.894305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:52.902684 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03d65494-dce2-480c-9d20-6212594cb483 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1520 microversion: 2.1 time: 0.165188 Jun 18 22:46:52.903417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3234/6446] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:52 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:53.401771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d3d77944-1e7e-4270-be80-df50f415a188 req-d403f18e-7261-488e-8d67-70637eeb85e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786aa4dc-53c8-46ff-ad14-94afdfe71f08", "name": "network-vif-unplugged", "status": "completed", "tag": "e15a813f-82e4-472b-b7db-674ed4853240"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:53.411626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d3d77944-1e7e-4270-be80-df50f415a188 req-d403f18e-7261-488e-8d67-70637eeb85e1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:53.412238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d3d77944-1e7e-4270-be80-df50f415a188 req-d403f18e-7261-488e-8d67-70637eeb85e1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:53.424589 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d3d77944-1e7e-4270-be80-df50f415a188 req-d403f18e-7261-488e-8d67-70637eeb85e1 service nova] Creating event network-vif-unplugged:e15a813f-82e4-472b-b7db-674ed4853240 for instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 on nch1-master-1 Jun 18 22:46:53.430082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-d3d77944-1e7e-4270-be80-df50f415a188 req-d403f18e-7261-488e-8d67-70637eeb85e1 service nova] Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:46:53.440973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d3d77944-1e7e-4270-be80-df50f415a188 req-d403f18e-7261-488e-8d67-70637eeb85e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043069 Jun 18 22:46:53.442103 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3213/6447] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:53.920488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:53.921435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:53.929207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:53.929758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:53.930631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:53.931149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:54.065379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:54.072971 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8d055d10-63a7-4866-a2bc-2028c80b2290 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1519 microversion: 2.1 time: 0.156567 Jun 18 22:46:54.073576 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3235/6448] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:53 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:55.095371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:55.096261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:55.103170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:55.103618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:55.104377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:55.104820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:55.107484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:46:55.247326 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:55.259119 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-82606bcf-d6ae-4563-b970-a6b20dee7763 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1517 microversion: 2.1 time: 0.170649 Jun 18 22:46:55.259970 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3214/6449] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:55 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:55.464374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-642e7c8c-d34e-4fd1-9519-27387500c32d req-62286041-e6f0-4955-922d-642c30396ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "786aa4dc-53c8-46ff-ad14-94afdfe71f08", "tag": "e15a813f-82e4-472b-b7db-674ed4853240"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:55.476692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-642e7c8c-d34e-4fd1-9519-27387500c32d req-62286041-e6f0-4955-922d-642c30396ef7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:55.477362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-642e7c8c-d34e-4fd1-9519-27387500c32d req-62286041-e6f0-4955-922d-642c30396ef7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:55.494336 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-642e7c8c-d34e-4fd1-9519-27387500c32d req-62286041-e6f0-4955-922d-642c30396ef7 service nova] Creating event network-changed:e15a813f-82e4-472b-b7db-674ed4853240 for instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 on nch1-master-1 Jun 18 22:46:55.500369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-642e7c8c-d34e-4fd1-9519-27387500c32d req-62286041-e6f0-4955-922d-642c30396ef7 service nova] Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:46:55.511418 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-642e7c8c-d34e-4fd1-9519-27387500c32d req-62286041-e6f0-4955-922d-642c30396ef7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052529 Jun 18 22:46:55.512042 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3236/6450] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:46:56.284198 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:56.285136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:56.296881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:56.297699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:56.299119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:56.299554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:56.432647 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:56.441256 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4626793b-ba17-47cb-a1da-710d69d2ba7e tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1517 microversion: 2.1 time: 0.163811 Jun 18 22:46:56.441816 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3215/6451] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:56 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:57.465243 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:57.466424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:57.475005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:57.475448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:57.476244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:57.476685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:57.614134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:57.622250 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c7fd082-0c76-4e2f-b1cf-6103d31bbc24 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1514 microversion: 2.1 time: 0.166234 Jun 18 22:46:57.622860 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3237/6452] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:57 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:57.639129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:57.639695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:57.647764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:57.648255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:57.649634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:57.650087 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:57.711965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f06af57c-cd70-4950-869a-3526172b6156 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "POST /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08/action" status: 204 len: 0 microversion: 2.1 time: 0.076291 Jun 18 22:46:57.712796 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3216/6453] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:46:57 2022] POST /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:46:57.724203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:57.725020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:57.731829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:57.732547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:57.733526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:57.734121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:57.866767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:57.874867 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6b88f80d-4368-40ac-a420-62218582a9ba tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1514 microversion: 2.1 time: 0.156359 Jun 18 22:46:57.875456 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3238/6454] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:57 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:58.892731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:58.893505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:58.901484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:58.901945 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:58.902734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:58.903169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.104726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:59.112916 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16b73b0c-afcf-4df5-b14f-030d43b8a68f tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1506 microversion: 2.1 time: 0.224488 Jun 18 22:46:59.113515 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3217/6455] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:58 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:59.129829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:59.130466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:59.138036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.138529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.139339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.139792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.281875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:59.290528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7a4289b1-3f82-4f8c-83db-5f23d48fd13b tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1506 microversion: 2.1 time: 0.164523 Jun 18 22:46:59.291674 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3239/6456] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:59 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:59.311701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:59.312350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:59.318997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.319454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.320235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.320672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.343818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a8294a76-8ef0-4dea-921f-0638aff9a8bb req-2e4ebf5b-a209-4464-bca3-d66c55411923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786aa4dc-53c8-46ff-ad14-94afdfe71f08", "name": "network-vif-plugged", "status": "completed", "tag": "e15a813f-82e4-472b-b7db-674ed4853240"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:46:59.354263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a8294a76-8ef0-4dea-921f-0638aff9a8bb req-2e4ebf5b-a209-4464-bca3-d66c55411923 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.354946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a8294a76-8ef0-4dea-921f-0638aff9a8bb req-2e4ebf5b-a209-4464-bca3-d66c55411923 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.367789 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a8294a76-8ef0-4dea-921f-0638aff9a8bb req-2e4ebf5b-a209-4464-bca3-d66c55411923 service nova] Creating event network-vif-plugged:e15a813f-82e4-472b-b7db-674ed4853240 for instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 on nch1-master-1 Jun 18 22:46:59.373136 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a8294a76-8ef0-4dea-921f-0638aff9a8bb req-2e4ebf5b-a209-4464-bca3-d66c55411923 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Jun 18 22:46:59.373835 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3240/6457] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:46:59.457767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:59.465796 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-174ba97d-fe04-4e9b-b02a-2fe9549a9df7 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1506 microversion: 2.1 time: 0.158293 Jun 18 22:46:59.466344 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3218/6458] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:59 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:46:59.482638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:59.483246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:59.489892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.490436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.491200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.491646 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.523060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:46:59.604254 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5ddfdee-8ad4-471e-b3ac-51fd3aa7671c tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "DELETE /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 204 len: 0 microversion: 2.1 time: 0.125420 Jun 18 22:46:59.604750 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3241/6459] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:46:59 2022] DELETE /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:46:59.625932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:59.626442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:59.635764 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.636551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.637701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.638137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.666224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:46:59.719203 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.compute.api [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Instance is already in deleting state, ignoring this request Jun 18 22:46:59.720037 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d6f34f2e-8d66-4d85-9f2f-554b587bf046 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "DELETE /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 204 len: 0 microversion: 2.1 time: 0.098083 Jun 18 22:46:59.720603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3219/6460] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:46:59 2022] DELETE /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:46:59.729684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:46:59.730411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:46:59.736942 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.737454 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.738272 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:46:59.738717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:46:59.881358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:46:59.889584 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fd982ae6-524b-423f-bb8e-6a30d428fbd2 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1512 microversion: 2.1 time: 0.164226 Jun 18 22:46:59.890179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3242/6461] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:46:59 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:47:00.910146 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:00.910773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:00.918026 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:00.918483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:00.919261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:00.919697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:01.061606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd511accdb1fe499691157d0580dc3f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08e42cd4b04a45a89ca54f832b312a68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:01.069776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9fe723db-eea8-44e1-955d-ff8d82c02819 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 200 len: 1512 microversion: 2.1 time: 0.165569 Jun 18 22:47:01.070326 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3220/6462] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:00 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:01.484524 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-80772932-c5fd-40d2-ac16-d1ca8cc5c6a4 req-45bc247f-9ec9-4be3-a3fb-71a8ab8b109b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786aa4dc-53c8-46ff-ad14-94afdfe71f08", "name": "network-vif-deleted", "tag": "e15a813f-82e4-472b-b7db-674ed4853240"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:47:01.497658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-80772932-c5fd-40d2-ac16-d1ca8cc5c6a4 req-45bc247f-9ec9-4be3-a3fb-71a8ab8b109b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:01.498119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-80772932-c5fd-40d2-ac16-d1ca8cc5c6a4 req-45bc247f-9ec9-4be3-a3fb-71a8ab8b109b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:01.511741 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-80772932-c5fd-40d2-ac16-d1ca8cc5c6a4 req-45bc247f-9ec9-4be3-a3fb-71a8ab8b109b service nova] Creating event network-vif-deleted:e15a813f-82e4-472b-b7db-674ed4853240 for instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 on nch1-master-1 Jun 18 22:47:01.517934 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-80772932-c5fd-40d2-ac16-d1ca8cc5c6a4 req-45bc247f-9ec9-4be3-a3fb-71a8ab8b109b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037014 Jun 18 22:47:01.518540 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3243/6463] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:47:02.091532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:02.092607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 786aa4dc-53c8-46ff-ad14-94afdfe71f08] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:02.104595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:02.105506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:02.106776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:02.107505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:02.122875 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] HTTP exception thrown: Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 could not be found. Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Request method failure captured: Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 HTTP/1.1 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlWHT03-EyBF4m0_TiXmZvmuqbZccTyNDZVGxQW359KDJTH7jLPrGrNC6g80FMMtjvYZ1VeyOzDsROAQkVSt4w7lvtLl6HaO-g6YLHW5UYIN8TizctWCypDSD5wUsWdHvpjJspwEp6Qm1h1SnAzjUwOU5FrH1fqR8mVITVRe9qBdI6U Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 08e42cd4b04a45a89ca54f832b312a68 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e42cd4b04a45a89ca54f832b312a68", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 08e42cd4b04a45a89ca54f832b312a68 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerDiskConfigTestJSON-241153805-project Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d511accdb1fe499691157d0580dc3f04 Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerDiskConfigTestJSON-241153805-project Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 could not be found. Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '786aa4dc-53c8-46ff-ad14-94afdfe71f08'} Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 could not be found. Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 could not be found. Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:47:02.124530 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 could not be found. Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Returning 404 to user: Instance 786aa4dc-53c8-46ff-ad14-94afdfe71f08 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e3471c0-ea30-4418-b5aa-c21b928de271 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08" status: 404 len: 111 microversion: 2.1 time: 0.041102 Jun 18 22:47:02.129266 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3221/6464] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:02 2022] GET /compute/v2.1/servers/786aa4dc-53c8-46ff-ad14-94afdfe71f08 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:47:02.135391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f4f391e3-3cb3-4f5d-a02d-9ced63dcb5d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '.version_select at 0x7fea07a5ddc0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:02.157137 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f4f391e3-3cb3-4f5d-a02d-9ced63dcb5d5 tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588991573" status: 202 len: 0 microversion: 2.1 time: 0.025988 Jun 18 22:47:02.157723 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3244/6465] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588991573 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:47:02.779361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:02.779870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:02.786270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:02.786728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:02.787492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:02.787928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:02.801604 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] HTTP exception thrown: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Request method failure captured: Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: request: DELETE /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db HTTP/1.1 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlWHT03-EyBF4m0_TiXmZvmuqbZccTyNDZVGxQW359KDJTH7jLPrGrNC6g80FMMtjvYZ1VeyOzDsROAQkVSt4w7lvtLl6HaO-g6YLHW5UYIN8TizctWCypDSD5wUsWdHvpjJspwEp6Qm1h1SnAzjUwOU5FrH1fqR8mVITVRe9qBdI6U Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 08e42cd4b04a45a89ca54f832b312a68 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e42cd4b04a45a89ca54f832b312a68", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 08e42cd4b04a45a89ca54f832b312a68 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerDiskConfigTestJSON-241153805-project Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d511accdb1fe499691157d0580dc3f04 Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerDiskConfigTestJSON-241153805-project Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3a48ca3b-a419-4e21-bf55-00a3c4eb01db'} Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:47:02.803177 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Returning 404 to user: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f6be8e28-b0ae-4cb4-80f4-b37b3d53eaff tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 404 len: 111 microversion: 2.1 time: 0.029208 Jun 18 22:47:02.807552 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3222/6466] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:47:02 2022] DELETE /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:47:02.813172 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:02.813995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] [instance: 3a48ca3b-a419-4e21-bf55-00a3c4eb01db] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:02.821959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:02.822428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:02.823216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:02.823675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:02.837795 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] HTTP exception thrown: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Request method failure captured: Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db HTTP/1.1 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlWHT03-EyBF4m0_TiXmZvmuqbZccTyNDZVGxQW359KDJTH7jLPrGrNC6g80FMMtjvYZ1VeyOzDsROAQkVSt4w7lvtLl6HaO-g6YLHW5UYIN8TizctWCypDSD5wUsWdHvpjJspwEp6Qm1h1SnAzjUwOU5FrH1fqR8mVITVRe9qBdI6U Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 08e42cd4b04a45a89ca54f832b312a68 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/08e42cd4b04a45a89ca54f832b312a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_08e42cd4b04a45a89ca54f832b312a68", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 08e42cd4b04a45a89ca54f832b312a68 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-241153805 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerDiskConfigTestJSON-241153805-project Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d511accdb1fe499691157d0580dc3f04 Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerDiskConfigTestJSON-241153805-project Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3a48ca3b-a419-4e21-bf55-00a3c4eb01db'} Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:47:02.839452 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] Returning 404 to user: Instance 3a48ca3b-a419-4e21-bf55-00a3c4eb01db could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa2e4f44-1865-4868-bf2a-52d411b9c5de tempest-ServerDiskConfigTestJSON-241153805 tempest-ServerDiskConfigTestJSON-241153805-project] 10.222.0.30 "GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db" status: 404 len: 111 microversion: 2.1 time: 0.031775 Jun 18 22:47:02.843959 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3245/6467] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:02 2022] GET /compute/v2.1/servers/3a48ca3b-a419-4e21-bf55-00a3c4eb01db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:47:11.814576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f158f08d-5bb7-4977-801b-c8f25ecf91e3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'create', calling method: .version_select at 0x7fea07194820>, body: {"keypair": {"name": "tempest-keypair-1450728854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6eaGqSsEyr1CdC+C5tEJWNGfx+0uoPDU1Vw/uJsAyddTtZh8PqVfbS4OYrDFrgM9MGpAgFgn3ik13Ikg+TNkAXL3jTwTE0yGKewvHWN6mZFFj8KEkB3LwRMPnSGminFA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:47:11.829384 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f158f08d-5bb7-4977-801b-c8f25ecf91e3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:47:11.835167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f158f08d-5bb7-4977-801b-c8f25ecf91e3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:47:11.849616 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f158f08d-5bb7-4977-801b-c8f25ecf91e3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:47:12.792635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:12.863487 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-f158f08d-5bb7-4977-801b-c8f25ecf91e3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 45142. Jun 18 22:47:12.885363 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f158f08d-5bb7-4977-801b-c8f25ecf91e3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.213013 Jun 18 22:47:12.885909 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3223/6468] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:47:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:47:14.189879 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2121556789", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e351e931-3243-4d98-8f37-e8aed44aa13e"}], "security_groups": [{"name": "tempest-securitygroup--1984002391"}], "key_name": "tempest-keypair-1450728854", "user_data": "}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:47:14.205853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:14.206542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:14.329259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] validate_networks() for [('e351e931-3243-4d98-8f37-e8aed44aa13e', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:47:14.794514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:47:14.795169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:47:14.795818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:47:14.796401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:47:14.797019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:47:14.807669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:14.808179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:14.809022 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:14.809523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:14.826686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:47:14.832583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:47:14.846412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:47:14.848750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:47:14.900408 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e3aab55-2085-40f4-be87-6efaf424d3ab tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.715188 Jun 18 22:47:14.901704 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3246/6469] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:47:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:47:14.913711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8d482192-aa24-4fd7-8caf-379c4f8b3285 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:14.914684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8d482192-aa24-4fd7-8caf-379c4f8b3285 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:14.916899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:14.983142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8d482192-aa24-4fd7-8caf-379c4f8b3285 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:14.990972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8d482192-aa24-4fd7-8caf-379c4f8b3285 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1239 microversion: 2.1 time: 0.082495 Jun 18 22:47:14.991631 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3224/6470] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:14 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:47:16.008778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:16.009505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:16.016978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:16.017450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:16.018471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:16.018930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:16.080899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:16.089185 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-859468b3-1972-4b29-8e4c-01603400d103 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1297 microversion: 2.1 time: 0.085217 Jun 18 22:47:16.089770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3247/6471] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:16 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:17.106693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:17.107386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:17.116053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:17.116943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:17.117826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:17.118342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:17.270477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:17.279270 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-13defc0d-a715-4aac-a3f4-63dd5cbe98b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.176768 Jun 18 22:47:17.279927 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3225/6472] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:17 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:17.290650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-fd2b2263-7e91-461b-8410-8bb1aa68b4e7 req-baee27d7-b6cc-473e-bef3-3fe025f2fe42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:47:17.300547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fd2b2263-7e91-461b-8410-8bb1aa68b4e7 req-baee27d7-b6cc-473e-bef3-3fe025f2fe42 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:17.301083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-fd2b2263-7e91-461b-8410-8bb1aa68b4e7 req-baee27d7-b6cc-473e-bef3-3fe025f2fe42 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:17.325643 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-fd2b2263-7e91-461b-8410-8bb1aa68b4e7 req-baee27d7-b6cc-473e-bef3-3fe025f2fe42 service nova] Creating event network-changed:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch1-master-1 Jun 18 22:47:17.331263 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-fd2b2263-7e91-461b-8410-8bb1aa68b4e7 req-baee27d7-b6cc-473e-bef3-3fe025f2fe42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044584 Jun 18 22:47:17.337262 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3248/6473] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:47:18.301536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:18.302554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:18.313885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:18.314632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:18.315893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:18.316618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:18.452194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:18.460350 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-00a55339-ecad-4020-b874-7699ce3c83e5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.166207 Jun 18 22:47:18.460923 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3226/6474] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:18 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:19.482777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:19.483708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:19.492400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:19.493011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:19.494082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:19.494676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:19.630040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:19.638461 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-72411b50-0559-467e-92ff-567562167a94 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.163574 Jun 18 22:47:19.639047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3249/6475] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:19 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:20.656713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:20.657551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:20.665538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:20.665999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:20.666783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:20.667237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:20.807809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:20.815955 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-327c2592-763a-4f24-8ee3-fc0672c497f1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.163437 Jun 18 22:47:20.816506 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3227/6476] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:20 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:21.838575 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:21.839146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:21.846812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:21.847292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:21.848214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:21.848734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:21.990004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:21.998011 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-edaf7311-bbb1-460b-b18b-3975aee9e1a4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.163906 Jun 18 22:47:21.998587 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3250/6477] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:21 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:23.014906 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:23.015546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:23.023155 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:23.023634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:23.024434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:23.024849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:23.162293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:23.170419 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88cbeff4-ea90-471a-8fb3-276a3f2dd7ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.159524 Jun 18 22:47:23.170983 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3228/6478] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:23 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:23.300528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a5e79c97-0a22-4eea-89f7-e862399d3311 req-749df9bc-5919-41bf-b1fc-ebc4b3aef572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "name": "network-vif-plugged", "status": "completed", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:47:23.310457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a5e79c97-0a22-4eea-89f7-e862399d3311 req-749df9bc-5919-41bf-b1fc-ebc4b3aef572 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:23.310915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a5e79c97-0a22-4eea-89f7-e862399d3311 req-749df9bc-5919-41bf-b1fc-ebc4b3aef572 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:23.324989 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a5e79c97-0a22-4eea-89f7-e862399d3311 req-749df9bc-5919-41bf-b1fc-ebc4b3aef572 service nova] Creating event network-vif-plugged:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch1-master-1 Jun 18 22:47:23.330126 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a5e79c97-0a22-4eea-89f7-e862399d3311 req-749df9bc-5919-41bf-b1fc-ebc4b3aef572 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034640 Jun 18 22:47:23.330744 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3251/6479] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:47:24.189574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:24.190359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:24.199160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:24.199645 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:24.200430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:24.200881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:24.337741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:24.346282 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7178c102-ede6-4468-856d-9968ce9dc066 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1365 microversion: 2.1 time: 0.161850 Jun 18 22:47:24.346852 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3229/6480] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:24 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:25.362197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:25.363153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:25.367906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:25.368622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:25.376218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:25.376681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:25.377501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:25.377950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:25.524012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:47:25.535216 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee3f32f3-7c36-4329-8fea-5921893d7c03 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1552 microversion: 2.1 time: 0.174796 Jun 18 22:47:25.535795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3252/6481] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:47:25 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1552 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:47:25.554194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:47:25.554728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:47:25.556512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:47:25.563129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:25.563576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:25.564343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:25.564774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:25.648781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-746f8308-fcd3-4747-88bb-48048ac8141a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098506 Jun 18 22:47:25.649447 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3230/6482] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:47:25 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:47:27.044777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7f6239db-3b65-409e-a257-140eced74363 req-fe3f730a-e7e9-4fc4-8db7-7320d6a66610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:47:27.052786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7f6239db-3b65-409e-a257-140eced74363 req-fe3f730a-e7e9-4fc4-8db7-7320d6a66610 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:47:27.053352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7f6239db-3b65-409e-a257-140eced74363 req-fe3f730a-e7e9-4fc4-8db7-7320d6a66610 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:47:27.064410 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7f6239db-3b65-409e-a257-140eced74363 req-fe3f730a-e7e9-4fc4-8db7-7320d6a66610 service nova] Creating event network-changed:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch1-master-1 Jun 18 22:47:27.069532 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7f6239db-3b65-409e-a257-140eced74363 req-fe3f730a-e7e9-4fc4-8db7-7320d6a66610 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102385 Jun 18 22:47:27.070123 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3253/6483] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:48:31.054859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=15 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:31.055697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=34 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:31.059968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:31.060537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:31.067425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.067869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.068629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.069066 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.204148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:31.213961 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b2572ea-463f-4b5e-bb53-44438a0cb58b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1669 microversion: 2.1 time: 0.161253 Jun 18 22:48:31.214582 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3231/6484] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:31 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:31.233321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:31.234031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=32 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:31.238665 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:31.239378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:31.247343 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.247802 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.248602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.249047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.385501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:31.394260 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09792f43-8857-4e14-815f-3ca8e0bd7076 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1669 microversion: 2.1 time: 0.164482 Jun 18 22:48:31.394837 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3254/6485] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:31 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:31.410609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:31.411235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:31.417776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.418227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.418971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.419407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.560212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:31.568684 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ba739535-7e03-480d-bc94-6b774f6ac394 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1669 microversion: 2.1 time: 0.161994 Jun 18 22:48:31.569304 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3232/6486] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:31 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:31.585470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:31.586515 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:31.593266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.593726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.594502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.594943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.622914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:31.628890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Old instance type m1.heat2, new instance type m1.heat {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:48:31.635350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:48:31.635779 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:48:31.636269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:48:31.636695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:48:31.637228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:48:31.705472 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34925525-363b-40a1-8b75-325fc4b17c08 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3/action" status: 202 len: 0 microversion: 2.1 time: 0.124124 Jun 18 22:48:31.706092 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3255/6487] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:48:31 2022] POST /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:48:31.714896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:31.715758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:31.723374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.723827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.724634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:31.725092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:31.858803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:31.866608 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9843014-5df6-447e-ac1d-41d11eaa9ebf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1678 microversion: 2.1 time: 0.155873 Jun 18 22:48:31.867191 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3233/6488] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:31 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:32.888058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:32.888717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:32.897254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:32.897811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:32.898701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:32.899224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:33.037078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:33.045889 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2eff55e8-d1cc-4c10-b4d8-89b57986107f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1678 microversion: 2.1 time: 0.164480 Jun 18 22:48:33.046471 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3256/6489] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:32 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:34.066223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:34.067254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:34.077635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:34.078095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:34.078861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:34.079299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:34.212881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:34.220700 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cd3179a6-5880-4a77-94cc-02f2b68e4fc9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1678 microversion: 2.1 time: 0.160532 Jun 18 22:48:34.221281 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3234/6490] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:34 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:35.238562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:35.239165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:35.247058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:35.247622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:35.248570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:35.249014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:35.388102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:35.396038 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-023d6c3b-3c2f-4534-98df-566f28d6186c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1678 microversion: 2.1 time: 0.161514 Jun 18 22:48:35.396590 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3257/6491] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:35 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:36.414500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:36.415132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:36.422994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:36.423439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:36.424205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:36.424637 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:36.564528 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:36.572575 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dfff173d-0b22-4ebc-8bf7-6b47e4e946a2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.162059 Jun 18 22:48:36.573179 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3235/6492] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:36 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:37.591950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:37.592558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:37.599719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:37.600178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:37.600958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:37.601505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:37.746323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:37.754039 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cb8165dc-2634-4adc-b684-6d6a10af1a84 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.166203 Jun 18 22:48:37.754610 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3258/6493] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:37 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:38.774147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:38.774939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:38.784743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:38.785457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:38.786523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:38.787124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:38.927843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:38.935965 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b002924d-c9f8-44c9-aa3e-683a0b16f1f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.167245 Jun 18 22:48:38.936548 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3236/6494] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:38 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:39.956558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:39.957267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:39.965414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:39.965910 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:39.966747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:39.967228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:40.105985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:40.114277 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-71a5bc11-bc33-4c06-ae11-1ec73ae42d33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.163272 Jun 18 22:48:40.114867 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3259/6495] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:39 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:41.135825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:41.136934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:41.148943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:41.149745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:41.151015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:41.151752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:41.294550 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:41.303261 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bde32a36-5f57-4ee9-b111-26c91dd8870f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.173920 Jun 18 22:48:41.303990 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3237/6496] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:41 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:42.326280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:42.327366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:42.335988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:42.336449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:42.337296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:42.337745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:42.471959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:42.480483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bc00d81d-5796-4043-b613-7971fee97fcc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.161301 Jun 18 22:48:42.481055 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3260/6497] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:42 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:43.502071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:43.502729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:43.510993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:43.511498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:43.512354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:43.512842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:43.653090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:43.662714 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-23a8a9b2-ec22-4d70-86e6-03159359442d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.167004 Jun 18 22:48:43.663305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3238/6498] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:43 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:44.679755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:44.680329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:44.687596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:44.688059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:44.688854 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:44.689338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:44.825329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:44.837561 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f9ec05c3-78f8-40a2-acc8-acdb43b1dc17 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.161593 Jun 18 22:48:44.838234 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3261/6499] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:44 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:45.860692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:45.861615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:45.873518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:45.874275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:45.875546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:45.876280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:46.028727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:46.037506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ea3dd92-1247-43d8-bce5-3f9eeeee6860 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.183428 Jun 18 22:48:46.038153 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3239/6500] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:45 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:47.055841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:47.056471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:47.064751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:47.065253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:47.066041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:47.066485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:47.201208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:47.208875 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-006044e5-2ab3-45c1-9c3e-0ece0e50b188 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1683 microversion: 2.1 time: 0.157259 Jun 18 22:48:47.209831 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3262/6501] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:47 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:48.226810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:48.227439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:48.234656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:48.235278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:48.236147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:48.237061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:48.369241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:48.378940 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-162e41b9-f196-438f-8da6-224810857e8f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1682 microversion: 2.1 time: 0.156029 Jun 18 22:48:48.379522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3240/6502] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:48 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:48.648679 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2631c2b7-3b3a-4455-acdd-89afa87ca51b req-4d3dff7d-c954-471d-be0b-765c9555854a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "name": "network-vif-unplugged", "status": "completed", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:48.658045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2631c2b7-3b3a-4455-acdd-89afa87ca51b req-4d3dff7d-c954-471d-be0b-765c9555854a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:48.658560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2631c2b7-3b3a-4455-acdd-89afa87ca51b req-4d3dff7d-c954-471d-be0b-765c9555854a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:48.674472 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2631c2b7-3b3a-4455-acdd-89afa87ca51b req-4d3dff7d-c954-471d-be0b-765c9555854a service nova] Creating event network-vif-unplugged:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch2-master-1 Jun 18 22:48:48.688070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-2631c2b7-3b3a-4455-acdd-89afa87ca51b req-4d3dff7d-c954-471d-be0b-765c9555854a service nova] Instance 22034ef5-ef19-4a3c-a687-811011df96b3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:48:48.701588 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2631c2b7-3b3a-4455-acdd-89afa87ca51b req-4d3dff7d-c954-471d-be0b-765c9555854a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146380 Jun 18 22:48:48.702531 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3263/6503] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:48:49.396324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:49.396904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:49.406736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:49.407376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:49.408390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:49.408832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:49.549489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:49.557981 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ab765cd-42cd-4ba2-8581-5f51d5ba1ce0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1682 microversion: 2.1 time: 0.165853 Jun 18 22:48:49.558798 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3241/6504] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:49 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:50.581681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:50.582847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:50.594311 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:50.595078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:50.598047 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:50.598500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:50.728063 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-d29d1a9a-cc3e-42ae-bc10-c8d112c72911 req-e08814ed-026f-4716-8e4f-2067c7737dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:50.737562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d29d1a9a-cc3e-42ae-bc10-c8d112c72911 req-e08814ed-026f-4716-8e4f-2067c7737dff service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:50.738012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-d29d1a9a-cc3e-42ae-bc10-c8d112c72911 req-e08814ed-026f-4716-8e4f-2067c7737dff service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:50.750094 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-d29d1a9a-cc3e-42ae-bc10-c8d112c72911 req-e08814ed-026f-4716-8e4f-2067c7737dff service nova] Creating event network-changed:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch2-master-1 Jun 18 22:48:50.751270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:50.755905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-d29d1a9a-cc3e-42ae-bc10-c8d112c72911 req-e08814ed-026f-4716-8e4f-2067c7737dff service nova] Instance 22034ef5-ef19-4a3c-a687-811011df96b3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:48:50.759227 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2555b613-cc6c-4a34-b63d-1d62a97d5fd8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1680 microversion: 2.1 time: 0.186872 Jun 18 22:48:50.759809 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3264/6505] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:50 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:50.776267 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-d29d1a9a-cc3e-42ae-bc10-c8d112c72911 req-e08814ed-026f-4716-8e4f-2067c7737dff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051898 Jun 18 22:48:50.776849 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3242/6506] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:48:51.777691 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:51.778302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:51.786841 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:51.787304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:51.788144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:51.788530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:51.927778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:51.935585 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a5ef0f1-3129-4bbf-8a2a-e43ecd39527e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1677 microversion: 2.1 time: 0.163117 Jun 18 22:48:51.936159 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3265/6507] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:51 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:51.961003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:51.961849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:51.971114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:51.971564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:51.972334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:51.972771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:52.042402 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ebfe7d0-ca9b-4a04-a808-6828820c7a99 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3/action" status: 204 len: 0 microversion: 2.1 time: 0.090413 Jun 18 22:48:52.042998 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3243/6508] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:48:51 2022] POST /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:48:52.052068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:52.052694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:52.059341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:52.059868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:52.060759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:52.061305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:52.201331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:52.209818 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aa466e3a-9123-420b-aef9-c37106547b51 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1677 microversion: 2.1 time: 0.162058 Jun 18 22:48:52.210487 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3266/6509] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:52 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:53.105110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-511d6797-5052-4c3c-90b1-b3b1bbe69526 req-55d8a32d-4c79-4b5a-b8a1-55dd6adec1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "name": "network-vif-plugged", "status": "completed", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:53.120170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-511d6797-5052-4c3c-90b1-b3b1bbe69526 req-55d8a32d-4c79-4b5a-b8a1-55dd6adec1d3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.120613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-511d6797-5052-4c3c-90b1-b3b1bbe69526 req-55d8a32d-4c79-4b5a-b8a1-55dd6adec1d3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.132123 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-511d6797-5052-4c3c-90b1-b3b1bbe69526 req-55d8a32d-4c79-4b5a-b8a1-55dd6adec1d3 service nova] Creating event network-vif-plugged:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch2-master-1 Jun 18 22:48:53.137328 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-511d6797-5052-4c3c-90b1-b3b1bbe69526 req-55d8a32d-4c79-4b5a-b8a1-55dd6adec1d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102265 Jun 18 22:48:53.138250 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3244/6510] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:48:53.232304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:53.233410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:53.242595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.243288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.244097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.244545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.381532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:53.389860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-365a12f3-de7e-41c4-a1f1-0d102b8fddf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1669 microversion: 2.1 time: 0.164653 Jun 18 22:48:53.390449 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3267/6511] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:53 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:53.407285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:53.408014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:53.414828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.415475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.416320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.416723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.560437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:53.568375 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7b00fdc1-5e72-469b-beff-164b45e774c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1669 microversion: 2.1 time: 0.165357 Jun 18 22:48:53.568940 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3245/6512] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:53 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:53.585608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:53.586248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:53.592642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.593154 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.593946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.594404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.730018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:53.738271 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f27acfa4-8aa4-4a80-a7e0-4aa724cac65a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1669 microversion: 2.1 time: 0.156834 Jun 18 22:48:53.738856 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3268/6513] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:53 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:53.755031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:53.755536 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:53.761835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.762279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.763036 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.763460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.788183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:48:53.813266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:53.869305 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c98c9123-fd02-4d4e-b380-990e01e37572 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 204 len: 0 microversion: 2.1 time: 0.118020 Jun 18 22:48:53.869928 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3246/6514] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:48:53 2022] DELETE /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:48:53.878472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:53.879146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:53.885376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.885846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.886632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:53.887086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:53.905612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:48:54.026585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:54.034439 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c84e4164-f741-428d-b668-66501adc28ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1675 microversion: 2.1 time: 0.159853 Jun 18 22:48:54.035220 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3269/6515] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:53 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:55.057894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:55.058608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:55.066138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:55.066698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:55.067463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:55.067921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:55.203057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:55.212100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9f6ad20-fcb1-4990-9ab7-8ebe359e24de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1675 microversion: 2.1 time: 0.158516 Jun 18 22:48:55.212675 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3247/6516] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:55 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:56.229671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:56.230329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:56.238720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:56.239190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:56.240041 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:56.240495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:56.251563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-dc9023ad-eeb8-4e15-8bfd-9e70ed97445b req-dd180db8-823c-4bef-a94a-82e9cf8afd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22034ef5-ef19-4a3c-a687-811011df96b3", "name": "network-vif-deleted", "tag": "904f6f6f-49c9-48f1-adc4-a7180d8f7ac3"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:56.263557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dc9023ad-eeb8-4e15-8bfd-9e70ed97445b req-dd180db8-823c-4bef-a94a-82e9cf8afd30 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:56.264288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dc9023ad-eeb8-4e15-8bfd-9e70ed97445b req-dd180db8-823c-4bef-a94a-82e9cf8afd30 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:56.277679 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-dc9023ad-eeb8-4e15-8bfd-9e70ed97445b req-dd180db8-823c-4bef-a94a-82e9cf8afd30 service nova] Creating event network-vif-deleted:904f6f6f-49c9-48f1-adc4-a7180d8f7ac3 for instance 22034ef5-ef19-4a3c-a687-811011df96b3 on nch2-master-1 Jun 18 22:48:56.283886 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-dc9023ad-eeb8-4e15-8bfd-9e70ed97445b req-dd180db8-823c-4bef-a94a-82e9cf8afd30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035617 Jun 18 22:48:56.284496 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3248/6517] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:48:56.329203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:56.338486 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8c957bcf-4c2f-46df-b96b-7b98c1c08e2f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 200 len: 1607 microversion: 2.1 time: 0.112782 Jun 18 22:48:56.339387 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3270/6518] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:56 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 1607 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:48:57.360859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:57.362095 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:57.374457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:57.375200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:57.376459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:57.377232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:57.391505 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 HTTP/1.1 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '22034ef5-ef19-4a3c-a687-811011df96b3'} Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:48:57.393065 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2133bb0d-3fc1-4f4d-b005-2bb028e118fc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 404 len: 111 microversion: 2.1 time: 0.041031 Jun 18 22:48:57.397805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3249/6519] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:57 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:48:57.407587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:57.408208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:57.415756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:57.416236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:57.417016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:57.417508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:57.431022 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 HTTP/1.1 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '22034ef5-ef19-4a3c-a687-811011df96b3'} Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:48:57.432672 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ffccd31e-1ece-4c07-9a9b-22ea3162d602 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 404 len: 111 microversion: 2.1 time: 0.030469 Jun 18 22:48:57.437223 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3271/6520] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:57 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:48:57.483113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1586853605", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e351e931-3243-4d98-8f37-e8aed44aa13e"}], "security_groups": [{"name": "tempest-securitygroup--1984002391"}], "key_name": "tempest-keypair-1450728854", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:48:57.593303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] validate_networks() for [('e351e931-3243-4d98-8f37-e8aed44aa13e', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:48:57.995541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:48:57.995971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:48:57.996485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:48:57.996942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:48:57.997375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:48:58.007029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:58.007490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:58.008304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:48:58.008746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:48:58.028012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:48:58.033849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:48:58.047491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:48:58.049856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:48:58.096575 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [30f2985d-6453-44eb-9005-b6ba3eec437a] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:48:59.111215 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [30f2985d-6453-44eb-9005-b6ba3eec437a] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 45388. Jun 18 22:48:59.116702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bfaa48e4-aca6-4ecc-9cb0-ac3d915080c9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.637269 Jun 18 22:48:59.117398 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3250/6521] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:48:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:48:59.127618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37c6fbfe-d82a-49f1-80f7-82e305eb3a37 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:48:59.128844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37c6fbfe-d82a-49f1-80f7-82e305eb3a37 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:48:59.187169 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-37c6fbfe-d82a-49f1-80f7-82e305eb3a37 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:48:59.194257 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37c6fbfe-d82a-49f1-80f7-82e305eb3a37 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1239 microversion: 2.1 time: 0.070478 Jun 18 22:48:59.194838 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3272/6522] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:48:59 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:00.213300 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:00.213928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:00.221562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:00.221991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:00.223037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:00.223619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:00.286149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:00.294835 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b5cc0b4-78ae-4d88-a351-37944f162026 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1297 microversion: 2.1 time: 0.086927 Jun 18 22:49:00.295412 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3251/6523] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:00 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:01.312084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:01.312731 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:01.316507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=45 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:01.323724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:01.324200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:01.325021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:01.325493 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:01.436983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a813db1b-6430-4266-b84d-a2f0bba65360 req-fca8108b-88ea-47b2-a29a-4ccce61aed21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:49:01.444623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:01.456136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a813db1b-6430-4266-b84d-a2f0bba65360 req-fca8108b-88ea-47b2-a29a-4ccce61aed21 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:01.458308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a813db1b-6430-4266-b84d-a2f0bba65360 req-fca8108b-88ea-47b2-a29a-4ccce61aed21 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:01.480483 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a813db1b-6430-4266-b84d-a2f0bba65360 req-fca8108b-88ea-47b2-a29a-4ccce61aed21 service nova] Creating event network-changed:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch1-master-1 Jun 18 22:49:01.486299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a813db1b-6430-4266-b84d-a2f0bba65360 req-fca8108b-88ea-47b2-a29a-4ccce61aed21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058060 Jun 18 22:49:01.487603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3252/6524] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:49:01.500327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:01.509801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e1eef25f-3587-4443-832e-e845c0aa8f43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.201704 Jun 18 22:49:01.510662 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3273/6525] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:01 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:02.535223 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:02.535901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:02.542795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:02.543243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:02.543988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:02.544453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:02.684489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:02.692494 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b39dfa2a-1395-4742-b458-18aa9f04f38f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.166021 Jun 18 22:49:02.693097 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3253/6526] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:02 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:03.710761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:03.711373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:03.719588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:03.720069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:03.720849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:03.721325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:03.857282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:03.865023 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-54fc8973-7b14-44cb-a1d5-f7319b17a17a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.158778 Jun 18 22:49:03.865827 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3274/6527] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:03 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:04.886914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:04.887893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:04.900022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:04.900777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:04.902147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:04.902853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:05.049778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:05.058670 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec0184c2-e2e6-402c-b1bc-d74f8a415506 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.178313 Jun 18 22:49:05.059232 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3254/6528] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:04 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:06.076466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:06.077134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:06.084394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:06.085244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:06.086039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:06.086494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:06.218815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:06.227037 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a4af8f1a-40e5-4baf-b3cb-ff35d3a601a6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.154581 Jun 18 22:49:06.227623 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3275/6529] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:06 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:07.246483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:07.247373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:07.254843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:07.255290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:07.256052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:07.256489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:07.389785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:07.397559 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-94916ea7-0fa5-45e7-aef5-3ac1efa7c56d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.156096 Jun 18 22:49:07.398108 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3255/6530] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:07 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:07.832435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-27e6ece7-fec8-478c-906f-9dd54938d98f req-918150b6-769c-4298-8069-c6817caa67f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "name": "network-vif-plugged", "status": "completed", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:49:07.842826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-27e6ece7-fec8-478c-906f-9dd54938d98f req-918150b6-769c-4298-8069-c6817caa67f9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:07.843299 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-27e6ece7-fec8-478c-906f-9dd54938d98f req-918150b6-769c-4298-8069-c6817caa67f9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:07.855309 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-27e6ece7-fec8-478c-906f-9dd54938d98f req-918150b6-769c-4298-8069-c6817caa67f9 service nova] Creating event network-vif-plugged:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch1-master-1 Jun 18 22:49:07.860550 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-27e6ece7-fec8-478c-906f-9dd54938d98f req-918150b6-769c-4298-8069-c6817caa67f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Jun 18 22:49:07.861186 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3276/6531] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:49:08.417610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:08.418307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:08.421123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:08.422162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:08.431460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:08.432033 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:08.433083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:08.433670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:08.576701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:08.587228 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2af21898-d1f3-4830-a9cf-51e75d97dac5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1365 microversion: 2.1 time: 0.175179 Jun 18 22:49:08.587818 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3256/6532] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:08 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:09.609055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:49:09.616457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:09.617699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:09.625075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:09.625570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:09.626370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:09.626826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:09.761496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:49:09.769659 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0bf59ad-21a8-4edf-8c84-1a48c66b18e8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1552 microversion: 2.1 time: 0.164024 Jun 18 22:49:09.770274 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3277/6533] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:49:09 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:49:09.793345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:49:09.793842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:49:09.801115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:09.801568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:09.802328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:09.802797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:09.883995 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30a1e03c-3f0a-46b5-88a5-d5e5bc722a73 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095132 Jun 18 22:49:09.884663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3257/6534] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:49:09 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:49:10.821484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2dfd8792-77ca-4fee-8a7a-f902123d46ab req-d751dcca-e3e6-4523-9286-2898b96c8b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:49:10.830658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2dfd8792-77ca-4fee-8a7a-f902123d46ab req-d751dcca-e3e6-4523-9286-2898b96c8b0a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:49:10.831119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2dfd8792-77ca-4fee-8a7a-f902123d46ab req-d751dcca-e3e6-4523-9286-2898b96c8b0a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:49:10.842769 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2dfd8792-77ca-4fee-8a7a-f902123d46ab req-d751dcca-e3e6-4523-9286-2898b96c8b0a service nova] Creating event network-changed:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch1-master-1 Jun 18 22:49:10.848226 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2dfd8792-77ca-4fee-8a7a-f902123d46ab req-d751dcca-e3e6-4523-9286-2898b96c8b0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030627 Jun 18 22:49:10.849180 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3278/6535] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:50:14.402899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=11 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:14.403817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:14.408210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1e1a3035-62b5-4e50-b040-e064b95d9cf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:14.416119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1e1a3035-62b5-4e50-b040-e064b95d9cf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:14.416568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1e1a3035-62b5-4e50-b040-e064b95d9cf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:14.439142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1e1a3035-62b5-4e50-b040-e064b95d9cf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Going to try to stop instance {{(pid=130902) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 22:50:14.481609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1e1a3035-62b5-4e50-b040-e064b95d9cf3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action" status: 202 len: 0 microversion: 2.1 time: 0.082447 Jun 18 22:50:14.482198 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3258/6536] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:50:14 2022] POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:50:14.489193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=11 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:14.490058 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=38 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:14.495208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:14.496188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:14.505121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:14.505593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:14.506367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:14.506811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:14.647754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:14.655812 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b90f095f-29ad-4cdf-9521-fb0ddfe6f244 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.168685 Jun 18 22:50:14.656330 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3279/6537] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:14 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:15.677903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:15.678626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:15.687775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:15.688232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:15.689012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:15.689490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:15.830821 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:15.839185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d00f582-57bc-4392-b08c-684599b1e59e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.166891 Jun 18 22:50:15.839853 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3259/6538] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:15 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:16.859677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:16.860402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:16.869258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:16.869812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:16.870874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:16.871399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:17.013832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:17.023466 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-02a3bfcf-5a06-4aca-b890-a63790d12afe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.168884 Jun 18 22:50:17.024294 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3280/6539] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:16 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:18.044654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:18.045725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:18.057415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:18.058173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:18.059570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:18.060004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:18.206184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:18.214706 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2ff0e3c9-383f-479b-9215-47227bb55e80 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.176648 Jun 18 22:50:18.215413 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3260/6540] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:18 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:19.237873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:19.238523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:19.246251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:19.246734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:19.247549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:19.248017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:19.390896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:19.399042 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7b170ecd-8d2e-43f7-a3a0-d15e1aae8156 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.165647 Jun 18 22:50:19.399618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3281/6541] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:19 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:20.418783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:20.419356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:20.427129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:20.427768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:20.428548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:20.428987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:20.580555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:20.589403 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f21905cc-0467-4b86-97d3-e60c79b90433 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.174659 Jun 18 22:50:20.589954 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3261/6542] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:20 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:21.609907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:21.610626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:21.618945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:21.619462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:21.620373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:21.620895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:21.755244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:21.762908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a24f9176-4684-4f0e-9695-79b78328d02b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.159130 Jun 18 22:50:21.763492 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3282/6543] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:21 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:22.780642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:22.781294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:22.788565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:22.789016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:22.789816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:22.790254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:22.926158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:22.933945 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d2fdc0e1-fbb2-4460-9623-df13f4ccd14e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.157365 Jun 18 22:50:22.934516 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3262/6544] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:22 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:23.955290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:23.956315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:23.968177 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:23.968635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:23.969446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:23.969893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:24.114233 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:24.122355 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-759277d2-1c37-4fac-af9a-7f42468eb4d3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.173568 Jun 18 22:50:24.122950 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3283/6545] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:23 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:25.144458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:25.145483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:25.157082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:25.157864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:25.159141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:25.159872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:25.302453 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:25.310799 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1fdd0e2b-6500-4d8b-9a3a-5724a920919f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1656 microversion: 2.1 time: 0.173367 Jun 18 22:50:25.311384 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3263/6546] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:25 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1656 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:25.327680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:25.328685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:25.336582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:25.337069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:25.337857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:25.338316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:25.366680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:25.372816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Old instance type m1.heat2, new instance type m1.heat {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:50:25.379187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:50:25.379602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:50:25.380111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:50:25.380539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:50:25.380967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:50:25.449074 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dbe864e3-b4a8-429c-9e16-a3b224a8c1b5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action" status: 202 len: 0 microversion: 2.1 time: 0.125450 Jun 18 22:50:25.450012 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3284/6547] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:50:25 2022] POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:50:25.458027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:25.458642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:25.465466 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:25.465914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:25.466794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:25.467279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:25.605589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:25.613404 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fe9efccd-2764-49e9-9805-df2dc7069654 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.159185 Jun 18 22:50:25.613987 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3264/6548] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:25 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:26.631298 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:26.631899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:26.643124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:26.643597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:26.644403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:26.644863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:26.792601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:26.801406 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2027f578-58f9-4e8a-9d08-19d6a5aed7c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1679 microversion: 2.1 time: 0.174304 Jun 18 22:50:26.801975 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3285/6549] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:26 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:27.822720 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:27.823547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:27.834427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:27.835114 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:27.836676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:27.837389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:27.976865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:27.985074 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4b29f551-f181-4e09-b570-547552dab326 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1684 microversion: 2.1 time: 0.168471 Jun 18 22:50:27.985670 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3265/6550] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:27 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:29.006898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:29.007935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:29.018409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:29.018875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:29.019676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:29.020129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:29.156059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:29.164222 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6bf0a4ec-9663-4adb-b7c0-08794192ed5a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1684 microversion: 2.1 time: 0.163909 Jun 18 22:50:29.164779 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3286/6551] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:28 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:29.983237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a143e840-59e9-49a2-87a3-2ec5bb148204 req-695edc93-1dd3-46ba-a461-631323c5cc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "name": "network-vif-unplugged", "status": "completed", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:29.992534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a143e840-59e9-49a2-87a3-2ec5bb148204 req-695edc93-1dd3-46ba-a461-631323c5cc8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:29.992987 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a143e840-59e9-49a2-87a3-2ec5bb148204 req-695edc93-1dd3-46ba-a461-631323c5cc8d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:30.005986 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a143e840-59e9-49a2-87a3-2ec5bb148204 req-695edc93-1dd3-46ba-a461-631323c5cc8d service nova] Creating event network-vif-unplugged:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch2-master-1 Jun 18 22:50:30.011529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-a143e840-59e9-49a2-87a3-2ec5bb148204 req-695edc93-1dd3-46ba-a461-631323c5cc8d service nova] Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:50:30.022806 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a143e840-59e9-49a2-87a3-2ec5bb148204 req-695edc93-1dd3-46ba-a461-631323c5cc8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043496 Jun 18 22:50:30.023743 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3266/6552] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:50:30.183011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:30.183730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:30.191750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:30.192216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:30.193018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:30.193502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:30.338705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:30.346612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ec6f13a-e89d-42f7-97cb-de4ea65e0523 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1683 microversion: 2.1 time: 0.167678 Jun 18 22:50:30.347526 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3287/6553] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:30 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:31.371103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:31.372139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:31.380258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:31.380711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:31.381535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:31.381971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:31.525309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:31.533887 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b16e65b6-54d2-47c2-b5a1-658f36c6082e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1681 microversion: 2.1 time: 0.172775 Jun 18 22:50:31.534472 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3267/6554] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:31 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:32.044310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b5521679-5f61-479b-b87c-17fe57dc997f req-5808ee45-d6fb-47cf-8fa9-d70751d593c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:32.055106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b5521679-5f61-479b-b87c-17fe57dc997f req-5808ee45-d6fb-47cf-8fa9-d70751d593c6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.055570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b5521679-5f61-479b-b87c-17fe57dc997f req-5808ee45-d6fb-47cf-8fa9-d70751d593c6 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.067864 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b5521679-5f61-479b-b87c-17fe57dc997f req-5808ee45-d6fb-47cf-8fa9-d70751d593c6 service nova] Creating event network-changed:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch2-master-1 Jun 18 22:50:32.074051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-b5521679-5f61-479b-b87c-17fe57dc997f req-5808ee45-d6fb-47cf-8fa9-d70751d593c6 service nova] Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:50:32.085050 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b5521679-5f61-479b-b87c-17fe57dc997f req-5808ee45-d6fb-47cf-8fa9-d70751d593c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046947 Jun 18 22:50:32.085662 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3288/6555] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:50:32.556315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:32.557050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:32.564455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.564935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.565738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.566173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.706124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:32.714552 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f52d53b-db74-4ee8-a701-ab04f780a9da tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1677 microversion: 2.1 time: 0.162249 Jun 18 22:50:32.715132 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3268/6556] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:32 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:32.734190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:32.734905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:32.741512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.741975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.742750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.743192 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.801772 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa26b801-7b69-4cf9-be49-ae77897c1dfc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action" status: 204 len: 0 microversion: 2.1 time: 0.071562 Jun 18 22:50:32.802410 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3289/6557] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:50:32 2022] POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:50:32.810885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:32.811628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:32.819019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.819750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.820587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:32.821176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:32.955065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:32.962970 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0dc6943a-2a4d-4486-b753-aca683b260db tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1677 microversion: 2.1 time: 0.156290 Jun 18 22:50:32.963530 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3269/6558] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:32 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:33.982014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:33.982658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:33.990695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:33.991234 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:33.992115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:33.992623 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:34.127315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:34.135013 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3b5a0a12-e70e-4f9e-a705-b65020de2ce5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1677 microversion: 2.1 time: 0.157815 Jun 18 22:50:34.135795 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3290/6559] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:33 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:35.152024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:35.153271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:35.161116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.161563 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.162363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.162801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.297753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:35.305962 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8c9a56af-395c-4969-a089-dd476a3c2fa1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1656 microversion: 2.1 time: 0.157904 Jun 18 22:50:35.306539 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3270/6560] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:35 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:35.322348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:35.322984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:35.330407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.333076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.333897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.334363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.471806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:35.479625 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40064bd6-0f27-402c-a797-0a3e09152589 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1656 microversion: 2.1 time: 0.161145 Jun 18 22:50:35.480197 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3291/6561] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:35 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:35.496502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5ce27860-8637-4d58-b70b-fc2b2a91d7ed tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:35.503336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ce27860-8637-4d58-b70b-fc2b2a91d7ed tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.503815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5ce27860-8637-4d58-b70b-fc2b2a91d7ed tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.527079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5ce27860-8637-4d58-b70b-fc2b2a91d7ed tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Going to try to start instance {{(pid=130902) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 22:50:35.572689 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5ce27860-8637-4d58-b70b-fc2b2a91d7ed tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action" status: 202 len: 0 microversion: 2.1 time: 0.080036 Jun 18 22:50:35.573326 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3271/6562] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:50:35 2022] POST /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:50:35.582049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:35.583251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:35.591253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.591729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.592982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.593461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.628280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ea0f1b42-5471-4fc0-951c-77ba29207b32 req-d0e0dde9-1e7a-41fb-be11-be45ad642119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "name": "network-vif-plugged", "status": "completed", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:35.640190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea0f1b42-5471-4fc0-951c-77ba29207b32 req-d0e0dde9-1e7a-41fb-be11-be45ad642119 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:35.640937 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ea0f1b42-5471-4fc0-951c-77ba29207b32 req-d0e0dde9-1e7a-41fb-be11-be45ad642119 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:35.653776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ea0f1b42-5471-4fc0-951c-77ba29207b32 req-d0e0dde9-1e7a-41fb-be11-be45ad642119 service nova] Creating event network-vif-plugged:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch2-master-1 Jun 18 22:50:35.659687 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ea0f1b42-5471-4fc0-951c-77ba29207b32 req-d0e0dde9-1e7a-41fb-be11-be45ad642119 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Jun 18 22:50:35.660417 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3272/6563] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:50:35.740674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:35.748409 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9593ad66-395f-4149-995f-ff661ae1bf45 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1665 microversion: 2.1 time: 0.170449 Jun 18 22:50:35.748991 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3292/6564] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:35 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1665 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:36.771169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:36.771865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:36.781572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:36.782068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:36.782989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:36.783470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:36.804264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:36.921608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:36.931315 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d25325de-8052-464c-b7a5-25ead170537c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1669 microversion: 2.1 time: 0.168368 Jun 18 22:50:36.931952 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3273/6565] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:36 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:36.948089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:36.948627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:36.955978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:36.956451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:36.957284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:36.957723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:36.973523 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:36.985894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:50:37.084080 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6990cb83-5f15-4d3d-9148-b6f0bfea5d9d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 204 len: 0 microversion: 2.1 time: 0.139389 Jun 18 22:50:37.084848 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3293/6566] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:50:36 2022] DELETE /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:50:37.094495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:37.095123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:37.101596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:37.102058 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:37.102832 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:37.103275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:37.240346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:37.251623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-262c2310-b5a1-49fc-98e9-d3129a0384c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1675 microversion: 2.1 time: 0.160847 Jun 18 22:50:37.252447 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3274/6567] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:37 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:50:38.279995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:38.281225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:38.289431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:38.289840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:38.290632 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:38.291093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:38.422749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:38.430663 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-edcff96a-bb84-4b88-badf-c921e0070bad tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 200 len: 1675 microversion: 2.1 time: 0.157926 Jun 18 22:50:38.431388 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3294/6568] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:38 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:39.225797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-6304db15-eb47-451d-8c1a-5293d64dff5e req-1cfe3dcf-de9f-4973-a138-619a981ce240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "013c9a99-0f71-4172-afb5-1c150e96cc86", "name": "network-vif-deleted", "tag": "c723fb70-2a03-41a4-bb3b-3f82b5909314"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:39.235624 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6304db15-eb47-451d-8c1a-5293d64dff5e req-1cfe3dcf-de9f-4973-a138-619a981ce240 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:39.236246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-6304db15-eb47-451d-8c1a-5293d64dff5e req-1cfe3dcf-de9f-4973-a138-619a981ce240 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:39.249824 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-6304db15-eb47-451d-8c1a-5293d64dff5e req-1cfe3dcf-de9f-4973-a138-619a981ce240 service nova] Creating event network-vif-deleted:c723fb70-2a03-41a4-bb3b-3f82b5909314 for instance 013c9a99-0f71-4172-afb5-1c150e96cc86 on nch2-master-1 Jun 18 22:50:39.255577 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-6304db15-eb47-451d-8c1a-5293d64dff5e req-1cfe3dcf-de9f-4973-a138-619a981ce240 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 Jun 18 22:50:39.256483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3275/6569] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:50:39.447991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:39.448626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:39.455711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:39.456212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:39.456979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:39.457654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:39.475531 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 HTTP/1.1 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '013c9a99-0f71-4172-afb5-1c150e96cc86'} Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:50:39.477287 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fdc0cbb4-d178-4431-8c89-87597696e59c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 404 len: 111 microversion: 2.1 time: 0.034878 Jun 18 22:50:39.481634 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3295/6570] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:39 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:50:39.494475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:39.495339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:39.501862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:39.502381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:39.503269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:39.503798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:39.517862 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 HTTP/1.1 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '013c9a99-0f71-4172-afb5-1c150e96cc86'} Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:50:39.519667 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5295be6f-6181-426a-9eb5-620e65a22670 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 404 len: 111 microversion: 2.1 time: 0.032661 Jun 18 22:50:39.523623 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3276/6571] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:39 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:50:39.570393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1514530835", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e351e931-3243-4d98-8f37-e8aed44aa13e"}], "security_groups": [{"name": "tempest-securitygroup--1984002391"}], "key_name": "tempest-keypair-1450728854", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:39.673266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] validate_networks() for [('e351e931-3243-4d98-8f37-e8aed44aa13e', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:50:40.111029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:50:40.111485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:50:40.112036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:50:40.112463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:50:40.112889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:50:40.122506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:40.122972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:40.123790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:40.124245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:40.144827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:50:40.150365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:50:40.164014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:50:40.166359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:50:40.215124 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-77bee0a5-7563-4231-9f72-5253aa02654d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.648635 Jun 18 22:50:40.217113 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3296/6572] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:50:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:50:40.226804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8cd06378-b13b-4349-afba-dc2a68d3896a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:40.227500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8cd06378-b13b-4349-afba-dc2a68d3896a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:40.290867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8cd06378-b13b-4349-afba-dc2a68d3896a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:40.299453 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8cd06378-b13b-4349-afba-dc2a68d3896a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1239 microversion: 2.1 time: 0.076659 Jun 18 22:50:40.300012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3277/6573] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:40 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:41.318810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:41.320332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:41.329461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:41.329980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:41.331017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:41.331477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:41.398628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:41.406573 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d5fcc8be-21a5-4169-b1d0-a9dea6fb4cd4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1309 microversion: 2.1 time: 0.093407 Jun 18 22:50:41.407152 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3297/6574] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:41 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:42.424603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:42.425273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:42.432662 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:42.433088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:42.439600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:42.440046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:42.664144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dab9d306-4113-42d6-911a-e75cb109dc1b req-a3b2262b-a022-45fa-8928-3bab179d53af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:42.679761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dab9d306-4113-42d6-911a-e75cb109dc1b req-a3b2262b-a022-45fa-8928-3bab179d53af service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:42.680445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dab9d306-4113-42d6-911a-e75cb109dc1b req-a3b2262b-a022-45fa-8928-3bab179d53af service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:42.696964 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dab9d306-4113-42d6-911a-e75cb109dc1b req-a3b2262b-a022-45fa-8928-3bab179d53af service nova] Creating event network-changed:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:50:42.705884 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dab9d306-4113-42d6-911a-e75cb109dc1b req-a3b2262b-a022-45fa-8928-3bab179d53af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057017 Jun 18 22:50:42.708347 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3298/6575] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:50:42.984589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:42.995526 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f904938-1da3-4c4c-8819-8b83ed06b9fe tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1365 microversion: 2.1 time: 0.575202 Jun 18 22:50:42.996127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3278/6576] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:42 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1365 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:44.019591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:44.020410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:44.027579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:44.028078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:44.028915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:44.029886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:44.169631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:44.181041 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-689557cf-993f-46da-a9d8-8326aaac7512 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1365 microversion: 2.1 time: 0.169520 Jun 18 22:50:44.181876 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3299/6577] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:44 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:45.198659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:45.199262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:45.202185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=45 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:45.208122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:45.208569 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:45.209374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:45.209889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:45.356795 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:45.365839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52bf6f3d-7491-4903-b50a-110c50840199 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1365 microversion: 2.1 time: 0.170928 Jun 18 22:50:45.366491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3279/6578] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:45 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:46.384048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:46.385300 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:46.391634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:46.394325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:46.394989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:46.395973 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:46.396564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:46.535305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:46.543162 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e34f50f-17c0-4133-b5b9-9c296e95087a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1365 microversion: 2.1 time: 0.163169 Jun 18 22:50:46.543776 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3300/6579] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:46 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:47.561141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:47.561892 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:47.569018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:47.569498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:47.570260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:47.570694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:47.705009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:47.713374 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1748ed25-219d-4814-a91c-0b3aca28de89 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1365 microversion: 2.1 time: 0.156416 Jun 18 22:50:47.713939 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3280/6580] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:47 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:48.338751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7aac16e3-cb0e-4c39-a0cd-dc728b0c1fb6 req-a7a61245-e1a4-43bc-ac71-d37f2f3c3c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "name": "network-vif-plugged", "status": "completed", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:48.348696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7aac16e3-cb0e-4c39-a0cd-dc728b0c1fb6 req-a7a61245-e1a4-43bc-ac71-d37f2f3c3c99 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:48.349211 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7aac16e3-cb0e-4c39-a0cd-dc728b0c1fb6 req-a7a61245-e1a4-43bc-ac71-d37f2f3c3c99 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:48.360406 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7aac16e3-cb0e-4c39-a0cd-dc728b0c1fb6 req-a7a61245-e1a4-43bc-ac71-d37f2f3c3c99 service nova] Creating event network-vif-plugged:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:50:48.365511 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7aac16e3-cb0e-4c39-a0cd-dc728b0c1fb6 req-a7a61245-e1a4-43bc-ac71-d37f2f3c3c99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031089 Jun 18 22:50:48.366117 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3301/6581] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:50:48.731379 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:48.732003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:48.739532 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:48.739994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:48.740774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:48.741255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:49.146219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:49.154618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6c1bf910-e890-4334-856c-55d7c4e182c1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1365 microversion: 2.1 time: 0.427258 Jun 18 22:50:49.155219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3281/6582] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:48 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1365 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:50.173467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:50.174704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:50.181547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:50.182716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:50.194206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:50.194666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:50.195444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:50.195887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:50.333750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:50:50.342027 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-94386281-eeaf-474b-b1a7-7272baaa0b00 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1552 microversion: 2.1 time: 0.171710 Jun 18 22:50:50.342610 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3302/6583] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:50:50 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:50:50.359361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:50:50.359881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:50:50.362723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:50:50.368504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:50.369013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:50.369840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:50.370277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:50.448766 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c8e0974-2b30-4281-b517-94f9a89e368f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093276 Jun 18 22:50:50.449409 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3282/6584] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:50:50 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:50:51.381063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5a22db33-b5d3-4340-9a4b-57a01296c1b5 req-b0a88a87-f545-4bd9-9122-517892868de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:50:51.390352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5a22db33-b5d3-4340-9a4b-57a01296c1b5 req-b0a88a87-f545-4bd9-9122-517892868de0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:50:51.391179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5a22db33-b5d3-4340-9a4b-57a01296c1b5 req-b0a88a87-f545-4bd9-9122-517892868de0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:50:51.402342 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5a22db33-b5d3-4340-9a4b-57a01296c1b5 req-b0a88a87-f545-4bd9-9122-517892868de0 service nova] Creating event network-changed:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:50:51.407628 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5a22db33-b5d3-4340-9a4b-57a01296c1b5 req-b0a88a87-f545-4bd9-9122-517892868de0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030286 Jun 18 22:50:51.408343 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3303/6585] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:51:55.107376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=7 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:55.108195 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=40 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:55.113436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:51:55.114416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:51:55.121350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:55.121806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:55.122572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:55.123010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:55.152533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:51:55.158780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Old instance type m1.heat2, new instance type m1.heat {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:51:55.165524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:51:55.165953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:51:55.166433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:51:55.166850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:51:55.167269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:51:55.233997 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1e2f880f-155b-4e39-b8d1-4b6f0130af15 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001/action" status: 202 len: 0 microversion: 2.1 time: 0.129679 Jun 18 22:51:55.234775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3283/6586] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:51:55 2022] POST /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:51:55.241946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:55.243238 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:51:55.247697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:51:55.248244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:51:55.256050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:55.256625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:55.257550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:55.258045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:55.516663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:51:55.524778 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2654697f-85f0-4830-b852-0d9222a45468 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1678 microversion: 2.1 time: 0.285552 Jun 18 22:51:55.525390 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3304/6587] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:51:55 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:51:56.544818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:51:56.545852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:51:56.554811 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:56.555293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:56.556106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:56.556546 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:56.699725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:51:56.709510 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ed005ea6-adc7-4249-8639-8acbad98c4b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1678 microversion: 2.1 time: 0.170884 Jun 18 22:51:56.710082 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3284/6588] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:51:56 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:51:57.733212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:51:57.734256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:51:57.743308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:57.743770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:57.744557 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:57.745008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:57.876323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:51:57.884296 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16843d05-f035-465d-9b31-3c0fcfb556ff tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.157758 Jun 18 22:51:57.884875 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3305/6589] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:51:57 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:51:58.906247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:51:58.907204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:51:58.915974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:58.916439 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:58.917276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:51:58.917722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:51:59.058899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:51:59.067402 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ab6aeaa-c747-4dc6-b50b-71c6ce695d7c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.167937 Jun 18 22:51:59.067966 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3285/6590] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:51:58 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:00.085338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:00.086195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:00.096400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:00.097075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:00.098157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:00.098769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:00.240166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:00.247977 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2724fffb-4526-4bc9-bd60-6429e9b544c8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.167621 Jun 18 22:52:00.248804 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3306/6591] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:00 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:01.269727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:01.270797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:01.278387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:01.278842 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:01.279616 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:01.280053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:01.468523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:01.476368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a37b030-866a-4b4e-92cf-f3c80efb5539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.213263 Jun 18 22:52:01.476947 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3286/6592] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:01 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:02.501772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:02.502811 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:02.512043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:02.512505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:02.513334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:02.513781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:02.652948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:02.661043 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24b32ac3-f83d-427c-a25f-6cc54a5ef790 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.165868 Jun 18 22:52:02.661645 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3307/6593] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:02 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:03.682015 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:03.682685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:03.690455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:03.690946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:03.691765 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:03.692232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:03.829558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:03.842596 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-18354067-28eb-4c9b-bfad-12c9cb6c410f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.166333 Jun 18 22:52:03.843458 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3287/6594] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:03 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:04.867075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:04.868044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:04.879762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:04.880953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:04.882337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:04.883252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:05.021786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:05.030366 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1fb5d7fb-db1c-41e3-914e-7cd4200e8e21 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.169841 Jun 18 22:52:05.030920 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3308/6595] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:04 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:06.047531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:06.048164 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:06.056997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:06.057494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:06.058283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:06.058728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:06.210320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:06.221984 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c5a2dc5d-7bdf-4c5c-8eb9-932a760d7e33 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.178772 Jun 18 22:52:06.222707 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3288/6596] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:06 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:07.240770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:07.241471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:07.248796 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:07.249302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:07.250090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:07.250541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:07.390980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:07.398927 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7752ef0a-4c13-45b4-8a01-74532df0e61f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.162676 Jun 18 22:52:07.400213 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3309/6597] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:07 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:08.428197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:08.429092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:08.441427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:08.442187 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:08.443471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:08.444216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:08.590098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:08.598472 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4cfc689d-0dad-495a-aa06-918b4498ea70 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1683 microversion: 2.1 time: 0.177589 Jun 18 22:52:08.599048 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3289/6598] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:08 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:09.471111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b4a4421c-b8b7-4182-9619-3d60791ddc1c req-119842a9-101a-47ae-831b-add8bb8cff47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "name": "network-vif-unplugged", "status": "completed", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:09.479712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4a4421c-b8b7-4182-9619-3d60791ddc1c req-119842a9-101a-47ae-831b-add8bb8cff47 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:09.480252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b4a4421c-b8b7-4182-9619-3d60791ddc1c req-119842a9-101a-47ae-831b-add8bb8cff47 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:09.494605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b4a4421c-b8b7-4182-9619-3d60791ddc1c req-119842a9-101a-47ae-831b-add8bb8cff47 service nova] Creating event network-vif-unplugged:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch2-master-1 Jun 18 22:52:09.500335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-b4a4421c-b8b7-4182-9619-3d60791ddc1c req-119842a9-101a-47ae-831b-add8bb8cff47 service nova] Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:52:09.511271 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b4a4421c-b8b7-4182-9619-3d60791ddc1c req-119842a9-101a-47ae-831b-add8bb8cff47 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046695 Jun 18 22:52:09.511961 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3310/6599] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:09.616408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:09.617004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:09.625283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:09.625738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:09.626580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:09.627262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:09.769803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:09.777972 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e95be3e0-207e-4290-9b67-7764c2682539 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1682 microversion: 2.1 time: 0.165761 Jun 18 22:52:09.778567 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3290/6600] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:09 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:10.802198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:10.803270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:10.814014 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:10.814817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:10.816051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:10.816795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:10.954810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:10.963324 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2b1b33a9-bcff-4471-ac7f-17c8ec6ffc11 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1680 microversion: 2.1 time: 0.169468 Jun 18 22:52:10.963907 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3311/6601] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:10 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:11.532746 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-919aa799-a818-4c0c-9a3d-c64893494868 req-e5e91464-bed1-4aab-8ad8-a2b3a38b26db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:11.545166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-919aa799-a818-4c0c-9a3d-c64893494868 req-e5e91464-bed1-4aab-8ad8-a2b3a38b26db service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:11.545615 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-919aa799-a818-4c0c-9a3d-c64893494868 req-e5e91464-bed1-4aab-8ad8-a2b3a38b26db service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:11.560295 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-919aa799-a818-4c0c-9a3d-c64893494868 req-e5e91464-bed1-4aab-8ad8-a2b3a38b26db service nova] Creating event network-changed:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch2-master-1 Jun 18 22:52:11.567111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-919aa799-a818-4c0c-9a3d-c64893494868 req-e5e91464-bed1-4aab-8ad8-a2b3a38b26db service nova] Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:52:11.579037 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-919aa799-a818-4c0c-9a3d-c64893494868 req-e5e91464-bed1-4aab-8ad8-a2b3a38b26db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052564 Jun 18 22:52:11.579685 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3291/6602] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:11.984800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:11.985560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:11.992918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:11.993497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:11.994291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:11.994738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.134664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:12.142713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-07b18608-d187-4b15-ab2a-a3fb75eb9544 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1677 microversion: 2.1 time: 0.163935 Jun 18 22:52:12.143586 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3312/6603] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:11 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:12.161680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:12.162681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:12.174417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:12.175303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.176290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:12.177240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.223174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:12.223650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.224859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:12.225358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.247776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:52:12.252986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:52:12.363138 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3d3a63bc-053a-4bd3-afdc-3662e9db78dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001/action" status: 202 len: 0 microversion: 2.1 time: 0.207002 Jun 18 22:52:12.365065 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3292/6604] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:52:12 2022] POST /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:52:12.372984 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:12.373689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:12.381288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:12.381738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.382533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:12.382988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:12.527488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:12.539525 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f2631dc9-dab9-46f0-9c80-0facab687d4d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1676 microversion: 2.1 time: 0.170785 Jun 18 22:52:12.547012 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3313/6605] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:12 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:52:13.562215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:13.563235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:13.577714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:13.578172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:13.578980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:13.579420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:13.729786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:13.741297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4e474d64-f9dc-4454-aea3-becb427a604c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1676 microversion: 2.1 time: 0.186108 Jun 18 22:52:13.742019 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3293/6606] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:13 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:14.187245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-c4ffa72e-443a-4361-a342-6adaaad31327 req-7f74a8c2-28d8-4c3c-8b32-d97f0b016dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "name": "network-vif-plugged", "status": "completed", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:14.196792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c4ffa72e-443a-4361-a342-6adaaad31327 req-7f74a8c2-28d8-4c3c-8b32-d97f0b016dcb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:14.197479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-c4ffa72e-443a-4361-a342-6adaaad31327 req-7f74a8c2-28d8-4c3c-8b32-d97f0b016dcb service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:14.210323 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-c4ffa72e-443a-4361-a342-6adaaad31327 req-7f74a8c2-28d8-4c3c-8b32-d97f0b016dcb service nova] Creating event network-vif-plugged:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch2-master-1 Jun 18 22:52:14.216482 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-c4ffa72e-443a-4361-a342-6adaaad31327 req-7f74a8c2-28d8-4c3c-8b32-d97f0b016dcb service nova] Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:52:14.227423 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-c4ffa72e-443a-4361-a342-6adaaad31327 req-7f74a8c2-28d8-4c3c-8b32-d97f0b016dcb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043983 Jun 18 22:52:14.228032 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3314/6607] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:14.759160 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:14.759773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:14.767465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:14.767926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:14.768708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:14.769186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:14.909057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:14.917004 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-65bdf88d-6dff-47a0-b569-e38924e94c43 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1676 microversion: 2.1 time: 0.161840 Jun 18 22:52:14.917608 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3294/6608] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:14 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:15.644248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b8d480fe-a54b-4327-b51e-2f58150ba185 req-32b5fcee-2079-49b8-ab8d-9db239f81367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "name": "network-vif-unplugged", "status": "completed", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:15.652937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b8d480fe-a54b-4327-b51e-2f58150ba185 req-32b5fcee-2079-49b8-ab8d-9db239f81367 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:15.653433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b8d480fe-a54b-4327-b51e-2f58150ba185 req-32b5fcee-2079-49b8-ab8d-9db239f81367 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:15.665261 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b8d480fe-a54b-4327-b51e-2f58150ba185 req-32b5fcee-2079-49b8-ab8d-9db239f81367 service nova] Creating event network-vif-unplugged:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:52:15.670730 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-b8d480fe-a54b-4327-b51e-2f58150ba185 req-32b5fcee-2079-49b8-ab8d-9db239f81367 service nova] Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:52:15.681490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b8d480fe-a54b-4327-b51e-2f58150ba185 req-32b5fcee-2079-49b8-ab8d-9db239f81367 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042283 Jun 18 22:52:15.682283 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3315/6609] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:15.934504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:15.935109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:15.942352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:15.942798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:15.943576 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:15.943989 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:15.962522 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:16.106700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:16.115964 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ddb0b377-a5e6-4020-9a8d-7b79c300ef74 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1676 microversion: 2.1 time: 0.185388 Jun 18 22:52:16.116654 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3295/6610] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:15 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:52:17.139922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:17.141101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:17.151037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:17.151497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:17.152290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:17.152745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:17.292936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:17.301162 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7065daac-267f-438d-9d6d-500d9dcc7be1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1676 microversion: 2.1 time: 0.169949 Jun 18 22:52:17.301714 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3316/6611] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:17 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:17.705903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8a8c2c3c-e0ec-4a00-8165-cd87d7722eb8 req-c62774f9-8a6b-419f-b470-57aa6f37e3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:17.718216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8a8c2c3c-e0ec-4a00-8165-cd87d7722eb8 req-c62774f9-8a6b-419f-b470-57aa6f37e3df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:17.718664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8a8c2c3c-e0ec-4a00-8165-cd87d7722eb8 req-c62774f9-8a6b-419f-b470-57aa6f37e3df service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:17.730678 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8a8c2c3c-e0ec-4a00-8165-cd87d7722eb8 req-c62774f9-8a6b-419f-b470-57aa6f37e3df service nova] Creating event network-changed:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:52:17.736393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-8a8c2c3c-e0ec-4a00-8165-cd87d7722eb8 req-c62774f9-8a6b-419f-b470-57aa6f37e3df service nova] Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:52:17.747263 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8a8c2c3c-e0ec-4a00-8165-cd87d7722eb8 req-c62774f9-8a6b-419f-b470-57aa6f37e3df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047980 Jun 18 22:52:17.747847 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3296/6612] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:18.324755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:18.325401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:18.332684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:18.333166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:18.333978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:18.334423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:18.478010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:18.489530 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-337387e1-6e0f-4894-a42b-6c64ef9dcf8b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1676 microversion: 2.1 time: 0.169994 Jun 18 22:52:18.490276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3317/6613] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:18 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:19.513235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:19.513966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:19.521947 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:19.522438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:19.523257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:19.523697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:19.658428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:19.666728 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ccfaf55f-5486-4cfc-8f87-3709c377f941 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1669 microversion: 2.1 time: 0.160936 Jun 18 22:52:19.667319 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3297/6614] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:19 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:19.683139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:19.683804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:19.691981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:19.692362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:19.693153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:19.693605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:19.831248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:19.843698 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fcf77e0c-7eb8-4432-aedc-3534fcae33dc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1669 microversion: 2.1 time: 0.164267 Jun 18 22:52:19.844516 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3318/6615] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:19 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:19.860587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:19.861242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:19.867555 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:19.868004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:19.868762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:19.869255 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:20.006151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:20.014567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-35eb9908-2ff5-41c9-8015-8da10499b1b1 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1669 microversion: 2.1 time: 0.158118 Jun 18 22:52:20.015114 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3298/6616] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:19 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:52:20.030727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:20.031240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:20.037921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:20.038385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:20.039179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:20.039589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:20.070799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:52:20.131518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:20.160059 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37be517c-685d-45c6-85ba-4a81cba8b5ba tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 204 len: 0 microversion: 2.1 time: 0.133003 Jun 18 22:52:20.160699 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3319/6617] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:52:20 2022] DELETE /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:52:20.168977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:20.169621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:20.175966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:20.176430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:20.177227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:20.177664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:20.311086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:20.319150 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c0d9ddca-3132-429c-adb7-32b0149a7242 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1675 microversion: 2.1 time: 0.154032 Jun 18 22:52:20.319748 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3299/6618] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:20 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:21.064585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-94ea5f86-828c-40ef-b16b-15147f6524fa req-aede0c8c-cab9-46ce-96fe-a77974a81ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "name": "network-vif-plugged", "status": "completed", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:21.073785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-94ea5f86-828c-40ef-b16b-15147f6524fa req-aede0c8c-cab9-46ce-96fe-a77974a81ddc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:21.074457 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-94ea5f86-828c-40ef-b16b-15147f6524fa req-aede0c8c-cab9-46ce-96fe-a77974a81ddc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:21.085877 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-94ea5f86-828c-40ef-b16b-15147f6524fa req-aede0c8c-cab9-46ce-96fe-a77974a81ddc service nova] Creating event network-vif-plugged:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:52:21.091250 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-94ea5f86-828c-40ef-b16b-15147f6524fa req-aede0c8c-cab9-46ce-96fe-a77974a81ddc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030771 Jun 18 22:52:21.091866 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3320/6619] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:21.343337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:21.344338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:21.355749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:21.356199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:21.356958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:21.357430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:21.503349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:21.513634 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-97146123-e5db-4fbe-a4f9-e6491fa8cc1b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1675 microversion: 2.1 time: 0.179000 Jun 18 22:52:21.514436 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3300/6620] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:21 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:22.461224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5692b622-c91f-49ce-ac46-846521d51f02 req-7ffee0b0-cc4b-41b4-bf7a-8ffe358887a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a15a4fe5-83b5-4c00-a984-a8e3f9bf2001", "name": "network-vif-deleted", "tag": "c4537cf9-9f3a-47b7-b74b-3f19f0640b06"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:22.470067 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5692b622-c91f-49ce-ac46-846521d51f02 req-7ffee0b0-cc4b-41b4-bf7a-8ffe358887a5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:22.470519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5692b622-c91f-49ce-ac46-846521d51f02 req-7ffee0b0-cc4b-41b4-bf7a-8ffe358887a5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:22.482107 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5692b622-c91f-49ce-ac46-846521d51f02 req-7ffee0b0-cc4b-41b4-bf7a-8ffe358887a5 service nova] Creating event network-vif-deleted:c4537cf9-9f3a-47b7-b74b-3f19f0640b06 for instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 on nch1-master-1 Jun 18 22:52:22.486898 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5692b622-c91f-49ce-ac46-846521d51f02 req-7ffee0b0-cc4b-41b4-bf7a-8ffe358887a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030645 Jun 18 22:52:22.490353 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3321/6621] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:22.534886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:22.542920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:22.546582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:22.559733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:22.560458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:22.561281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:22.561726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:22.599817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:22.600274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:22.600733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lazy-loading 'fault' on Instance uuid a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:52:22.642319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:22.660491 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-37f01e8b-ea20-4a8f-b47b-2ab61b845364 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 200 len: 1329 microversion: 2.1 time: 0.120229 Jun 18 22:52:22.660491 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3301/6622] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:22 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 1329 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:23.671206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:23.672222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:23.681553 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:23.682213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:23.683283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:23.683753 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:23.697835 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 HTTP/1.1 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'a15a4fe5-83b5-4c00-a984-a8e3f9bf2001'} Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:52:23.699537 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-96de33dd-3773-45ed-bdca-8f6b15fcd00c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 404 len: 111 microversion: 2.1 time: 0.034461 Jun 18 22:52:23.704417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3322/6623] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:23 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:52:23.718143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:23.720912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:23.729403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:23.729863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:23.730655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:23.731144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:23.750631 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 HTTP/1.1 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a15a4fe5-83b5-4c00-a984-a8e3f9bf2001'} Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:52:23.752732 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0aec7bc8-3770-4e67-b935-036202ca71ce tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 404 len: 111 microversion: 2.1 time: 0.041301 Jun 18 22:52:23.761003 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3302/6624] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:23 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:52:23.811853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1807743012", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "e351e931-3243-4d98-8f37-e8aed44aa13e"}], "security_groups": [{"name": "tempest-securitygroup--1984002391"}], "key_name": "tempest-keypair-1450728854", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:23.944704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] validate_networks() for [('e351e931-3243-4d98-8f37-e8aed44aa13e', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:52:24.332201 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:52:24.332786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:52:24.333397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:52:24.333868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:52:24.334618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:52:24.352416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:24.352868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:24.353741 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:24.354184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:24.372913 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:52:24.380728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:52:24.397006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:52:24.399374 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:52:24.459105 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e1e6068c-0d88-4dfe-9502-b488225199e0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.651865 Jun 18 22:52:24.459786 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3323/6625] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:52:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:52:24.470623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2a50f8e6-ed9c-42a5-98a0-bd0e58a3e4b7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:24.471238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2a50f8e6-ed9c-42a5-98a0-bd0e58a3e4b7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:24.527738 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2a50f8e6-ed9c-42a5-98a0-bd0e58a3e4b7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:24.535295 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2a50f8e6-ed9c-42a5-98a0-bd0e58a3e4b7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1239 microversion: 2.1 time: 0.068402 Jun 18 22:52:24.544353 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3303/6626] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:24 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:25.554498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:25.555121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:25.557194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:25.565631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:25.566099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:25.567173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:25.567951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:25.635083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:25.643405 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e560a9ca-3eca-42b2-ae89-0bb89847a96a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1297 microversion: 2.1 time: 0.093749 Jun 18 22:52:25.643978 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3324/6627] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:25 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:26.661859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:26.662491 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:26.665661 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:26.674370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:26.675008 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:26.676022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:26.676554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:26.769742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9cfb1277-65ad-4548-aaa6-397feb0ace6e req-c62d9432-c704-4af6-914d-b0aa98ec2455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:26.788472 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9cfb1277-65ad-4548-aaa6-397feb0ace6e req-c62d9432-c704-4af6-914d-b0aa98ec2455 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:26.789191 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9cfb1277-65ad-4548-aaa6-397feb0ace6e req-c62d9432-c704-4af6-914d-b0aa98ec2455 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:26.822019 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9cfb1277-65ad-4548-aaa6-397feb0ace6e req-c62d9432-c704-4af6-914d-b0aa98ec2455 service nova] Creating event network-changed:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:52:26.828255 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9cfb1277-65ad-4548-aaa6-397feb0ace6e req-c62d9432-c704-4af6-914d-b0aa98ec2455 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062772 Jun 18 22:52:26.829256 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3325/6628] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:26.843050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:26.851612 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7c4ce09-b567-48e6-8bc6-5581eeec72e4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.193905 Jun 18 22:52:26.855637 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3304/6629] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:26 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:27.870659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:27.872033 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:27.879916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:27.880404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:27.881258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:27.881696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:28.031267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:28.039476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae875496-870b-4e9c-bbce-6aff3f3ec559 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.175022 Jun 18 22:52:28.044070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3326/6630] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:27 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:29.059559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:29.060188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:29.067772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:29.068227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:29.069006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:29.069490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:29.206188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:29.217132 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d999d09f-fe30-4bd7-9843-32f2eb94d116 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.163703 Jun 18 22:52:29.217722 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3305/6631] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:29 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:30.236023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:30.236772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:30.244760 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:30.245251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:30.246070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:30.246513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:30.385148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:30.393216 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-601b6c6f-9774-43c8-8376-e0fe6eca559d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.161228 Jun 18 22:52:30.394024 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3327/6632] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:30 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:31.411675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:31.412247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:31.419979 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:31.420433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:31.421283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:31.421724 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:31.561683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:31.573985 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c08ac98-549b-4a2e-9d39-996bff8c9939 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.166378 Jun 18 22:52:31.574572 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3306/6633] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:31 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:32.381732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1b88a360-b6a4-45b2-8605-26fa654efbdf req-bdec4c91-48f9-48f1-9999-569c1ee3c64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "name": "network-vif-plugged", "status": "completed", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:32.391419 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1b88a360-b6a4-45b2-8605-26fa654efbdf req-bdec4c91-48f9-48f1-9999-569c1ee3c64a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:32.391923 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1b88a360-b6a4-45b2-8605-26fa654efbdf req-bdec4c91-48f9-48f1-9999-569c1ee3c64a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:32.594773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:32.595397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:32.603774 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:32.604139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:32.604940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:32.605429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:32.684473 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1b88a360-b6a4-45b2-8605-26fa654efbdf req-bdec4c91-48f9-48f1-9999-569c1ee3c64a service nova] Creating event network-vif-plugged:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:52:32.689919 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1b88a360-b6a4-45b2-8605-26fa654efbdf req-bdec4c91-48f9-48f1-9999-569c1ee3c64a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312154 Jun 18 22:52:32.690735 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3328/6634] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:32.741587 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:32.749689 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b04060bb-e1a3-400b-8a30-ea448680c8c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.159214 Jun 18 22:52:32.750305 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3307/6635] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:32 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:33.768212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:33.768945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:33.776621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:33.777114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:33.777917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:33.778372 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:33.926825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:33.935224 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a731f6be-939f-409e-acf3-bb3ab3a58db2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1365 microversion: 2.1 time: 0.171511 Jun 18 22:52:33.935811 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3329/6636] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:33 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:34.957312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:34.958336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:34.962744 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:34.970397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:34.971044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:34.971622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:34.972064 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:35.110703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:52:35.118710 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17616033-f841-40fb-81d2-a07fdebaa80b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1552 microversion: 2.1 time: 0.168089 Jun 18 22:52:35.119306 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3308/6637] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:52:34 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:52:35.135744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:52:35.136285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:52:35.138414 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:35.139104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:52:35.145630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:35.146097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:35.146884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:35.147336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:35.225347 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67008cea-3219-45d9-8880-bec397367c6c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093457 Jun 18 22:52:35.225935 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3330/6638] 10.222.0.30 () {58 vars in 1274 bytes} [Sat Jun 18 22:52:35 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:36.241658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8ac8e316-4fc8-4785-9fb1-94ba0f7601fc req-04df1b29-3a92-4315-a595-825e7474086d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:52:36.250104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8ac8e316-4fc8-4785-9fb1-94ba0f7601fc req-04df1b29-3a92-4315-a595-825e7474086d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:52:36.250554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8ac8e316-4fc8-4785-9fb1-94ba0f7601fc req-04df1b29-3a92-4315-a595-825e7474086d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:52:36.261712 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8ac8e316-4fc8-4785-9fb1-94ba0f7601fc req-04df1b29-3a92-4315-a595-825e7474086d service nova] Creating event network-changed:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:52:36.267114 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8ac8e316-4fc8-4785-9fb1-94ba0f7601fc req-04df1b29-3a92-4315-a595-825e7474086d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096065 Jun 18 22:52:36.267714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3309/6639] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:52:54.373357 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:52:54.373950 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 22:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:52:54.919723 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:52:54.920615 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 22:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:53:12.608922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=13 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:12.609847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=40 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:12.613740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:12.614378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:12.621435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:12.621897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:12.622674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:12.623118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:12.755539 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:12.765736 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-24af6ddc-7896-4e36-811b-c08fbaca445f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1669 microversion: 2.1 time: 0.158433 Jun 18 22:53:12.766497 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3331/6640] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:12 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:12.780955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=11 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:12.781749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=72 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:12.786082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2db69f0-64b6-4b7a-8899-04a96dc2e132"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:12.787273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:12.794409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:12.794843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:12.795626 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:12.796060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:13.064635 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-30be7d9a-4743-492c-bb19-812c3d730d7a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285639 Jun 18 22:53:13.065278 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3310/6641] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:53:12 2022] POST /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:53:16.398595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:16.399619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:16.406695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:16.407162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:16.407950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:16.408402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:16.437446 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:16.443574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Old instance type m1.heat2, new instance type m1.heat {{(pid=130903) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 22:53:16.451800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:53:16.452246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:53:16.452738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:53:16.453208 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:53:16.453643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:53:16.526490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7a0a383-fb97-4b88-b88e-0f2690de0769 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/action" status: 202 len: 0 microversion: 2.1 time: 0.131909 Jun 18 22:53:16.527306 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3332/6642] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:53:16 2022] POST /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:53:16.536653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:16.537438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:16.543919 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:16.544371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:16.545210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:16.545657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:17.086283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:17.095300 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b461aef-ac61-4631-977f-69562dea609d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1724 microversion: 2.1 time: 0.563718 Jun 18 22:53:17.096035 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3311/6643] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:16 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1724 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:18.112865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:18.113470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:18.120899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:18.121415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:18.122202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:18.122660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:18.254605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:18.262952 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cae3a323-2933-4fbf-8fb1-574809526636 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1724 microversion: 2.1 time: 0.154931 Jun 18 22:53:18.263737 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3333/6644] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:18 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:19.284846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:19.285887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:19.293780 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:19.294174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:19.294950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:19.295393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:19.437671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:19.450080 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55f95c74-f9ca-4225-beb6-187ab685153d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.171549 Jun 18 22:53:19.450903 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3312/6645] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:19 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:20.475136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:20.475845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:20.484024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:20.484546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:20.485477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:20.485982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:20.620433 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:20.628886 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b36a39b7-667b-4b84-8ec3-4302c0cf0f79 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.160253 Jun 18 22:53:20.629468 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3334/6646] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:20 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:21.652215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:21.653229 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:21.665059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:21.665836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:21.667165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:21.667895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:21.808547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:21.817382 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-78c48e3f-3990-4c20-a59a-0239a023ae64 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.172036 Jun 18 22:53:21.817937 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3313/6647] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:21 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:22.834671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:22.835202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:22.843213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:22.843683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:22.844489 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:22.844924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:22.980458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:22.993219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5c8a430-2124-43ce-8a6b-390aedfceacc tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.162411 Jun 18 22:53:22.994047 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3335/6648] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:22 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:24.020106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:24.021475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:24.029397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:24.029864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:24.030656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:24.031088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:24.177456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:24.185805 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16e91171-0e6d-4c26-b272-0ca6c4e61c76 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.172411 Jun 18 22:53:24.186421 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3314/6649] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:24 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:25.206917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:25.208240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:25.220550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:25.221407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:25.222694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:25.223436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:25.354082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:25.362965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3df82ccd-d511-48e3-95d7-942859f6ee1f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.162702 Jun 18 22:53:25.363541 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3336/6650] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:25 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:26.386232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:26.387503 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:26.398899 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:26.399357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:26.400122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:26.400591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:26.535827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:26.545238 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d95afeaf-7e1e-403f-a49e-681861b6937d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.166534 Jun 18 22:53:26.546174 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3315/6651] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:26 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:27.562634 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:27.563254 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:27.570978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:27.571425 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:27.572222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:27.572678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:27.727526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:27.739307 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ce070ead-0ac4-42cd-a972-0fc09edd22c6 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.180359 Jun 18 22:53:27.740132 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3337/6652] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:27 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:28.768386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:28.769596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:28.777483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:28.777948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:28.779238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:28.779957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:28.927088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:28.935899 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a02570b6-f68f-4a79-91a4-037a5e356c6b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.181666 Jun 18 22:53:28.936476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3316/6653] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:28 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:29.953837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:29.954456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:29.962019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:29.962490 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:29.963309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:29.964117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:30.108890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:30.123970 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f945104a-e815-4a5d-b674-8353a700b51e tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.173800 Jun 18 22:53:30.124684 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3338/6654] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:29 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:31.144309 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:31.144918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:31.152493 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:31.152949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:31.153762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:31.154204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:31.287052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:31.295450 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55d87f03-9546-4947-9e93-06c9049bf87c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.155094 Jun 18 22:53:31.295973 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3317/6655] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:31 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:32.317225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:32.319296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:32.331200 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:32.331981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:32.333320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:32.334072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:32.471188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:32.479654 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6303ccb0-2441-41b4-a983-1984c6ced299 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.169358 Jun 18 22:53:32.480226 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3339/6656] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:32 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:33.501304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:33.502462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:33.514340 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:33.515092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:33.516700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:33.517475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:33.657100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:33.665910 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c767c229-7466-4b95-addb-ee424c23753a tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.171281 Jun 18 22:53:33.666490 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3318/6657] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:33 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:53:34.686876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:34.687825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:34.698881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:34.699336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:34.700168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:34.700618 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:34.840441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:34.849083 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f98a4d24-841a-48f8-842f-c6719dc6491f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.168967 Jun 18 22:53:34.849693 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3340/6658] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:34 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:35.867442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:35.868215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:35.875939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:35.876433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:35.877233 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:35.877698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:36.014365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:36.023000 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a6a6672-8e02-4fa6-b964-1b84d7599954 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.159621 Jun 18 22:53:36.023591 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3319/6659] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:35 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:37.043270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:37.043917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:37.051108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:37.051568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:37.052339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:37.052787 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:37.182975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:37.191210 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a52ccb79-c333-490d-a8a0-e888f86b7e0f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.153018 Jun 18 22:53:37.191773 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3341/6660] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:37 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:38.213185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:38.214158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:38.221714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:38.222149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:38.222930 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:38.223371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:38.362676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:38.376413 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7763a092-e99d-4443-872e-154554027ea0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.169096 Jun 18 22:53:38.377262 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3320/6661] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:38 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:39.402570 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:39.403662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:39.415278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:39.416157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:39.416949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:39.417429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:39.548281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:39.556702 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fdafea18-e834-4f09-aed2-499f4087a7ae tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.160655 Jun 18 22:53:39.557313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3342/6662] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:39 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:40.577320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:40.577981 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:40.586695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:40.587240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:40.588148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:40.588666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:40.726677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:40.735932 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-09829479-74ae-4c0a-abad-021f193aa710 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1729 microversion: 2.1 time: 0.163740 Jun 18 22:53:40.736887 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3321/6663] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:40 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:41.590085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d18176be-2226-480e-b378-e81948e6c7cc req-93b5c3a3-2421-4c4e-ad8f-85268360abf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "name": "network-vif-unplugged", "status": "completed", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:41.600430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d18176be-2226-480e-b378-e81948e6c7cc req-93b5c3a3-2421-4c4e-ad8f-85268360abf0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:41.600892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d18176be-2226-480e-b378-e81948e6c7cc req-93b5c3a3-2421-4c4e-ad8f-85268360abf0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:41.613973 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d18176be-2226-480e-b378-e81948e6c7cc req-93b5c3a3-2421-4c4e-ad8f-85268360abf0 service nova] Creating event network-vif-unplugged:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch1-master-1 Jun 18 22:53:41.619556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-d18176be-2226-480e-b378-e81948e6c7cc req-93b5c3a3-2421-4c4e-ad8f-85268360abf0 service nova] Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:53:41.631717 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d18176be-2226-480e-b378-e81948e6c7cc req-93b5c3a3-2421-4c4e-ad8f-85268360abf0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046024 Jun 18 22:53:41.632350 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3343/6664] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:53:41.754264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:41.754886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:41.762391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:41.762776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:41.763601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:41.764048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:41.902784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:41.911387 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4abfd0c-edc6-4c88-8dfc-d85812edacb9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1728 microversion: 2.1 time: 0.161246 Jun 18 22:53:41.911908 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3322/6665] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:41 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:42.928794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:42.929534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:42.932481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=31 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:42.938624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:42.939092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:42.939872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:42.940324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:42.943023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:43.074285 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:43.083075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0fb0ce5b-70c9-4cf7-b378-b0d5a2825c71 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1726 microversion: 2.1 time: 0.158777 Jun 18 22:53:43.085773 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3344/6666] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:42 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:43.655083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-16d223cb-e0cb-423e-a7c5-1582c98c578f req-9258114a-1a55-4ff8-8714-9c5093eaf412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:43.659854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=27 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:43.666380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-16d223cb-e0cb-423e-a7c5-1582c98c578f req-9258114a-1a55-4ff8-8714-9c5093eaf412 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:43.666843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-16d223cb-e0cb-423e-a7c5-1582c98c578f req-9258114a-1a55-4ff8-8714-9c5093eaf412 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:43.669531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:43.680550 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-16d223cb-e0cb-423e-a7c5-1582c98c578f req-9258114a-1a55-4ff8-8714-9c5093eaf412 service nova] Creating event network-changed:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch1-master-1 Jun 18 22:53:43.687278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-16d223cb-e0cb-423e-a7c5-1582c98c578f req-9258114a-1a55-4ff8-8714-9c5093eaf412 service nova] Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:53:43.706626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-16d223cb-e0cb-423e-a7c5-1582c98c578f req-9258114a-1a55-4ff8-8714-9c5093eaf412 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061228 Jun 18 22:53:43.709555 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3323/6667] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:53:44.104061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:44.104776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:44.114776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:44.115412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:44.116501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:44.117136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:44.270000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:44.278647 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5e3aa62-7f08-4db1-bab8-39b24c7f656d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1726 microversion: 2.1 time: 0.180305 Jun 18 22:53:44.279238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3345/6668] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:44 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:45.297727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:45.298350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:45.305062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:45.305562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:45.306316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:45.306783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:45.441500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:45.450011 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e564a415-a093-477a-9ed6-64737b6f45de tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1726 microversion: 2.1 time: 0.157692 Jun 18 22:53:45.450601 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3324/6669] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:45 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:46.469155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:46.471094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:46.477706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:46.478213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:46.478985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:46.479447 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:46.620915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:46.629492 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6bca2ced-de46-4086-b625-4490310b44c5 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1726 microversion: 2.1 time: 0.164438 Jun 18 22:53:46.630371 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3346/6670] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:46 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:47.648167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:47.648750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:47.656389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:47.656841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:47.657672 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:47.658111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:47.800350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:47.809792 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2f466b3d-a499-47a1-a35b-8da072973762 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1726 microversion: 2.1 time: 0.165635 Jun 18 22:53:47.810809 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3325/6671] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:47 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:48.835642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:48.836639 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:48.846136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:48.846535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:48.847326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:48.847776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:48.982237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:48.990630 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0df1c0df-c94f-4c88-a9a2-f3dd00b03df3 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1723 microversion: 2.1 time: 0.161623 Jun 18 22:53:48.991218 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3347/6672] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:48 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:49.007395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:49.007938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:49.015597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:49.016053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:49.016822 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:49.017301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:49.058895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:49.059343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:49.060227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:49.060663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:49.081244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:53:49.086608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Getting quotas for user d589e9b3b6114231927b43bb4269e7db and project c50bcdb7ce3f4fd59d056bf30bda1676. Resources: {'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:53:49.198504 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-51ee8a1e-96da-4557-bb9b-c1b0ba34e2cf tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "POST /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/action" status: 202 len: 0 microversion: 2.1 time: 0.194864 Jun 18 22:53:49.199091 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3326/6673] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:53:49 2022] POST /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:53:49.207675 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:49.208277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:49.215078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:49.215538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:49.216316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:49.216782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:49.354657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:49.372995 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f988178f-9738-4984-958d-9d7e986e8720 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.169347 Jun 18 22:53:49.382776 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3348/6674] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:49 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:50.397099 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:50.398214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:50.408457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:50.408916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:50.409737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:50.410183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:50.555044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:50.563909 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-58b8bbc5-0c40-4fd5-9425-648a38d8958c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.175572 Jun 18 22:53:50.564499 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3327/6675] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:50 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:51.440719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0b0af511-5b3c-462d-b044-35ff3d78b056 req-3a55718f-30cd-4267-a37e-05670067ade8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "name": "network-vif-plugged", "status": "completed", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:51.451975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0b0af511-5b3c-462d-b044-35ff3d78b056 req-3a55718f-30cd-4267-a37e-05670067ade8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:51.452422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0b0af511-5b3c-462d-b044-35ff3d78b056 req-3a55718f-30cd-4267-a37e-05670067ade8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:51.466349 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0b0af511-5b3c-462d-b044-35ff3d78b056 req-3a55718f-30cd-4267-a37e-05670067ade8 service nova] Creating event network-vif-plugged:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch1-master-1 Jun 18 22:53:51.471940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-0b0af511-5b3c-462d-b044-35ff3d78b056 req-3a55718f-30cd-4267-a37e-05670067ade8 service nova] Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:53:51.483245 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0b0af511-5b3c-462d-b044-35ff3d78b056 req-3a55718f-30cd-4267-a37e-05670067ade8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047038 Jun 18 22:53:51.483863 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3349/6676] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:53:51.587391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:51.587962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:51.595909 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:51.596365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:51.597192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:51.597628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:51.755398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:51.763927 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7f0ecceb-21f3-450d-813d-75137bcd02c7 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.180930 Jun 18 22:53:51.764812 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3328/6677] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:51 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:52.781336 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:52.782083 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:52.789629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:52.790092 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:52.790884 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:52.791322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:52.923785 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:52.933950 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c5222472-4798-49f6-8eeb-6997b4bef1ca tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.156613 Jun 18 22:53:52.935413 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3350/6678] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:52 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:53.022999 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-362d02f8-307f-4709-bedf-f70b4acd3ab3 req-19d53fb0-deff-4b9e-8d54-eef49f9c3be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "name": "network-vif-unplugged", "status": "completed", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:53.032090 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-362d02f8-307f-4709-bedf-f70b4acd3ab3 req-19d53fb0-deff-4b9e-8d54-eef49f9c3be2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:53.033643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-362d02f8-307f-4709-bedf-f70b4acd3ab3 req-19d53fb0-deff-4b9e-8d54-eef49f9c3be2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:53.048614 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-362d02f8-307f-4709-bedf-f70b4acd3ab3 req-19d53fb0-deff-4b9e-8d54-eef49f9c3be2 service nova] Creating event network-vif-unplugged:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:53:53.054663 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-362d02f8-307f-4709-bedf-f70b4acd3ab3 req-19d53fb0-deff-4b9e-8d54-eef49f9c3be2 service nova] Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:53:53.068151 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-362d02f8-307f-4709-bedf-f70b4acd3ab3 req-19d53fb0-deff-4b9e-8d54-eef49f9c3be2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137908 Jun 18 22:53:53.068964 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3329/6679] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:53:53.952549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:53.953316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:53.960734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:53.961202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:53.962018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:53.962463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:54.101261 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:54.109536 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-34b2b42a-a16a-495b-ae6c-fa93751eb4f9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.161038 Jun 18 22:53:54.110351 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3351/6680] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:53 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:55.099895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-b4cd351c-7212-466e-b489-4418c7b93dbc req-4849fa8d-882c-4033-8f07-5bfc063e51a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:53:55.108393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b4cd351c-7212-466e-b489-4418c7b93dbc req-4849fa8d-882c-4033-8f07-5bfc063e51a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:55.109018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-b4cd351c-7212-466e-b489-4418c7b93dbc req-4849fa8d-882c-4033-8f07-5bfc063e51a0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:55.120839 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-b4cd351c-7212-466e-b489-4418c7b93dbc req-4849fa8d-882c-4033-8f07-5bfc063e51a0 service nova] Creating event network-changed:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:53:55.126762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-b4cd351c-7212-466e-b489-4418c7b93dbc req-4849fa8d-882c-4033-8f07-5bfc063e51a0 service nova] Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 22:53:55.128415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:55.129104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:55.138036 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:55.138201 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-b4cd351c-7212-466e-b489-4418c7b93dbc req-4849fa8d-882c-4033-8f07-5bfc063e51a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043741 Jun 18 22:53:55.138648 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3330/6681] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:53:55.138794 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:55.140383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:55.141635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:55.300081 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:55.310004 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e517027b-ca41-4866-85e8-583ce8ee5043 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.186342 Jun 18 22:53:55.311075 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3352/6682] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:55 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:53:56.331337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:56.331966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:56.340855 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:56.341345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:56.342134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:56.342580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:56.478352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:56.487359 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d19970bc-60ff-4877-a830-80f1856f1159 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.163754 Jun 18 22:53:56.487939 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3331/6683] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:56 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:57.510487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:57.511611 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:57.522953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:57.523424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:57.524210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:57.524664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:57.660029 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:57.668777 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f816ecb2-3197-41e6-8d91-5787ea956112 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1722 microversion: 2.1 time: 0.164995 Jun 18 22:53:57.669412 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3353/6684] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:57 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:58.690527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:58.691554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:58.703339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:58.704092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:58.706266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:58.707025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:58.847853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:58.857281 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bd53c9ce-aae2-456f-b275-6f7f49af0363 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1715 microversion: 2.1 time: 0.173318 Jun 18 22:53:58.857903 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3332/6685] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:58 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:58.874449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:58.875071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:58.882608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:58.883086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:58.883861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:58.884315 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.021735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:59.030293 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2e315da1-e5fd-4b58-911d-7da5ae95c4c2 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1715 microversion: 2.1 time: 0.159806 Jun 18 22:53:59.030897 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3354/6686] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:58 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:59.047068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:59.047680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:59.054301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:59.054802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.055575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:59.056009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.076403 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:53:59.204050 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:59.215138 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-820dc64d-9f5b-425d-aa05-2423291f7cf0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1715 microversion: 2.1 time: 0.172223 Jun 18 22:53:59.215958 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3333/6687] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:59 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1715 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:53:59.235610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:59.236126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:59.244266 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:59.244737 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.245594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:59.246050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.271916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:53:59.380562 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-379fc5ec-0022-4bd2-829f-9acd1de6761c tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 204 len: 0 microversion: 2.1 time: 0.148510 Jun 18 22:53:59.381187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3355/6688] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:53:59 2022] DELETE /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:53:59.390131 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:53:59.390885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:53:59.398022 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:59.398679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.399510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:53:59.400035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:53:59.538518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:53:59.550622 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2965cfa1-d292-48e9-a759-b47170c9f371 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1721 microversion: 2.1 time: 0.164577 Jun 18 22:53:59.551363 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3334/6689] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:53:59 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:00.572621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:00.573354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:00.580773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:00.581267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:00.582062 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:00.582512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:00.719621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:00.733698 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6195b765-3a8f-48ca-9ff2-8b83e98e828b tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1721 microversion: 2.1 time: 0.167163 Jun 18 22:54:00.734298 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3356/6690] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:00 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:00.951185 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c090236c-cb65-41e2-8f59-61abed9d1748 req-cfe25a58-9c86-4b33-be9b-9c6d3ccd338e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "name": "network-vif-plugged", "status": "completed", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:00.961018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c090236c-cb65-41e2-8f59-61abed9d1748 req-cfe25a58-9c86-4b33-be9b-9c6d3ccd338e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:00.961673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c090236c-cb65-41e2-8f59-61abed9d1748 req-cfe25a58-9c86-4b33-be9b-9c6d3ccd338e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:00.974627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c090236c-cb65-41e2-8f59-61abed9d1748 req-cfe25a58-9c86-4b33-be9b-9c6d3ccd338e service nova] Creating event network-vif-plugged:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:54:00.979756 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c090236c-cb65-41e2-8f59-61abed9d1748 req-cfe25a58-9c86-4b33-be9b-9c6d3ccd338e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095349 Jun 18 22:54:00.980348 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3335/6691] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:01.751453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:01.752257 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:01.762390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:01.762865 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:01.763676 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:01.764388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:01.832068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd589e9b3b6114231927b43bb4269e7db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c50bcdb7ce3f4fd59d056bf30bda1676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:01.840819 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-754ca749-dda6-4c06-a436-5f28d2178055 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 200 len: 1653 microversion: 2.1 time: 0.093442 Jun 18 22:54:01.841444 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3357/6692] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:01 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 1653 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:01.909868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0b7af30e-ea1d-4cce-9478-fdccd43721dc req-c059b418-949e-4b0d-af74-8263db0069da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cda31eb-a32c-46c4-8196-09d4ea994396", "name": "network-vif-deleted", "tag": "52805b59-fd7e-4baf-b916-c69735abf739"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:01.920202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0b7af30e-ea1d-4cce-9478-fdccd43721dc req-c059b418-949e-4b0d-af74-8263db0069da service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:01.920986 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0b7af30e-ea1d-4cce-9478-fdccd43721dc req-c059b418-949e-4b0d-af74-8263db0069da service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:01.935059 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-0b7af30e-ea1d-4cce-9478-fdccd43721dc req-c059b418-949e-4b0d-af74-8263db0069da service nova] Creating event network-vif-deleted:52805b59-fd7e-4baf-b916-c69735abf739 for instance 5cda31eb-a32c-46c4-8196-09d4ea994396 on nch2-master-1 Jun 18 22:54:01.940821 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0b7af30e-ea1d-4cce-9478-fdccd43721dc req-c059b418-949e-4b0d-af74-8263db0069da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Jun 18 22:54:01.941775 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3336/6693] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:54:02.858189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:02.858845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:02.866321 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:02.866805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:02.867601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:02.868060 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:02.882762 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 HTTP/1.1 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '5cda31eb-a32c-46c4-8196-09d4ea994396'} Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:02.884798 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6daee9c8-3c90-4b30-913d-6b23c657e68f tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 404 len: 111 microversion: 2.1 time: 0.032988 Jun 18 22:54:02.889732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3358/6694] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:02 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:02.947772 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:02.948859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:02.955648 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:02.956096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:02.956857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:02.957383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:02.970492 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-volume_attachments HTTP/1.1 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'server_id': '5cda31eb-a32c-46c4-8196-09d4ea994396'} Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:02.972186 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1adc16b0-ec44-43f8-8165-fdc33a3f3391 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031372 Jun 18 22:54:02.976693 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3337/6695] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:54:02 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.181577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.182125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.189450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.189914 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.190692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.191141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.208111 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 HTTP/1.1 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '5cda31eb-a32c-46c4-8196-09d4ea994396'} Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.209805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a1dbd4a2-dbb1-4dfe-a6d7-070a1e3e5161 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 404 len: 111 microversion: 2.1 time: 0.033863 Jun 18 22:54:04.215421 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3359/6696] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:04 2022] DELETE /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.220285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.220932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 5cda31eb-a32c-46c4-8196-09d4ea994396] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.227686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.228128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.228893 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.229361 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.243170 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 HTTP/1.1 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '5cda31eb-a32c-46c4-8196-09d4ea994396'} Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.244726 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 5cda31eb-a32c-46c4-8196-09d4ea994396 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-353cb7af-2512-47fb-91c0-56aa962de3f4 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396" status: 404 len: 111 microversion: 2.1 time: 0.029795 Jun 18 22:54:04.248879 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3338/6697] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:04 2022] GET /compute/v2.1/servers/5cda31eb-a32c-46c4-8196-09d4ea994396 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.254951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.255475 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.262248 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.262719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.263473 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.263961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.278245 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 HTTP/1.1 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'a15a4fe5-83b5-4c00-a984-a8e3f9bf2001'} Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.279873 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ee6ea5f4-9cd4-485e-af45-ee4eae3ab014 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 404 len: 111 microversion: 2.1 time: 0.030363 Jun 18 22:54:04.283645 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3360/6698] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:04 2022] DELETE /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.290263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.290889 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: a15a4fe5-83b5-4c00-a984-a8e3f9bf2001] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.297303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.297702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.298510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.298951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.312680 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 HTTP/1.1 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'a15a4fe5-83b5-4c00-a984-a8e3f9bf2001'} Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.314275 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cc866f07-52d9-4d2f-b863-1a156ff2d63d tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001" status: 404 len: 111 microversion: 2.1 time: 0.029561 Jun 18 22:54:04.318417 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3339/6699] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:04 2022] GET /compute/v2.1/servers/a15a4fe5-83b5-4c00-a984-a8e3f9bf2001 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.324423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.324948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.331123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.331591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.332368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.332819 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.346839 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 HTTP/1.1 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '013c9a99-0f71-4172-afb5-1c150e96cc86'} Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.348430 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e13f3d18-a356-4585-8770-22a59a33a4e9 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 404 len: 111 microversion: 2.1 time: 0.029635 Jun 18 22:54:04.352805 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3361/6700] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:04 2022] DELETE /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.358741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.359366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 013c9a99-0f71-4172-afb5-1c150e96cc86] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.365612 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.366071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.366875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.367308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.380994 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 HTTP/1.1 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '013c9a99-0f71-4172-afb5-1c150e96cc86'} Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.382554 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 013c9a99-0f71-4172-afb5-1c150e96cc86 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2c9ad3c-daf9-48dc-92b6-e3840d1872b0 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86" status: 404 len: 111 microversion: 2.1 time: 0.029772 Jun 18 22:54:04.387395 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3340/6701] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:04 2022] GET /compute/v2.1/servers/013c9a99-0f71-4172-afb5-1c150e96cc86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 18 22:54:04.395278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.395800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.402384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.402851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.403628 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.404086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.406797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:04.419428 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 HTTP/1.1 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '22034ef5-ef19-4a3c-a687-811011df96b3'} Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.421069 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-25e58bb4-758d-4b71-aaca-b55c19281fac tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 404 len: 111 microversion: 2.1 time: 0.031873 Jun 18 22:54:04.425734 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3362/6702] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:04 2022] DELETE /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.433665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.434286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] [instance: 22034ef5-ef19-4a3c-a687-811011df96b3] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:04.441411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.441863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.442631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:04.443067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:04.457641 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] HTTP exception thrown: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Request method failure captured: Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 HTTP/1.1 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlXvaoamRWOvjRcUIt4BpFGngCfS2xHKg9sn8CUVa8Xi36Vo1MuI1QYwcLmpZY33wHEnTQc4d9djACIgMWI3d6Iwslbs8HXJRBdL6g5Q_JGsj8a4MMOxmtefoOOD69vUzAHyh3KfHRR2tqvfmcq4qxPLS1tEdRn_Q3ap_ZpKqg2Ia9I Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c50bcdb7ce3f4fd59d056bf30bda1676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c50bcdb7ce3f4fd59d056bf30bda1676", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: c50bcdb7ce3f4fd59d056bf30bda1676 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServerActionsTestJSON-1349922889 Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d589e9b3b6114231927b43bb4269e7db Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServerActionsTestJSON-1349922889-project Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '22034ef5-ef19-4a3c-a687-811011df96b3'} Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:04.459295 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Returning 404 to user: Instance 22034ef5-ef19-4a3c-a687-811011df96b3 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:04.464297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d6094a92-f14e-4967-b3ad-fb8eda7d67a8 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3" status: 404 len: 111 microversion: 2.1 time: 0.035073 Jun 18 22:54:04.465098 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3341/6703] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:04 2022] GET /compute/v2.1/servers/22034ef5-ef19-4a3c-a687-811011df96b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:04.473329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b2c0812-28f7-43d3-ace6-eaae251e1d31 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] Calling method '.version_select at 0x7fea140b50d0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:04.498124 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b2c0812-28f7-43d3-ace6-eaae251e1d31 tempest-ServerActionsTestJSON-1349922889 tempest-ServerActionsTestJSON-1349922889-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450728854" status: 202 len: 0 microversion: 2.1 time: 0.029257 Jun 18 22:54:04.498709 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3363/6704] 10.222.0.30 () {58 vars in 1220 bytes} [Sat Jun 18 22:54:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450728854 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:54:14.053676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-727568518", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "32ffafa2-900c-45fd-b6d0-e110a64f2928"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:14.060721 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:14.108221 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] validate_networks() for [('32ffafa2-900c-45fd-b6d0-e110a64f2928', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:54:14.448537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:14.554554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:54:14.554978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:54:14.555582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:54:14.555998 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:54:14.556416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:54:14.566836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:14.567413 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:14.568194 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:14.568641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:14.588199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Getting quotas for project 58dc2dd785cf47faa138714fd5649208. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:54:14.594366 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Getting quotas for user 47dd5343c7624f21882b08dbaaab7b43 and project 58dc2dd785cf47faa138714fd5649208. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:54:14.607106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:54:14.610313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:54:14.658702 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [30f2985d-6453-44eb-9005-b6ba3eec437a] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 22:54:15.671060 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [30f2985d-6453-44eb-9005-b6ba3eec437a] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 46282. Jun 18 22:54:15.677137 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f81a204-0b56-4245-a7d1-07d7fdac74ca tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.762973 Jun 18 22:54:15.678620 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3342/6705] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:54:15.687324 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:15.688112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:15.692568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-90979ad7-a496-4cd1-9e5b-9bdb96ec58d8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:15.693255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-90979ad7-a496-4cd1-9e5b-9bdb96ec58d8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:15.774278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-90979ad7-a496-4cd1-9e5b-9bdb96ec58d8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:15.782308 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-90979ad7-a496-4cd1-9e5b-9bdb96ec58d8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1216 microversion: 2.1 time: 0.096844 Jun 18 22:54:15.784835 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3364/6706] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:15 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:16.802287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:16.802923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:16.813540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:16.814001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:16.817692 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:16.818371 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:16.904500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:16.916697 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f0e774da-5e6a-43b0-b7a7-85541688cc94 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1286 microversion: 2.1 time: 0.119527 Jun 18 22:54:16.917613 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3343/6707] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:16 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:17.934967 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:17.936186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:17.945431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:17.946277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:17.947258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:17.947707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:18.106958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:18.115337 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-969ff293-fcfb-464e-adbf-01bbb2ebefa0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.184315 Jun 18 22:54:18.124582 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3365/6708] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:17 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:18.167243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-38c5fa54-d9c5-46ab-ba94-eadc205cfc4b req-4261a6a7-8599-45d2-91f6-41d893b8541b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3806d814-f0b0-4ef2-b636-06044f600c35", "tag": "e2534cb0-5d2a-4c9c-961b-b92230fe113d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:18.182386 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38c5fa54-d9c5-46ab-ba94-eadc205cfc4b req-4261a6a7-8599-45d2-91f6-41d893b8541b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:18.182834 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-38c5fa54-d9c5-46ab-ba94-eadc205cfc4b req-4261a6a7-8599-45d2-91f6-41d893b8541b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:18.195003 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-38c5fa54-d9c5-46ab-ba94-eadc205cfc4b req-4261a6a7-8599-45d2-91f6-41d893b8541b service nova] Creating event network-changed:e2534cb0-5d2a-4c9c-961b-b92230fe113d for instance 3806d814-f0b0-4ef2-b636-06044f600c35 on nch1-master-1 Jun 18 22:54:18.201108 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-38c5fa54-d9c5-46ab-ba94-eadc205cfc4b req-4261a6a7-8599-45d2-91f6-41d893b8541b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040540 Jun 18 22:54:18.202025 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3344/6709] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:19.133152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:19.133786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:19.141289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:19.141758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:19.142542 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:19.143003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:19.277250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:19.285008 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91271a98-4f73-4f0b-b761-7ba9a4a8381a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.155876 Jun 18 22:54:19.285617 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3366/6710] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:19 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:20.306887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:20.307991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:20.320545 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:20.321364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:20.322150 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:20.322618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:20.469124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:20.480803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b9e854f3-a30d-42b6-80e1-2c8d2470b088 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.181056 Jun 18 22:54:20.481599 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3345/6711] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:20 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:21.502808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:21.503895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:21.512782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:21.513268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:21.514084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:21.514569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:21.647607 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:21.655558 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-018755cd-10e0-44ef-be5b-b774775f45b1 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.159699 Jun 18 22:54:21.656152 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3367/6712] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:21 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:22.672870 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:22.673492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:22.681085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:22.681558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:22.682438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:22.682877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:22.812816 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:22.820771 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1f66ec08-fdf3-4d84-9170-e4035c3aaf67 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.151914 Jun 18 22:54:22.821372 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3346/6713] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:22 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:23.775385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5b053d5e-9e79-40bb-bdc9-1d87aa5491ec req-f4e9c884-bd83-4413-980f-ebbf15b74563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3806d814-f0b0-4ef2-b636-06044f600c35", "name": "network-vif-plugged", "status": "completed", "tag": "e2534cb0-5d2a-4c9c-961b-b92230fe113d"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:23.790283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5b053d5e-9e79-40bb-bdc9-1d87aa5491ec req-f4e9c884-bd83-4413-980f-ebbf15b74563 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:23.790916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5b053d5e-9e79-40bb-bdc9-1d87aa5491ec req-f4e9c884-bd83-4413-980f-ebbf15b74563 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:23.803424 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5b053d5e-9e79-40bb-bdc9-1d87aa5491ec req-f4e9c884-bd83-4413-980f-ebbf15b74563 service nova] Creating event network-vif-plugged:e2534cb0-5d2a-4c9c-961b-b92230fe113d for instance 3806d814-f0b0-4ef2-b636-06044f600c35 on nch1-master-1 Jun 18 22:54:23.808595 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5b053d5e-9e79-40bb-bdc9-1d87aa5491ec req-f4e9c884-bd83-4413-980f-ebbf15b74563 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037144 Jun 18 22:54:23.809222 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3368/6714] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:23.838334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:23.839414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:23.850604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:23.851061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:23.851894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:23.852344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:23.989199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:23.997133 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-266538ce-31ce-4315-8a0a-efe7c810b143 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.163019 Jun 18 22:54:23.997742 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3347/6715] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:23 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:25.021015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:25.022194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:25.031176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:25.031644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:25.032441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:25.032930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:25.186512 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:25.197071 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d09572d5-9ce8-42a0-a832-0fc1d494185e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1316 microversion: 2.1 time: 0.184629 Jun 18 22:54:25.206192 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3369/6716] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:25 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:26.214684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:26.215346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:26.217510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:26.218184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:26.224610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:26.225068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:26.225874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:26.226316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:26.385559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:26.394928 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2d38c96-07f0-4e1c-bca9-7637c68bdd1f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.184624 Jun 18 22:54:26.395561 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3348/6717] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:26 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:26.454455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-621831949", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "32ffafa2-900c-45fd-b6d0-e110a64f2928"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:26.467004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:26.521253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] validate_networks() for [('32ffafa2-900c-45fd-b6d0-e110a64f2928', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:54:26.907837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:54:26.908513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:54:26.909017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:54:26.909471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:54:26.909904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:54:26.922275 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:26.922970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:26.924206 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:26.924664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:26.943905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Getting quotas for project 58dc2dd785cf47faa138714fd5649208. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:54:26.949782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Getting quotas for user 47dd5343c7624f21882b08dbaaab7b43 and project 58dc2dd785cf47faa138714fd5649208. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:54:26.962495 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:54:26.965230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:54:27.010396 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-137af6a2-6d07-4c83-b618-7a747c606136 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562049 Jun 18 22:54:27.011053 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3370/6718] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:54:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:54:27.021487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b66dca00-fd3e-4c96-9092-03fe63708017 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:27.022116 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b66dca00-fd3e-4c96-9092-03fe63708017 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:27.080385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b66dca00-fd3e-4c96-9092-03fe63708017 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:27.087702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b66dca00-fd3e-4c96-9092-03fe63708017 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1216 microversion: 2.1 time: 0.069791 Jun 18 22:54:27.088668 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3349/6719] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:27 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:28.111328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:28.112135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:28.120491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:28.121093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:28.122009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:28.123242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:28.188049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:28.196708 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9eae646b-5b18-4e85-8c19-16b2c6e3c600 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1286 microversion: 2.1 time: 0.090443 Jun 18 22:54:28.197434 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3371/6720] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:28 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:29.216373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:29.217287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:29.226003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:29.226757 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:29.227551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:29.227995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:29.379517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:29.387196 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c44de679-65bc-42a3-8e90-225f18950a3b tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1316 microversion: 2.1 time: 0.176607 Jun 18 22:54:29.387872 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3350/6721] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:29 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1316 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:29.427526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-d264e514-e7de-4db3-893d-be30a2be45f0 req-988d49c8-8b99-4ddc-8232-57f9756bef9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d55454a-c99e-4115-a024-918cb1b88148", "tag": "34faf50c-4ead-4281-b8c5-2605908a121f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:29.438839 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d264e514-e7de-4db3-893d-be30a2be45f0 req-988d49c8-8b99-4ddc-8232-57f9756bef9f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:29.439387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-d264e514-e7de-4db3-893d-be30a2be45f0 req-988d49c8-8b99-4ddc-8232-57f9756bef9f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:29.452637 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-d264e514-e7de-4db3-893d-be30a2be45f0 req-988d49c8-8b99-4ddc-8232-57f9756bef9f service nova] Creating event network-changed:34faf50c-4ead-4281-b8c5-2605908a121f for instance 0d55454a-c99e-4115-a024-918cb1b88148 on nch2-master-1 Jun 18 22:54:29.457832 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-d264e514-e7de-4db3-893d-be30a2be45f0 req-988d49c8-8b99-4ddc-8232-57f9756bef9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Jun 18 22:54:29.458446 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3372/6722] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:30.405107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:30.405745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:30.412914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:30.413420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:30.414201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:30.414638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:30.557993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:30.568900 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3f664446-f04e-45dd-94a7-eb2b5903ddb8 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1316 microversion: 2.1 time: 0.168128 Jun 18 22:54:30.569522 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3351/6723] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:30 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:31.589772 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:31.590440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:31.597326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:31.597788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:31.598578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:31.599031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:31.738098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:31.745928 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3969e15d-5a94-4718-8690-fe000aacddbb tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1316 microversion: 2.1 time: 0.161920 Jun 18 22:54:31.746569 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3373/6724] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:31 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:32.766547 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:32.767572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:32.779232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:32.779680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:32.780449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:32.780885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:32.913781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:32.921749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e27dfd57-9943-4e29-9f25-3147621c7414 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1316 microversion: 2.1 time: 0.161844 Jun 18 22:54:32.922440 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3352/6725] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:32 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:33.943179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:33.944306 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:33.954379 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:33.954849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:33.955641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:33.956097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:34.093368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:34.101121 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67f33230-5c5c-4197-ac4c-e59656d3fd1a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1316 microversion: 2.1 time: 0.164657 Jun 18 22:54:34.101690 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3374/6726] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:33 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:35.064538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-61392a54-575f-4bbc-af2a-7a595b98d709 req-e7b4af2a-1a87-4e8b-9f11-1a07654925be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d55454a-c99e-4115-a024-918cb1b88148", "name": "network-vif-plugged", "status": "completed", "tag": "34faf50c-4ead-4281-b8c5-2605908a121f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:35.074315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-61392a54-575f-4bbc-af2a-7a595b98d709 req-e7b4af2a-1a87-4e8b-9f11-1a07654925be service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:35.074771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-61392a54-575f-4bbc-af2a-7a595b98d709 req-e7b4af2a-1a87-4e8b-9f11-1a07654925be service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:35.086528 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-61392a54-575f-4bbc-af2a-7a595b98d709 req-e7b4af2a-1a87-4e8b-9f11-1a07654925be service nova] Creating event network-vif-plugged:34faf50c-4ead-4281-b8c5-2605908a121f for instance 0d55454a-c99e-4115-a024-918cb1b88148 on nch2-master-1 Jun 18 22:54:35.092084 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-61392a54-575f-4bbc-af2a-7a595b98d709 req-e7b4af2a-1a87-4e8b-9f11-1a07654925be service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031320 Jun 18 22:54:35.092692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3353/6727] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:35.118305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:35.119649 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:35.128203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:35.128673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:35.129582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:35.130301 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:35.269940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:35.277599 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d91b94d9-96f2-46a1-b516-6662f13854e9 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1316 microversion: 2.1 time: 0.163563 Jun 18 22:54:35.278179 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3375/6728] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:35 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:36.296072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:36.296657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:36.303364 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:36.303851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:36.304877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:36.305423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:36.444875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:36.452713 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4d62fa47-c489-4ad7-a74e-aa7d461b2a17 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1505 microversion: 2.1 time: 0.162273 Jun 18 22:54:36.453481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3354/6729] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:36 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:36.469830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:36.470380 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:36.477417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:36.477891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:36.478670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:36.479137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:36.508294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:54:36.591689 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fe5c12cd-05e4-4e74-8b88-e364ac70d218 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 204 len: 0 microversion: 2.1 time: 0.125704 Jun 18 22:54:36.592307 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3376/6730] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:36 2022] DELETE /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:54:36.601425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:36.602030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:36.608535 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:36.608991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:36.609794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:36.610250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:36.752729 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:36.760834 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5b1c1f3-6055-43cb-a73d-e36c7f901e8e tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1511 microversion: 2.1 time: 0.163419 Jun 18 22:54:36.761463 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3355/6731] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:36 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:37.783451 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:37.784661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:37.787861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:37.789007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:37.799363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:37.799836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:37.800625 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:37.801090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:37.936581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:37.944548 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d669cc80-002c-4334-abea-e4b5259a0029 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 200 len: 1511 microversion: 2.1 time: 0.168593 Jun 18 22:54:37.945164 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3377/6732] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:37 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:38.311430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-a90f331f-4791-430c-848c-a27f8cba10d4 req-f6fdc699-299f-4398-b12d-cb7aea0338c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d55454a-c99e-4115-a024-918cb1b88148", "name": "network-vif-deleted", "tag": "34faf50c-4ead-4281-b8c5-2605908a121f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:38.318310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:38.339591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a90f331f-4791-430c-848c-a27f8cba10d4 req-f6fdc699-299f-4398-b12d-cb7aea0338c1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:38.341879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-a90f331f-4791-430c-848c-a27f8cba10d4 req-f6fdc699-299f-4398-b12d-cb7aea0338c1 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:38.364095 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-a90f331f-4791-430c-848c-a27f8cba10d4 req-f6fdc699-299f-4398-b12d-cb7aea0338c1 service nova] Creating event network-vif-deleted:34faf50c-4ead-4281-b8c5-2605908a121f for instance 0d55454a-c99e-4115-a024-918cb1b88148 on nch2-master-1 Jun 18 22:54:38.370963 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-a90f331f-4791-430c-848c-a27f8cba10d4 req-f6fdc699-299f-4398-b12d-cb7aea0338c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065370 Jun 18 22:54:38.376857 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3356/6733] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:38.967579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:38.968905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:38.976227 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:38.976678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:38.977541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:38.977996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:38.992248 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] HTTP exception thrown: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 HTTP/1.1 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0d55454a-c99e-4115-a024-918cb1b88148'} Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:38.994031 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 404 to user: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5e182784-5ccd-4dd6-b1eb-20315c76e344 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 404 len: 111 microversion: 2.1 time: 0.035011 Jun 18 22:54:38.999237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3378/6734] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:38 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:39.006046 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:39.006763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.013708 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.014161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.014942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.015485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.150231 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:39.158343 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d455bce-aa9d-481d-8d9c-14a2bba69c0d tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.156656 Jun 18 22:54:39.158926 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3357/6735] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:39 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:39.179595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-640f67d9-addd-4e6c-8790-1a49bd40c8a4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:39.180606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-640f67d9-addd-4e6c-8790-1a49bd40c8a4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: e4dcf64d-e883-44e3-862e-5946cc3505d0] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.186556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-640f67d9-addd-4e6c-8790-1a49bd40c8a4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] HTTP exception thrown: Instance e4dcf64d-e883-44e3-862e-5946cc3505d0 could not be found. Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-640f67d9-addd-4e6c-8790-1a49bd40c8a4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/e4dcf64d-e883-44e3-862e-5946cc3505d0/action HTTP/1.1 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 32 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: {"resize": {"flavorRef": "452"}} Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance e4dcf64d-e883-44e3-862e-5946cc3505d0 could not be found. Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': 'e4dcf64d-e883-44e3-862e-5946cc3505d0', 'body': {'resize': {'flavorRef': '452'}}} Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4dcf64d-e883-44e3-862e-5946cc3505d0 could not be found. Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:39.188132 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4dcf64d-e883-44e3-862e-5946cc3505d0 could not be found. Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4dcf64d-e883-44e3-862e-5946cc3505d0 could not be found. Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-640f67d9-addd-4e6c-8790-1a49bd40c8a4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 404 to user: Instance e4dcf64d-e883-44e3-862e-5946cc3505d0 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-640f67d9-addd-4e6c-8790-1a49bd40c8a4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "POST /compute/v2.1/servers/e4dcf64d-e883-44e3-862e-5946cc3505d0/action" status: 404 len: 111 microversion: 2.1 time: 0.014009 Jun 18 22:54:39.193282 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3379/6736] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:54:39 2022] POST /compute/v2.1/servers/e4dcf64d-e883-44e3-862e-5946cc3505d0/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:39.200216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:39.200845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.207559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.208020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.208794 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.209281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.350038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:39.358183 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7a15ea98-2d4b-4c92-b6a2-782599f63ced tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.161899 Jun 18 22:54:39.358767 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3358/6737] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:39 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:39.376180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:39.376837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.384129 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.384600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.385436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.385899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.519513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:39.527935 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-59372a80-cf86-4ed5-aa64-803ac2fc9943 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.155764 Jun 18 22:54:39.528517 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3380/6738] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:39 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:39.547621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "af133b7d-e84b-4789-851f-64e58e10e282"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:39.549088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.558786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.559450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.560640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.561158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.604653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:39.610412 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] HTTP exception thrown: Flavor af133b7d-e84b-4789-851f-64e58e10e282 could not be found. Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: request: POST /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35/action HTTP/1.1 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 65 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: {"resize": {"flavorRef": "af133b7d-e84b-4789-851f-64e58e10e282"}} Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: exception: Flavor af133b7d-e84b-4789-851f-64e58e10e282 could not be found. Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3806d814-f0b0-4ef2-b636-06044f600c35', 'body': {'resize': {'flavorRef': 'af133b7d-e84b-4789-851f-64e58e10e282'}}} Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 18 22:54:39.612394 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor af133b7d-e84b-4789-851f-64e58e10e282 could not be found. Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor af133b7d-e84b-4789-851f-64e58e10e282 could not be found. Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor af133b7d-e84b-4789-851f-64e58e10e282 could not be found. Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 400 to user: Flavor af133b7d-e84b-4789-851f-64e58e10e282 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6e11692e-c450-467f-b22e-0368bf2e4ea4 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "POST /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35/action" status: 400 len: 107 microversion: 2.1 time: 0.073029 Jun 18 22:54:39.621603 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3359/6739] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:54:39 2022] POST /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35/action => generated 107 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:54:39.626696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:39.627337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.633803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.634279 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.635069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.635526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.773832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:39.785379 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8a1b40f0-c4f3-4933-ab2c-2e69ffa31120 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.164398 Jun 18 22:54:39.786120 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3381/6740] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:39 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:39.806779 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:39.807325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:39.813929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.814350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.815358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:39.815802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:39.956055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:39.966036 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b8c59469-0648-4f3c-8855-6b54774b7199 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.163337 Jun 18 22:54:39.966832 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3360/6741] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:39 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:39.982743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa658e3b-be8c-47b5-90db-56fcd8c88a10 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa658e3b-be8c-47b5-90db-56fcd8c88a10 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: request: POST /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35/action HTTP/1.1 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 29 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: {"resize": {"flavorRef": ""}} Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3806d814-f0b0-4ef2-b636-06044f600c35', 'body': {'resize': {'flavorRef': ''}}} Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise error Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi On instance['resize']: Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi '' Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:39.987148 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fa658e3b-be8c-47b5-90db-56fcd8c88a10 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fa658e3b-be8c-47b5-90db-56fcd8c88a10 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "POST /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35/action" status: 400 len: 113 microversion: 2.1 time: 0.009986 Jun 18 22:54:39.992450 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3382/6742] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:54:39 2022] POST /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 18 22:54:39.997399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:39.998024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:40.004289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.004770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.005574 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.006011 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.139585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:40.151077 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4ad841a3-a4e0-4057-a4e0-86425218971a tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1506 microversion: 2.1 time: 0.157309 Jun 18 22:54:40.151866 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3361/6743] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:39 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:40.173509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:40.174028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:40.181406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.181871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.182656 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.183103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.196673 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] HTTP exception thrown: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 HTTP/1.1 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '0d55454a-c99e-4115-a024-918cb1b88148'} Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:40.198303 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 404 to user: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b385d248-0e23-430b-ac52-45a04b795d05 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 404 len: 111 microversion: 2.1 time: 0.031051 Jun 18 22:54:40.203558 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3383/6744] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:40 2022] DELETE /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:40.209243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:40.209875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 0d55454a-c99e-4115-a024-918cb1b88148] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:40.216554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.217017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.217881 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.218368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.232709 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] HTTP exception thrown: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 HTTP/1.1 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '0d55454a-c99e-4115-a024-918cb1b88148'} Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:40.234324 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:40.239062 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 404 to user: Instance 0d55454a-c99e-4115-a024-918cb1b88148 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:40.239927 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef52266c-80e8-48c6-8bf1-f7f37e174f84 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148" status: 404 len: 111 microversion: 2.1 time: 0.034770 Jun 18 22:54:40.240440 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3362/6745] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:40 2022] GET /compute/v2.1/servers/0d55454a-c99e-4115-a024-918cb1b88148 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:54:40.248767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:40.249323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:40.255900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.256368 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.257229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.257681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.283131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:54:40.304750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:40.383974 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a04c02f-9aa7-43ae-bc0c-eeb9e93186c0 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 204 len: 0 microversion: 2.1 time: 0.138845 Jun 18 22:54:40.384532 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3384/6746] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:54:40 2022] DELETE /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 18 22:54:40.393739 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:40.394372 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:40.401584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.402044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.402835 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:40.403274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:40.407596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=100 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:54:40.540589 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:40.548913 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c4655965-f75e-4c9d-802e-f4c7f0ee8719 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1512 microversion: 2.1 time: 0.159315 Jun 18 22:54:40.549506 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3363/6747] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:40 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:41.569341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:41.570090 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:41.577563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:41.578032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:41.578828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:41.579281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:41.721366 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:41.729522 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55e9b94b-b733-4af6-bd34-093fc9a38762 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1512 microversion: 2.1 time: 0.165190 Jun 18 22:54:41.730105 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3385/6748] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:41 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:42.310561 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9e2329d9-202f-494f-bc8b-7f831c0f195d req-3fbfef73-2052-4a74-91a5-39595f323a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3806d814-f0b0-4ef2-b636-06044f600c35", "name": "network-vif-deleted", "tag": "e2534cb0-5d2a-4c9c-961b-b92230fe113d"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:54:42.320675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9e2329d9-202f-494f-bc8b-7f831c0f195d req-3fbfef73-2052-4a74-91a5-39595f323a1a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:42.321159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9e2329d9-202f-494f-bc8b-7f831c0f195d req-3fbfef73-2052-4a74-91a5-39595f323a1a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:42.333407 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9e2329d9-202f-494f-bc8b-7f831c0f195d req-3fbfef73-2052-4a74-91a5-39595f323a1a service nova] Creating event network-vif-deleted:e2534cb0-5d2a-4c9c-961b-b92230fe113d for instance 3806d814-f0b0-4ef2-b636-06044f600c35 on nch1-master-1 Jun 18 22:54:42.339131 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9e2329d9-202f-494f-bc8b-7f831c0f195d req-3fbfef73-2052-4a74-91a5-39595f323a1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032354 Jun 18 22:54:42.340521 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3364/6749] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:54:42.747428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:42.748061 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:42.755729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:42.756204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:42.756996 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:42.757481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:42.790471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:42.790959 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:42.791555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lazy-loading 'fault' on Instance uuid 3806d814-f0b0-4ef2-b636-06044f600c35 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:54:42.836194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47dd5343c7624f21882b08dbaaab7b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58dc2dd785cf47faa138714fd5649208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:54:42.843669 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4c773320-2bf8-44f2-964f-6b0bbc8f5d63 tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 200 len: 1306 microversion: 2.1 time: 0.100382 Jun 18 22:54:42.844254 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3386/6750] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:42 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:54:43.866445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:54:43.867602 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] [instance: 3806d814-f0b0-4ef2-b636-06044f600c35] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:54:43.878517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:43.878970 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:43.879749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:54:43.880193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:54:43.893992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] HTTP exception thrown: Instance 3806d814-f0b0-4ef2-b636-06044f600c35 could not be found. Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Request method failure captured: Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 HTTP/1.1 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirleVLLRBEqNDU56xmQmK-nU8hIWIbBaPtIjHJyNrePEx32LfXC7mJKiSoXRzOhAhDNse2gTdlo4qOZtLUqnPpiXeWOmhtM60aO2SoTOa-WjkhjD7mLTLgLffv2QBli4RZn_Q_Mw32GM0YKpL1miUTqc3qsTs4xV8LFjnCemN3PjZW7Y Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/58dc2dd785cf47faa138714fd5649208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_58dc2dd785cf47faa138714fd5649208", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 58dc2dd785cf47faa138714fd5649208 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-ServersNegativeTestJSON-768338472 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 47dd5343c7624f21882b08dbaaab7b43 Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-ServersNegativeTestJSON-768338472-project Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 3806d814-f0b0-4ef2-b636-06044f600c35 could not be found. Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '3806d814-f0b0-4ef2-b636-06044f600c35'} Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3806d814-f0b0-4ef2-b636-06044f600c35 could not be found. Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3806d814-f0b0-4ef2-b636-06044f600c35 could not be found. Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:54:43.895643 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3806d814-f0b0-4ef2-b636-06044f600c35 could not be found. Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] Returning 404 to user: Instance 3806d814-f0b0-4ef2-b636-06044f600c35 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-151249b6-b6c0-412f-9919-1b77bc0b019f tempest-ServersNegativeTestJSON-768338472 tempest-ServersNegativeTestJSON-768338472-project] 10.222.0.30 "GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35" status: 404 len: 111 microversion: 2.1 time: 0.039283 Jun 18 22:54:43.900041 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3365/6751] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:54:43 2022] GET /compute/v2.1/servers/3806d814-f0b0-4ef2-b636-06044f600c35 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:55:25.575922 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2871fa14-2cc5-4064-894e-cedaebc87081 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Action: 'create', calling method: .version_select at 0x7fea07912940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1361581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4fEAzUZqHPG/WMnXbypcfi5+uYKJ+GI8tpVglKXxnxD2ATJr54wLncQX8TqqT8rWVw2GW9bxD9egwPpMpXSvCDR7VlqVY3fCq7NQH/PfOSMga8ixIdv605R+4x04fZgQ=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:25.580664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:25.581455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:25.597928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2871fa14-2cc5-4064-894e-cedaebc87081 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Getting quotas for project f576ae59a362455993f77dfdb870e37a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:55:25.603250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-2871fa14-2cc5-4064-894e-cedaebc87081 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Getting quotas for user c544eb954e434fbda5d92667d6f4a2a8 and project f576ae59a362455993f77dfdb870e37a. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:55:25.629192 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2871fa14-2cc5-4064-894e-cedaebc87081 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.057260 Jun 18 22:55:25.629826 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3387/6752] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:55:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:55:25.680159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1113466641", "imageRef": "b9a39769-5b23-42a8-bbc3-4a2bd9ead8d4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1361581", "networks": [{"uuid": "344cde12-4f7c-41dd-b80e-e8dc3ef2f8fc"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:25.687814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:25.688463 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:25.735804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] validate_networks() for [('344cde12-4f7c-41dd-b80e-e8dc3ef2f8fc', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:55:26.118425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:55:26.118854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:55:26.119337 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:55:26.119755 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:55:26.120172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:55:26.129434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:26.129886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:26.130682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:26.131122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:26.148918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Getting quotas for project f576ae59a362455993f77dfdb870e37a. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:55:26.154156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Getting quotas for user c544eb954e434fbda5d92667d6f4a2a8 and project f576ae59a362455993f77dfdb870e37a. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:55:26.166600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:55:26.168806 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b9a39769-5b23-42a8-bbc3-4a2bd9ead8d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:55:26.219627 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-66932ffa-4aba-4a53-baf5-7871f5e4bc39 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543635 Jun 18 22:55:26.220287 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3366/6753] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:55:26.230538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9713ffe7-c8fa-47db-9bdf-6c29f40d7ad2 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:26.231170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9713ffe7-c8fa-47db-9bdf-6c29f40d7ad2 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:26.287086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9713ffe7-c8fa-47db-9bdf-6c29f40d7ad2 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:26.295561 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9713ffe7-c8fa-47db-9bdf-6c29f40d7ad2 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1256 microversion: 2.1 time: 0.069021 Jun 18 22:55:26.296142 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3388/6754] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:26 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1256 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:27.313393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:27.314259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:27.321465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:27.322165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:27.322925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:27.323396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:27.391400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:27.399735 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-412a9b5d-efa5-4332-a021-40bfed9583f7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1314 microversion: 2.1 time: 0.091406 Jun 18 22:55:27.400903 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3367/6755] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:27 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:28.417531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:28.419104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:28.427909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:28.428726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:28.429578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:28.430209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:28.575876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:28.583749 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-181c927e-83db-4955-b218-6daae65f842d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.170299 Jun 18 22:55:28.584658 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3389/6756] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:28 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:29.601595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:29.602325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:29.609718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:29.610174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:29.610959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:29.611397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:29.763197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:29.771508 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fb45a082-29d9-41d9-88f4-5f5911dd4143 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.173976 Jun 18 22:55:29.772195 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3368/6757] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:29 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:30.792088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:30.793076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:30.801183 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:30.801658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:30.802477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:30.802937 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:30.945598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:30.953670 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-542daeb7-cfb4-41f8-86f1-c7d3d56a694f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.166368 Jun 18 22:55:30.954510 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3390/6758] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:30 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:31.971573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:31.972234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:31.979787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:31.980239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:31.981024 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:31.981492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:32.118935 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:32.127082 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c87a9e5-e6cd-4ead-b257-fc93b6ba4d21 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.159607 Jun 18 22:55:32.127865 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3369/6759] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:31 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:33.144464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:33.145348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:33.152589 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:33.153089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:33.153916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:33.154377 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:33.294398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:33.302130 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cffb05dc-f72e-4d40-9255-0df559c1e63d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.161704 Jun 18 22:55:33.302711 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3391/6760] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:33 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:34.319454 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:34.320107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:34.327853 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:34.328293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:34.329101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:34.329549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:34.469489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:34.477628 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b0c2e58e-38be-4f5e-8979-00fb801ea2c5 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.162239 Jun 18 22:55:34.478215 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3370/6761] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:34 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:35.499071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:35.500098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:35.510008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:35.510478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:35.511271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:35.511726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:35.645148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:35.653635 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-001250df-ab8c-48eb-b584-29ada36c927c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.160888 Jun 18 22:55:35.654201 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3392/6762] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:35 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:36.238265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c62a9540-9c36-4489-8674-1bed933cdbd8 req-5ac54a08-08fe-4ed9-89fe-42c7c8bb477f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:36.258440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:36.266932 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:36.274107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c62a9540-9c36-4489-8674-1bed933cdbd8 req-5ac54a08-08fe-4ed9-89fe-42c7c8bb477f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:36.274864 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c62a9540-9c36-4489-8674-1bed933cdbd8 req-5ac54a08-08fe-4ed9-89fe-42c7c8bb477f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:36.298303 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c62a9540-9c36-4489-8674-1bed933cdbd8 req-5ac54a08-08fe-4ed9-89fe-42c7c8bb477f service nova] Creating event network-changed:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:55:36.304938 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c62a9540-9c36-4489-8674-1bed933cdbd8 req-5ac54a08-08fe-4ed9-89fe-42c7c8bb477f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076687 Jun 18 22:55:36.305613 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3371/6763] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:55:36.671286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:36.672021 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:36.674103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:55:36.680823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:36.681316 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:36.682123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:36.682800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:36.817749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:36.825897 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aadae6d4-1d0c-482f-bf07-68db2ed5ef45 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.158710 Jun 18 22:55:36.826473 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3393/6764] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:36 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:37.845301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:37.845985 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:37.853005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:37.853487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:37.854274 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:37.854718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:37.988489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:37.996593 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9716e723-64ed-4adf-8d21-eb4d6c196365 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.157046 Jun 18 22:55:37.997203 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3372/6765] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:37 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:39.017876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:39.018953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:39.028195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:39.028670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:39.029504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:39.029957 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:39.161535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:39.169522 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1b63ae90-b81b-48fc-8436-4fa60c02a298 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.158176 Jun 18 22:55:39.170072 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3394/6766] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:39 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:40.190928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:40.191871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:40.200702 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:40.201165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:40.201966 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:40.202410 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:40.340020 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:40.347855 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5cc177ac-a3f8-47ce-9ddb-e19e3ecbb7bb tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.163643 Jun 18 22:55:40.348444 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3373/6767] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:40 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:41.291759 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e39ba7f3-48e9-408e-8ab8-aba653c7bbf3 req-52576967-ca70-421c-832c-f52803549bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "name": "network-vif-plugged", "status": "completed", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:41.301792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e39ba7f3-48e9-408e-8ab8-aba653c7bbf3 req-52576967-ca70-421c-832c-f52803549bd9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:41.302907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e39ba7f3-48e9-408e-8ab8-aba653c7bbf3 req-52576967-ca70-421c-832c-f52803549bd9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:41.315872 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e39ba7f3-48e9-408e-8ab8-aba653c7bbf3 req-52576967-ca70-421c-832c-f52803549bd9 service nova] Creating event network-vif-plugged:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:55:41.321173 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e39ba7f3-48e9-408e-8ab8-aba653c7bbf3 req-52576967-ca70-421c-832c-f52803549bd9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Jun 18 22:55:41.321777 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3395/6768] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:55:41.365362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:41.366006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:41.373350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:41.373817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:41.374600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:41.375045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:41.508938 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:41.516745 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d4be8a89-31e3-4c23-a164-380e59d091e4 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1356 microversion: 2.1 time: 0.155464 Jun 18 22:55:41.517367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3374/6769] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:41 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:42.539168 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:42.540330 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:42.553006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.553844 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.555038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.555604 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.691355 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:42.699441 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4743eac4-a846-468d-ac46-853851293d10 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1546 microversion: 2.1 time: 0.167622 Jun 18 22:55:42.700032 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3396/6770] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:42 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:42.716170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:42.716799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:42.724396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.724856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.725674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.726124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.877959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:42.887895 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a43374e6-d00b-486d-9c46-ac343c4a9597 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1546 microversion: 2.1 time: 0.176104 Jun 18 22:55:42.888481 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3375/6771] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:42 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:42.903965 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:42.907250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:42.908032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Searching by: {'deleted': False, 'project_id': 'f576ae59a362455993f77dfdb870e37a'} {{(pid=130903) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 18 22:55:42.913817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.914328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.915134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.915581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.939184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.multi_cell_list [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130903) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 18 22:55:42.967605 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-389d02a5-8aeb-4971-92c7-eedeb63428af tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067553 Jun 18 22:55:42.968187 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3397/6772] 10.222.0.30 () {58 vars in 1124 bytes} [Sat Jun 18 22:55:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:55:42.979611 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:42.980241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:42.986718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.987178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:42.987951 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:42.988400 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:43.127683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:43.136269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e93f4fd6-9586-4f75-a47f-69852f063b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1546 microversion: 2.1 time: 0.161469 Jun 18 22:55:43.136862 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3376/6773] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:42 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:44.693131 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26b856df-e6aa-433f-b188-fe21b8474789"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:44.694229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:44.701511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:44.701912 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:44.702689 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:44.703136 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:44.957521 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3ad98d2c-d804-4b99-8393-fbb79d3485c7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268221 Jun 18 22:55:44.958099 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3398/6774] 10.222.0.30 () {60 vars in 1322 bytes} [Sat Jun 18 22:55:44 2022] POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:55:48.321653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:48.322283 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:48.329542 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:48.329996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:48.330782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:48.331228 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:48.470242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:48.479189 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b40322ff-ff9f-44b6-b978-9959a5506c8f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1592 microversion: 2.1 time: 0.161664 Jun 18 22:55:48.479755 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3377/6775] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:48 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1592 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:50.579288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-46a3b282-d2b1-4a82-b63d-9a46f74c1f1a req-5792f16f-e221-4bb1-a38b-ab6b7bb0d12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:50.588972 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46a3b282-d2b1-4a82-b63d-9a46f74c1f1a req-5792f16f-e221-4bb1-a38b-ab6b7bb0d12c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:50.590193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-46a3b282-d2b1-4a82-b63d-9a46f74c1f1a req-5792f16f-e221-4bb1-a38b-ab6b7bb0d12c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:50.604173 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-46a3b282-d2b1-4a82-b63d-9a46f74c1f1a req-5792f16f-e221-4bb1-a38b-ab6b7bb0d12c service nova] Creating event network-changed:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:55:50.609671 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-46a3b282-d2b1-4a82-b63d-9a46f74c1f1a req-5792f16f-e221-4bb1-a38b-ab6b7bb0d12c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Jun 18 22:55:50.610894 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3399/6776] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:55:51.681843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1070441691"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:51.682449 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:51.689390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:51.689843 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:51.690623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:51.691055 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:51.820337 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.network.security_group_api [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Adding security group 10331632-e8cc-48e4-86dc-65d2707a9af8 to port 8f061a43-ec54-465e-b212-b09ded6adfcb Jun 18 22:55:52.178471 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8039a98b-0214-4e9c-973b-3288d5b4de2b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/action" status: 202 len: 0 microversion: 2.1 time: 0.499193 Jun 18 22:55:52.179841 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3378/6777] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:55:51 2022] POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 22:55:52.189780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:55:52.190502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:55:52.198596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:52.199066 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:52.199870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:52.200320 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:52.375112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:55:52.384478 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-45d81997-7a60-4522-9714-ef3c748e892d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1758 microversion: 2.1 time: 0.200250 Jun 18 22:55:52.385096 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3400/6778] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:55:52 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:55:52.626215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-58762a8a-0324-4557-922d-6cf15ce8c864 req-0207fdfb-9fe7-4abe-84f6-46d3fd5ab5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:55:52.634784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-58762a8a-0324-4557-922d-6cf15ce8c864 req-0207fdfb-9fe7-4abe-84f6-46d3fd5ab5a7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:55:52.635252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-58762a8a-0324-4557-922d-6cf15ce8c864 req-0207fdfb-9fe7-4abe-84f6-46d3fd5ab5a7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:55:52.646989 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-58762a8a-0324-4557-922d-6cf15ce8c864 req-0207fdfb-9fe7-4abe-84f6-46d3fd5ab5a7 service nova] Creating event network-changed:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:55:52.654625 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-58762a8a-0324-4557-922d-6cf15ce8c864 req-0207fdfb-9fe7-4abe-84f6-46d3fd5ab5a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032221 Jun 18 22:55:52.655429 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3379/6779] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:56:14.933898 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:56:14.935039 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 22:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:56:18.073838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:56:18.074903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:18.077712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:18.078527 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:18.079271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:18.085836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:18.086304 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:18.087125 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:18.087578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:18.173667 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-30f981b7-529c-4e3b-9e4f-fbaadec4ad0f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/action" status: 202 len: 0 microversion: 2.1 time: 0.103880 Jun 18 22:56:18.174470 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3401/6780] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:56:18 2022] POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:56:18.180933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:18.181740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=70 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:56:18.186121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:18.186976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:18.194723 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:18.195210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:18.195984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:18.196420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:18.353052 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:18.361689 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ddd9b45f-beed-4759-a168-06b053d95d38 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1750 microversion: 2.1 time: 0.182733 Jun 18 22:56:18.362279 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3380/6781] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:18 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:19.385069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:19.386165 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:19.397204 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:19.397994 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:19.399305 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:19.400073 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:19.558719 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:19.571189 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bec4bd7a-1580-4c17-b2da-7ce6130e3206 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.194817 Jun 18 22:56:19.571994 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3402/6782] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:19 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:20.593248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:20.594173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:20.601684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:20.602144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:20.602922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:20.603365 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:20.753262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:20.761550 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6bde6253-2707-4e66-b30f-2484de427c4c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.175375 Jun 18 22:56:20.762128 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3381/6783] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:20 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:21.788070 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:21.789132 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:21.800009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:21.800481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:21.801302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:21.801750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:21.958872 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:21.968051 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4b5b5734-b3c4-4b78-a8d5-7603400c8df8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.186659 Jun 18 22:56:21.968646 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3403/6784] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:21 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:22.989462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:22.990378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:23.002640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:23.003105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:23.003861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:23.004333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:23.153247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:23.165181 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c626284-faf6-4986-ab36-3d97779e475e tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.182459 Jun 18 22:56:23.166001 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3382/6785] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:22 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:24.189108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:24.190502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:24.202347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:24.203120 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:24.204409 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:24.205181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:24.368822 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:24.379100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-29cbd7b3-413a-4114-9402-590f85b91b49 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.196621 Jun 18 22:56:24.379682 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3404/6786] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:24 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:25.396346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:25.396959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:25.407934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:25.408643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:25.410239 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:25.410833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:25.558514 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:25.570850 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3939ab85-7d24-4da9-8af0-474be409079f tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.178358 Jun 18 22:56:25.571712 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3383/6787] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:25 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:26.593786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:26.594584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:26.601855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:26.602326 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:26.603123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:26.603578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:26.750955 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:26.759413 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4555d598-e01a-4e43-98d3-26cd72cc8f71 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.171183 Jun 18 22:56:26.759977 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3405/6788] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:26 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:27.776650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:27.777264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:27.784771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:27.785278 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:27.786061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:27.786506 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:27.940039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:27.950368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5a364375-72fd-4c4b-bdf4-1a702cdc359b tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.177715 Jun 18 22:56:27.950964 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3384/6789] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:27 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:28.972347 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:28.972927 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:28.980514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:28.980982 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:28.981805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:28.982256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:29.131397 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:29.141857 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-42df955b-5d17-447b-9b84-6fd0d850024d tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.175681 Jun 18 22:56:29.142489 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3406/6790] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:28 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:30.160085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:30.160678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:30.168901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:30.169382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:30.170161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:30.170596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:30.319014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:30.327865 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fed50183-f196-49fd-884b-e33938303351 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.171904 Jun 18 22:56:30.328414 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3385/6791] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:30 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:31.349546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:31.350269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:31.359435 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:31.360015 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:31.361018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:31.361615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:31.510179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:31.521163 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6a162eeb-fc58-46e5-bd14-18aa24413b68 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.177791 Jun 18 22:56:31.521770 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3407/6792] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:31 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:32.542207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:32.543113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:32.553813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:32.554473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:32.555584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:32.557104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:32.728529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:32.738040 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-493f61de-65a5-4d53-a794-0d38844460d6 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.201555 Jun 18 22:56:32.738627 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3386/6793] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:32 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:33.760896 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:33.761509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:33.769018 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:33.769510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:33.770297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:33.770743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:33.932875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:33.946153 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fffa989-c4fe-458a-953d-bbb1423af362 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1755 microversion: 2.1 time: 0.188977 Jun 18 22:56:33.946984 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3408/6794] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:33 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:56:34.968579 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:56:34.969693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:56:34.978693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:34.979147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:34.979916 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:56:34.980354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:56:35.131096 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:56:35.139971 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9cb5f055-6cee-4f75-94df-28c3141d15cd tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1758 microversion: 2.1 time: 0.178461 Jun 18 22:56:35.140537 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3387/6795] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:56:34 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:07.341778 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1070441691"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:07.342386 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:07.344952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:07.345658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:07.351851 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:07.352319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:07.353140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:07.353600 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:07.616721 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.network.security_group_api [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Removing security group 10331632-e8cc-48e4-86dc-65d2707a9af8 from port 8f061a43-ec54-465e-b212-b09ded6adfcb Jun 18 22:57:07.961890 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b36473e6-8335-4533-a989-8165e3029f33 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/action" status: 202 len: 0 microversion: 2.1 time: 0.627444 Jun 18 22:57:07.963521 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3409/6796] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:57:07 2022] POST /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:57:07.971650 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-31c0c842-6dfd-41ba-ab97-ec5b2abc4095 req-a4aff41d-5478-4cf2-9a8b-ea4f1371149f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:07.982123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:07.983392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=48 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:07.986996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-31c0c842-6dfd-41ba-ab97-ec5b2abc4095 req-a4aff41d-5478-4cf2-9a8b-ea4f1371149f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:07.987805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-31c0c842-6dfd-41ba-ab97-ec5b2abc4095 req-a4aff41d-5478-4cf2-9a8b-ea4f1371149f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:08.024854 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-31c0c842-6dfd-41ba-ab97-ec5b2abc4095 req-a4aff41d-5478-4cf2-9a8b-ea4f1371149f service nova] Creating event network-changed:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:57:08.031601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-31c0c842-6dfd-41ba-ab97-ec5b2abc4095 req-a4aff41d-5478-4cf2-9a8b-ea4f1371149f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064894 Jun 18 22:57:08.032223 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3388/6797] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:57:09.186271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:09.186843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:09.193295 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:09.193766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:09.194559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:09.195000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:09.279225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lazy-loading 'services' on Instance uuid 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:57:09.355328 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f95a806c-219a-4c08-b6db-1f68a3145f00 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments/26b856df-e6aa-433f-b188-fe21b8474789" status: 202 len: 0 microversion: 2.1 time: 0.173995 Jun 18 22:57:09.355934 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3410/6798] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:57:09 2022] DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments/26b856df-e6aa-433f-b188-fe21b8474789 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:57:09.366136 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:09.367308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:09.375338 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:09.375828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:09.377344 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:09.377875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:09.411277 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2cfe800e-abf7-432b-aaec-f072abb39913 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050366 Jun 18 22:57:09.411938 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3389/6799] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:57:09 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:57:10.050350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-1bc31f8b-1bde-445a-8703-90cb1d5972fd req-821e587c-64b6-4855-8674-460c12d09f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:10.059643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bc31f8b-1bde-445a-8703-90cb1d5972fd req-821e587c-64b6-4855-8674-460c12d09f34 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:10.060103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-1bc31f8b-1bde-445a-8703-90cb1d5972fd req-821e587c-64b6-4855-8674-460c12d09f34 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:10.073465 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-1bc31f8b-1bde-445a-8703-90cb1d5972fd req-821e587c-64b6-4855-8674-460c12d09f34 service nova] Creating event network-changed:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:57:10.078730 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-1bc31f8b-1bde-445a-8703-90cb1d5972fd req-821e587c-64b6-4855-8674-460c12d09f34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032734 Jun 18 22:57:10.079358 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3411/6800] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:57:10.423549 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:10.425189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:10.432629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:10.433140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:10.433908 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:10.434331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:10.464430 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a7044495-f0f4-41a6-9267-140017d94dc7 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044908 Jun 18 22:57:10.465007 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3390/6801] 10.222.0.30 () {58 vars in 1301 bytes} [Sat Jun 18 22:57:10 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 18 22:57:10.477533 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:10.478173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:10.485710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:10.486179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:10.487631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:10.488089 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:10.564382 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] HTTP exception thrown: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f is not attached to volume 26b856df-e6aa-433f-b188-fe21b8474789 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Request method failure captured: Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: request: DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments/26b856df-e6aa-433f-b188-fe21b8474789 HTTP/1.1 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlfOvWhVg1Y7u57FoZ5GsCnUhhKsdECDzUDNijnWcYglMx8GlZLov0B44nWjNTe9gR9gPqHiacajMsQ9yAkOoQv6oh4A0SyCdjsNyyqDN7fIEQ6dpRlAKYjacXSbLLRQ2Qkrd6mn4s9MPD-2rg6kRMaMC_VJbedtYGJsCh59p0zp7Us Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: f576ae59a362455993f77dfdb870e37a Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestMinimumBasicScenario-154202770 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f576ae59a362455993f77dfdb870e37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f576ae59a362455993f77dfdb870e37a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f576ae59a362455993f77dfdb870e37a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f576ae59a362455993f77dfdb870e37a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestMinimumBasicScenario-154202770 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: f576ae59a362455993f77dfdb870e37a Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestMinimumBasicScenario-154202770 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestMinimumBasicScenario-154202770-project Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c544eb954e434fbda5d92667d6f4a2a8 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestMinimumBasicScenario-154202770-project Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f is not attached to volume 26b856df-e6aa-433f-b188-fe21b8474789 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'server_id': '2d94bf5b-7e8b-45c6-9f11-3691f5c8314f', 'id': '26b856df-e6aa-433f-b188-fe21b8474789'} Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 26b856df-e6aa-433f-b188-fe21b8474789. Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f is not attached to volume 26b856df-e6aa-433f-b188-fe21b8474789 Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:57:10.570488 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f is not attached to volume 26b856df-e6aa-433f-b188-fe21b8474789 Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Returning 404 to user: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f is not attached to volume 26b856df-e6aa-433f-b188-fe21b8474789 {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3305d18-3539-4d0d-bea8-64829d3702ff tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments/26b856df-e6aa-433f-b188-fe21b8474789" status: 404 len: 154 microversion: 2.1 time: 0.100131 Jun 18 22:57:10.574754 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3412/6802] 10.222.0.30 () {58 vars in 1415 bytes} [Sat Jun 18 22:57:10 2022] DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f/os-volume_attachments/26b856df-e6aa-433f-b188-fe21b8474789 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:57:11.717984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:11.718740 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:11.725993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:11.726440 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:11.727186 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:11.727642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:11.753432 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:57:11.834609 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f506c715-593e-4cf4-8f03-8dc4357d492a tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 204 len: 0 microversion: 2.1 time: 0.121768 Jun 18 22:57:11.835170 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3391/6803] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:57:11 2022] DELETE /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:57:11.844176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:11.844809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:11.852953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:11.853480 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:11.854267 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:11.854722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:11.987808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:11.995667 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-092cc0a3-f632-4b42-80b4-452f1d6c4b52 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1552 microversion: 2.1 time: 0.155910 Jun 18 22:57:11.996238 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3413/6804] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:11 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:13.019078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:13.020341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:13.032544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:13.033014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:13.033878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:13.034327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:13.229840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:13.239680 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1b52b3ce-971a-44e7-9e95-fcc3758e61c3 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1552 microversion: 2.1 time: 0.227885 Jun 18 22:57:13.240279 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3392/6805] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:13 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:13.955093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8812486f-3bee-4153-b783-f867e0d4b972 req-34ef1fa0-3798-4913-8738-96f5a2423e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d94bf5b-7e8b-45c6-9f11-3691f5c8314f", "name": "network-vif-deleted", "tag": "8f061a43-ec54-465e-b212-b09ded6adfcb"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:13.964727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8812486f-3bee-4153-b783-f867e0d4b972 req-34ef1fa0-3798-4913-8738-96f5a2423e3c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:13.965550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8812486f-3bee-4153-b783-f867e0d4b972 req-34ef1fa0-3798-4913-8738-96f5a2423e3c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:13.977973 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8812486f-3bee-4153-b783-f867e0d4b972 req-34ef1fa0-3798-4913-8738-96f5a2423e3c service nova] Creating event network-vif-deleted:8f061a43-ec54-465e-b212-b09ded6adfcb for instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f on nch2-master-1 Jun 18 22:57:13.983860 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8812486f-3bee-4153-b783-f867e0d4b972 req-34ef1fa0-3798-4913-8738-96f5a2423e3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032556 Jun 18 22:57:13.984494 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3414/6806] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:57:14.259857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:14.261416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:14.271068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:14.271646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:14.272442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:14.272890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:14.319188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:14.319674 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:14.320107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lazy-loading 'fault' on Instance uuid 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 22:57:14.366205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544eb954e434fbda5d92667d6f4a2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f576ae59a362455993f77dfdb870e37a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:14.374539 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-07106218-e312-40e7-9eee-0dbb883f2dcc tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 200 len: 1346 microversion: 2.1 time: 0.120474 Jun 18 22:57:14.375416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3393/6807] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:14 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:15.397373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:15.398418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] [instance: 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:15.409510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:15.409979 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:15.410986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:15.411449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:15.425600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] HTTP exception thrown: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f could not be found. Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Request method failure captured: Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f HTTP/1.1 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlfOvWhVg1Y7u57FoZ5GsCnUhhKsdECDzUDNijnWcYglMx8GlZLov0B44nWjNTe9gR9gPqHiacajMsQ9yAkOoQv6oh4A0SyCdjsNyyqDN7fIEQ6dpRlAKYjacXSbLLRQ2Qkrd6mn4s9MPD-2rg6kRMaMC_VJbedtYGJsCh59p0zp7Us Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: f576ae59a362455993f77dfdb870e37a Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestMinimumBasicScenario-154202770 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f576ae59a362455993f77dfdb870e37a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f576ae59a362455993f77dfdb870e37a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f576ae59a362455993f77dfdb870e37a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f576ae59a362455993f77dfdb870e37a", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestMinimumBasicScenario-154202770 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: f576ae59a362455993f77dfdb870e37a Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestMinimumBasicScenario-154202770 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestMinimumBasicScenario-154202770-project Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: c544eb954e434fbda5d92667d6f4a2a8 Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestMinimumBasicScenario-154202770-project Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f could not be found. Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '2d94bf5b-7e8b-45c6-9f11-3691f5c8314f'} Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f could not be found. Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f could not be found. Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:57:15.427291 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f could not be found. Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Returning 404 to user: Instance 2d94bf5b-7e8b-45c6-9f11-3691f5c8314f could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3655ff73-3c9d-47d2-86da-576275ca018c tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f" status: 404 len: 111 microversion: 2.1 time: 0.038874 Jun 18 22:57:15.431946 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3415/6808] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:15 2022] GET /compute/v2.1/servers/2d94bf5b-7e8b-45c6-9f11-3691f5c8314f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:57:15.437928 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c7f2d333-2819-44ff-8d74-876ce1c099e8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] Calling method '.version_select at 0x7fea142fb040>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:15.463718 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c7f2d333-2819-44ff-8d74-876ce1c099e8 tempest-TestMinimumBasicScenario-154202770 tempest-TestMinimumBasicScenario-154202770-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1361581" status: 202 len: 0 microversion: 2.1 time: 0.029639 Jun 18 22:57:15.464280 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3394/6809] 10.222.0.30 () {58 vars in 1262 bytes} [Sat Jun 18 22:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1361581 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:57:25.063915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9bee40e9-a683-4627-aed7-cff5b0531527 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: .version_select at 0x7fea07a5d550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1387141841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLJKKx6MW1Tk6zVnteDbx7wRikrKrGFt+02MkqqQGLUrYbHynAC6uKTT4w1GJQGv9LX2z1Xu0xOGLiet2cYtts1n3Vpk3pL0/myrJI1ACHKhNlJSKoDA6U6MJ1Ow7CA9g=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:25.078610 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9bee40e9-a683-4627-aed7-cff5b0531527 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:57:25.084345 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-9bee40e9-a683-4627-aed7-cff5b0531527 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:57:25.116542 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9bee40e9-a683-4627-aed7-cff5b0531527 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.226013 Jun 18 22:57:25.117176 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3416/6810] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:57:24 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:57:30.886263 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:30.887287 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:30.893844 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1096742738", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1cb2a5f6-f790-4612-be48-8288b9a79dac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1387141841", "security_groups": [{"name": "tempest-secgroup-smoke-274840722"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:31.018059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] validate_networks() for [('1cb2a5f6-f790-4612-be48-8288b9a79dac', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:57:31.492642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:57:31.493578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:57:31.494433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:57:31.495097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:57:31.495604 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:57:31.509297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:31.510306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:31.511343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:31.515071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:31.539129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:57:31.547754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:57:31.566544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:57:31.569684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:57:31.631846 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8fd52330-72ea-4833-a108-57bf0f50bc5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747724 Jun 18 22:57:31.633082 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3395/6811] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:57:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 22:57:31.644017 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-414a5b22-3c26-491f-81a3-6491b9004311 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:31.644766 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-414a5b22-3c26-491f-81a3-6491b9004311 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:31.647728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:31.716684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-414a5b22-3c26-491f-81a3-6491b9004311 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:31.726563 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-414a5b22-3c26-491f-81a3-6491b9004311 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1267 microversion: 2.1 time: 0.085963 Jun 18 22:57:31.727171 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3417/6812] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:31 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:32.754911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:32.755741 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:32.767482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:32.767958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:32.768783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:32.769316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:32.853407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:32.861525 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a399927-1eca-4d5d-8766-63acd0ad4f98 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1319 microversion: 2.1 time: 0.116844 Jun 18 22:57:32.865251 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3396/6813] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:32 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1319 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:33.881506 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:33.882182 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:33.889402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:33.889876 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:33.891166 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:33.892082 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:34.062059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:34.070118 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ed8b432-8077-44d7-9c75-407582dff3c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.194123 Jun 18 22:57:34.070696 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3418/6814] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:33 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:34.484678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-1813611b-0994-4872-b6cc-4f36808b7df1 req-1f0db545-2ba7-4967-a9c9-c9721821b709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3082db37-984e-4570-9d35-ff62347ff230", "tag": "d3957562-cf63-4fef-a5b9-bba95a03d572"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:34.496996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1813611b-0994-4872-b6cc-4f36808b7df1 req-1f0db545-2ba7-4967-a9c9-c9721821b709 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:34.497734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-1813611b-0994-4872-b6cc-4f36808b7df1 req-1f0db545-2ba7-4967-a9c9-c9721821b709 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:34.513749 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-1813611b-0994-4872-b6cc-4f36808b7df1 req-1f0db545-2ba7-4967-a9c9-c9721821b709 service nova] Creating event network-changed:d3957562-cf63-4fef-a5b9-bba95a03d572 for instance 3082db37-984e-4570-9d35-ff62347ff230 on nch1-master-1 Jun 18 22:57:34.519483 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-1813611b-0994-4872-b6cc-4f36808b7df1 req-1f0db545-2ba7-4967-a9c9-c9721821b709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039158 Jun 18 22:57:34.520367 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3397/6815] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:57:35.087390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:35.088049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:35.096407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:35.096881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:35.097755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:35.098210 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:35.236151 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:35.243997 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4e0ef77-1009-4d80-b4af-f8cb4d128916 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.160692 Jun 18 22:57:35.244661 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3419/6816] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:35 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:36.265356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:36.266518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:36.278749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:36.279500 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:36.280815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:36.281558 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:36.426308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:36.434472 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec20380b-e210-4e0a-b17e-1e4ef623c4f9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.176305 Jun 18 22:57:36.435060 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3398/6817] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:36 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:37.452012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:37.452671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:37.455198 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:37.460768 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:37.461273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:37.462040 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:37.462487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:37.612586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:37.620956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b6775696-0bad-42de-89fe-2b2aeb0cc779 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.173128 Jun 18 22:57:37.621579 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3420/6818] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:37 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:38.638784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:38.639401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:38.646847 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:38.647301 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:38.648074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:38.648510 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:38.786313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:38.794336 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b5d4891a-7bd7-4466-b2e4-09cd7c4d354b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.160055 Jun 18 22:57:38.794923 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3399/6819] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:38 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:39.815537 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:39.816644 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:39.828494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:39.829313 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:39.830281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:39.830728 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:39.968897 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:39.977246 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e46f6e84-c570-42ea-980d-1712a8af04e6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.168325 Jun 18 22:57:39.977836 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3421/6820] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:39 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:40.710213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-45f19e03-e2e0-4502-8619-fcd622ccfee9 req-39b7ab8e-bf50-4ac9-b642-79bdf5062f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3082db37-984e-4570-9d35-ff62347ff230", "name": "network-vif-plugged", "status": "completed", "tag": "d3957562-cf63-4fef-a5b9-bba95a03d572"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:40.720250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-45f19e03-e2e0-4502-8619-fcd622ccfee9 req-39b7ab8e-bf50-4ac9-b642-79bdf5062f7a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:40.720250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-45f19e03-e2e0-4502-8619-fcd622ccfee9 req-39b7ab8e-bf50-4ac9-b642-79bdf5062f7a service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:40.732825 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-45f19e03-e2e0-4502-8619-fcd622ccfee9 req-39b7ab8e-bf50-4ac9-b642-79bdf5062f7a service nova] Creating event network-vif-plugged:d3957562-cf63-4fef-a5b9-bba95a03d572 for instance 3082db37-984e-4570-9d35-ff62347ff230 on nch1-master-1 Jun 18 22:57:40.738044 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-45f19e03-e2e0-4502-8619-fcd622ccfee9 req-39b7ab8e-bf50-4ac9-b642-79bdf5062f7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Jun 18 22:57:40.738822 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3400/6821] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:57:40.994580 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:40.995141 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:41.002792 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:41.003271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:41.004071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:41.004588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:41.143565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:41.151793 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e6d669fa-cfea-4f85-b21e-0e39f9ec375a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1392 microversion: 2.1 time: 0.161386 Jun 18 22:57:41.152381 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3422/6822] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:40 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:42.165690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:42.166886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:42.172122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:42.172841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:42.184777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:42.185288 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:42.186323 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:42.186828 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:42.329911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:42.342299 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d44a93ec-fe57-48f9-aef1-0cf7733210cf tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1563 microversion: 2.1 time: 0.177381 Jun 18 22:57:42.343157 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3401/6823] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:42 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:42.360003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:42.360633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:42.362578 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:57:42.368860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:42.369381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:42.370178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:42.370627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:42.503821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:42.511989 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c2784097-4e18-4c6a-8e94-0940685780e1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1563 microversion: 2.1 time: 0.155886 Jun 18 22:57:42.512575 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3423/6824] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:42 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:57:44.125894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:57:44.126594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:57:44.127497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2427cc23-6933-4efc-9343-dd218297ba47 req-ade6df91-e4c6-4f13-a924-6ebeb412688d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3082db37-984e-4570-9d35-ff62347ff230", "tag": "d3957562-cf63-4fef-a5b9-bba95a03d572"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:57:44.133703 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:44.134254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:44.135110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:44.135620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:44.137086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2427cc23-6933-4efc-9343-dd218297ba47 req-ade6df91-e4c6-4f13-a924-6ebeb412688d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:57:44.137562 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2427cc23-6933-4efc-9343-dd218297ba47 req-ade6df91-e4c6-4f13-a924-6ebeb412688d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:57:44.149413 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2427cc23-6933-4efc-9343-dd218297ba47 req-ade6df91-e4c6-4f13-a924-6ebeb412688d service nova] Creating event network-changed:d3957562-cf63-4fef-a5b9-bba95a03d572 for instance 3082db37-984e-4570-9d35-ff62347ff230 on nch1-master-1 Jun 18 22:57:44.155122 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2427cc23-6933-4efc-9343-dd218297ba47 req-ade6df91-e4c6-4f13-a924-6ebeb412688d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032659 Jun 18 22:57:44.155729 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3424/6825] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 22:57:44.280872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:57:44.290776 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f4515550-4048-43ea-b232-0e7475af3679 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1563 microversion: 2.1 time: 0.170487 Jun 18 22:57:44.291714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3402/6826] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:57:44 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:17.637068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=9 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:17.637875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=38 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:17.642916 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:58:17.643971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:17.651886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:17.652354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:17.653547 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:17.654012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:17.705370 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a6b7f6c1-ad57-4183-94db-e90b276f6dd4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action" status: 200 len: 24570 microversion: 2.1 time: 0.070514 Jun 18 22:58:17.706262 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3425/6827] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:58:17 2022] POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action => generated 24570 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:58:48.129830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:48.131009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=36 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:48.137504 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:58:48.138387 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:48.146962 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:48.147426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:48.148190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:48.148622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:48.224411 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-71add0b9-3010-4e2f-82b3-e374a4e7f061 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action" status: 202 len: 0 microversion: 2.1 time: 0.097611 Jun 18 22:58:48.225323 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3403/6828] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:58:48 2022] POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:58:48.234428 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:48.235144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:48.238203 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:48.238892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:58:48.244657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:48.245194 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:48.246075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:48.246516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:48.392328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:48.400259 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8c0362f6-d062-40d3-adab-89154b9d4219 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1686 microversion: 2.1 time: 0.170240 Jun 18 22:58:48.405473 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3426/6829] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:48 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:49.423878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:49.424596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:49.432327 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:49.432785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:49.433598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:49.434047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:49.570247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:49.578116 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9a49d616-6307-4725-b3fd-4bdd9115482c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1666 microversion: 2.1 time: 0.161685 Jun 18 22:58:49.578700 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3404/6830] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:49 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:50.679262 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:58:50.680846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:50.691745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:50.692220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:50.693019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:50.693513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:50.745256 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-47ff0a1a-3bc3-40d9-a473-a33c7ba4ba71 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action" status: 200 len: 32642 microversion: 2.1 time: 0.073350 Jun 18 22:58:50.745925 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3427/6831] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:58:50 2022] POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action => generated 32642 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:58:50.757472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:58:50.758035 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:50.765390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:50.765850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:50.766679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:50.767123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:50.840154 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-722a9db7-9bcf-4500-8de9-06e4aa31fa3a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action" status: 202 len: 0 microversion: 2.1 time: 0.086116 Jun 18 22:58:50.841413 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3405/6832] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:58:50 2022] POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:58:50.850549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:50.851481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:50.859167 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:50.859626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:50.860411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:50.860886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:50.996658 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:51.009162 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0c7d1f42-617d-4fba-9bcf-547b13da574b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1673 microversion: 2.1 time: 0.162623 Jun 18 22:58:51.009996 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3428/6833] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:50 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:52.033925 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:52.034636 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:52.041781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:52.042247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:52.043038 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:52.043520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:52.184521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:52.192993 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-72ed4e7c-2f73-46c0-95d6-b45afdb53288 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1673 microversion: 2.1 time: 0.167710 Jun 18 22:58:52.193676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3406/6834] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:52 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:53.214777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:53.216252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:53.228024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:53.228801 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:53.230160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:53.230917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:53.366830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:53.374859 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a2bcfce-c5a5-48a3-9b2f-bbbf4a10958c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1673 microversion: 2.1 time: 0.166850 Jun 18 22:58:53.375440 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3429/6835] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:53 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:54.398088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:54.398956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:54.409922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:54.410376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:54.411156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:54.411603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:54.560430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:54.568376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1ad62f5a-85a8-4d91-b998-daf726944008 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1673 microversion: 2.1 time: 0.177240 Jun 18 22:58:54.568964 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3407/6836] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:54 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:55.589983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:55.591240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:55.603378 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:55.604145 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:55.605540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:55.606290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:55.747099 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:55.755383 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3e90760-977c-4607-8b53-ae80737a36c7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1673 microversion: 2.1 time: 0.172179 Jun 18 22:58:55.755971 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3430/6837] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:55 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:56.776307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:56.777380 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:56.787097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:56.787480 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:56.788247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:56.788683 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:56.920781 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:56.930777 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8a0a4506-9b26-4d9b-a8b8-b42d747adca0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1681 microversion: 2.1 time: 0.160759 Jun 18 22:58:56.931429 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3408/6838] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:56 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:58:57.038874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:58:57.039780 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:57.047197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:57.047666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:57.048462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:57.048977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:57.099058 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b11eaff0-b693-49c6-9beb-bc70394a21c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action" status: 200 len: 38602 microversion: 2.1 time: 0.064182 Jun 18 22:58:57.099696 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3431/6839] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:58:57 2022] POST /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230/action => generated 38602 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:58:58.443862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:58.444389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:58.451814 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:58.452262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:58.453057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:58.453497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:58.483201 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 22:58:58.523624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ae30fc45-21b5-4ff1-98c6-454a8137ef17 req-148bd1be-ffc8-4ae4-9ce5-0eb2776bafaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3082db37-984e-4570-9d35-ff62347ff230", "tag": "d3957562-cf63-4fef-a5b9-bba95a03d572"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:58:58.533359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ae30fc45-21b5-4ff1-98c6-454a8137ef17 req-148bd1be-ffc8-4ae4-9ce5-0eb2776bafaa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:58.533564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ae30fc45-21b5-4ff1-98c6-454a8137ef17 req-148bd1be-ffc8-4ae4-9ce5-0eb2776bafaa service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:58.545375 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ae30fc45-21b5-4ff1-98c6-454a8137ef17 req-148bd1be-ffc8-4ae4-9ce5-0eb2776bafaa service nova] Creating event network-changed:d3957562-cf63-4fef-a5b9-bba95a03d572 for instance 3082db37-984e-4570-9d35-ff62347ff230 on nch1-master-1 Jun 18 22:58:58.552718 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ae30fc45-21b5-4ff1-98c6-454a8137ef17 req-148bd1be-ffc8-4ae4-9ce5-0eb2776bafaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117200 Jun 18 22:58:58.553707 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3432/6840] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:58:58.572344 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-75282a23-8ce4-41cd-a4e7-6cc5c6325eb3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 204 len: 0 microversion: 2.1 time: 0.138943 Jun 18 22:58:58.573602 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3409/6841] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 22:58:58 2022] DELETE /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 22:58:58.583195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:58.584063 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:58.591258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:58.591827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:58.592695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:58.593249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:58.732028 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:58.740073 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c562808f-46ab-4034-a235-7d361d631c0f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1687 microversion: 2.1 time: 0.161574 Jun 18 22:58:58.740674 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3433/6842] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:58 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 22:58:59.763704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:58:59.764869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:58:59.776731 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:59.777539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:59.778804 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:58:59.779539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:58:59.920156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:58:59.928474 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d2dba11-f62e-4a0a-98ae-080d6aa04baa tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1687 microversion: 2.1 time: 0.172420 Jun 18 22:58:59.929311 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3410/6843] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:58:59 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:00.945905 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:00.946850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:00.954315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:00.955039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:00.956455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:00.957341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:00.974924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b3b8adcf-98ee-415b-bdb2-691612f40002 req-a401a1bc-d6c0-451b-97bb-a76e54b5fb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3082db37-984e-4570-9d35-ff62347ff230", "name": "network-vif-deleted", "tag": "d3957562-cf63-4fef-a5b9-bba95a03d572"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:00.987246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b3b8adcf-98ee-415b-bdb2-691612f40002 req-a401a1bc-d6c0-451b-97bb-a76e54b5fb49 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:00.987971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b3b8adcf-98ee-415b-bdb2-691612f40002 req-a401a1bc-d6c0-451b-97bb-a76e54b5fb49 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:01.002794 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b3b8adcf-98ee-415b-bdb2-691612f40002 req-a401a1bc-d6c0-451b-97bb-a76e54b5fb49 service nova] Creating event network-vif-deleted:d3957562-cf63-4fef-a5b9-bba95a03d572 for instance 3082db37-984e-4570-9d35-ff62347ff230 on nch1-master-1 Jun 18 22:59:01.010081 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b3b8adcf-98ee-415b-bdb2-691612f40002 req-a401a1bc-d6c0-451b-97bb-a76e54b5fb49 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114966 Jun 18 22:59:01.011425 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3434/6844] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:59:01.028076 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:01.036726 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-96fb7bb3-269c-4e79-a3cc-791b9c6ec32c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 200 len: 1352 microversion: 2.1 time: 0.094326 Jun 18 22:59:01.036861 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3411/6845] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:00 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:02.054231 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:02.054956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 3082db37-984e-4570-9d35-ff62347ff230] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:02.062605 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:02.063068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:02.063863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:02.064376 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:02.078061 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] HTTP exception thrown: Instance 3082db37-984e-4570-9d35-ff62347ff230 could not be found. Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Request method failure captured: Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 HTTP/1.1 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlhU4oMrKLkrpAGiGgBHWqB4pySBW52_d972INf4aVrthBn3v_vJg6rRpwOVwVaY7rEhuUUvhltf5kiiBAvpqNN2bHK72eIzZhzmnavSzf0mJzikbhzZsx-BZ2w4MAZFAFYm7QGHI92JDNLtsIU3gZX9VLTzSDSASSAObIS-Bm5LvEM Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ec0cfc75efa4bb1a32bd2a7a44e3390", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: b1e8d5153b9345ee9619fc6dfe6a1033 Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 3082db37-984e-4570-9d35-ff62347ff230 could not be found. Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '3082db37-984e-4570-9d35-ff62347ff230'} Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3082db37-984e-4570-9d35-ff62347ff230 could not be found. Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3082db37-984e-4570-9d35-ff62347ff230 could not be found. Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 22:59:02.079743 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3082db37-984e-4570-9d35-ff62347ff230 could not be found. Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Returning 404 to user: Instance 3082db37-984e-4570-9d35-ff62347ff230 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cde40dde-2494-4dc6-90ae-cada6103fb3b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230" status: 404 len: 111 microversion: 2.1 time: 0.031331 Jun 18 22:59:02.085278 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3435/6846] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:02 2022] GET /compute/v2.1/servers/3082db37-984e-4570-9d35-ff62347ff230 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 22:59:05.116983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d09d0b9f-711a-4bd7-abf4-07c45f107956 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '.version_select at 0x7fea14c32ca0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:05.141949 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d09d0b9f-711a-4bd7-abf4-07c45f107956 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1387141841" status: 202 len: 0 microversion: 2.1 time: 0.038042 Jun 18 22:59:05.143115 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3412/6847] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Jun 18 22:59:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1387141841 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:59:05.170738 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-72eb42a2-c57b-4eff-8471-57658b66ff90 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: .version_select at 0x7fea07a5ddc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1618683137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZCpHsPHrVwiCreUsSlhgKTBkoKq21MEKaMWlLQe/YcnJKsIAvDZ8kwHjanQ42Nlg7mE9JIq/D4RTbKUWtLVtE11EzFpDmkBp/WIwluV4X4sjrjaml4bTVwMtZ+NPxTZg=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:05.185653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-72eb42a2-c57b-4eff-8471-57658b66ff90 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:59:05.191630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-72eb42a2-c57b-4eff-8471-57658b66ff90 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:59:05.217801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-72eb42a2-c57b-4eff-8471-57658b66ff90 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051014 Jun 18 22:59:05.218440 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3436/6848] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 22:59:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:59:11.259169 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:11.263773 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1602512620", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "b4f77dcf-7818-46c2-b87c-2d7eb7555334"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1618683137", "security_groups": [{"name": "tempest-secgroup-smoke-1176000799"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:11.389109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] validate_networks() for [('b4f77dcf-7818-46c2-b87c-2d7eb7555334', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 22:59:11.794197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 22:59:11.794704 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 22:59:11.795267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 22:59:11.795762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 22:59:11.796277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 22:59:11.805859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:11.806321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:11.807142 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:11.807591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:11.826678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 22:59:11.833949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 22:59:11.847183 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 22:59:11.849533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 22:59:11.898658 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d34941a7-050f-44a9-bdfc-ea44951b51d3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641309 Jun 18 22:59:11.899597 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3413/6849] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 22:59:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 22:59:11.910826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-030633cc-2421-458e-b990-5f7121467d04 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:11.911469 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-030633cc-2421-458e-b990-5f7121467d04 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:11.967828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-030633cc-2421-458e-b990-5f7121467d04 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:11.975307 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-030633cc-2421-458e-b990-5f7121467d04 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1267 microversion: 2.1 time: 0.069449 Jun 18 22:59:11.976630 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3437/6850] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:11 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:12.993222 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:12.994627 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:13.002675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:13.003264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:13.004171 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:13.004733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:13.173584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:13.182540 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-213dce15-4e4a-4e3b-a1d8-c82e5cdf38f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1327 microversion: 2.1 time: 0.194361 Jun 18 22:59:13.185098 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3414/6851] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:12 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1327 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:14.200039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:14.200695 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:14.203173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=44 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:14.210561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:14.211026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:14.211832 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:14.212286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:14.471867 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:14.481457 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3d68e960-01c1-4605-a0a1-e5d7236f3d4c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1393 microversion: 2.1 time: 0.285119 Jun 18 22:59:14.482338 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3438/6852] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:14 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1393 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:14.543381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-dd6c41ff-9afc-4452-9036-e56c4a2c9957 req-e23bc826-5061-49c4-9e92-de220e8c8bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127ea5c4-baad-486d-bba0-8665c6523473", "tag": "aa208f99-14d8-4dc9-9734-b49313d8eef8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:14.560537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dd6c41ff-9afc-4452-9036-e56c4a2c9957 req-e23bc826-5061-49c4-9e92-de220e8c8bcc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:14.560817 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-dd6c41ff-9afc-4452-9036-e56c4a2c9957 req-e23bc826-5061-49c4-9e92-de220e8c8bcc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:14.578803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-dd6c41ff-9afc-4452-9036-e56c4a2c9957 req-e23bc826-5061-49c4-9e92-de220e8c8bcc service nova] Creating event network-changed:aa208f99-14d8-4dc9-9734-b49313d8eef8 for instance 127ea5c4-baad-486d-bba0-8665c6523473 on nch2-master-1 Jun 18 22:59:14.584721 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-dd6c41ff-9afc-4452-9036-e56c4a2c9957 req-e23bc826-5061-49c4-9e92-de220e8c8bcc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045483 Jun 18 22:59:14.585665 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3415/6853] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:59:15.499663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:15.500268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:15.507934 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:15.508407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:15.509241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:15.509700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:15.648560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:15.656994 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-91e6ef54-9119-4731-920c-17177134deca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1393 microversion: 2.1 time: 0.161312 Jun 18 22:59:15.657608 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3439/6854] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:15 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:16.675836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:16.676578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:16.684512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:16.685057 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:16.685869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:16.686329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:16.830469 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:16.838781 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-dabf79a4-6020-4049-b1dc-8d3996f5939e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1393 microversion: 2.1 time: 0.168380 Jun 18 22:59:16.839378 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3416/6855] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:16 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:17.856823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:17.857484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:17.865078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:17.865565 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:17.866361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:17.866823 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:18.091908 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:18.099682 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-953d135a-8a5b-4445-8a9c-d54c70de1322 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1393 microversion: 2.1 time: 0.246913 Jun 18 22:59:18.100252 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3440/6856] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:17 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:19.119617 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:19.120216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:19.124139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:19.130023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:19.130478 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:19.131252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:19.131691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:19.360810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:19.369461 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fc6ade44-dd9c-4cb4-a0ed-0e88f9670ce0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1393 microversion: 2.1 time: 0.255776 Jun 18 22:59:19.370050 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3417/6857] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:19 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1393 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:20.312116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-61bf2378-4d35-49d5-b1c1-580df04a9385 req-f5c79714-0103-495d-84c0-c3de1134f143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ea5c4-baad-486d-bba0-8665c6523473", "name": "network-vif-plugged", "status": "completed", "tag": "aa208f99-14d8-4dc9-9734-b49313d8eef8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:20.323840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:20.332358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61bf2378-4d35-49d5-b1c1-580df04a9385 req-f5c79714-0103-495d-84c0-c3de1134f143 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:20.332818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-61bf2378-4d35-49d5-b1c1-580df04a9385 req-f5c79714-0103-495d-84c0-c3de1134f143 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:20.346050 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-61bf2378-4d35-49d5-b1c1-580df04a9385 req-f5c79714-0103-495d-84c0-c3de1134f143 service nova] Creating event network-vif-plugged:aa208f99-14d8-4dc9-9734-b49313d8eef8 for instance 127ea5c4-baad-486d-bba0-8665c6523473 on nch2-master-1 Jun 18 22:59:20.351490 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-61bf2378-4d35-49d5-b1c1-580df04a9385 req-f5c79714-0103-495d-84c0-c3de1134f143 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104424 Jun 18 22:59:20.352176 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3441/6858] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:59:20.386370 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:20.387433 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:20.396149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:20.396597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:20.397401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:20.397838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:20.536152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:20.544040 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d872a601-d1f7-4e0c-8887-c92f681e4e76 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1393 microversion: 2.1 time: 0.162366 Jun 18 22:59:20.544612 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3418/6859] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:20 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:21.562399 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:21.563031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:21.569977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:21.570667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:21.571682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:21.572218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:21.712921 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:21.723684 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b57f0c97-a402-47dc-aced-eb38309cb0c5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1566 microversion: 2.1 time: 0.166605 Jun 18 22:59:21.724265 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3442/6860] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:21 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:21.740250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:21.740872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:21.748162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:21.748619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:21.749417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:21.749852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:21.815235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:21.841149 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:21.896915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:21.906220 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2aa03102-6295-4c0e-bc03-2f75c15187b0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1566 microversion: 2.1 time: 0.170043 Jun 18 22:59:21.906893 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3419/6861] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:21 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:23.845683 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:23.846375 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:23.847614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-9926e47b-129c-4b63-bbc7-462c9365ed10 req-f6de56d5-5b4b-4ebd-be46-5879c5357cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127ea5c4-baad-486d-bba0-8665c6523473", "tag": "aa208f99-14d8-4dc9-9734-b49313d8eef8"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:23.852000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:23.855059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:23.855488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:23.856636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:23.857338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:23.858355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9926e47b-129c-4b63-bbc7-462c9365ed10 req-f6de56d5-5b4b-4ebd-be46-5879c5357cb9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:23.858873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-9926e47b-129c-4b63-bbc7-462c9365ed10 req-f6de56d5-5b4b-4ebd-be46-5879c5357cb9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:23.871063 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-9926e47b-129c-4b63-bbc7-462c9365ed10 req-f6de56d5-5b4b-4ebd-be46-5879c5357cb9 service nova] Creating event network-changed:aa208f99-14d8-4dc9-9734-b49313d8eef8 for instance 127ea5c4-baad-486d-bba0-8665c6523473 on nch2-master-1 Jun 18 22:59:23.877271 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-9926e47b-129c-4b63-bbc7-462c9365ed10 req-f6de56d5-5b4b-4ebd-be46-5879c5357cb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034197 Jun 18 22:59:23.878509 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3420/6862] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 22:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 22:59:23.999244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:24.007386 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-85283786-63bc-4b87-a626-f1467da1ebf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1566 microversion: 2.1 time: 0.166593 Jun 18 22:59:24.013242 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3443/6863] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:23 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:34.455244 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 22:59:34.456370 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 22:59:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 22:59:47.290642 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:47.291830 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:47.295332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=7 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:47.296083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=36 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:47.304227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:47.304677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:47.305483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:47.305918 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:47.366342 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4170903e-8d88-43e1-9b57-6c41da498760 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473/action" status: 200 len: 24574 microversion: 2.1 time: 0.080635 Jun 18 22:59:47.366889 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3421/6864] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:59:47 2022] POST /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473/action => generated 24574 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 22:59:53.770133 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 22:59:53.771720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:53.774255 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=5 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:53.774986 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=32 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 22:59:53.780840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:53.781334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:53.782118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:53.782569 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:53.862520 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c70bd904-a9dd-4570-bdd9-617a217038f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473/action" status: 202 len: 0 microversion: 2.1 time: 0.099882 Jun 18 22:59:53.863178 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3444/6865] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 22:59:53 2022] POST /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 22:59:53.873293 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:53.874014 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:53.882117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:53.882581 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:53.883369 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:53.883818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:54.023084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:54.030880 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cb17151a-cb4f-46cb-96c7-d93a2490e925 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1677 microversion: 2.1 time: 0.161898 Jun 18 22:59:54.031683 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3422/6866] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:53 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:55.050094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:55.050809 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:55.057920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:55.058383 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:55.059225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:55.059701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:55.206140 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:55.216028 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0a01d212-a55b-45fd-a016-869311bb5ec9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.171093 Jun 18 22:59:55.216615 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3445/6867] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:55 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:56.238462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:56.239446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:56.251957 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:56.252409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:56.253216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:56.253649 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:56.392638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:56.405227 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f89924d-f4f4-4509-9936-868ca6535290 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.173075 Jun 18 22:59:56.406097 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3423/6868] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:56 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:57.422918 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:57.423498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:57.431558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:57.431981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:57.432881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:57.433422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:57.574123 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:57.581951 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e565dcc1-8962-4d11-9581-6ef36fbbce96 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.163056 Jun 18 22:59:57.582501 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3446/6869] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:57 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:58.601693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:58.602622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:58.612067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:58.612678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:58.613725 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:58.614296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:58.767074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:58.775359 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b8ca9be5-c1ad-49f9-a032-69516666ebed tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.178703 Jun 18 22:59:58.775991 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3424/6870] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:58 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 22:59:59.801065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 22:59:59.802800 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 22:59:59.812716 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:59.813214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:59.814034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 22:59:59.814453 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 22:59:59.955899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 22:59:59.964088 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-aed8f1fb-5c94-474b-98d7-8448ffdbb831 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.174564 Jun 18 22:59:59.964658 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3447/6871] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 22:59:59 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:00.984306 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:00.984973 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:00.993381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:00.993885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:00.994745 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:00.995234 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:01.136492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:01.148185 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-43695ac6-13c7-484b-bfeb-dec4b0c57ed5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.168390 Jun 18 23:00:01.149389 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3425/6872] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:00 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:02.170027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:02.171059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:02.182943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:02.183410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:02.184205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:02.184661 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:02.322643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:02.330676 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3272bdb6-4c73-41ab-b98a-a9380fe5cce4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.167324 Jun 18 23:00:02.331248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3448/6873] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:02 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:03.351796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:03.352861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:03.364848 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:03.365654 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:03.366915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:03.367641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:03.519700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:03.528057 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e327fd56-cd13-4560-9877-4ba7cfc6d11b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.182862 Jun 18 23:00:03.528633 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3426/6874] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:03 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:04.550065 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:04.551087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:04.563814 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:04.564591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:04.565951 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:04.566712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:04.702335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:04.710374 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5fce399d-fee5-4abf-9e4c-176bff9cf062 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1682 microversion: 2.1 time: 0.167043 Jun 18 23:00:04.710955 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3449/6875] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:04 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:05.732100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:05.733117 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:05.745373 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:05.745826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:05.746603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:05.747047 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:05.892319 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:05.903601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2e8a7ede-8664-4c5c-a32c-736de1903159 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1685 microversion: 2.1 time: 0.178228 Jun 18 23:00:05.904193 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3427/6876] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:05 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:30.114602 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:00:30.115568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:30.118052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:30.118818 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:30.126724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:30.127193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:30.128010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:30.128463 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:30.188461 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2895c032-2b31-4d76-836d-a31b841a2cf1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473/action" status: 200 len: 68995 microversion: 2.1 time: 0.077966 Jun 18 23:00:30.189155 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3450/6877] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:00:30 2022] POST /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473/action => generated 68995 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:00:37.567238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:37.567767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:37.568895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-a74ebe94-3305-4b05-b7b0-0ed488b1b2d7 req-c8ed44ef-4b91-4f18-8d72-52284b21957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127ea5c4-baad-486d-bba0-8665c6523473", "tag": "aa208f99-14d8-4dc9-9734-b49313d8eef8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:00:37.571282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=14 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:37.572123 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=40 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:37.575837 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:37.576427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:37.577258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:37.577700 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:37.583563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a74ebe94-3305-4b05-b7b0-0ed488b1b2d7 req-c8ed44ef-4b91-4f18-8d72-52284b21957e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:37.584020 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-a74ebe94-3305-4b05-b7b0-0ed488b1b2d7 req-c8ed44ef-4b91-4f18-8d72-52284b21957e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:37.612564 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:00:37.622119 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-a74ebe94-3305-4b05-b7b0-0ed488b1b2d7 req-c8ed44ef-4b91-4f18-8d72-52284b21957e service nova] Creating event network-changed:aa208f99-14d8-4dc9-9734-b49313d8eef8 for instance 127ea5c4-baad-486d-bba0-8665c6523473 on nch2-master-1 Jun 18 23:00:37.647556 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-a74ebe94-3305-4b05-b7b0-0ed488b1b2d7 req-c8ed44ef-4b91-4f18-8d72-52284b21957e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083098 Jun 18 23:00:37.648163 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3451/6878] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:00:37.735975 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aaed4072-bc1c-4711-93fd-ee0844eee699 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 204 len: 0 microversion: 2.1 time: 0.175023 Jun 18 23:00:37.741080 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3428/6879] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:00:37 2022] DELETE /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:00:37.749853 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:37.750671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:37.757726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:37.758630 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:37.759430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:37.759968 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:37.944268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:37.953416 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6418cdec-eae1-4178-973c-7d58e597f651 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1691 microversion: 2.1 time: 0.210119 Jun 18 23:00:37.954709 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3452/6880] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:37 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:38.974590 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:38.975308 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:38.982854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:38.983314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:38.984101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:38.984537 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:39.135599 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:39.144093 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fec5da6a-d441-4cb1-8062-39d612551ee3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1691 microversion: 2.1 time: 0.175018 Jun 18 23:00:39.144676 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3429/6881] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:38 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:39.828293 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-24506ce9-3061-47a0-952e-43bb7221f7cf req-61bd154f-c41a-4fdf-9333-85a2ddb4a549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127ea5c4-baad-486d-bba0-8665c6523473", "name": "network-vif-deleted", "tag": "aa208f99-14d8-4dc9-9734-b49313d8eef8"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:00:39.838579 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-24506ce9-3061-47a0-952e-43bb7221f7cf req-61bd154f-c41a-4fdf-9333-85a2ddb4a549 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:39.839159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-24506ce9-3061-47a0-952e-43bb7221f7cf req-61bd154f-c41a-4fdf-9333-85a2ddb4a549 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:39.850168 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-24506ce9-3061-47a0-952e-43bb7221f7cf req-61bd154f-c41a-4fdf-9333-85a2ddb4a549 service nova] Creating event network-vif-deleted:aa208f99-14d8-4dc9-9734-b49313d8eef8 for instance 127ea5c4-baad-486d-bba0-8665c6523473 on nch2-master-1 Jun 18 23:00:39.855484 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-24506ce9-3061-47a0-952e-43bb7221f7cf req-61bd154f-c41a-4fdf-9333-85a2ddb4a549 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084311 Jun 18 23:00:39.856213 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3453/6882] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:00:40.162068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:40.163307 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:40.172429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:40.173170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:40.173991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:40.174796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:40.208543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:40.209065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:40.209551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lazy-loading 'fault' on Instance uuid 127ea5c4-baad-486d-bba0-8665c6523473 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:00:40.250863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:40.258387 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d84756d5-21e8-453a-860a-254890aa453c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 200 len: 1357 microversion: 2.1 time: 0.101171 Jun 18 23:00:40.258942 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3430/6883] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:40 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:41.280487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:41.281367 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 127ea5c4-baad-486d-bba0-8665c6523473] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:41.289888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:41.290400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:41.291270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:41.291777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:41.306956 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] HTTP exception thrown: Instance 127ea5c4-baad-486d-bba0-8665c6523473 could not be found. Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Request method failure captured: Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 HTTP/1.1 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlhU4oMrKLkrpAGiGgBHWqB4pySBW52_d972INf4aVrthBn3v_vJg6rRpwOVwVaY7rEhuUUvhltf5kiiBAvpqNN2bHK72eIzZhzmnavSzf0mJzikbhzZsx-BZ2w4MAZFAFYm7QGHI92JDNLtsIU3gZX9VLTzSDSASSAObIS-Bm5LvEM Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ec0cfc75efa4bb1a32bd2a7a44e3390", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: b1e8d5153b9345ee9619fc6dfe6a1033 Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 127ea5c4-baad-486d-bba0-8665c6523473 could not be found. Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '127ea5c4-baad-486d-bba0-8665c6523473'} Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127ea5c4-baad-486d-bba0-8665c6523473 could not be found. Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127ea5c4-baad-486d-bba0-8665c6523473 could not be found. Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:00:41.308784 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127ea5c4-baad-486d-bba0-8665c6523473 could not be found. Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Returning 404 to user: Instance 127ea5c4-baad-486d-bba0-8665c6523473 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-dd804bb4-936b-444d-8979-129a567dd2bb tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473" status: 404 len: 111 microversion: 2.1 time: 0.036592 Jun 18 23:00:41.314225 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3454/6884] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:41 2022] GET /compute/v2.1/servers/127ea5c4-baad-486d-bba0-8665c6523473 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:00:44.617551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7d339919-8ef7-49dc-90f0-7b41eb08c03d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '.version_select at 0x7fea14c32430>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:44.649811 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7d339919-8ef7-49dc-90f0-7b41eb08c03d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618683137" status: 202 len: 0 microversion: 2.1 time: 0.036628 Jun 18 23:00:44.650416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3431/6885] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Jun 18 23:00:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1618683137 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 18 23:00:44.679361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cc3488ca-ba12-4fb0-a681-3b60175c1bc5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: .version_select at 0x7fea145a11f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-116166501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaK5SAfniH7PC3m3vcanr30lHhFcH5+wqh0ML963USJeNN93rZOpUiOiRgPBHBiONuaU7Tcaize7iCq2KTr2on3NuSfVBYdLtQhj8eoDdD8CwrFfDsRbdYdTD8Hi9HN8Q=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:00:44.701162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cc3488ca-ba12-4fb0-a681-3b60175c1bc5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:00:44.706287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-cc3488ca-ba12-4fb0-a681-3b60175c1bc5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:00:44.732653 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cc3488ca-ba12-4fb0-a681-3b60175c1bc5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057284 Jun 18 23:00:44.733236 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3455/6886] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 23:00:44 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:00:49.996894 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1684108801", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "9841a814-1037-4a12-bd9d-178112d43b7c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-116166501", "security_groups": [{"name": "tempest-secgroup-smoke-2029172257"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:00:50.113297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] validate_networks() for [('9841a814-1037-4a12-bd9d-178112d43b7c', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:00:50.255321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:50.606331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:00:50.607333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:00:50.608728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:00:50.609623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:00:50.610168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:00:50.630497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:50.631544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:50.631995 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:50.632521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:50.655681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:00:50.661867 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:00:50.675501 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:00:50.677836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:00:50.731165 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-9d755c46-3fa9-4f2a-9ce7-f4a2002d082c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.737980 Jun 18 23:00:50.732130 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3432/6887] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:00:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 23:00:50.744370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e670026d-890e-45c9-abee-7849793986db tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:50.745721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e670026d-890e-45c9-abee-7849793986db tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:50.826516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e670026d-890e-45c9-abee-7849793986db tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:50.843834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e670026d-890e-45c9-abee-7849793986db tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1266 microversion: 2.1 time: 0.104703 Jun 18 23:00:50.845070 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3456/6888] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:50 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:00:51.862596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:51.863256 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:51.881620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:51.886334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:51.889641 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:51.890355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:52.024548 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:52.035012 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-989d4607-e8de-461b-91f7-d1f9540e9257 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1326 microversion: 2.1 time: 0.176801 Jun 18 23:00:52.036523 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3433/6889] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:51 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1326 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:53.053287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:53.053849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:53.063327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:00:53.066769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:53.067474 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:53.068478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:53.069404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:53.268500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:53.279728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b9df2044-5682-4e89-a889-7731952ebb6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.230440 Jun 18 23:00:53.283282 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3457/6890] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:53 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:53.976965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-ba5b167c-4d13-400f-8934-3b2257602bdd req-845dadbb-78fb-4c51-89b6-769bd9474181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:00:53.989390 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ba5b167c-4d13-400f-8934-3b2257602bdd req-845dadbb-78fb-4c51-89b6-769bd9474181 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:53.989890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-ba5b167c-4d13-400f-8934-3b2257602bdd req-845dadbb-78fb-4c51-89b6-769bd9474181 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:54.002280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-ba5b167c-4d13-400f-8934-3b2257602bdd req-845dadbb-78fb-4c51-89b6-769bd9474181 service nova] Creating event network-changed:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch1-master-1 Jun 18 23:00:54.007769 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-ba5b167c-4d13-400f-8934-3b2257602bdd req-845dadbb-78fb-4c51-89b6-769bd9474181 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035544 Jun 18 23:00:54.008452 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3434/6891] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:00:54.300325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:54.301221 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:54.308970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:54.309456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:54.310511 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:54.311000 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:54.448393 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:54.456477 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-145bf8fa-eef9-4d2c-9a37-0d31a6e068da tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.160414 Jun 18 23:00:54.457082 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3458/6892] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:54 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:55.480568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:55.481800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:55.492572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:55.493407 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:55.494678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:55.495419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:55.661927 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:55.674142 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f3f92a83-608d-4048-915a-24c9b3fa6dc2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.201882 Jun 18 23:00:55.674998 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3435/6893] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:55 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:56.695179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:56.695757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:56.703157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:56.703622 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:56.704418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:56.704874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:56.848458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:56.856728 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fb737f42-9f36-419c-8745-fbd89a39c8a6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.165643 Jun 18 23:00:56.857364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3459/6894] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:56 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:57.875462 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:57.876098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:57.883796 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:57.884257 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:57.885061 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:57.885534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:58.038481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:58.047583 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a1a5c285-6b26-42fc-8eff-5ea6852544ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.176226 Jun 18 23:00:58.048449 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3436/6895] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:57 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:00:59.064229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:00:59.064868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:00:59.073278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:59.073770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:59.074725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:00:59.075222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:00:59.214309 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:00:59.222775 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-40a4d0bc-88fb-4489-9711-6af3b0f4a2f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.162570 Jun 18 23:00:59.223348 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3460/6896] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:00:59 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:00.240325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:01:00.240917 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:00.248396 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:00.248865 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:00.249685 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:00.250135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:00.388010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:01:00.396383 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-19429f5a-5ebe-4f87-b4e3-fcc2e8503563 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.160157 Jun 18 23:01:00.396979 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3437/6897] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:01:00 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:01.422761 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:01:01.423774 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:01.428128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:01.429509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:01.437636 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:01.438137 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:01.438949 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:01.439391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:01.573296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:01:01.581452 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6f329acb-63f0-47ed-9813-4217ba7e8481 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.165314 Jun 18 23:01:01.582112 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3461/6898] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:01:01 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:01.780818 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:01.781776 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:01.832051 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-fe2b6a0d-5fb8-42b6-b617-9375b2293079 req-f84dda75-48db-4ae9-a44d-e5e2539adf61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "name": "network-vif-plugged", "status": "completed", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:01:01.842005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fe2b6a0d-5fb8-42b6-b617-9375b2293079 req-f84dda75-48db-4ae9-a44d-e5e2539adf61 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:01.842460 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fe2b6a0d-5fb8-42b6-b617-9375b2293079 req-f84dda75-48db-4ae9-a44d-e5e2539adf61 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:01.853806 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-fe2b6a0d-5fb8-42b6-b617-9375b2293079 req-f84dda75-48db-4ae9-a44d-e5e2539adf61 service nova] Creating event network-vif-plugged:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch1-master-1 Jun 18 23:01:01.859296 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-fe2b6a0d-5fb8-42b6-b617-9375b2293079 req-f84dda75-48db-4ae9-a44d-e5e2539adf61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083327 Jun 18 23:01:01.859900 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3438/6899] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:01:02.603291 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:01:02.604127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:02.612615 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:02.613088 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:02.613907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:02.614335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:02.758532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:01:02.766764 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2c2d6f16-2364-48ec-ac24-c7958aca1483 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1392 microversion: 2.1 time: 0.170170 Jun 18 23:01:02.767364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3462/6900] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:01:02 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:03.788775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:01:03.789994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:03.802336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:03.803088 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:03.804368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:03.805102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:03.955252 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:01:03.963357 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-56f95c95-3521-4cb9-8a33-bdca7fcabb5b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1565 microversion: 2.1 time: 0.181931 Jun 18 23:01:03.963933 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3439/6901] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:01:03 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:03.980310 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:01:03.980964 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:03.988287 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:03.988751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:03.989584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:03.990042 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:04.130431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:01:04.138625 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93f22116-74ba-4f25-8041-26286e5cf8f0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1565 microversion: 2.1 time: 0.162261 Jun 18 23:01:04.139194 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3463/6902] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:01:03 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:06.096248 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:01:06.097465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:06.106623 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:06.107165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:06.108067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:06.108603 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:06.204662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-0d77bfd0-ff1b-44b9-a3d5-d005d555992f req-17152a03-2916-432b-8a1f-6e0b3d35e871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:01:06.213448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d77bfd0-ff1b-44b9-a3d5-d005d555992f req-17152a03-2916-432b-8a1f-6e0b3d35e871 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:06.213919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-0d77bfd0-ff1b-44b9-a3d5-d005d555992f req-17152a03-2916-432b-8a1f-6e0b3d35e871 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:06.227293 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-0d77bfd0-ff1b-44b9-a3d5-d005d555992f req-17152a03-2916-432b-8a1f-6e0b3d35e871 service nova] Creating event network-changed:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch1-master-1 Jun 18 23:01:06.232586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-0d77bfd0-ff1b-44b9-a3d5-d005d555992f req-17152a03-2916-432b-8a1f-6e0b3d35e871 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089965 Jun 18 23:01:06.233217 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3464/6903] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:01:06.263655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:01:06.271454 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d80d1bbf-3916-41f6-9924-c174eccb2848 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1565 microversion: 2.1 time: 0.180063 Jun 18 23:01:06.272029 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3440/6904] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:01:06 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:01:37.611874 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=7 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:37.613886 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=44 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:01:37.620581 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:01:37.621726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:01:37.629186 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:37.629662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:37.630455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:01:37.630915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:01:37.682498 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-363c5b12-1a8e-4927-bfad-352ef9c17597 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action" status: 200 len: 24573 microversion: 2.1 time: 0.074405 Jun 18 23:01:37.683126 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3465/6905] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:01:37 2022] POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:02:16.787002 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:16.788259 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=42 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:16.795001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:02:16.795997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:16.807003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:16.807485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:16.808262 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:16.808701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:16.837959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:16.844698 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Old instance type m1.heat2, new instance type m1.heat {{(pid=130902) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 18 23:02:16.851513 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:02:16.851946 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:02:16.852431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:02:16.852851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:02:16.853310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:02:16.924515 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c431ac8-17c1-4262-9f1f-fdb1093d7b0d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action" status: 202 len: 0 microversion: 2.1 time: 0.141075 Jun 18 23:02:16.925131 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3441/6906] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:02:16 2022] POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:02:16.934587 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:16.935334 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:16.938010 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:16.939149 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=4 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:16.945749 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:16.946180 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:16.946989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:16.947436 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:17.134563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:17.142762 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8aa5ea0b-a6cc-494f-8e73-b301b9e81654 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1693 microversion: 2.1 time: 0.212864 Jun 18 23:02:17.143353 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3466/6907] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:16 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:18.161992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:18.163351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:18.170042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:18.170496 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:18.171276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:18.171711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:18.319197 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:18.328067 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3b6cb3d-f0b8-4fe5-b5d2-d5325d52e5f2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1693 microversion: 2.1 time: 0.171849 Jun 18 23:02:18.328625 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3442/6908] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:18 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:19.349694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:19.350668 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:19.366052 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:19.366529 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:19.367328 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:19.367846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:19.505591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:19.514101 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-da02bd04-9dec-45a9-9f6b-40682a4c86e4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.171160 Jun 18 23:02:19.514685 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3467/6909] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:19 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:20.533427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:20.534068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:20.541980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:20.542557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:20.543397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:20.543915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:20.683942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:20.691715 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0b0bfe2f-25f6-4922-9284-e72848aed2a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.163176 Jun 18 23:02:20.692267 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3443/6910] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:20 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:21.713452 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:21.714498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:21.722740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:21.723209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:21.724008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:21.724459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:21.869455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:21.878565 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c510f49b-2f62-4882-baa6-e4953638a162 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.171728 Jun 18 23:02:21.879135 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3468/6911] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:21 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:22.904849 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:22.905943 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:22.917961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:22.918620 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:22.919768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:22.920244 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:23.069080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:23.077168 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21fe6bec-25a4-48a6-ae1c-ca5f56263cc0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.178971 Jun 18 23:02:23.077745 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3444/6912] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:22 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:24.097669 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:24.098757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:24.110663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:24.111429 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:24.112722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:24.113514 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:24.258678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:24.266638 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67e1fe7d-b398-4d54-9a77-c7b8a4513c9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.175959 Jun 18 23:02:24.267208 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3469/6913] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:24 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:25.341665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:25.342296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:25.350975 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:25.351631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:25.352791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:25.353471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:25.492086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:25.500265 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-25d4d6c3-9344-4f25-bfd5-a40989855a34 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.217820 Jun 18 23:02:25.500846 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3445/6914] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:25 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:26.517924 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:26.518544 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:26.526426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:26.526935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:26.527735 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:26.528160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:26.670241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:26.678005 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-478d949f-1af9-4d68-961f-63e6b384b13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.164188 Jun 18 23:02:26.678797 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3470/6915] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:26 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:27.695575 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:27.696159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:27.703826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:27.704279 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:27.705060 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:27.705518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:27.861243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:27.868936 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7fd060bd-b1c6-4875-8b45-7111c5c9ca30 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.177354 Jun 18 23:02:27.869547 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3446/6916] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:27 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:28.886184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:28.886805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:28.894388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:28.894855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:28.895643 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:28.896093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:29.035940 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:29.043950 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e3d01c4c-ff56-457d-8260-b6cb34fd55d5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.161753 Jun 18 23:02:29.044596 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3471/6917] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:28 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:30.063459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:30.064086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:30.071573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:30.072031 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:30.072805 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:30.073310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:30.216886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:30.224992 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-94157143-94ef-43fc-9855-47f3104bed5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1698 microversion: 2.1 time: 0.166469 Jun 18 23:02:30.225601 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3447/6918] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:30 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:31.242859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:31.243532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:31.251057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:31.251525 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:31.252307 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:31.252795 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:31.292990 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-177bf42f-1489-4586-aedf-c6c9d13a96a3 req-27a3497a-2404-43e9-a2f6-c79357c6a8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "name": "network-vif-unplugged", "status": "completed", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:02:31.324949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-177bf42f-1489-4586-aedf-c6c9d13a96a3 req-27a3497a-2404-43e9-a2f6-c79357c6a8f5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:31.325418 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-177bf42f-1489-4586-aedf-c6c9d13a96a3 req-27a3497a-2404-43e9-a2f6-c79357c6a8f5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:31.341617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-177bf42f-1489-4586-aedf-c6c9d13a96a3 req-27a3497a-2404-43e9-a2f6-c79357c6a8f5 service nova] Creating event network-vif-unplugged:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch2-master-1 Jun 18 23:02:31.351797 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [req-177bf42f-1489-4586-aedf-c6c9d13a96a3 req-27a3497a-2404-43e9-a2f6-c79357c6a8f5 service nova] Instance 507a8303-e513-48bf-a202-20f3fecc1bdb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130902) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 23:02:31.372370 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-177bf42f-1489-4586-aedf-c6c9d13a96a3 req-27a3497a-2404-43e9-a2f6-c79357c6a8f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083446 Jun 18 23:02:31.373257 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3448/6919] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:02:31.421290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:31.430416 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-61538618-0d4d-44eb-96ed-bf8c192ce36e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1697 microversion: 2.1 time: 0.191360 Jun 18 23:02:31.441221 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3472/6920] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:31 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1697 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:32.454631 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:32.455243 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:32.462824 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:32.463289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:32.464080 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:32.464529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:32.608276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:32.616283 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-377ef1df-4ff3-43f2-81c4-3dcc8fecf64d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1695 microversion: 2.1 time: 0.170552 Jun 18 23:02:32.616878 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3449/6921] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:32 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1695 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:33.395789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b078a5df-ef7c-4cf8-bc55-b4a1440ff56c req-9aa7bf39-fd69-4aa2-a2dc-dd2e234610bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:02:33.406244 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b078a5df-ef7c-4cf8-bc55-b4a1440ff56c req-9aa7bf39-fd69-4aa2-a2dc-dd2e234610bd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:33.406764 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b078a5df-ef7c-4cf8-bc55-b4a1440ff56c req-9aa7bf39-fd69-4aa2-a2dc-dd2e234610bd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:33.420168 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b078a5df-ef7c-4cf8-bc55-b4a1440ff56c req-9aa7bf39-fd69-4aa2-a2dc-dd2e234610bd service nova] Creating event network-changed:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch2-master-1 Jun 18 23:02:33.426260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [req-b078a5df-ef7c-4cf8-bc55-b4a1440ff56c req-9aa7bf39-fd69-4aa2-a2dc-dd2e234610bd service nova] Instance 507a8303-e513-48bf-a202-20f3fecc1bdb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=130903) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 18 23:02:33.437527 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b078a5df-ef7c-4cf8-bc55-b4a1440ff56c req-9aa7bf39-fd69-4aa2-a2dc-dd2e234610bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046255 Jun 18 23:02:33.438118 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3473/6922] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:02:33.634342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:33.634913 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:33.642593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:33.643134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:33.643988 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:33.644494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:33.788455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:33.800651 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-17236e4a-6224-404e-9f16-66e055290ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1695 microversion: 2.1 time: 0.170309 Jun 18 23:02:33.803445 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3450/6923] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:33 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:34.826576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:34.827781 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:34.835449 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:34.835900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:34.836709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:34.837202 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:34.976723 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:34.984648 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-913b1ff0-08c8-4ead-8041-7b25c5654bae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1692 microversion: 2.1 time: 0.166840 Jun 18 23:02:34.985417 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3474/6924] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:34 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:35.001551 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:02:35.002089 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:35.009470 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:35.009926 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:35.010701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:35.011139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:35.071973 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-80d9295d-1943-44e9-922e-180a2267ed08 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action" status: 204 len: 0 microversion: 2.1 time: 0.074258 Jun 18 23:02:35.072616 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3451/6925] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:02:34 2022] POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:02:35.081148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:35.081769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:35.088241 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:35.088829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:35.090671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:35.091352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:35.239767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:35.248922 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0bb60327-1764-4198-987b-fa55dbf68e24 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1692 microversion: 2.1 time: 0.171396 Jun 18 23:02:35.257259 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3475/6926] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:35 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:35.266246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:35.266991 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:35.273758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:35.274082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:35.274754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:35.275184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:35.423666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:35.431613 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-481189b0-25ed-4213-bf9d-44b25b1491a9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1692 microversion: 2.1 time: 0.169753 Jun 18 23:02:35.432227 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3452/6927] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:35 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:36.454652 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:02:36.455249 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:36.462352 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:36.462806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:36.463596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:36.464032 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:36.603097 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:02:36.615188 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-043c49f9-ca93-48a7-a9f5-b1e4ee48e73e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1684 microversion: 2.1 time: 0.168230 Jun 18 23:02:36.616046 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3476/6928] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:02:36 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:02:37.252952 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-19f1ee4f-a25b-4706-9985-9ecdbc9c11f2 req-70c7f2b2-7bff-4a47-a198-493aedb03de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "name": "network-vif-plugged", "status": "completed", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:02:37.263016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-19f1ee4f-a25b-4706-9985-9ecdbc9c11f2 req-70c7f2b2-7bff-4a47-a198-493aedb03de0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:37.263474 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-19f1ee4f-a25b-4706-9985-9ecdbc9c11f2 req-70c7f2b2-7bff-4a47-a198-493aedb03de0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:37.276027 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-19f1ee4f-a25b-4706-9985-9ecdbc9c11f2 req-70c7f2b2-7bff-4a47-a198-493aedb03de0 service nova] Creating event network-vif-plugged:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch2-master-1 Jun 18 23:02:37.281159 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-19f1ee4f-a25b-4706-9985-9ecdbc9c11f2 req-70c7f2b2-7bff-4a47-a198-493aedb03de0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032047 Jun 18 23:02:37.281794 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3453/6929] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:02:54.392979 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:02:54.393923 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:02:54.466830 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:02:54.467042 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:02:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:02:58.828195 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:02:58.829247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:02:58.831866 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=22 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:58.832554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=64 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:02:58.838842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:58.839327 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:58.840479 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:02:58.840966 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:02:58.892815 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f4870be-53b2-4f33-ae9a-ec41d1e0038b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action" status: 200 len: 24578 microversion: 2.1 time: 0.068807 Jun 18 23:02:58.893478 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3477/6930] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:02:58 2022] POST /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb/action => generated 24578 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:03:06.223357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:06.224132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:06.225218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-19c8971a-61da-4171-8722-f0e938aab2fc req-b804f262-ab0c-4c27-886f-9a059366d115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:06.227722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=30 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:06.229342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:06.234934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:06.235410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-19c8971a-61da-4171-8722-f0e938aab2fc req-b804f262-ab0c-4c27-886f-9a059366d115 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:06.235585 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:06.235992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-19c8971a-61da-4171-8722-f0e938aab2fc req-b804f262-ab0c-4c27-886f-9a059366d115 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:06.236538 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:06.237165 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:06.251359 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-19c8971a-61da-4171-8722-f0e938aab2fc req-b804f262-ab0c-4c27-886f-9a059366d115 service nova] Creating event network-changed:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch2-master-1 Jun 18 23:03:06.257560 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-19c8971a-61da-4171-8722-f0e938aab2fc req-b804f262-ab0c-4c27-886f-9a059366d115 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036449 Jun 18 23:03:06.258254 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3478/6931] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:03:06.269521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:03:06.360809 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-733d7f72-ee67-461e-8058-9429c73f22ca tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 204 len: 0 microversion: 2.1 time: 0.141541 Jun 18 23:03:06.364809 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3454/6932] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:03:06 2022] DELETE /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:03:06.371545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:06.372573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:06.379283 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:06.379992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:06.380981 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:06.382228 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:06.523788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:06.531627 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4fc95017-fcbd-4635-8b7a-af01a77de181 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1690 microversion: 2.1 time: 0.164873 Jun 18 23:03:06.532207 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3479/6933] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:06 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:07.550250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:07.550994 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:07.559170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:07.559634 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:07.560593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:07.561068 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:07.708290 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:07.716813 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7dd315a-b1a5-4ebe-be82-d35870c84a9e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 200 len: 1690 microversion: 2.1 time: 0.170886 Jun 18 23:03:07.717482 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3455/6934] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:07 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:08.274530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-208263ad-2d4e-4698-bed8-75c24f8849fe req-adb98129-233f-41f0-bdfa-1b8b2a58957e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "507a8303-e513-48bf-a202-20f3fecc1bdb", "name": "network-vif-deleted", "tag": "aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:08.282960 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-208263ad-2d4e-4698-bed8-75c24f8849fe req-adb98129-233f-41f0-bdfa-1b8b2a58957e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:08.283418 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-208263ad-2d4e-4698-bed8-75c24f8849fe req-adb98129-233f-41f0-bdfa-1b8b2a58957e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:08.294995 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-208263ad-2d4e-4698-bed8-75c24f8849fe req-adb98129-233f-41f0-bdfa-1b8b2a58957e service nova] Creating event network-vif-deleted:aa235f5e-227b-4aa6-a31d-7d1b30c3e2e0 for instance 507a8303-e513-48bf-a202-20f3fecc1bdb on nch2-master-1 Jun 18 23:03:08.300219 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-208263ad-2d4e-4698-bed8-75c24f8849fe req-adb98129-233f-41f0-bdfa-1b8b2a58957e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030479 Jun 18 23:03:08.300810 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3480/6935] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:03:08.736670 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:08.737296 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 507a8303-e513-48bf-a202-20f3fecc1bdb] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:08.744682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:08.745166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:08.745929 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:08.746362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:08.760208 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] HTTP exception thrown: Instance 507a8303-e513-48bf-a202-20f3fecc1bdb could not be found. Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Request method failure captured: Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb HTTP/1.1 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlhU4oMrKLkrpAGiGgBHWqB4pySBW52_d972INf4aVrthBn3v_vJg6rRpwOVwVaY7rEhuUUvhltf5kiiBAvpqNN2bHK72eIzZhzmnavSzf0mJzikbhzZsx-BZ2w4MAZFAFYm7QGHI92JDNLtsIU3gZX9VLTzSDSASSAObIS-Bm5LvEM Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ec0cfc75efa4bb1a32bd2a7a44e3390", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: b1e8d5153b9345ee9619fc6dfe6a1033 Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 507a8303-e513-48bf-a202-20f3fecc1bdb could not be found. Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '507a8303-e513-48bf-a202-20f3fecc1bdb'} Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 507a8303-e513-48bf-a202-20f3fecc1bdb could not be found. Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 507a8303-e513-48bf-a202-20f3fecc1bdb could not be found. Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:03:08.761961 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 507a8303-e513-48bf-a202-20f3fecc1bdb could not be found. Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Returning 404 to user: Instance 507a8303-e513-48bf-a202-20f3fecc1bdb could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3c372a4c-e6bf-41bb-b6e7-3adce3c71ad6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb" status: 404 len: 111 microversion: 2.1 time: 0.032083 Jun 18 23:03:08.766483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3456/6936] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:08 2022] GET /compute/v2.1/servers/507a8303-e513-48bf-a202-20f3fecc1bdb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:03:12.109828 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4ef4c38b-1aa6-4fb1-810d-d0abe2976c8d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '.version_select at 0x7fea07a1aca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:12.139217 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4ef4c38b-1aa6-4fb1-810d-d0abe2976c8d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-116166501" status: 202 len: 0 microversion: 2.1 time: 0.033801 Jun 18 23:03:12.140463 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3481/6937] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Jun 18 23:03:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-116166501 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:03:12.170652 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-320e71a4-7f68-4774-ad0c-ec10ac67c8ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: .version_select at 0x7fea1423dc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-710500464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKveZ51ezyvVcic+r6Rg1jt+zOLrrqTvoeP/IJPAIKv/BZURnDKXo2kidBW1EhtnFMXobMTvFFff6cYgtrol+yCTH694UZaeayGtIU4JR4aM8817FVId6TCaxTl8goiWEQ=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:12.187188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-320e71a4-7f68-4774-ad0c-ec10ac67c8ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:03:12.193717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-320e71a4-7f68-4774-ad0c-ec10ac67c8ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:03:12.220452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-320e71a4-7f68-4774-ad0c-ec10ac67c8ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053880 Jun 18 23:03:12.221166 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3457/6938] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 23:03:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:03:18.076541 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2093627530", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "85fc813e-3237-43a0-a93b-f872addfb5b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-710500464", "security_groups": [{"name": "tempest-secgroup-smoke-1845950621"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:18.187026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] validate_networks() for [('85fc813e-3237-43a0-a93b-f872addfb5b0', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:03:18.288806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=14 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:18.716176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:03:18.716624 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:03:18.717143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:03:18.717595 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:03:18.718027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:03:18.727748 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:18.728216 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:18.729064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:18.729519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:18.750950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:03:18.756987 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:03:18.770925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:03:18.773407 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:03:18.823694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e2e3fcac-464c-4c4c-a574-2853dd4b72ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751111 Jun 18 23:03:18.824351 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3482/6939] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:03:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 23:03:18.832959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:18.837097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d8373338-6ffd-4182-9765-36857b295a9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:18.837728 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d8373338-6ffd-4182-9765-36857b295a9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:18.910767 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d8373338-6ffd-4182-9765-36857b295a9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:18.919735 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d8373338-6ffd-4182-9765-36857b295a9a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1266 microversion: 2.1 time: 0.088614 Jun 18 23:03:18.920315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3458/6940] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:18 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:19.938103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:19.939401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:19.955833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:19.956573 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:19.958430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:19.959205 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:20.070104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:20.080153 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-205e7cd4-de19-492c-a52a-c46bce3d826a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1326 microversion: 2.1 time: 0.147091 Jun 18 23:03:20.085618 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3483/6941] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:19 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:21.099425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:21.100783 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:21.114568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:21.115282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:21.116572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:21.117240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:21.306875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:21.323251 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ac33efb9-1ee1-4540-a13d-c2bed7fd8be2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.228756 Jun 18 23:03:21.334310 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3459/6942] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:21 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:21.423353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5476f43a-4016-41cb-a490-a43cee5bceaf req-5031464f-ab76-4c8f-8ef4-d8cc186207e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8981a02c-9750-4798-8116-c245289aee6c", "tag": "9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:21.440706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5476f43a-4016-41cb-a490-a43cee5bceaf req-5031464f-ab76-4c8f-8ef4-d8cc186207e5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:21.445717 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5476f43a-4016-41cb-a490-a43cee5bceaf req-5031464f-ab76-4c8f-8ef4-d8cc186207e5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:21.469365 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5476f43a-4016-41cb-a490-a43cee5bceaf req-5031464f-ab76-4c8f-8ef4-d8cc186207e5 service nova] Creating event network-changed:9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5 for instance 8981a02c-9750-4798-8116-c245289aee6c on nch2-master-1 Jun 18 23:03:21.479774 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5476f43a-4016-41cb-a490-a43cee5bceaf req-5031464f-ab76-4c8f-8ef4-d8cc186207e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060286 Jun 18 23:03:21.480732 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3484/6943] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:03:22.341747 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:22.342320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:22.350111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:22.350622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:22.351381 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:22.351819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:22.488174 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:22.496099 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c423c748-acb4-4ec8-b89f-7967b14e827b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.158924 Jun 18 23:03:22.496679 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3460/6944] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:22 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:23.515104 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:23.515900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:23.522739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:23.523209 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:23.524007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:23.524486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:23.665577 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:23.673717 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f538c499-eb1a-4a2d-968d-e48fc22271f7 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.163965 Jun 18 23:03:23.674302 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3485/6945] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:23 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:24.692235 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:24.692845 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:24.699801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:24.700322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:24.701135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:24.701584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:24.838505 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:24.846924 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-637c2f43-c8eb-4f73-bac0-f4899813ff5f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.158998 Jun 18 23:03:24.847719 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3461/6946] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:24 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:25.864422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:25.865111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:25.873251 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:25.874046 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:25.875096 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:25.875555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:26.025284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:26.033825 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-29a58712-d31e-4c05-afa5-e635c2f33eec tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.173393 Jun 18 23:03:26.034378 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3486/6947] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:25 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:03:27.055861 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:27.056492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:27.064591 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:27.065494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:27.066429 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:27.066876 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:27.203045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:27.211140 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aa18cc7b-bc98-4f39-aa9f-1d33390515a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.159654 Jun 18 23:03:27.211717 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3462/6948] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:27 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:27.549861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-9e13804b-4439-4597-926a-c27cacc69d92 req-09f9f081-31ff-4cbe-94cd-89eb97d37621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8981a02c-9750-4798-8116-c245289aee6c", "name": "network-vif-plugged", "status": "completed", "tag": "9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:27.559394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9e13804b-4439-4597-926a-c27cacc69d92 req-09f9f081-31ff-4cbe-94cd-89eb97d37621 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:27.559856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-9e13804b-4439-4597-926a-c27cacc69d92 req-09f9f081-31ff-4cbe-94cd-89eb97d37621 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:27.571634 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-9e13804b-4439-4597-926a-c27cacc69d92 req-09f9f081-31ff-4cbe-94cd-89eb97d37621 service nova] Creating event network-vif-plugged:9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5 for instance 8981a02c-9750-4798-8116-c245289aee6c on nch2-master-1 Jun 18 23:03:27.576600 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-9e13804b-4439-4597-926a-c27cacc69d92 req-09f9f081-31ff-4cbe-94cd-89eb97d37621 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030697 Jun 18 23:03:27.577287 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3487/6949] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:03:28.233102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:28.234227 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:28.241762 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:28.242219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:28.243001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:28.243456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:28.383247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:28.394860 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d0eef72-5617-48b0-9872-1df69f75411f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1392 microversion: 2.1 time: 0.168119 Jun 18 23:03:28.395663 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3463/6950] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:28 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:29.412540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:29.413751 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:29.420031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:29.421214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:29.423894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:29.434440 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:29.435157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:29.436363 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:29.437190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:29.582807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:29.591429 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-55a3d47a-6087-4c0c-bb1f-cee69cbd415d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1564 microversion: 2.1 time: 0.181858 Jun 18 23:03:29.592007 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3488/6951] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:29 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:03:29.607803 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:29.608431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:29.610782 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:29.617718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:29.618178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:29.618974 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:29.619431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:29.757515 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:29.765376 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-21c402f7-2b79-46f6-b2f7-0c1f78a844a1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1564 microversion: 2.1 time: 0.161368 Jun 18 23:03:29.765957 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3464/6952] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:29 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:03:31.804712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:31.806057 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:31.807019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-994bf1a1-593d-4a41-a04b-39d693e0bc39 req-e2905035-489b-46be-9317-a0b57f6f54d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8981a02c-9750-4798-8116-c245289aee6c", "tag": "9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:31.813128 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:31.813599 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:31.814459 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:31.814906 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:31.817143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-994bf1a1-593d-4a41-a04b-39d693e0bc39 req-e2905035-489b-46be-9317-a0b57f6f54d7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:31.817664 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-994bf1a1-593d-4a41-a04b-39d693e0bc39 req-e2905035-489b-46be-9317-a0b57f6f54d7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:31.829835 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-994bf1a1-593d-4a41-a04b-39d693e0bc39 req-e2905035-489b-46be-9317-a0b57f6f54d7 service nova] Creating event network-changed:9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5 for instance 8981a02c-9750-4798-8116-c245289aee6c on nch2-master-1 Jun 18 23:03:31.835483 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-994bf1a1-593d-4a41-a04b-39d693e0bc39 req-e2905035-489b-46be-9317-a0b57f6f54d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032549 Jun 18 23:03:31.836519 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3465/6953] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:03:31.959289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:31.968830 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2ad06e38-8a43-4cea-9ec8-f02652691068 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1564 microversion: 2.1 time: 0.168337 Jun 18 23:03:31.969545 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3489/6954] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:31 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:03:53.239412 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:53.240468 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:53.243516 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:53.244168 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=38 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:53.250269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:53.250732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:53.251489 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:53.251923 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:53.304880 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c39c05f4-f96d-4838-9c9e-af73e4f339b4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action" status: 200 len: 24537 microversion: 2.1 time: 0.069581 Jun 18 23:03:53.305504 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3466/6955] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:03:53 2022] POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action => generated 24537 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:03:59.695718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c4565033-a897-4fd1-9453-30fdadf62f93 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:03:59.699635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:59.700745 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=36 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:03:59.711477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4565033-a897-4fd1-9453-30fdadf62f93 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:59.712319 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c4565033-a897-4fd1-9453-30fdadf62f93 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:59.737317 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c4565033-a897-4fd1-9453-30fdadf62f93 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Going to try to stop instance {{(pid=130903) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 18 23:03:59.782908 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c4565033-a897-4fd1-9453-30fdadf62f93 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action" status: 202 len: 0 microversion: 2.1 time: 0.093749 Jun 18 23:03:59.783696 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3490/6956] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:03:59 2022] POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:03:59.792831 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:03:59.793577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:03:59.803012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:59.804029 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:59.805065 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:03:59.805520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:03:59.962018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:03:59.971763 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-34e4331c-e235-4706-b786-c97eac946aa1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.183293 Jun 18 23:03:59.972346 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3467/6957] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:03:59 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:04:00.992847 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:00.994338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:01.002250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:01.002712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:01.003513 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:01.003961 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:01.146890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:01.156320 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8318d3a5-f2eb-4d1a-bc25-6dce8beacf63 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.167862 Jun 18 23:04:01.156986 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3491/6958] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:00 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:02.177768 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:02.178691 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:02.188107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:02.188571 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:02.189399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:02.189846 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:02.327356 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:02.335262 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8ff3ea1e-edc9-445c-932f-25acf684e984 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.163983 Jun 18 23:04:02.335821 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3468/6959] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:02 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:03.357219 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:03.358232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:03.369588 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:03.370050 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:03.370826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:03.371280 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:03.509670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:03.517986 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ca8d8663-4c78-4c28-bc19-41fcc60e0472 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.167648 Jun 18 23:04:03.518576 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3492/6960] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:03 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:04.536534 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:04.537179 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:04.544825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:04.545310 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:04.546082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:04.546520 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:04.695693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:04.704297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-425e2cdd-64fc-4bd2-a491-d3fa14a5f251 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.171767 Jun 18 23:04:04.704851 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3469/6961] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:04 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:05.725870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:05.726850 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:05.737725 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:05.738503 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:05.739808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:05.740561 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:05.878465 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:05.886258 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ed3f6410-af3b-458c-a1ed-92b80a73ddbd tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.167230 Jun 18 23:04:05.886852 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3493/6962] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:05 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:06.907722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:06.908712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:06.919543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:06.920341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:06.921580 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:06.922200 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:07.062192 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:07.072319 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ee1f1352-9ea7-4f05-a863-e25fbd8873ae tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.171167 Jun 18 23:04:07.072927 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3470/6963] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:06 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:08.089920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:08.090920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:08.098536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:08.099007 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:08.099806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:08.100256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:08.235466 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:08.243421 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d90869d5-202b-4d32-b2b6-d55b7d13246e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.157571 Jun 18 23:04:08.243973 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3494/6964] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:08 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:09.264329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:09.265209 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:09.277752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:09.278212 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:09.279030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:09.279473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:09.415464 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:09.423474 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d0a85ac5-4076-484e-88ce-57ed79df4b6f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1693 microversion: 2.1 time: 0.165467 Jun 18 23:04:09.424056 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3471/6965] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:09 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:10.444835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:10.445930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:10.454799 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:10.455273 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:10.456111 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:10.456556 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:10.601505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:10.609735 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c6959a52-ea2b-4a30-b4cc-b4241d3e2e43 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1670 microversion: 2.1 time: 0.171662 Jun 18 23:04:10.610329 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3495/6966] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:10 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:11.703577 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:11.704622 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:11.713665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:11.714207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:11.715494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:11.716013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:11.766780 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-fd3ead74-96d7-42dd-9afd-3014f9e512ea tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action" status: 200 len: 35942 microversion: 2.1 time: 0.069141 Jun 18 23:04:11.767431 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3472/6967] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:04:11 2022] POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action => generated 35942 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:04:11.779100 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bdf4adac-18d7-4470-bcf6-377c231320ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:11.786887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdf4adac-18d7-4470-bcf6-377c231320ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:11.787353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bdf4adac-18d7-4470-bcf6-377c231320ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:11.812144 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bdf4adac-18d7-4470-bcf6-377c231320ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Going to try to start instance {{(pid=130903) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 18 23:04:11.856541 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bdf4adac-18d7-4470-bcf6-377c231320ab tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action" status: 202 len: 0 microversion: 2.1 time: 0.081301 Jun 18 23:04:11.857237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3496/6968] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:04:11 2022] POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:04:11.866098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:11.866809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:11.874173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:11.874638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:11.875376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:11.875813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:12.013879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:12.022273 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b4549b69-173d-4f58-82cb-eade4c69c921 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1679 microversion: 2.1 time: 0.160367 Jun 18 23:04:12.023105 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3473/6969] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:11 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:13.041583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:13.042297 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:13.049258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:13.049718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:13.050499 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:13.050946 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:13.199212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:13.207930 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c7db787a-81b0-496f-b304-a61ff06df3f5 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1683 microversion: 2.1 time: 0.171549 Jun 18 23:04:13.208506 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3497/6970] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:13 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:37.438857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:37.439791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:37.442687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:37.443354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=44 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:37.451329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:37.451784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:37.452570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:37.453013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:37.505728 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b43c7de2-0743-45f7-b10c-9ae1a7666ccc tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action" status: 200 len: 60501 microversion: 2.1 time: 0.070771 Jun 18 23:04:37.506406 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3474/6971] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:04:37 2022] POST /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c/action => generated 60501 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:04:44.907341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:44.908550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:44.908877 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-c1805c43-2379-498f-87f6-8de61d6342a2 req-d25bbd64-c24b-45a1-a614-a18944bb1372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8981a02c-9750-4798-8116-c245289aee6c", "tag": "9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:44.912627 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=16 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:44.913069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:44.919629 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:44.919825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c1805c43-2379-498f-87f6-8de61d6342a2 req-d25bbd64-c24b-45a1-a614-a18944bb1372 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:44.920103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:44.920240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-c1805c43-2379-498f-87f6-8de61d6342a2 req-d25bbd64-c24b-45a1-a614-a18944bb1372 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:44.920902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:44.921684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:44.935599 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-c1805c43-2379-498f-87f6-8de61d6342a2 req-d25bbd64-c24b-45a1-a614-a18944bb1372 service nova] Creating event network-changed:9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5 for instance 8981a02c-9750-4798-8116-c245289aee6c on nch2-master-1 Jun 18 23:04:44.941309 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-c1805c43-2379-498f-87f6-8de61d6342a2 req-d25bbd64-c24b-45a1-a614-a18944bb1372 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036361 Jun 18 23:04:44.942706 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3475/6972] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:04:44.950448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:04:45.047309 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-849c3d0a-a257-465f-81af-6ba803824fb6 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 204 len: 0 microversion: 2.1 time: 0.143893 Jun 18 23:04:45.048696 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3498/6973] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:04:44 2022] DELETE /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:04:45.060048 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:45.061312 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:45.068348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:45.068800 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:45.069605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:45.070037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:45.265819 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:45.273621 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-833e7cc4-65ca-4e9f-ae05-6f35f27a38a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1689 microversion: 2.1 time: 0.220256 Jun 18 23:04:45.274164 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3476/6974] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:45 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:46.292430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:46.293175 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:46.300416 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:46.300878 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:46.301701 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:46.302147 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:46.484852 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:46.492965 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7e0e4895-6755-4bc7-87e3-66595f274c50 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1689 microversion: 2.1 time: 0.204912 Jun 18 23:04:46.493684 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3499/6975] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:46 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:47.074216 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-df3a9974-4d23-4c36-afc7-306d81ea784c req-1b869aa7-8adb-4055-890a-74fd936b4a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8981a02c-9750-4798-8116-c245289aee6c", "name": "network-vif-deleted", "tag": "9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:47.083726 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-df3a9974-4d23-4c36-afc7-306d81ea784c req-1b869aa7-8adb-4055-890a-74fd936b4a1e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:47.084173 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-df3a9974-4d23-4c36-afc7-306d81ea784c req-1b869aa7-8adb-4055-890a-74fd936b4a1e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:47.097451 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-df3a9974-4d23-4c36-afc7-306d81ea784c req-1b869aa7-8adb-4055-890a-74fd936b4a1e service nova] Creating event network-vif-deleted:9c5eeac1-d7ab-4b84-9560-d4d4f318b6f5 for instance 8981a02c-9750-4798-8116-c245289aee6c on nch2-master-1 Jun 18 23:04:47.103531 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-df3a9974-4d23-4c36-afc7-306d81ea784c req-1b869aa7-8adb-4055-890a-74fd936b4a1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Jun 18 23:04:47.104147 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3477/6976] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:04:47.510757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:47.511405 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:47.519945 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:47.520564 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:47.521678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:47.522331 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:47.562112 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:47.562584 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:47.563059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lazy-loading 'fault' on Instance uuid 8981a02c-9750-4798-8116-c245289aee6c {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:04:47.611381 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:47.618704 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f3962e1e-e05d-415b-8342-36666cf019d9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 200 len: 1356 microversion: 2.1 time: 0.111980 Jun 18 23:04:47.619237 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3500/6977] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:47 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:48.642292 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:48.643427 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 8981a02c-9750-4798-8116-c245289aee6c] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:48.654333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:48.655085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:48.656363 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:48.657100 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:48.677381 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] HTTP exception thrown: Instance 8981a02c-9750-4798-8116-c245289aee6c could not be found. Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Request method failure captured: Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c HTTP/1.1 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlhU4oMrKLkrpAGiGgBHWqB4pySBW52_d972INf4aVrthBn3v_vJg6rRpwOVwVaY7rEhuUUvhltf5kiiBAvpqNN2bHK72eIzZhzmnavSzf0mJzikbhzZsx-BZ2w4MAZFAFYm7QGHI92JDNLtsIU3gZX9VLTzSDSASSAObIS-Bm5LvEM Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ec0cfc75efa4bb1a32bd2a7a44e3390", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: b1e8d5153b9345ee9619fc6dfe6a1033 Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 8981a02c-9750-4798-8116-c245289aee6c could not be found. Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '8981a02c-9750-4798-8116-c245289aee6c'} Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8981a02c-9750-4798-8116-c245289aee6c could not be found. Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8981a02c-9750-4798-8116-c245289aee6c could not be found. Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:04:48.679082 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8981a02c-9750-4798-8116-c245289aee6c could not be found. Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Returning 404 to user: Instance 8981a02c-9750-4798-8116-c245289aee6c could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7ce92714-e4a3-43ef-95f1-b652c126fcf9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c" status: 404 len: 111 microversion: 2.1 time: 0.047308 Jun 18 23:04:48.684334 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3478/6978] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:48 2022] GET /compute/v2.1/servers/8981a02c-9750-4798-8116-c245289aee6c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:04:52.068583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5b3ea28-6eee-4705-a048-f1cd89acb2e0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '.version_select at 0x7fea140a0ca0>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:52.097148 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5b3ea28-6eee-4705-a048-f1cd89acb2e0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-710500464" status: 202 len: 0 microversion: 2.1 time: 0.032521 Jun 18 23:04:52.097771 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3501/6979] 10.222.0.30 () {58 vars in 1280 bytes} [Sat Jun 18 23:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-710500464 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:04:52.129694 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-90fb4cf2-2e30-475e-82e3-eae7cc1c569e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: .version_select at 0x7fea19bd9280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2058056681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+ITH2p/J832A/3ODajql9MmM0b9tqm9auTX2ntiHTIMbx3ar4OOz0nBb+PWavIHDbgi8ncd+N9K3uSvpFEUM967vo/F/RrhiNqT5eVU0FJuolNg/kUBCvmzMdAmkWblw=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:52.145359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-90fb4cf2-2e30-475e-82e3-eae7cc1c569e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:04:52.151482 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-90fb4cf2-2e30-475e-82e3-eae7cc1c569e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:04:52.177745 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-90fb4cf2-2e30-475e-82e3-eae7cc1c569e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052089 Jun 18 23:04:52.178308 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3479/6980] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 23:04:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:04:57.753734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-612804424", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "networks": [{"uuid": "1f8bcbf2-2c22-41c6-88a1-e47fb6bb4fb6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2058056681", "security_groups": [{"name": "tempest-secgroup-smoke-1432617184"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:04:57.763864 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:04:57.878422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] validate_networks() for [('1f8bcbf2-2c22-41c6-88a1-e47fb6bb4fb6', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:04:58.297671 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:04:58.298077 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:04:58.298563 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:04:58.299333 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:04:58.299711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:04:58.312365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:58.312826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:58.313895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:58.314349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:58.335118 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:04:58.341213 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Getting quotas for user b1e8d5153b9345ee9619fc6dfe6a1033 and project 4ec0cfc75efa4bb1a32bd2a7a44e3390. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:04:58.355039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:04:58.357817 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:04:58.413005 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fe03f92f-cbcd-47a5-aa72-ea19edce5ada tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.663405 Jun 18 23:04:58.419369 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3502/6981] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:04:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 18 23:04:58.425668 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3fc649bc-4f09-4124-82c5-6d4146cdfe3c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:58.426237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3fc649bc-4f09-4124-82c5-6d4146cdfe3c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:58.511993 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3fc649bc-4f09-4124-82c5-6d4146cdfe3c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:58.521431 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3fc649bc-4f09-4124-82c5-6d4146cdfe3c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1266 microversion: 2.1 time: 0.100639 Jun 18 23:04:58.529429 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3480/6982] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:58 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:04:59.553226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:04:59.554870 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:04:59.566516 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:59.577855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:59.579179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:04:59.579806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:04:59.676240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:04:59.686603 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f5e62e2e-2ba1-4234-9855-064f740692ff tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1326 microversion: 2.1 time: 0.143509 Jun 18 23:04:59.688143 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3503/6983] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:04:59 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:00.704671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:00.706039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:00.708242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=16 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:00.715942 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:00.716401 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:00.719699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:00.720376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:00.869833 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:00.879817 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ebb36680-67bb-45db-9fe8-e89fb41130e2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.179168 Jun 18 23:05:00.880483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3481/6984] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:00 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:01.139680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2dfe11ad-1e34-4dc9-9c10-d0bcb9dec3f8 req-3c8ac201-7b69-4651-9f5c-d64a4fe374c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f1e70b-d34a-4147-ada8-a51d095b5fd9", "tag": "32647614-32b9-427b-ab31-b0168d3edc6f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:01.156117 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2dfe11ad-1e34-4dc9-9c10-d0bcb9dec3f8 req-3c8ac201-7b69-4651-9f5c-d64a4fe374c5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:01.157325 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2dfe11ad-1e34-4dc9-9c10-d0bcb9dec3f8 req-3c8ac201-7b69-4651-9f5c-d64a4fe374c5 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:01.174953 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2dfe11ad-1e34-4dc9-9c10-d0bcb9dec3f8 req-3c8ac201-7b69-4651-9f5c-d64a4fe374c5 service nova] Creating event network-changed:32647614-32b9-427b-ab31-b0168d3edc6f for instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 on nch2-master-1 Jun 18 23:05:01.183528 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2dfe11ad-1e34-4dc9-9c10-d0bcb9dec3f8 req-3c8ac201-7b69-4651-9f5c-d64a4fe374c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047914 Jun 18 23:05:01.185557 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3504/6985] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:05:01.901540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:01.902562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:01.914471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:01.915213 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:01.916475 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:01.917261 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:02.056254 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:02.064741 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-db46aafb-25a9-465d-a0ec-49db22fbc13b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.169712 Jun 18 23:05:02.065293 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3482/6986] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:01 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:03.087074 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:03.087805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:03.095783 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:03.096247 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:03.097024 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:03.097502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:03.238549 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:03.248571 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-71447146-e1a5-4d82-bf31-5711a2bb9f7d tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.169706 Jun 18 23:05:03.249176 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3505/6987] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:03 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:04.270019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:04.271032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:04.283152 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:04.283953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:04.285286 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:04.286092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:04.427529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:04.435697 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1bc4a25a-7add-4557-825c-418ebddaab5c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.172291 Jun 18 23:05:04.436296 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3483/6988] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:04 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:05.452181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:05.452808 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:05.461412 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:05.461883 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:05.462666 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:05.463116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:05.610702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:05.618904 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c78ba715-a3a5-4b24-b3b0-0c5b2ece4946 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.170716 Jun 18 23:05:05.619506 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3506/6989] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:05 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:06.643860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:06.644851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:06.655679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:06.656138 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:06.656907 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:06.657450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:06.798900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:06.806881 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be71f858-df98-4b43-9e1d-ace246128b8a tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.169060 Jun 18 23:05:06.807440 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3484/6990] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:06 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:07.826861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:07.827555 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:07.835389 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:07.835860 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:07.836684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:07.837196 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:07.976582 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:07.984713 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cfa801cf-4c27-4d18-a4e6-c3f79a9d62b2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.163247 Jun 18 23:05:07.985263 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3507/6991] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:07 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:08.055754 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-7c7a48fc-d2c1-4ade-a2fe-0fbceead44af req-60e84d08-7448-4af9-b1a3-69f69181b57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f1e70b-d34a-4147-ada8-a51d095b5fd9", "name": "network-vif-plugged", "status": "completed", "tag": "32647614-32b9-427b-ab31-b0168d3edc6f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:08.060210 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:08.066265 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7c7a48fc-d2c1-4ade-a2fe-0fbceead44af req-60e84d08-7448-4af9-b1a3-69f69181b57c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:08.066715 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-7c7a48fc-d2c1-4ade-a2fe-0fbceead44af req-60e84d08-7448-4af9-b1a3-69f69181b57c service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:08.078507 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-7c7a48fc-d2c1-4ade-a2fe-0fbceead44af req-60e84d08-7448-4af9-b1a3-69f69181b57c service nova] Creating event network-vif-plugged:32647614-32b9-427b-ab31-b0168d3edc6f for instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 on nch2-master-1 Jun 18 23:05:08.083553 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-7c7a48fc-d2c1-4ade-a2fe-0fbceead44af req-60e84d08-7448-4af9-b1a3-69f69181b57c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Jun 18 23:05:08.084155 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3485/6992] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:05:09.001963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:09.002597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:09.004663 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:09.005507 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:09.011932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:09.012394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:09.013197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:09.013648 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:09.147989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:09.156044 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5bd2c822-7421-439e-931a-8fa8af2037c3 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1392 microversion: 2.1 time: 0.158062 Jun 18 23:05:09.156967 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3508/6993] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:08 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:10.171322 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:10.178037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:10.179023 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:10.188027 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:10.188635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:10.190539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:10.191129 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:10.330414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:10.338567 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-33fc82b6-b3ee-4b10-9e92-892299f4275c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1564 microversion: 2.1 time: 0.168649 Jun 18 23:05:10.339161 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3486/6994] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:10 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:10.355187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:10.355891 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:10.363359 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:10.363905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:10.364699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:10.365174 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:10.509371 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:10.521114 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b643c6f8-c763-49a7-a440-17a6ce95e2c9 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1564 microversion: 2.1 time: 0.169571 Jun 18 23:05:10.521965 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3509/6995] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:10 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:12.153554 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:12.154189 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:12.157502 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-01a4e2da-b36c-4d5e-8850-405d99d828ce req-05df65fa-1ede-4b43-822a-6276532f811e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f1e70b-d34a-4147-ada8-a51d095b5fd9", "tag": "32647614-32b9-427b-ab31-b0168d3edc6f"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:12.163346 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:12.164270 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:12.165107 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:12.165556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:12.167995 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-01a4e2da-b36c-4d5e-8850-405d99d828ce req-05df65fa-1ede-4b43-822a-6276532f811e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:12.169403 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-01a4e2da-b36c-4d5e-8850-405d99d828ce req-05df65fa-1ede-4b43-822a-6276532f811e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:12.181151 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-01a4e2da-b36c-4d5e-8850-405d99d828ce req-05df65fa-1ede-4b43-822a-6276532f811e service nova] Creating event network-changed:32647614-32b9-427b-ab31-b0168d3edc6f for instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 on nch2-master-1 Jun 18 23:05:12.186503 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-01a4e2da-b36c-4d5e-8850-405d99d828ce req-05df65fa-1ede-4b43-822a-6276532f811e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034789 Jun 18 23:05:12.187616 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3510/6996] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:05:12.305517 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:12.316438 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3c642b7-ca8f-4631-ab03-5d6f4325511e tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1564 microversion: 2.1 time: 0.167113 Jun 18 23:05:12.317174 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3487/6997] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:12 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:33.581332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:33.582385 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:33.585134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:33.585812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=42 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:33.592810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:33.593585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:33.594391 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:33.594846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:33.655968 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9a8eadc9-862a-4f3d-9c97-0b3cd51047d4 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action" status: 200 len: 24566 microversion: 2.1 time: 0.079474 Jun 18 23:05:33.656882 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3511/6998] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:05:33 2022] POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action => generated 24566 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:05:40.016658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:40.017333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:40.019321 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=5 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:40.019982 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=38 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:05:40.026871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:40.027329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:40.028161 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:40.028609 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:40.053638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lazy-loading 'flavor' on Instance uuid 95f1e70b-d34a-4147-ada8-a51d095b5fd9 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:05:40.131005 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-52c2e136-dc43-4f91-8476-6de0eb074571 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action" status: 202 len: 0 microversion: 2.1 time: 0.118572 Jun 18 23:05:40.131655 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3488/6999] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:05:40 2022] POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:05:40.140696 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:40.141619 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:40.149935 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:40.150862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:40.151715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:40.152264 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:40.297337 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:40.307797 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-23e3b2bb-21e1-40f1-ab6b-1c7f8991b61b tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1691 microversion: 2.1 time: 0.171424 Jun 18 23:05:40.308391 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3512/7000] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:40 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:05:41.332705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:41.333954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:41.345573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:41.346336 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:41.347578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:41.348053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:41.483260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:41.491599 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aa3f1502-61c0-440c-9b10-05101ddc1330 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1674 microversion: 2.1 time: 0.167751 Jun 18 23:05:41.492184 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3489/7001] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:41 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:42.580023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:42.581054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:42.589505 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:42.590338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:42.591126 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:42.591583 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:42.644597 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7d8774a7-c645-4747-a1e1-2fbb1e6399d0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action" status: 200 len: 35317 microversion: 2.1 time: 0.068622 Jun 18 23:05:42.645255 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3513/7002] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:05:42 2022] POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action => generated 35317 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:05:42.656732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:42.657398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:42.664857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:42.665343 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:42.666113 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:42.666529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:42.743310 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-df7aa8f0-ff52-4d25-b90d-8a342573b058 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action" status: 202 len: 0 microversion: 2.1 time: 0.090446 Jun 18 23:05:42.744006 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3490/7003] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:05:42 2022] POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:05:42.753064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:42.754076 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:42.761431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:42.761887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:42.762664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:42.763116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:42.902369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:42.910343 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7a0096e9-e210-4926-b82c-34ff8842875c tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1680 microversion: 2.1 time: 0.161598 Jun 18 23:05:42.910937 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3514/7004] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:42 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:43.935086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:43.936250 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:43.944827 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:43.945313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:43.946083 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:43.946521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:44.093802 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:44.102768 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6f8d40df-90f3-4aba-9261-c72a67ed8686 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1680 microversion: 2.1 time: 0.176181 Jun 18 23:05:44.103534 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3491/7005] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:43 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:45.124608 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:45.125699 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:45.134545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:45.135013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:45.135798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:45.136240 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:45.272617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:45.280453 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-60064fe3-2a15-42db-9d2d-2250adda1728 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1683 microversion: 2.1 time: 0.162452 Jun 18 23:05:45.281026 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3515/7006] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:45 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:45.377118 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:45.378067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:45.385436 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:45.385895 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:45.386669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:45.387102 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:45.431742 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2c2cef99-e671-499c-bfd5-a5ad6d5787a0 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action" status: 200 len: 35317 microversion: 2.1 time: 0.058511 Jun 18 23:05:45.432364 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3492/7007] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:05:45 2022] POST /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9/action => generated 35317 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 18 23:05:46.500054 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:46.501568 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:46.501737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-87f638bf-bc49-48a3-9bd3-77bf7f784f53 req-f9e778ad-2d9e-43bc-81f4-fef8b971deab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f1e70b-d34a-4147-ada8-a51d095b5fd9", "tag": "32647614-32b9-427b-ab31-b0168d3edc6f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:46.511072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:46.511557 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-87f638bf-bc49-48a3-9bd3-77bf7f784f53 req-f9e778ad-2d9e-43bc-81f4-fef8b971deab service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:46.512012 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-87f638bf-bc49-48a3-9bd3-77bf7f784f53 req-f9e778ad-2d9e-43bc-81f4-fef8b971deab service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:46.513232 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:46.514620 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:46.515404 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:46.524238 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-87f638bf-bc49-48a3-9bd3-77bf7f784f53 req-f9e778ad-2d9e-43bc-81f4-fef8b971deab service nova] Creating event network-changed:32647614-32b9-427b-ab31-b0168d3edc6f for instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 on nch2-master-1 Jun 18 23:05:46.529235 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-87f638bf-bc49-48a3-9bd3-77bf7f784f53 req-f9e778ad-2d9e-43bc-81f4-fef8b971deab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031628 Jun 18 23:05:46.530062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3493/7008] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:05:46.548829 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:05:46.648440 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-82e80181-0cae-44cd-b11d-6f07681c7b12 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 204 len: 0 microversion: 2.1 time: 0.153457 Jun 18 23:05:46.649313 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3516/7009] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:05:46 2022] DELETE /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:05:46.658771 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:46.659689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:46.666205 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:46.666882 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:46.667839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:46.668280 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:46.811112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:46.819019 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef49709c-6dc7-463a-a11f-06a38c3fc63f tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1689 microversion: 2.1 time: 0.165123 Jun 18 23:05:46.819581 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3494/7010] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:46 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:47.842798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:47.843971 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:47.855890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:47.856670 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:47.858026 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:47.858782 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:47.998443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:48.006517 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-67a0ffe0-9f2e-48d9-b4c7-0c3bdcc729ad tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1689 microversion: 2.1 time: 0.171457 Jun 18 23:05:48.007111 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3517/7011] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:47 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:48.888214 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-06bafcfb-9159-43ac-92d0-c8387169a063 req-4aa14992-0eea-4b84-975a-0f6fa1d929fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f1e70b-d34a-4147-ada8-a51d095b5fd9", "name": "network-vif-deleted", "tag": "32647614-32b9-427b-ab31-b0168d3edc6f"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:05:48.896614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-06bafcfb-9159-43ac-92d0-c8387169a063 req-4aa14992-0eea-4b84-975a-0f6fa1d929fd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:48.897056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-06bafcfb-9159-43ac-92d0-c8387169a063 req-4aa14992-0eea-4b84-975a-0f6fa1d929fd service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:48.909398 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-06bafcfb-9159-43ac-92d0-c8387169a063 req-4aa14992-0eea-4b84-975a-0f6fa1d929fd service nova] Creating event network-vif-deleted:32647614-32b9-427b-ab31-b0168d3edc6f for instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 on nch2-master-1 Jun 18 23:05:48.914687 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-06bafcfb-9159-43ac-92d0-c8387169a063 req-4aa14992-0eea-4b84-975a-0f6fa1d929fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084728 Jun 18 23:05:48.915608 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3495/7012] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:05:49.032106 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:49.033218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:49.042184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:49.042659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:49.043456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:49.043902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:49.076530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:49.076991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:49.077478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lazy-loading 'fault' on Instance uuid 95f1e70b-d34a-4147-ada8-a51d095b5fd9 {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:05:49.119263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1e8d5153b9345ee9619fc6dfe6a1033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec0cfc75efa4bb1a32bd2a7a44e3390', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:05:49.127682 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a685b985-d023-42da-ae6c-65e0ec7a3bc1 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 200 len: 1356 microversion: 2.1 time: 0.105593 Jun 18 23:05:49.128284 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3518/7013] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:49 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:05:50.152862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:50.154097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] [instance: 95f1e70b-d34a-4147-ada8-a51d095b5fd9] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:05:50.165315 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:50.165977 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:50.167324 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:05:50.168077 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:05:50.184996 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] HTTP exception thrown: Instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 could not be found. Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Request method failure captured: Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 HTTP/1.1 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlhU4oMrKLkrpAGiGgBHWqB4pySBW52_d972INf4aVrthBn3v_vJg6rRpwOVwVaY7rEhuUUvhltf5kiiBAvpqNN2bHK72eIzZhzmnavSzf0mJzikbhzZsx-BZ2w4MAZFAFYm7QGHI92JDNLtsIU3gZX9VLTzSDSASSAObIS-Bm5LvEM Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4ec0cfc75efa4bb1a32bd2a7a44e3390"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4ec0cfc75efa4bb1a32bd2a7a44e3390", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 4ec0cfc75efa4bb1a32bd2a7a44e3390 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-929234655 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: b1e8d5153b9345ee9619fc6dfe6a1033 Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestNetworkAdvancedServerOps-929234655-project Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 could not be found. Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '95f1e70b-d34a-4147-ada8-a51d095b5fd9'} Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 could not be found. Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 could not be found. Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:05:50.186705 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 could not be found. Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Returning 404 to user: Instance 95f1e70b-d34a-4147-ada8-a51d095b5fd9 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4bc0a6e6-51c9-492e-a7f3-29d307794863 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9" status: 404 len: 111 microversion: 2.1 time: 0.044682 Jun 18 23:05:50.191502 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3496/7014] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:05:50 2022] GET /compute/v2.1/servers/95f1e70b-d34a-4147-ada8-a51d095b5fd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:05:53.623684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-114de38c-60c2-4b66-a829-e7453ffab5c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] Calling method '.version_select at 0x7fea14108670>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:05:53.645416 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-114de38c-60c2-4b66-a829-e7453ffab5c2 tempest-TestNetworkAdvancedServerOps-929234655 tempest-TestNetworkAdvancedServerOps-929234655-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2058056681" status: 202 len: 0 microversion: 2.1 time: 0.026009 Jun 18 23:05:53.646277 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3519/7015] 10.222.0.30 () {58 vars in 1283 bytes} [Sat Jun 18 23:05:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2058056681 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:06:05.084960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=18 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:05.086268 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:05.319900 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69200237-7b72-4c59-b88e-a02956092bed tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'create', calling method: .version_select at 0x7fea0762f9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1674230062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyl9y3azevl4uEJo3Ut7tGIabhLt33wZaBXaG006OfKMWcPyi9LGKIDRb4GYj3bCYWKXsJGSAEmwVM1MCtwQLkTrVzlOmOu5zQq5whEqdP+XQrHUvz4f3ClMtOeVCzwdA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:06:05.334840 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-69200237-7b72-4c59-b88e-a02956092bed tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:06:05.342238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-69200237-7b72-4c59-b88e-a02956092bed tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for user 62490dbd2f174221b6dda00ce8c3e916 and project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:06:05.373986 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69200237-7b72-4c59-b88e-a02956092bed tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.297282 Jun 18 23:06:05.380511 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3497/7016] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 23:06:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:06:06.409638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:06.410431 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:06.414757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1824584827", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1674230062", "security_groups": [{"name": "tempest-secgroup-smoke-1150859230"}], "networks": [{"uuid": "f11d592a-b12f-40b0-9589-7e1d4e589175"}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:06:06.529881 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] validate_networks() for [('f11d592a-b12f-40b0-9589-7e1d4e589175', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:06:06.909871 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:06:06.910323 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:06:06.911003 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:06:06.911443 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:06:06.911907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:06:06.921483 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:06.921952 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:06.922773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:06.923214 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:06.948856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:06:06.954509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for user 62490dbd2f174221b6dda00ce8c3e916 and project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:06:06.967574 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:06:06.969983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:06:07.016414 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ceb4533b-8cad-4f0d-b163-90d70954dde5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.608665 Jun 18 23:06:07.017100 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3520/7017] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:06:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 23:06:07.028199 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a3fe3623-1e28-464a-9bab-89a4dcca4699 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:07.028829 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a3fe3623-1e28-464a-9bab-89a4dcca4699 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:07.093679 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a3fe3623-1e28-464a-9bab-89a4dcca4699 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:07.101086 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a3fe3623-1e28-464a-9bab-89a4dcca4699 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1247 microversion: 2.1 time: 0.077723 Jun 18 23:06:07.101884 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3498/7018] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:07 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:06:08.127905 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8c1b8fa4-fb84-4c5f-8a2c-5b4701dead89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:08.129915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8c1b8fa4-fb84-4c5f-8a2c-5b4701dead89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:08.198750 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8c1b8fa4-fb84-4c5f-8a2c-5b4701dead89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:08.205949 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8c1b8fa4-fb84-4c5f-8a2c-5b4701dead89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1247 microversion: 2.1 time: 0.090418 Jun 18 23:06:08.206730 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3521/7019] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:08 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:09.224355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-69820cdf-04bc-4d34-b190-a887ae4317dc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:09.225182 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-69820cdf-04bc-4d34-b190-a887ae4317dc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:09.297423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-69820cdf-04bc-4d34-b190-a887ae4317dc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:09.304506 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-69820cdf-04bc-4d34-b190-a887ae4317dc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1247 microversion: 2.1 time: 0.084220 Jun 18 23:06:09.305112 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3499/7020] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:09 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:10.322084 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f0d6e1dd-6f33-4b49-81a7-38855c97f978 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:10.322704 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f0d6e1dd-6f33-4b49-81a7-38855c97f978 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:10.378899 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f0d6e1dd-6f33-4b49-81a7-38855c97f978 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:10.386150 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f0d6e1dd-6f33-4b49-81a7-38855c97f978 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1247 microversion: 2.1 time: 0.068038 Jun 18 23:06:10.386975 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3522/7021] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:10 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:11.407606 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:11.408632 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:11.416960 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:11.417458 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:11.418241 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:11.418673 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:11.484333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:11.492124 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-6eb376d9-cb06-4581-a745-b447dfe94974 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1251 microversion: 2.1 time: 0.091343 Jun 18 23:06:11.492705 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3500/7022] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:11 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1251 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:12.509464 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:12.510229 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:12.518335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:12.518788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:12.519633 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:12.520101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:12.584148 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:12.593946 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4dc7e641-925d-4afb-bc64-c993443c2c9d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1305 microversion: 2.1 time: 0.088423 Jun 18 23:06:12.594477 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3523/7023] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:12 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:06:13.541490 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-8c9faeef-2409-40a9-95dd-a269e32df1d2 req-719dc1a6-c2ea-4f08-bb24-ddb0de9306e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:06:13.567073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8c9faeef-2409-40a9-95dd-a269e32df1d2 req-719dc1a6-c2ea-4f08-bb24-ddb0de9306e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:13.567799 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-8c9faeef-2409-40a9-95dd-a269e32df1d2 req-719dc1a6-c2ea-4f08-bb24-ddb0de9306e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:13.581269 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-8c9faeef-2409-40a9-95dd-a269e32df1d2 req-719dc1a6-c2ea-4f08-bb24-ddb0de9306e9 service nova] Creating event network-changed:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch2-master-1 Jun 18 23:06:13.586794 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-8c9faeef-2409-40a9-95dd-a269e32df1d2 req-719dc1a6-c2ea-4f08-bb24-ddb0de9306e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052545 Jun 18 23:06:13.587541 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3501/7024] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:06:13.613107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:13.613998 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:13.621929 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:13.622384 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:13.623187 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:13.623662 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:13.773121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:13.782502 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-888c8c95-7dde-484c-9a3b-02e526e1ee34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1373 microversion: 2.1 time: 0.172699 Jun 18 23:06:13.783474 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3524/7025] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:13 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:14.801619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:14.803158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:14.810556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:14.811120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:14.812042 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:14.812527 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:14.951348 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:14.959502 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c7ff81ea-97d6-4f63-ae16-681f27867777 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1373 microversion: 2.1 time: 0.163246 Jun 18 23:06:14.960098 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3502/7026] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:14 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:15.980958 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:15.982016 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:15.993909 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:15.994715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:15.996004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:15.996747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:16.135926 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:16.143957 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7fbcf660-997e-42f6-a124-2225c1dc225f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1373 microversion: 2.1 time: 0.169656 Jun 18 23:06:16.144527 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3525/7027] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:15 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:17.161826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:17.162596 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:17.170178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:17.170639 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:17.171420 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:17.171862 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:17.306873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:17.314846 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-957bb63e-22fb-4709-a632-06de392ce2d9 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1373 microversion: 2.1 time: 0.157218 Jun 18 23:06:17.315786 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3503/7028] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:17 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:18.332124 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:18.332758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:18.334825 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:18.341593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:18.342059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:18.342889 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:18.343349 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:18.424156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-374cdc27-a16f-42dd-abad-c8efb54605b7 req-ff59d1ed-7601-4759-bce1-e38a2c1a6386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "name": "network-vif-plugged", "status": "completed", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:06:18.434378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-374cdc27-a16f-42dd-abad-c8efb54605b7 req-ff59d1ed-7601-4759-bce1-e38a2c1a6386 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:18.434826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-374cdc27-a16f-42dd-abad-c8efb54605b7 req-ff59d1ed-7601-4759-bce1-e38a2c1a6386 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:18.446280 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-374cdc27-a16f-42dd-abad-c8efb54605b7 req-ff59d1ed-7601-4759-bce1-e38a2c1a6386 service nova] Creating event network-vif-plugged:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch2-master-1 Jun 18 23:06:18.451510 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-374cdc27-a16f-42dd-abad-c8efb54605b7 req-ff59d1ed-7601-4759-bce1-e38a2c1a6386 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098887 Jun 18 23:06:18.452092 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3504/7029] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:06:18.510344 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:18.518138 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c20c6048-1857-42ac-a07a-34bd47e42b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1373 microversion: 2.1 time: 0.190039 Jun 18 23:06:18.518725 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3526/7030] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:18 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:19.535104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:19.542110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:19.542954 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:19.551411 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:19.551949 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:19.552868 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:19.553435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:19.694143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:19.701974 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c212f971-8268-4c01-9dc8-b6380140ea64 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1373 microversion: 2.1 time: 0.168709 Jun 18 23:06:19.702476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3505/7031] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:19 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:20.723519 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:20.724550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:20.728522 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:06:20.738098 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:20.738868 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:20.740189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:20.740637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:20.881025 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:20.892609 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-bd3ecd6f-a011-4204-8dca-9d79dc1b6eff tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1557 microversion: 2.1 time: 0.175843 Jun 18 23:06:20.893334 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3527/7032] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:20 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:20.909073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:06:20.909706 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:06:20.917314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:20.917810 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:20.918586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:20.919032 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:21.052121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:06:21.060293 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-edb2154a-1808-4610-8db6-9cfd95d8ae1e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1557 microversion: 2.1 time: 0.155169 Jun 18 23:06:21.060900 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3506/7033] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:06:20 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:06:23.224672 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-ff1cff86-6f1f-4e5c-acd7-9699ae0d791c req-32cf40cd-d996-45e8-9cc0-5b137a8d69e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:06:23.233638 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff1cff86-6f1f-4e5c-acd7-9699ae0d791c req-32cf40cd-d996-45e8-9cc0-5b137a8d69e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:06:23.234093 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-ff1cff86-6f1f-4e5c-acd7-9699ae0d791c req-32cf40cd-d996-45e8-9cc0-5b137a8d69e9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:06:23.246249 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-ff1cff86-6f1f-4e5c-acd7-9699ae0d791c req-32cf40cd-d996-45e8-9cc0-5b137a8d69e9 service nova] Creating event network-changed:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch2-master-1 Jun 18 23:06:23.251694 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-ff1cff86-6f1f-4e5c-acd7-9699ae0d791c req-32cf40cd-d996-45e8-9cc0-5b137a8d69e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090924 Jun 18 23:06:23.252224 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3528/7034] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:07:54.408640 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:07:54.409932 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:07:54.975705 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:07:54.976632 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:08:17.312280 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [daffbafe-bde8-401a-8699-37b1ad1abba9] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 18 23:08:17.313240 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4c81e5c-75ec-49f9-aa78-65a84e7b7d0c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 18 23:08:17.313825 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:17.314640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=34 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:17.318883 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:08:17.319424 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:17.326667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:17.327124 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:17.327890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:17.328325 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:17.352733 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lazy-loading 'flavor' on Instance uuid 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:08:17.636459 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-15457e04-2a94-4e56-a5a9-ca0b62ddbacc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82/action" status: 202 len: 0 microversion: 2.1 time: 0.326800 Jun 18 23:08:17.637129 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3507/7035] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:08:17 2022] POST /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:08:17.644454 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11af18b5-c620-4e8c-9b06-4a70f2ff4468] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:08:17.645091 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:17.645875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=34 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:17.650269 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:17.650985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:17.658445 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:17.658928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:17.659707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:17.660159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:17.798535 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:17.806612 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-04c22d94-d966-4d2d-806e-67d2f2395e34 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.164658 Jun 18 23:08:17.807155 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3529/7036] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:17 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:18.835976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:18.835976 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:18.848058 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4c81e5c-75ec-49f9-aa78-65a84e7b7d0c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 48690. Jun 18 23:08:18.851172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:18.851628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:18.852415 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:18.852869 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:18.853736 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] [daffbafe-bde8-401a-8699-37b1ad1abba9] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 48688. Jun 18 23:08:18.998137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:19.006046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0fff9ee5-e42f-4412-9a4e-9b37fb117b22 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.184249 Jun 18 23:08:19.006598 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3508/7037] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:18 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:20.027613 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:20.028677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:20.040190 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:20.040667 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:20.041521 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:20.041983 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:20.048492 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] [11af18b5-c620-4e8c-9b06-4a70f2ff4468] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 48694. Jun 18 23:08:20.175988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:20.184265 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b4472008-9b66-4ebe-b856-a151b0bb29e5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.163494 Jun 18 23:08:20.184782 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3530/7038] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:20 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:21.201940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:21.202540 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:21.210260 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:21.210717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:21.211524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:21.211959 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:21.355442 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:21.363601 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c2cc624a-6b87-457b-87a5-d9fbf6e02efe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.165513 Jun 18 23:08:21.364177 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3509/7039] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:21 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:22.385810 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:22.386692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:22.397877 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:22.398645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:22.399911 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:22.400682 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:22.540807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:22.548901 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a8ce430d-d412-41a9-b0e2-866d6a684468 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.170202 Jun 18 23:08:22.549515 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3531/7040] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:22 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:23.570658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:23.571695 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:23.581485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:23.581940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:23.582713 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:23.583156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:23.725541 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:23.734002 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-59cdcc54-2b83-4a9b-889f-0265be43dbaa tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.170045 Jun 18 23:08:23.734623 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3510/7041] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:23 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:24.751265 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:24.751925 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:24.760008 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:24.760471 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:24.761360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:24.761824 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:24.911173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:24.919197 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-4675cc91-04ba-4dc6-8ab6-3a8bcb2f9673 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.172113 Jun 18 23:08:24.919760 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3532/7042] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:24 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:25.937230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:25.937856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:25.945997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:25.946595 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:25.947529 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:25.947964 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:26.102714 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:26.115464 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a338cabc-4ee3-4f42-bbb4-09b89ab8227d tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.182086 Jun 18 23:08:26.116169 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3511/7043] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:25 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:27.141430 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:27.142105 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:27.149590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:27.150053 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:27.150833 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:27.151281 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:27.299898 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:27.307827 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8dad1238-8a18-45a4-bde0-29d447d2f843 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.171219 Jun 18 23:08:27.308397 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3533/7044] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:27 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:28.329778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:28.330777 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:28.343188 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:28.343948 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:28.345166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:28.345600 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:28.492044 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:28.500029 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a56c4ee6-a4a9-42c9-bfc0-8f8cb5182801 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1702 microversion: 2.1 time: 0.177092 Jun 18 23:08:28.500602 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3512/7045] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:28 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1702 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:29.522394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:29.523005 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:29.532903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:29.533590 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:29.534654 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:29.535170 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:29.675857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:29.683885 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9470ae31-7d5d-48ce-9f54-53fffa35a947 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1702 microversion: 2.1 time: 0.167962 Jun 18 23:08:29.684431 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3534/7046] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:29 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1702 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:30.702465 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:30.703813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:30.711425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:30.711890 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:30.712758 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:30.713277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:30.866879 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:30.876045 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-99e03b1c-6c16-4057-a86d-9efe7ca55059 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.178384 Jun 18 23:08:30.876820 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3513/7047] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:30 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:31.893907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:31.895256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:31.902830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:31.903289 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:31.904078 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:31.904530 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:32.075102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:32.083540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-93ad2e25-8d7b-41f1-984a-6d27ac5f4f75 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.193714 Jun 18 23:08:32.084352 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3535/7048] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:31 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:32.974246 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-3ac6b3d4-35d2-435c-8aed-d9214f8332f0 req-9938fed5-938b-41eb-9a6d-61c9833a619b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "name": "network-vif-plugged", "status": "completed", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:08:32.984249 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3ac6b3d4-35d2-435c-8aed-d9214f8332f0 req-9938fed5-938b-41eb-9a6d-61c9833a619b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:32.984586 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-3ac6b3d4-35d2-435c-8aed-d9214f8332f0 req-9938fed5-938b-41eb-9a6d-61c9833a619b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:32.997368 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-3ac6b3d4-35d2-435c-8aed-d9214f8332f0 req-9938fed5-938b-41eb-9a6d-61c9833a619b service nova] Creating event network-vif-plugged:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch2-master-1 Jun 18 23:08:33.019702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-3ac6b3d4-35d2-435c-8aed-d9214f8332f0 req-9938fed5-938b-41eb-9a6d-61c9833a619b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049102 Jun 18 23:08:33.020714 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3514/7049] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:08:33.100591 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:33.101288 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:33.108188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:33.108920 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:33.109755 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:33.110500 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:33.279816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:33.288524 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a636f75a-098f-42b9-87e9-9bf19a0e6bb8 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.191884 Jun 18 23:08:33.289360 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3536/7050] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:33 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:34.309544 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:34.310911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:34.319618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:34.319618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:34.319618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:34.319618 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:34.488162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:34.497626 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-41058281-f7f4-4167-8cee-db1bf4a204d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.193341 Jun 18 23:08:34.498420 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3515/7051] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:34 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:35.516012 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:35.516900 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:35.524426 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:35.524902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:35.525711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:35.526199 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:35.666424 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:35.674388 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-f4ea596b-8e38-4448-93e2-d35636277383 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.162623 Jun 18 23:08:35.675173 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3537/7052] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:35 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:36.692711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:36.693352 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:36.701398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:36.701398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:36.702013 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:36.702455 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:36.849852 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:36.858683 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-31c80a08-d763-4ee2-a78b-89f5e5a8e624 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.170708 Jun 18 23:08:36.859297 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3516/7053] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:36 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:37.879085 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:37.880572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:37.888072 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:37.888540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:37.889362 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:37.889816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:38.055834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:38.064943 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9dab57f8-4d6f-493b-b25b-fc4f4fe98f89 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.192593 Jun 18 23:08:38.065547 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3538/7054] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:37 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:39.082486 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:39.083101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:39.090792 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:39.091242 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:39.092006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:39.092421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:39.230736 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:39.238715 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bf4ef581-7d4d-4684-8b63-d17cb260535b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1697 microversion: 2.1 time: 0.160207 Jun 18 23:08:39.239295 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3517/7055] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:39 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:40.259655 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:40.260734 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:40.273011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:40.273859 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:40.275222 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:40.276102 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:40.417497 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:40.429356 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-146a86d8-c5ee-4e76-9410-1cb291bf8a6b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1679 microversion: 2.1 time: 0.176207 Jun 18 23:08:40.430172 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3539/7056] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:40 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:41.448655 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:41.449285 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:41.457498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:41.457950 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:41.458717 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:41.459151 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:41.606446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:41.614452 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-05cf6596-efb2-46c5-818a-13ae7d65c055 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1679 microversion: 2.1 time: 0.170046 Jun 18 23:08:41.615068 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3518/7057] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:41 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:42.636518 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:42.637540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:42.649487 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.650256 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:42.651592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.652339 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:42.796674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:42.804842 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6c338fd8-8b04-4c3e-b3b5-0412928aa403 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1622 microversion: 2.1 time: 0.174931 Jun 18 23:08:42.805467 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3540/7058] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:42 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1622 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:42.821543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:08:42.822159 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:42.829707 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.830172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:42.830915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.831431 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:42.928989 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e376f573-cc43-48c6-a8a3-83352e942b66 req-81bbd0bb-9b2a-4f9f-8cf6-17df5403a543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "name": "network-vif-unplugged", "status": "completed", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:08:42.938153 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e376f573-cc43-48c6-a8a3-83352e942b66 req-81bbd0bb-9b2a-4f9f-8cf6-17df5403a543 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.938742 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e376f573-cc43-48c6-a8a3-83352e942b66 req-81bbd0bb-9b2a-4f9f-8cf6-17df5403a543 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:42.951491 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.compute.server_external_events [req-e376f573-cc43-48c6-a8a3-83352e942b66 req-81bbd0bb-9b2a-4f9f-8cf6-17df5403a543 service nova] Unable to find a host for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82. Dropping event network-vif-unplugged {{(pid=130903) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 23:08:42.952496 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e376f573-cc43-48c6-a8a3-83352e942b66 req-81bbd0bb-9b2a-4f9f-8cf6-17df5403a543 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028008 Jun 18 23:08:42.953193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3541/7059] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 18 23:08:42.978117 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-cbbd86f2-a1e1-4ec6-83d4-7cbd0d66f3d7 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82/action" status: 202 len: 0 microversion: 2.1 time: 0.160385 Jun 18 23:08:42.980985 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3519/7060] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:08:42 2022] POST /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:08:42.988597 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:42.989277 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:42.995863 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.996354 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:42.997181 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:42.997641 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:43.139501 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:43.148019 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-fd64ad8e-dfe4-4714-9f87-e2ea46cdab39 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1630 microversion: 2.1 time: 0.164398 Jun 18 23:08:43.148748 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3542/7061] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:42 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1630 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:44.166247 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:44.166871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:44.173485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:44.173969 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:44.174727 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:44.175176 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:44.319170 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:44.329177 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-c9aa25f1-c1a0-474d-8d30-c3f446db8b3a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.167772 Jun 18 23:08:44.333276 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3520/7062] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:44 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:08:45.272369 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-8bbb7520-17ff-45ce-825c-2adeae49daa7 req-64b48f03-e49b-4a5c-b0d2-8612ea16d4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:08:45.282392 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8bbb7520-17ff-45ce-825c-2adeae49daa7 req-64b48f03-e49b-4a5c-b0d2-8612ea16d4f8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:45.288715 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-8bbb7520-17ff-45ce-825c-2adeae49daa7 req-64b48f03-e49b-4a5c-b0d2-8612ea16d4f8 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:45.310437 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-8bbb7520-17ff-45ce-825c-2adeae49daa7 req-64b48f03-e49b-4a5c-b0d2-8612ea16d4f8 service nova] Creating event network-changed:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch1-master-1 Jun 18 23:08:45.317493 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-8bbb7520-17ff-45ce-825c-2adeae49daa7 req-64b48f03-e49b-4a5c-b0d2-8612ea16d4f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048142 Jun 18 23:08:45.318455 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3543/7063] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:08:45.350459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:45.351277 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:45.359028 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:45.359484 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:45.360281 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:45.360718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:45.365578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:45.506643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:45.514569 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4359e376-fc59-4f37-bfd8-7336869ef1af tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.170473 Jun 18 23:08:45.515165 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3521/7064] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:45 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:46.532721 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:46.533566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:46.546765 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:46.548245 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:46.549651 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:46.550757 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:46.746039 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:46.754044 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-449d67aa-68ca-45f4-a6c9-ca19fc521004 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.226777 Jun 18 23:08:46.754633 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3544/7065] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:46 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:47.783722 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:47.784351 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:47.787445 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=33 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:47.794354 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:47.795139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:47.796273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:47.796968 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:47.938711 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:47.950789 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0913833c-25e5-4fc7-938f-616b9d449114 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.182476 Jun 18 23:08:47.951650 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3522/7066] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:47 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:48.968444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:48.969276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:48.973593 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=33 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:48.980155 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:48.980616 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:48.981410 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:48.981855 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:48.984681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=89 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:08:49.124857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:49.135532 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e762e65a-e660-4969-8666-5973bb477856 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.171354 Jun 18 23:08:49.136364 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3545/7067] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:48 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:50.155355 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:50.155978 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:50.162863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:50.163282 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:50.164092 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:50.164526 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:50.305053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:50.313486 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-657f6006-672f-4f41-927d-ae71c326d76e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.162122 Jun 18 23:08:50.323095 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3523/7068] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:50 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:51.334296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:51.335121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:51.345164 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:51.345845 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:51.346985 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:51.347635 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:51.494188 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:51.503364 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88b10d16-93ef-4a08-b55b-9348964f57d6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.175157 Jun 18 23:08:51.504254 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3546/7069] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:51 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:52.524756 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:52.525578 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:52.532518 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:52.533167 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:52.534507 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:52.535106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:52.686471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:52.696676 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-069eb683-5564-45a8-8f57-588d997180d3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.178800 Jun 18 23:08:52.698130 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3524/7070] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:52 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:53.715220 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:53.715890 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:53.722773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:53.723246 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:53.724038 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:53.724528 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:53.900127 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:53.908315 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2a3865b3-ebf4-4b51-8ab6-7c53e7512add tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.197576 Jun 18 23:08:53.908898 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3547/7071] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:53 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:54.926677 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:54.927328 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:54.935193 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:54.935643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:54.936416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:54.936866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:55.093914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:55.101881 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0145dd3a-619e-45f2-8a01-5e9d56ba3cfc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.179278 Jun 18 23:08:55.102456 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3525/7072] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:54 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:56.119806 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:56.120494 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:56.127812 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:56.128278 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:56.129087 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:56.129538 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:56.267558 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:56.275311 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-83b02590-45e3-4bb7-add8-c3a61a8a8c6f tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.159621 Jun 18 23:08:56.275895 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3548/7073] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:56 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:57.296813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:57.297511 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:57.306172 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:57.306699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:57.307598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:57.308111 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:57.456753 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:57.469074 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-620b9e3a-4fc5-4c9b-92a7-d5688a929c31 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.178240 Jun 18 23:08:57.469906 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3526/7074] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:57 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:58.490880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:58.491895 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:58.501296 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:58.501769 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:58.502601 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:58.503059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:58.636705 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:58.645695 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-88d34884-c5d4-4ad6-adc4-a8ae1fefbaef tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.161597 Jun 18 23:08:58.646248 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3549/7075] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:58 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:08:59.663457 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:08:59.664074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:08:59.671687 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:59.672144 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:59.672921 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:08:59.673393 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:08:59.814696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:08:59.822966 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-3e81555c-64e7-4dd4-b6a8-218f234587fe tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.163553 Jun 18 23:08:59.823550 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3527/7076] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:08:59 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:00.843114 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:00.843743 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:00.851252 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:00.851718 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:00.852520 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:00.852975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:00.992176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:01.000023 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-75cd399d-7ad7-45af-bd9c-26210451041b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.163033 Jun 18 23:09:01.000605 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3550/7077] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:00 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:02.017686 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:02.018316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:02.025863 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:02.026320 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:02.027120 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:02.027556 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:02.163594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:02.171499 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-2bb1c5f1-f73b-4c0d-a1ad-e033023f925c tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.158229 Jun 18 23:09:02.172077 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3528/7078] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:02 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:03.193550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:03.194650 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:03.204685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:03.205218 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:03.206023 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:03.206470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:03.357157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:03.365586 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-430912ef-cb5a-4f46-b67e-8ba24371fd8b tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.178696 Jun 18 23:09:03.366173 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3551/7079] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:03 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:04.388497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:04.389416 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:04.396681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:04.397078 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:04.397875 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:04.398313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:04.536053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:04.544031 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-da00de78-8e23-4692-a50a-d50a99b097b5 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.159707 Jun 18 23:09:04.544692 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3529/7080] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:04 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:05.565727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:05.566703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:05.578438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:05.578887 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:05.579684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:05.580138 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:05.756842 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:05.765075 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6eb9c684-7662-43d1-86a9-6753bbb10078 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.206105 Jun 18 23:09:05.765686 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3552/7081] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:05 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:06.065362 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-260123d2-e04d-40d3-b55a-7cf6ca05fc4f req-0d6dad7d-03a5-4803-9fe1-89eb39c39711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "name": "network-vif-plugged", "status": "completed", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:09:06.075067 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-260123d2-e04d-40d3-b55a-7cf6ca05fc4f req-0d6dad7d-03a5-4803-9fe1-89eb39c39711 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:06.075594 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-260123d2-e04d-40d3-b55a-7cf6ca05fc4f req-0d6dad7d-03a5-4803-9fe1-89eb39c39711 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:06.087708 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-260123d2-e04d-40d3-b55a-7cf6ca05fc4f req-0d6dad7d-03a5-4803-9fe1-89eb39c39711 service nova] Creating event network-vif-plugged:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch1-master-1 Jun 18 23:09:06.093218 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-260123d2-e04d-40d3-b55a-7cf6ca05fc4f req-0d6dad7d-03a5-4803-9fe1-89eb39c39711 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031873 Jun 18 23:09:06.093805 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3530/7082] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:09:06.787109 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:06.788161 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:06.799862 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:06.800714 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:06.802055 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:06.802798 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:06.944708 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:06.954266 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-63ef418a-c62f-41cc-a3e6-ec69207438b6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.173855 Jun 18 23:09:06.954857 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3553/7083] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:06 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:07.973763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:07.974473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:07.981435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:07.981885 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:07.982658 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:07.983101 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:08.119289 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:08.127238 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e93de9e3-9778-4743-80e8-05e846acbfae tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1688 microversion: 2.1 time: 0.158850 Jun 18 23:09:08.127876 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3531/7084] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:07 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:09:09.147139 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:09:09.147771 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:09:09.155531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:09.155991 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:09.156770 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:09:09.157253 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:09:09.301875 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:09:09.309633 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c581f420-5530-4590-9fa0-afcaf9b92b13 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1675 microversion: 2.1 time: 0.166908 Jun 18 23:09:09.310207 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3554/7085] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:09:09 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:45.710190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=19 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:45.711391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=60 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:45.715276 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-e62670c8-d7db-40de-b996-5b6ed2a58ecf req-7c67e1fc-34d7-4672-9e79-e29d27a40e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:10:45.717487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:45.718001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:45.720043 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa28b31b-680e-43c3-b969-f3270b284fb4] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 18 23:10:45.720917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=19 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:45.721837 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=59 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:45.727441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:45.728110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:45.728250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e62670c8-d7db-40de-b996-5b6ed2a58ecf req-7c67e1fc-34d7-4672-9e79-e29d27a40e1f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:45.728744 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-e62670c8-d7db-40de-b996-5b6ed2a58ecf req-7c67e1fc-34d7-4672-9e79-e29d27a40e1f service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:45.728897 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:45.729398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:45.741682 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-e62670c8-d7db-40de-b996-5b6ed2a58ecf req-7c67e1fc-34d7-4672-9e79-e29d27a40e1f service nova] Creating event network-changed:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch1-master-1 Jun 18 23:10:45.747591 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-e62670c8-d7db-40de-b996-5b6ed2a58ecf req-7c67e1fc-34d7-4672-9e79-e29d27a40e1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037659 Jun 18 23:10:45.748276 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3555/7086] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:10:45.758353 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:10:45.847308 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ebb911e6-d8e4-48d2-96c3-7f313b6079ac tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 204 len: 0 microversion: 2.1 time: 0.138795 Jun 18 23:10:45.851587 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3532/7087] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:10:45 2022] DELETE /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:10:45.860550 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:45.861484 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:45.868509 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:45.869361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:45.870508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:45.871034 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:46.091816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:46.099785 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-0e6e72fc-7bd9-4397-be37-c9357e98a448 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.246500 Jun 18 23:10:46.100439 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3556/7088] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:45 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:47.118358 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:47.118980 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:47.126878 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:47.127357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:47.128139 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:47.128570 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:47.325342 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:47.333702 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-be66904c-b764-484f-bdaf-b98a283dbaf1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 200 len: 1681 microversion: 2.1 time: 0.220256 Jun 18 23:10:47.334282 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3533/7089] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:47 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:47.731486 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5f7a7e7c-3a2e-4b56-a004-aa47b2b8fda9 req-3a0628e7-b5a7-47dd-bfe9-3f4cb7df9d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fd18d24-c9f4-4d12-9c16-ee628e6fca82", "name": "network-vif-deleted", "tag": "99010b4f-6584-4892-8d7f-4e2c42953995"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:10:47.742329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5f7a7e7c-3a2e-4b56-a004-aa47b2b8fda9 req-3a0628e7-b5a7-47dd-bfe9-3f4cb7df9d29 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:47.742820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5f7a7e7c-3a2e-4b56-a004-aa47b2b8fda9 req-3a0628e7-b5a7-47dd-bfe9-3f4cb7df9d29 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:47.755489 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5f7a7e7c-3a2e-4b56-a004-aa47b2b8fda9 req-3a0628e7-b5a7-47dd-bfe9-3f4cb7df9d29 service nova] Creating event network-vif-deleted:99010b4f-6584-4892-8d7f-4e2c42953995 for instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 on nch1-master-1 Jun 18 23:10:47.761241 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5f7a7e7c-3a2e-4b56-a004-aa47b2b8fda9 req-3a0628e7-b5a7-47dd-bfe9-3f4cb7df9d29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Jun 18 23:10:47.761944 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3557/7090] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:10:48.355697 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:48.356332 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 7fd18d24-c9f4-4d12-9c16-ee628e6fca82] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:48.364404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:48.364904 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:48.365791 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:48.366273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:48.381574 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] HTTP exception thrown: Instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 could not be found. Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Request method failure captured: Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 HTTP/1.1 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlpXHuJH7Tl-ktV8gWlwrwpqTgCn9uTND9z6lLkF2d8GpD_I-shiF6WSLICAgaGFd8NBzKanVElnXqPxJtl1U-NorMyFXTvM9h8ivPK8IHKhBUEQi0DTJfqtNi9nCjgz7m8f5zqq55qRjMm-yTjbYFCpBTf2zGi-5_fNPrGaT3zpAuA Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: cf0a1057e25d41ca9225c5e5072f17a9 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestShelveInstance-658414119 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cf0a1057e25d41ca9225c5e5072f17a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf0a1057e25d41ca9225c5e5072f17a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf0a1057e25d41ca9225c5e5072f17a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cf0a1057e25d41ca9225c5e5072f17a9", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestShelveInstance-658414119 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: cf0a1057e25d41ca9225c5e5072f17a9 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestShelveInstance-658414119 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestShelveInstance-658414119-project Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: 62490dbd2f174221b6dda00ce8c3e916 Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestShelveInstance-658414119-project Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 could not be found. Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': '7fd18d24-c9f4-4d12-9c16-ee628e6fca82'} Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 could not be found. Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 could not be found. Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:10:48.383409 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 could not be found. Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Returning 404 to user: Instance 7fd18d24-c9f4-4d12-9c16-ee628e6fca82 could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-51a17e3a-dc7a-4af1-9839-ca763fa81edc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82" status: 404 len: 111 microversion: 2.1 time: 0.035442 Jun 18 23:10:48.388953 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3534/7091] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:48 2022] GET /compute/v2.1/servers/7fd18d24-c9f4-4d12-9c16-ee628e6fca82 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:10:48.555235 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-266b05ae-8963-4882-b911-d69559683d97 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '.version_select at 0x7fea145a1160>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:48.559693 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa28b31b-680e-43c3-b969-f3270b284fb4] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49020. Jun 18 23:10:48.582416 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-266b05ae-8963-4882-b911-d69559683d97 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1674230062" status: 202 len: 0 microversion: 2.1 time: 0.032533 Jun 18 23:10:48.583349 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3558/7092] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 23:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1674230062 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:10:48.608317 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a191277-2fb6-4fcb-a24d-b193e64c04f0 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'create', calling method: .version_select at 0x7fea0725f9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1223946460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmw41VTkiG62g7yvLLHjK7xGBB9Sf6IZDuwlrIey0jnVWbbF1/qeb1ljhpO85jSzBpKnoDKkwrNxdqeixPZXTj4AsvFmRqBqc97Xgek7iWI7wALdD+gFofTZqIZ5J9kPA=="}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:10:48.622414 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1a191277-2fb6-4fcb-a24d-b193e64c04f0 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:10:48.627640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-1a191277-2fb6-4fcb-a24d-b193e64c04f0 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for user 62490dbd2f174221b6dda00ce8c3e916 and project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'key_pairs'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:10:48.641051 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1a191277-2fb6-4fcb-a24d-b193e64c04f0 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:10:49.651436 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-1a191277-2fb6-4fcb-a24d-b193e64c04f0 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [c2c6ccb9-231d-4d07-bc66-356fd2dad4e5] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49030. Jun 18 23:10:49.670388 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a191277-2fb6-4fcb-a24d-b193e64c04f0 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.066081 Jun 18 23:10:49.671219 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3535/7093] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 23:10:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:10:53.252402 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2102442467", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1223946460", "security_groups": [{"name": "tempest-secgroup-smoke-742343588"}], "networks": [{"uuid": "f11d592a-b12f-40b0-9589-7e1d4e589175"}], "block_device_mapping_v2": [{"uuid": "e0c09c67-8c18-4506-8650-73e45a9d5b0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:10:53.378849 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.network.neutron [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] validate_networks() for [('f11d592a-b12f-40b0-9589-7e1d4e589175', None, None, None, None, None)] {{(pid=130903) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:10:53.816678 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Flavor limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:10:53.817365 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Image limits 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:10:53.818108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Flavor pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:10:53.818740 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Image pref 0:0:0 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:10:53.819417 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.virt.hardware [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130903) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:10:53.834064 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:53.834664 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:53.835936 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:53.836532 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:53.856456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:10:53.861790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Getting quotas for user 62490dbd2f174221b6dda00ce8c3e916 and project cf0a1057e25d41ca9225c5e5072f17a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:10:53.931585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Going to run 1 instances... {{(pid=130903) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:10:53.933903 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0c09c67-8c18-4506-8650-73e45a9d5b0d',volume_size=None,volume_type=None)] {{(pid=130903) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:10:54.082316 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-09f07ffd-64a6-464c-a649-3c777e1aedad tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.834788 Jun 18 23:10:54.082900 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3559/7094] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:10:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 23:10:54.093716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55a8eea2-1b1c-4af0-96db-ea0fd9feaa04 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:54.094459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55a8eea2-1b1c-4af0-96db-ea0fd9feaa04 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:54.149082 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55a8eea2-1b1c-4af0-96db-ea0fd9feaa04 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:54.156404 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55a8eea2-1b1c-4af0-96db-ea0fd9feaa04 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1089 microversion: 2.1 time: 0.066860 Jun 18 23:10:54.156980 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3536/7095] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:54 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:55.173657 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-eb3ff944-af1a-4ff9-8f04-e64511a2bd43 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:55.174290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-eb3ff944-af1a-4ff9-8f04-e64511a2bd43 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:55.228470 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-eb3ff944-af1a-4ff9-8f04-e64511a2bd43 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:55.235327 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-eb3ff944-af1a-4ff9-8f04-e64511a2bd43 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1089 microversion: 2.1 time: 0.066632 Jun 18 23:10:55.235954 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3560/7096] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:55 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:56.256426 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-81e31e64-c99f-4f7c-bd8f-05f3fd139ea3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:56.257498 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-81e31e64-c99f-4f7c-bd8f-05f3fd139ea3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:56.328696 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-81e31e64-c99f-4f7c-bd8f-05f3fd139ea3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:56.335958 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-81e31e64-c99f-4f7c-bd8f-05f3fd139ea3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1089 microversion: 2.1 time: 0.086313 Jun 18 23:10:56.336884 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3537/7097] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:56 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1089 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:57.368653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6923dc24-6581-4eef-ae80-a8a7440ab906 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:57.369720 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6923dc24-6581-4eef-ae80-a8a7440ab906 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:57.438846 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6923dc24-6581-4eef-ae80-a8a7440ab906 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:57.446155 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6923dc24-6581-4eef-ae80-a8a7440ab906 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1089 microversion: 2.1 time: 0.084208 Jun 18 23:10:57.446718 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3561/7098] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:57 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:58.467785 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:58.468955 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:58.472635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:10:58.478903 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:58.479404 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:58.480217 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:58.480659 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:58.545610 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:58.553634 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-88e3c246-0581-4864-858a-e386d399eedb tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1139 microversion: 2.1 time: 0.092950 Jun 18 23:10:58.554212 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3538/7099] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:58 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:10:59.570835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:10:59.571456 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:10:59.580360 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:59.580836 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:59.581988 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:10:59.582450 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:10:59.655726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:10:59.665276 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-d3cc4f9f-1e93-4007-baed-df29e50d7768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1205 microversion: 2.1 time: 0.098392 Jun 18 23:10:59.669069 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3562/7100] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:10:59 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:00.673467 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-20969c83-43e0-4f89-80c6-6c39897df295 req-be45e111-d958-4e54-8873-1fd4047f189b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:11:00.683049 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-20969c83-43e0-4f89-80c6-6c39897df295 req-be45e111-d958-4e54-8873-1fd4047f189b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:00.683294 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:00.683735 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-20969c83-43e0-4f89-80c6-6c39897df295 req-be45e111-d958-4e54-8873-1fd4047f189b service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:00.683857 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:00.691207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:00.691948 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:00.692928 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:00.693576 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:00.695547 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-20969c83-43e0-4f89-80c6-6c39897df295 req-be45e111-d958-4e54-8873-1fd4047f189b service nova] Creating event network-changed:11415b2c-4043-41d6-abae-0ae8631400bf for instance 36197cbd-3191-46fc-b426-95ca8f785d54 on nch2-master-1 Jun 18 23:11:00.701405 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-20969c83-43e0-4f89-80c6-6c39897df295 req-be45e111-d958-4e54-8873-1fd4047f189b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095320 Jun 18 23:11:00.702476 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3539/7101] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:11:00.847158 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:00.855274 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-e174f05b-1e1a-4c3b-b242-80c79bd309f4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.176111 Jun 18 23:11:00.855858 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3563/7102] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:00 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 18 23:11:01.875294 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:01.876302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:01.887629 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:01.888232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:01.889487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:01.890018 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:02.034079 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:02.042148 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0198ac4e-155d-4cf6-9923-00b732e4a743 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.173329 Jun 18 23:11:02.042660 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3540/7103] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:01 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:03.059970 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:03.060606 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:03.068259 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:03.068729 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:03.069572 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:03.070027 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:03.208031 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:03.216352 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-7f199aa3-92fb-4644-bf36-b9c21fa83768 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.160386 Jun 18 23:11:03.217119 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3564/7104] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:03 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:04.242375 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:04.243402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:04.253456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:04.253914 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:04.254693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:04.255132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:04.403643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:04.411903 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-5495a779-501f-4015-b217-75e6d6a46846 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.176258 Jun 18 23:11:04.412519 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3541/7105] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:04 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:05.434907 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:05.493152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:05.493788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:05.500059 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:05.500526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:05.501335 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:05.501788 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:05.637571 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:05.645939 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c0c22547-2667-439f-8e26-0521997fe371 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.218912 Jun 18 23:11:05.646520 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3565/7106] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:05 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:06.667801 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:06.668660 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:06.673295 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=8 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:06.682598 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:06.683350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:06.684601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:06.685378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:06.828345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:06.836284 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-0d5f0b09-222f-4b1d-83d8-d593da13e9c4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.175430 Jun 18 23:11:06.836869 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3542/7107] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:06 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:07.854332 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:07.855834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:07.858932 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=10 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:11:07.866598 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:07.867478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:07.868398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:07.868756 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:07.915178 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-2c692516-f5bc-4e0b-a4be-f9ce25472421 req-a0ee2476-7df9-4918-940f-94d375a1a744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "name": "network-vif-plugged", "status": "completed", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:11:07.932345 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2c692516-f5bc-4e0b-a4be-f9ce25472421 req-a0ee2476-7df9-4918-940f-94d375a1a744 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:07.933299 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-2c692516-f5bc-4e0b-a4be-f9ce25472421 req-a0ee2476-7df9-4918-940f-94d375a1a744 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:07.951904 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-2c692516-f5bc-4e0b-a4be-f9ce25472421 req-a0ee2476-7df9-4918-940f-94d375a1a744 service nova] Creating event network-vif-plugged:11415b2c-4043-41d6-abae-0ae8631400bf for instance 36197cbd-3191-46fc-b426-95ca8f785d54 on nch2-master-1 Jun 18 23:11:07.959803 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-2c692516-f5bc-4e0b-a4be-f9ce25472421 req-a0ee2476-7df9-4918-940f-94d375a1a744 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048716 Jun 18 23:11:07.960526 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3543/7108] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:11:08.012051 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:08.020215 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6e6e1d7b-3292-4bc1-8dd9-d1083b04864e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.170334 Jun 18 23:11:08.020798 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3566/7109] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:07 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:09.037638 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:09.038368 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:09.046072 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:09.046559 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:09.047329 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:09.047770 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:09.191524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:09.199472 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-a8e8ac45-eda3-4f5a-9738-572839facc2e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1260 microversion: 2.1 time: 0.166411 Jun 18 23:11:09.200068 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3544/7110] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:09 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:10.217415 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:10.218121 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:10.225712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:10.226176 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:10.226975 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:10.227398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:10.366030 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:10.374161 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-19771840-bcff-48fd-b612-236077015759 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1443 microversion: 2.1 time: 0.161501 Jun 18 23:11:10.374757 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3567/7111] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:10 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:10.393553 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:11:10.394389 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:11:10.401874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:10.402339 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:10.403121 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:10.403562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:10.542110 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:11:10.550241 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-116cc0dc-c9bf-4ab4-b197-3b4d6347fa99 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1443 microversion: 2.1 time: 0.160748 Jun 18 23:11:10.550797 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3545/7112] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:11:10 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:11:12.473481 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-3c898524-1592-422f-a382-75ed1dc8d8d7 req-f3e76841-45a2-4814-b0b6-04564d5d451d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:11:12.482733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3c898524-1592-422f-a382-75ed1dc8d8d7 req-f3e76841-45a2-4814-b0b6-04564d5d451d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:11:12.483271 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-3c898524-1592-422f-a382-75ed1dc8d8d7 req-f3e76841-45a2-4814-b0b6-04564d5d451d service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:11:12.494870 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-3c898524-1592-422f-a382-75ed1dc8d8d7 req-f3e76841-45a2-4814-b0b6-04564d5d451d service nova] Creating event network-changed:11415b2c-4043-41d6-abae-0ae8631400bf for instance 36197cbd-3191-46fc-b426-95ca8f785d54 on nch2-master-1 Jun 18 23:11:12.500064 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-3c898524-1592-422f-a382-75ed1dc8d8d7 req-f3e76841-45a2-4814-b0b6-04564d5d451d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 Jun 18 23:11:12.500779 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3568/7113] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:11:14.990265 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:11:14.990915 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:12:54.425329 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:12:54.426228 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:12:54.484130 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:12:54.484844 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:13:17.494298 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:17.495037 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=40 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:17.499331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:13:17.499901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:17.507437 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:17.507901 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:17.508743 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:17.509230 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:17.533276 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lazy-loading 'flavor' on Instance uuid 36197cbd-3191-46fc-b426-95ca8f785d54 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:13:17.609623 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e54bf7b8-04e3-4514-b5e0-203f27a2510a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54/action" status: 202 len: 0 microversion: 2.1 time: 0.117381 Jun 18 23:13:17.610565 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3546/7114] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:13:17 2022] POST /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:13:17.617804 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:17.618697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=50 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:13:17.623001 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:17.623732 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:17.631933 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:17.632455 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:17.633398 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:17.633848 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:17.772477 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:17.780544 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-16ff27c5-f2a3-4253-a8a9-f2f4fdfd731a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.165269 Jun 18 23:13:17.781130 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3569/7115] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:17 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:18.803621 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:18.804699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:18.813671 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:18.814153 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:18.814965 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:18.815428 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:18.965607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:18.977480 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ec22031e-103c-45a7-9809-f49150868dbd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.180923 Jun 18 23:13:18.978211 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3547/7116] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:18 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:20.000048 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:20.000686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:20.008653 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:20.009146 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:20.009930 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:20.010388 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:20.145540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:20.155282 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a64cea7c-aa4d-489c-85c1-ce879b71abcf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.159149 Jun 18 23:13:20.155929 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3570/7117] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:19 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:21.181357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:21.182383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:21.190619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:21.191071 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:21.191858 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:21.192316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:21.338872 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:21.347670 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b098fa3c-3dec-41e5-a51b-2023606a57a6 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.171647 Jun 18 23:13:21.348270 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3548/7118] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:21 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:22.366135 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:22.366693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:22.374302 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:22.374767 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:22.375560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:22.376011 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:22.512626 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:22.520798 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-be8a1673-b5e6-4961-96de-57d1ace326f1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.158797 Jun 18 23:13:22.521424 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3571/7119] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:22 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:23.540016 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:23.540676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:23.548166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:23.548640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:23.549441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:23.549886 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:23.687245 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:23.695217 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-16963a3d-df28-4873-b806-831b03e58222 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.159695 Jun 18 23:13:23.695795 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3549/7120] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:23 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:24.715752 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:24.716710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:24.728013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:24.728726 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:24.729762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:24.730207 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:24.887777 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:24.896063 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ae3f90af-9aab-46ee-91dc-f2bdf128fb09 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.186940 Jun 18 23:13:24.896657 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3572/7121] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:24 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:25.922132 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:25.923267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:25.934552 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:25.935009 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:25.935798 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:25.936237 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:26.076177 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:26.087755 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d3db7f94-5fc5-4250-b0ad-0c27bf954779 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.171896 Jun 18 23:13:26.088640 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3550/7122] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:25 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:27.115612 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:27.116660 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:27.128674 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:27.129488 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:27.130773 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:27.131510 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:27.276348 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:27.284287 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-917acd54-d962-492b-a9f1-d8cd834240a4 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.175483 Jun 18 23:13:27.284868 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3573/7123] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:27 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:28.301859 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:28.302488 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:28.310349 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:28.310813 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:28.311605 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:28.312056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:28.445003 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:28.457897 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f6f152e7-bfd3-4af1-aeb5-f82a4711a609 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.160064 Jun 18 23:13:28.458483 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3551/7124] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:28 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:29.484739 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:29.485888 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:29.497230 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:29.497703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:29.498496 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:29.498953 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:29.653178 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:29.661369 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-56f27533-904b-46de-a3e1-09ba8a9bee41 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.183156 Jun 18 23:13:29.661989 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3574/7125] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:29 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:30.682273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:30.683215 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:30.691653 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:30.692109 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:30.692873 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:30.693341 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:30.829202 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:30.837534 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-7e0e490d-f27e-4c5e-924f-433017b2dead tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1508 microversion: 2.1 time: 0.161867 Jun 18 23:13:30.838113 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3552/7126] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:30 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:30.854594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:13:30.855242 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:30.862693 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:30.863160 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:30.863943 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:30.864361 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:30.964548 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-765284e2-a531-49cf-b07d-4f49f681dd4a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "POST /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54/action" status: 202 len: 0 microversion: 2.1 time: 0.113603 Jun 18 23:13:30.965193 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3575/7127] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:13:30 2022] POST /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:13:30.979157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:30.979775 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:30.987103 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:30.987628 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:30.988476 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:30.989001 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:31.139419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:31.148096 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4af2755f-ecdd-4fc5-bc57-1f72acebdbde tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1516 microversion: 2.1 time: 0.173262 Jun 18 23:13:31.148530 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3553/7128] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:30 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:32.166444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:32.167049 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:32.176019 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:32.176977 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:32.177830 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:32.178292 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:32.286134 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-0477a613-f8b8-40c3-82e7-196b3b6d101e req-4b5169be-91ae-4677-bc74-601d47cff3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "name": "network-vif-unplugged", "status": "completed", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:13:32.295430 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0477a613-f8b8-40c3-82e7-196b3b6d101e req-4b5169be-91ae-4677-bc74-601d47cff3cc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:32.296385 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-0477a613-f8b8-40c3-82e7-196b3b6d101e req-4b5169be-91ae-4677-bc74-601d47cff3cc service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:32.311156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.compute.server_external_events [req-0477a613-f8b8-40c3-82e7-196b3b6d101e req-4b5169be-91ae-4677-bc74-601d47cff3cc service nova] Unable to find a host for instance 36197cbd-3191-46fc-b426-95ca8f785d54. Dropping event network-vif-unplugged {{(pid=130902) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 18 23:13:32.312634 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-0477a613-f8b8-40c3-82e7-196b3b6d101e req-4b5169be-91ae-4677-bc74-601d47cff3cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.094254 Jun 18 23:13:32.315725 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3554/7129] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 18 23:13:32.339045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:32.347529 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-03898e7e-22c3-4773-8c46-a948dd78625e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1518 microversion: 2.1 time: 0.185891 Jun 18 23:13:32.348120 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3576/7130] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:32 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:33.366098 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:33.366809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:33.374481 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:33.375007 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:33.375857 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:33.376350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:33.511097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:33.519076 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c78d9bf-b48b-49f6-b879-fc70897f8f94 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1574 microversion: 2.1 time: 0.156957 Jun 18 23:13:33.519678 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3555/7131] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:33 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:34.543954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:34.545427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:34.557950 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:34.558713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:34.560843 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:34.562143 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:34.701892 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:34.709963 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-470747ef-8721-4dd5-89bd-d046c92d6eb1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1574 microversion: 2.1 time: 0.172633 Jun 18 23:13:34.710550 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3577/7132] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:34 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:35.731839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:35.732912 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:35.741219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:35.741680 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:35.742456 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:35.742902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:35.883996 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:35.895578 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-aac33cd1-5958-43d9-8cd3-33942963766a tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1574 microversion: 2.1 time: 0.170225 Jun 18 23:13:35.896416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3556/7133] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:35 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:36.916803 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:36.917805 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:36.926645 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:36.927108 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:36.927893 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:36.928338 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:37.066710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:37.074547 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-b06972e2-e2cf-40f1-a450-6ee06dea70b1 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1574 microversion: 2.1 time: 0.164443 Jun 18 23:13:37.075134 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3578/7134] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:36 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:38.093438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:38.094232 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:38.102841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:38.103374 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:38.104273 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:38.104786 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:38.242030 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:38.249875 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-eac18040-da43-40b7-be48-d93b2f697c47 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1574 microversion: 2.1 time: 0.161613 Jun 18 23:13:38.250795 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3557/7135] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:38 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:38.305448 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-74ccdd86-e477-4f3e-9b48-1cb6d5843931 req-61d28d80-5d8a-48bd-9a20-b8beeef8728e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "name": "network-vif-plugged", "status": "completed", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:13:38.315239 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-74ccdd86-e477-4f3e-9b48-1cb6d5843931 req-61d28d80-5d8a-48bd-9a20-b8beeef8728e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:38.315706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-74ccdd86-e477-4f3e-9b48-1cb6d5843931 req-61d28d80-5d8a-48bd-9a20-b8beeef8728e service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:38.328003 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-74ccdd86-e477-4f3e-9b48-1cb6d5843931 req-61d28d80-5d8a-48bd-9a20-b8beeef8728e service nova] Creating event network-vif-plugged:11415b2c-4043-41d6-abae-0ae8631400bf for instance 36197cbd-3191-46fc-b426-95ca8f785d54 on nch2-master-1 Jun 18 23:13:38.333476 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-74ccdd86-e477-4f3e-9b48-1cb6d5843931 req-61d28d80-5d8a-48bd-9a20-b8beeef8728e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Jun 18 23:13:38.334106 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3579/7136] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:13:39.270004 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:39.270607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:39.278137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:39.278593 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:39.279377 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:39.279815 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:39.419888 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:39.428046 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-4a8cb61f-319a-40f0-a707-53003a92f7bd tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1574 microversion: 2.1 time: 0.162536 Jun 18 23:13:39.429416 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3558/7137] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:39 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:13:40.451035 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:13:40.452044 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:13:40.461438 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:40.462094 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:40.463197 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:13:40.463835 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:13:40.612115 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:13:40.620051 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1f091f6e-83a3-4a3e-9448-6f6661fe65f3 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1561 microversion: 2.1 time: 0.176514 Jun 18 23:13:40.620708 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3580/7138] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:13:40 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:14:34.999860 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:14:35.000838 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:14:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:15:01.888154 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=26 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:01.889701 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:01.893856 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-dbc35451-9aa3-4cf8-a749-af3ef829c79c req-6d605344-d63a-44d3-b8a2-110f0d9c2135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:01.894359 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:01.895224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:01.902686 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=26 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:01.903508 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:01.903693 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:01.904218 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:01.905297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:01.905763 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:01.906992 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dbc35451-9aa3-4cf8-a749-af3ef829c79c req-6d605344-d63a-44d3-b8a2-110f0d9c2135 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:01.907458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-dbc35451-9aa3-4cf8-a749-af3ef829c79c req-6d605344-d63a-44d3-b8a2-110f0d9c2135 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:01.924540 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-dbc35451-9aa3-4cf8-a749-af3ef829c79c req-6d605344-d63a-44d3-b8a2-110f0d9c2135 service nova] Creating event network-changed:11415b2c-4043-41d6-abae-0ae8631400bf for instance 36197cbd-3191-46fc-b426-95ca8f785d54 on nch2-master-1 Jun 18 23:15:01.931829 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-dbc35451-9aa3-4cf8-a749-af3ef829c79c req-6d605344-d63a-44d3-b8a2-110f0d9c2135 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043449 Jun 18 23:15:01.932788 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3581/7139] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:15:01.936997 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:15:02.026712 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-bbf8b7cc-bcef-4571-986a-b3ba075412ba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "DELETE /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 204 len: 0 microversion: 2.1 time: 0.139363 Jun 18 23:15:02.026712 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3559/7140] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:15:01 2022] DELETE /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:15:02.041566 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:02.042702 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:02.054861 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:02.055370 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:02.056224 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:02.056692 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:02.192712 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:02.200483 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-2eb28dfa-2422-41fd-852e-543cfbfa5dba tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.163937 Jun 18 23:15:02.201086 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3582/7141] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:02 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:03.220302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:03.221017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:03.228494 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:03.228984 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:03.229789 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:03.230633 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:03.374871 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:03.383730 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-63e1ee8c-c859-4973-9361-f5b940cf153e tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1567 microversion: 2.1 time: 0.168206 Jun 18 23:15:03.384315 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3560/7142] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:03 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:04.032826 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-803e8314-8749-41d8-af0e-0ea69abf9875 req-2a6f3a46-b731-4aa4-88ab-60d46ce90cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36197cbd-3191-46fc-b426-95ca8f785d54", "name": "network-vif-deleted", "tag": "11415b2c-4043-41d6-abae-0ae8631400bf"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:04.044776 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-803e8314-8749-41d8-af0e-0ea69abf9875 req-2a6f3a46-b731-4aa4-88ab-60d46ce90cc9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:04.045820 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-803e8314-8749-41d8-af0e-0ea69abf9875 req-2a6f3a46-b731-4aa4-88ab-60d46ce90cc9 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:04.059271 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-803e8314-8749-41d8-af0e-0ea69abf9875 req-2a6f3a46-b731-4aa4-88ab-60d46ce90cc9 service nova] Creating event network-vif-deleted:11415b2c-4043-41d6-abae-0ae8631400bf for instance 36197cbd-3191-46fc-b426-95ca8f785d54 on nch2-master-1 Jun 18 23:15:04.065801 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-803e8314-8749-41d8-af0e-0ea69abf9875 req-2a6f3a46-b731-4aa4-88ab-60d46ce90cc9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036522 Jun 18 23:15:04.066442 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3583/7143] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:15:04.401119 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:04.402423 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:04.410419 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:04.410880 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:04.411681 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:04.412331 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:04.447086 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:04.447635 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:04.448141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.objects.instance [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lazy-loading 'fault' on Instance uuid 36197cbd-3191-46fc-b426-95ca8f785d54 {{(pid=130902) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:15:04.493592 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62490dbd2f174221b6dda00ce8c3e916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0a1057e25d41ca9225c5e5072f17a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:04.503165 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b195378f-4016-4d64-9411-1aa7f17e6faf tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 200 len: 1225 microversion: 2.1 time: 0.105942 Jun 18 23:15:04.503863 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3561/7144] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:04 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:05.520659 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:05.521406 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] [instance: 36197cbd-3191-46fc-b426-95ca8f785d54] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:05.529329 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:05.529713 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:05.530534 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:05.530980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:05.546712 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] HTTP exception thrown: Instance 36197cbd-3191-46fc-b426-95ca8f785d54 could not be found. Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Request method failure captured: Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 HTTP/1.1 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlpXHuJH7Tl-ktV8gWlwrwpqTgCn9uTND9z6lLkF2d8GpD_I-shiF6WSLICAgaGFd8NBzKanVElnXqPxJtl1U-NorMyFXTvM9h8ivPK8IHKhBUEQi0DTJfqtNi9nCjgz7m8f5zqq55qRjMm-yTjbYFCpBTf2zGi-5_fNPrGaT3zpAuA Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: cf0a1057e25d41ca9225c5e5072f17a9 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestShelveInstance-658414119 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cf0a1057e25d41ca9225c5e5072f17a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf0a1057e25d41ca9225c5e5072f17a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf0a1057e25d41ca9225c5e5072f17a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cf0a1057e25d41ca9225c5e5072f17a9", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestShelveInstance-658414119 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: cf0a1057e25d41ca9225c5e5072f17a9 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestShelveInstance-658414119 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestShelveInstance-658414119-project Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: 62490dbd2f174221b6dda00ce8c3e916 Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestShelveInstance-658414119-project Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 36197cbd-3191-46fc-b426-95ca8f785d54 could not be found. Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '36197cbd-3191-46fc-b426-95ca8f785d54'} Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36197cbd-3191-46fc-b426-95ca8f785d54 could not be found. Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36197cbd-3191-46fc-b426-95ca8f785d54 could not be found. Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:15:05.548422 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36197cbd-3191-46fc-b426-95ca8f785d54 could not be found. Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Returning 404 to user: Instance 36197cbd-3191-46fc-b426-95ca8f785d54 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-3a394a18-a8ed-43d3-a231-4c04cddc84cc tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54" status: 404 len: 111 microversion: 2.1 time: 0.033664 Jun 18 23:15:05.554673 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3584/7145] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:05 2022] GET /compute/v2.1/servers/36197cbd-3191-46fc-b426-95ca8f785d54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:15:05.726472 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8f892c98-f07b-4191-a77b-ad9afefb0418 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] Calling method '.version_select at 0x7fea07637700>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:05.748297 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8f892c98-f07b-4191-a77b-ad9afefb0418 tempest-TestShelveInstance-658414119 tempest-TestShelveInstance-658414119-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1223946460" status: 202 len: 0 microversion: 2.1 time: 0.025895 Jun 18 23:15:05.748901 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3562/7146] 10.222.0.30 () {58 vars in 1253 bytes} [Sat Jun 18 23:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1223946460 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:15:23.407413 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=8 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:23.408894 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=12 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:23.641423 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-35c94e27-a629-4a04-b770-72f148175bf6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Action: 'create', calling method: .version_select at 0x7fea06f2c0d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1297536550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdadGlKegjDCpUrX+LxNAnaRGRHhl4ewDX0zRRodB+qQlp/AJRfk/OLrOEPvyHSe7yBpZ5daM388DXM14RH/O4uWYybBBSYNdRmhflJ9RSHhhycqnCah2gMSkyLpVqQg=="}} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:23.655838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-35c94e27-a629-4a04-b770-72f148175bf6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Getting quotas for project 581ddd3109e54ced88db078ddc164100. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:15:23.662394 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.quota [None req-35c94e27-a629-4a04-b770-72f148175bf6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Getting quotas for user d7c9524120a94412be5120a292e5e875 and project 581ddd3109e54ced88db078ddc164100. Resources: {'key_pairs'} {{(pid=130903) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:15:23.697142 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-35c94e27-a629-4a04-b770-72f148175bf6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.297200 Jun 18 23:15:23.698087 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3585/7147] 10.222.0.30 () {60 vars in 1158 bytes} [Sat Jun 18 23:15:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:15:24.711140 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:24.711934 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:24.717492 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1495791872", "imageRef": "5a3e12b2-cae5-4235-b8ef-6052c81f2dad", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1297536550", "security_groups": [{"name": "tempest-secgroup-smoke-1353005047"}], "networks": [{"uuid": "42083ad3-f60e-4e6d-8636-09b1ecede8bd"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:24.829376 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] validate_networks() for [('42083ad3-f60e-4e6d-8636-09b1ecede8bd', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:15:25.327851 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:15:25.328417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:15:25.329206 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:15:25.330085 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:15:25.330524 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:15:25.339992 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:25.340450 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:25.341676 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:25.342112 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:25.363446 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Getting quotas for project 581ddd3109e54ced88db078ddc164100. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:15:25.369157 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Getting quotas for user d7c9524120a94412be5120a292e5e875 and project 581ddd3109e54ced88db078ddc164100. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:15:25.382236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:15:25.386435 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a3e12b2-cae5-4235-b8ef-6052c81f2dad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:15:25.437617 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f35df7c9-40f1-4460-a6ee-4f567bcb86f8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728494 Jun 18 23:15:25.438453 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3563/7148] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:15:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 23:15:25.450322 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-a7dfa931-115a-4267-b402-3b53ba4df644 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:25.451258 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-a7dfa931-115a-4267-b402-3b53ba4df644 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:25.517420 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-a7dfa931-115a-4267-b402-3b53ba4df644 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:25.529912 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-a7dfa931-115a-4267-b402-3b53ba4df644 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1249 microversion: 2.1 time: 0.082450 Jun 18 23:15:25.531611 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3586/7149] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:25 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:26.552204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:26.553473 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:26.573572 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:26.574269 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:26.575238 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:26.575836 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:26.655562 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:26.664849 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e82df8d6-9f39-4831-a3e8-eb737f31f0f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1319 microversion: 2.1 time: 0.120494 Jun 18 23:15:26.665858 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3564/7150] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:26 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1319 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:27.683068 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:27.683700 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:27.690711 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:27.691179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:27.691978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:27.692733 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:27.848724 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:27.857405 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-37df1c08-632a-41e2-9839-2be0a31a67d9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1375 microversion: 2.1 time: 0.179192 Jun 18 23:15:27.858079 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3587/7151] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:27 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:28.337568 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-da2c1ffb-7ae7-4739-b124-b7c83a186500 req-5f882b75-03e0-4717-9e9c-8d72a593bfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:28.352487 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-da2c1ffb-7ae7-4739-b124-b7c83a186500 req-5f882b75-03e0-4717-9e9c-8d72a593bfd2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:28.353391 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-da2c1ffb-7ae7-4739-b124-b7c83a186500 req-5f882b75-03e0-4717-9e9c-8d72a593bfd2 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:28.372417 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-da2c1ffb-7ae7-4739-b124-b7c83a186500 req-5f882b75-03e0-4717-9e9c-8d72a593bfd2 service nova] Creating event network-changed:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:15:28.377484 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-da2c1ffb-7ae7-4739-b124-b7c83a186500 req-5f882b75-03e0-4717-9e9c-8d72a593bfd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043919 Jun 18 23:15:28.378078 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3565/7152] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:15:28.878797 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:28.879697 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:28.888237 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:28.888709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:28.889551 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:28.890009 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:29.030179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:29.038578 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8507a118-f4b5-485c-be5b-58a2e174387c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1375 microversion: 2.1 time: 0.166572 Jun 18 23:15:29.039141 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3588/7153] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:28 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:30.057025 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:30.057699 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:30.064584 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:30.065127 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:30.065958 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:30.066408 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:30.199378 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:30.207353 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef96c04b-586f-4841-a393-91d4a8a73514 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1375 microversion: 2.1 time: 0.155733 Jun 18 23:15:30.207935 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3566/7154] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:30 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:31.224134 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:31.224790 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:31.232346 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:31.232838 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:31.233736 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:31.234193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:31.373358 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:31.384252 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-6da2d5ca-f8b8-41db-993d-d3c023d532ea tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1375 microversion: 2.1 time: 0.164106 Jun 18 23:15:31.384963 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3589/7155] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:31 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:32.402565 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:32.403190 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:32.410761 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:32.411226 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:32.412010 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:32.412459 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:32.554181 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:32.562100 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-66d104e6-98c6-4937-8337-d8418d1e87e7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1375 microversion: 2.1 time: 0.163574 Jun 18 23:15:32.562669 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3567/7156] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:32 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:32.862596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-7c09cedb-cc62-406c-9534-f4a40d7c4c4e req-90b11b45-16fa-41e1-83c8-ce5420be2f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "name": "network-vif-plugged", "status": "completed", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:32.873390 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7c09cedb-cc62-406c-9534-f4a40d7c4c4e req-90b11b45-16fa-41e1-83c8-ce5420be2f80 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:32.874789 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-7c09cedb-cc62-406c-9534-f4a40d7c4c4e req-90b11b45-16fa-41e1-83c8-ce5420be2f80 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:32.889836 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-7c09cedb-cc62-406c-9534-f4a40d7c4c4e req-90b11b45-16fa-41e1-83c8-ce5420be2f80 service nova] Creating event network-vif-plugged:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:15:32.895362 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-7c09cedb-cc62-406c-9534-f4a40d7c4c4e req-90b11b45-16fa-41e1-83c8-ce5420be2f80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036699 Jun 18 23:15:32.895959 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3590/7157] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:15:33.579539 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:33.580156 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:33.587718 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:33.588166 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:33.588933 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:33.589402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:33.726531 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:33.734618 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-ef98b6fc-d88c-46ae-a4f7-74f8a04d1ca1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1375 microversion: 2.1 time: 0.159089 Jun 18 23:15:33.735171 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3568/7158] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:33 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:34.757268 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:34.758585 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:34.766963 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:34.767434 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:34.768226 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:34.768680 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:34.903444 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:34.913348 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-049c7170-5815-4152-9bb7-b822410ac79d tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1559 microversion: 2.1 time: 0.163632 Jun 18 23:15:34.913903 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3591/7159] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:34 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:34.933533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:15:34.934839 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:15:34.942267 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:34.942656 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:34.943434 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:34.943874 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:35.080866 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:15:35.088999 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-e6fdf521-d946-4b34-a7f3-e39930af07a7 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1559 microversion: 2.1 time: 0.159581 Jun 18 23:15:35.089564 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3569/7160] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:15:34 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:15:36.791807 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=6 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:15:36.848915 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-b1c8e111-1d60-4a81-8834-9dc927359109 req-8cae2baf-2fd7-4160-b61f-6ab738a758ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:15:36.857215 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b1c8e111-1d60-4a81-8834-9dc927359109 req-8cae2baf-2fd7-4160-b61f-6ab738a758ea service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:15:36.857685 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-b1c8e111-1d60-4a81-8834-9dc927359109 req-8cae2baf-2fd7-4160-b61f-6ab738a758ea service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:15:36.868834 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-b1c8e111-1d60-4a81-8834-9dc927359109 req-8cae2baf-2fd7-4160-b61f-6ab738a758ea service nova] Creating event network-changed:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:15:36.874003 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-b1c8e111-1d60-4a81-8834-9dc927359109 req-8cae2baf-2fd7-4160-b61f-6ab738a758ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086858 Jun 18 23:15:36.874605 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3592/7161] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:16:14.498758 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:16:14.499549 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:17:32.074416 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [daffbafe-bde8-401a-8699-37b1ad1abba9] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 18 23:17:32.075528 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4c81e5c-75ec-49f9-aa78-65a84e7b7d0c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 18 23:17:32.076045 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:32.076820 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:32.077669 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:32.078314 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=34 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:32.083742 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1545676094"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:17:32.085608 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:32.095461 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:32.095956 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:32.096750 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:32.097236 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:32.510025 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d7047cd2-58d0-48b0-955a-914418516bbd tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "POST /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57/action" status: 202 len: 0 microversion: 2.1 time: 0.437690 Jun 18 23:17:32.510691 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3570/7162] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:17:32 2022] POST /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 23:17:37.595707 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa28b31b-680e-43c3-b969-f3270b284fb4] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 18 23:17:37.597251 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11af18b5-c620-4e8c-9b06-4a70f2ff4468] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:17:37.598086 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:37.598706 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=28 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:37.611762 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "name": "network-vif-plugged", "status": "completed", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:17:37.621703 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:37.625286 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:37.640772 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] Creating event network-vif-plugged:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:17:37.646743 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] [b3ec41ef-6018-4195-b862-f9d6fa2f2ee7] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:17:38.610151 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa28b31b-680e-43c3-b969-f3270b284fb4] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49804. Jun 18 23:17:38.613499 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] [11af18b5-c620-4e8c-9b06-4a70f2ff4468] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49806. Jun 18 23:17:38.655280 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] [b3ec41ef-6018-4195-b862-f9d6fa2f2ee7] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49808. Jun 18 23:17:38.659316 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-126b4909-baaa-45d5-9f84-48ab68389cab req-d2d067d3-c639-4104-855f-9e68f79893b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.068231 Jun 18 23:17:38.663139 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3593/7163] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:17:46.073597 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:46.074399 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:46.079106 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1140283481", "imageRef": "983b8d93-6433-4035-871b-494c18ee95d5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1297536550", "security_groups": [{"name": "tempest-secgroup-smoke-1353005047"}], "networks": [{"uuid": "42083ad3-f60e-4e6d-8636-09b1ecede8bd"}]}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:17:46.102957 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4c81e5c-75ec-49f9-aa78-65a84e7b7d0c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49878. Jun 18 23:17:46.104402 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] [daffbafe-bde8-401a-8699-37b1ad1abba9] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49876. Jun 18 23:17:46.195856 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.network.neutron [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] validate_networks() for [('42083ad3-f60e-4e6d-8636-09b1ecede8bd', None, None, None, None, None)] {{(pid=130902) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 18 23:17:46.592734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Flavor limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 18 23:17:46.593191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Image limits 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 18 23:17:46.593646 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Flavor pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 18 23:17:46.594059 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Image pref 0:0:0 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 18 23:17:46.594471 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.virt.hardware [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130902) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 18 23:17:46.603915 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:46.604392 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:46.605302 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:46.605752 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:46.623350 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Getting quotas for project 581ddd3109e54ced88db078ddc164100. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 18 23:17:46.628841 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.quota [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Getting quotas for user d7c9524120a94412be5120a292e5e875 and project 581ddd3109e54ced88db078ddc164100. Resources: {'instances', 'cores', 'ram'} {{(pid=130902) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 18 23:17:46.642748 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Going to run 1 instances... {{(pid=130902) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 18 23:17:46.645425 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='983b8d93-6433-4035-871b-494c18ee95d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130902) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 18 23:17:46.701301 ncdv-master-1 devstack@n-api.service[130902]: ERROR oslo.messaging._drivers.impl_rabbit [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [30f2985d-6453-44eb-9005-b6ba3eec437a] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:17:47.562637 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-99b24cf6-5c6a-4e93-a508-9ee140b3e26e req-0586b86c-9fd4-4a6e-b66e-c80f2caf7a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "name": "network-vif-unplugged", "status": "completed", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:17:47.571978 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-99b24cf6-5c6a-4e93-a508-9ee140b3e26e req-0586b86c-9fd4-4a6e-b66e-c80f2caf7a13 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:47.572546 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-99b24cf6-5c6a-4e93-a508-9ee140b3e26e req-0586b86c-9fd4-4a6e-b66e-c80f2caf7a13 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:47.584049 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-99b24cf6-5c6a-4e93-a508-9ee140b3e26e req-0586b86c-9fd4-4a6e-b66e-c80f2caf7a13 service nova] Creating event network-vif-unplugged:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:17:47.589248 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-99b24cf6-5c6a-4e93-a508-9ee140b3e26e req-0586b86c-9fd4-4a6e-b66e-c80f2caf7a13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031630 Jun 18 23:17:47.590068 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3594/7164] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:17:47.711970 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [30f2985d-6453-44eb-9005-b6ba3eec437a] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49908. Jun 18 23:17:47.719344 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-265da083-4cda-4194-adb6-7d3cf6504b0b tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.647383 Jun 18 23:17:47.720618 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3571/7165] 10.222.0.30 () {60 vars in 1146 bytes} [Sat Jun 18 23:17:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 18 23:17:47.735341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-8adb53ae-bb08-473b-bece-6467e7f9185c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:47.736037 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-8adb53ae-bb08-473b-bece-6467e7f9185c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:47.853815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-8adb53ae-bb08-473b-bece-6467e7f9185c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:47.860880 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-8adb53ae-bb08-473b-bece-6467e7f9185c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1249 microversion: 2.1 time: 0.130786 Jun 18 23:17:47.861467 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3595/7166] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:47 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:48.879297 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:48.879940 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:48.887382 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:48.888097 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:48.889133 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:48.889734 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:48.959787 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:48.969475 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-552dd6e4-3d36-4504-a09d-a1c576c825ed tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1307 microversion: 2.1 time: 0.095015 Jun 18 23:17:48.970319 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3572/7167] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:48 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:49.987290 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:49.988594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:49.997263 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:49.997747 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:49.998559 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:49.998976 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:50.150159 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:50.158040 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-05927eef-1459-461d-a5ad-46b6642570f6 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.174952 Jun 18 23:17:50.158617 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3596/7168] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:49 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:51.175158 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:51.176497 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:51.184105 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:51.184939 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:51.186006 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:51.186665 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:51.330034 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:51.338040 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f84ebc8f-14ce-4bd2-ae07-61834b67feff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.166782 Jun 18 23:17:51.338872 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3573/7169] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:51 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:52.356485 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:52.357173 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:52.364617 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:52.365107 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:52.365902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:52.366353 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:52.506045 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:52.513866 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-1224ffc9-8bc8-4331-b5fc-e3a75ea27bcc tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.162322 Jun 18 23:17:52.514443 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3597/7170] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:52 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:53.531402 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:53.532601 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:53.541367 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:53.541826 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:53.542607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:53.543073 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:53.688667 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:53.696701 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-b705044a-e86a-4199-8adb-57207712203c tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.169203 Jun 18 23:17:53.697532 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3574/7171] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:53 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:54.438903 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:17:54.439506 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:17:54.714101 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:54.714727 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:54.722461 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:54.722919 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:54.723710 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:54.724156 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:54.870236 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:54.878832 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-52d92975-38d9-4873-8e79-ab9874d50767 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.168692 Jun 18 23:17:54.880466 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3598/7172] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:54 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:54.971701 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:17:54.972414 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:17:55.896573 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:55.897191 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:55.904860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:55.905495 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:55.906398 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:55.906902 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:56.075630 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:56.083530 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-92fe74be-94b2-47d7-a3fe-60138438c5fb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.191026 Jun 18 23:17:56.084127 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3575/7173] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:55 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:57.111594 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:57.112816 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:57.122122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:57.122707 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:57.123498 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:57.123954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:57.269709 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:57.277809 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c3a0464a-4c9d-42a1-ab19-208dbf1325c4 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.172909 Jun 18 23:17:57.278397 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3599/7174] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:57 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:58.299074 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:58.300053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:58.303135 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:58.304224 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell0:SELECT=6 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:58.318039 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:58.318784 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:58.320053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:58.320860 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:58.463204 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:58.472166 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-852eea7c-dbcc-4f1a-8118-65213546d043 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.179639 Jun 18 23:17:58.472743 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3576/7175] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:58 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:17:59.176545 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell0:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:17:59.239162 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-974a9559-5c60-418b-83e7-5793b320d1e9 req-c3b9bcf4-7d85-431d-a384-d291b4a819ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:17:59.247786 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-974a9559-5c60-418b-83e7-5793b320d1e9 req-c3b9bcf4-7d85-431d-a384-d291b4a819ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:59.248250 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-974a9559-5c60-418b-83e7-5793b320d1e9 req-c3b9bcf4-7d85-431d-a384-d291b4a819ed service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:59.260551 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-974a9559-5c60-418b-83e7-5793b320d1e9 req-c3b9bcf4-7d85-431d-a384-d291b4a819ed service nova] Creating event network-changed:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:17:59.265839 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-974a9559-5c60-418b-83e7-5793b320d1e9 req-c3b9bcf4-7d85-431d-a384-d291b4a819ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095850 Jun 18 23:17:59.266899 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3600/7176] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:17:59.489749 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:17:59.490357 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:17:59.498143 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:59.498619 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:59.499438 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:17:59.499887 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:17:59.637684 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:17:59.645424 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1a1cb228-44a2-46b3-8557-764b6c5595d2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.159722 Jun 18 23:17:59.646012 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3577/7177] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:17:59 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:00.667212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:00.668179 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:00.678130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:00.678758 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:00.679815 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:00.680427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:00.816969 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:00.825294 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c46c3792-e923-4476-9640-c9f3cef1f697 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.164807 Jun 18 23:18:00.825880 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3601/7178] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:00 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:01.845271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:01.846417 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:01.855485 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:01.856304 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:01.857477 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:01.857922 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:02.003688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:02.012851 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-d5f7049c-6460-489a-81e4-095f70e0eca9 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.173835 Jun 18 23:18:02.013473 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3578/7179] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:01 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:03.029478 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:03.030071 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:03.037684 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:03.038157 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:03.038954 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:03.039586 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:03.178560 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:03.187109 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c61b406f-46a0-4e4d-a3d0-bbbc460acac1 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.161583 Jun 18 23:18:03.187666 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3602/7180] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:03 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:04.208005 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:04.209108 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:04.221499 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:04.222258 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:04.223533 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:04.224264 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:04.363141 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:04.371209 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-164b158b-1868-4907-a04a-d7920368c913 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.169781 Jun 18 23:18:04.371784 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3579/7181] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:04 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:04.765441 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-26975880-aa55-415a-952c-cb69c5161759 req-355b950c-1207-42c6-aba3-491fb4eb7647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "name": "network-vif-plugged", "status": "completed", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:18:04.775640 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-26975880-aa55-415a-952c-cb69c5161759 req-355b950c-1207-42c6-aba3-491fb4eb7647 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:04.776103 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-26975880-aa55-415a-952c-cb69c5161759 req-355b950c-1207-42c6-aba3-491fb4eb7647 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:04.787924 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-26975880-aa55-415a-952c-cb69c5161759 req-355b950c-1207-42c6-aba3-491fb4eb7647 service nova] Creating event network-vif-plugged:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:18:04.793221 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-26975880-aa55-415a-952c-cb69c5161759 req-355b950c-1207-42c6-aba3-491fb4eb7647 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 Jun 18 23:18:04.793847 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3603/7182] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:18:05.390207 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:05.390971 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:05.399688 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:05.400137 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:05.400911 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:05.401397 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:05.542525 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:05.550525 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-24e64334-f62b-49b4-836b-5a8ef5481277 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1375 microversion: 2.1 time: 0.165668 Jun 18 23:18:05.551109 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3580/7183] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:05 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:06.573260 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:06.574122 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:06.581956 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:06.582504 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:06.583411 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:06.583938 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:06.735536 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:06.743648 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-9ef5ed33-6ca0-4f16-a430-c18272c11cd8 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1559 microversion: 2.1 time: 0.178192 Jun 18 23:18:06.744215 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3604/7184] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:06 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:06.760128 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:18:06.760709 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:18:06.768162 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:06.768613 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:06.769421 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:06.769854 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:06.912682 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:18:06.920529 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-590a7933-8b43-4934-9213-a78b23c51203 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1559 microversion: 2.1 time: 0.164510 Jun 18 23:18:06.921143 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3581/7185] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:18:06 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:18:09.280677 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-491cc8c0-0d8c-4a80-ab73-819dafaf39dd req-4ab5ff41-505f-49cf-96e5-9797ec2894f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:18:09.284681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=27 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:09.290827 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-491cc8c0-0d8c-4a80-ab73-819dafaf39dd req-4ab5ff41-505f-49cf-96e5-9797ec2894f4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:18:09.291554 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-491cc8c0-0d8c-4a80-ab73-819dafaf39dd req-4ab5ff41-505f-49cf-96e5-9797ec2894f4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:18:09.294458 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=51 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:18:09.304679 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-491cc8c0-0d8c-4a80-ab73-819dafaf39dd req-4ab5ff41-505f-49cf-96e5-9797ec2894f4 service nova] Creating event network-changed:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:18:09.310110 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-491cc8c0-0d8c-4a80-ab73-819dafaf39dd req-4ab5ff41-505f-49cf-96e5-9797ec2894f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033469 Jun 18 23:18:09.311268 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3605/7186] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:19:34.508833 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:19:34.510099 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:19:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:19:54.630880 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:19:54.631543 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:19:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:20:23.028896 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:23.029716 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=62 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:23.034019 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-179466370"}} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:23.035148 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:23.042732 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:23.043184 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:23.043953 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:23.044383 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:23.336948 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-08ced344-0a44-430b-94ed-04a11e59bf51 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "POST /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd/action" status: 202 len: 0 microversion: 2.1 time: 0.310160 Jun 18 23:20:23.337844 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3582/7187] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Jun 18 23:20:23 2022] POST /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 18 23:20:29.411467 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:29.412284 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=1 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:29.478401 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-5d60fc03-150a-490d-8af2-9ae2f934d4fb req-ae1fa9f5-a2f3-48ce-adaf-81c4c6629eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "name": "network-vif-plugged", "status": "completed", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:29.487184 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5d60fc03-150a-490d-8af2-9ae2f934d4fb req-ae1fa9f5-a2f3-48ce-adaf-81c4c6629eb7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:29.487642 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-5d60fc03-150a-490d-8af2-9ae2f934d4fb req-ae1fa9f5-a2f3-48ce-adaf-81c4c6629eb7 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:29.498538 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-5d60fc03-150a-490d-8af2-9ae2f934d4fb req-ae1fa9f5-a2f3-48ce-adaf-81c4c6629eb7 service nova] Creating event network-vif-plugged:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:20:29.503934 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-5d60fc03-150a-490d-8af2-9ae2f934d4fb req-ae1fa9f5-a2f3-48ce-adaf-81c4c6629eb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096544 Jun 18 23:20:29.504507 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3606/7188] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:20:41.781920 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:41.782643 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:41.784013 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa28b31b-680e-43c3-b969-f3270b284fb4] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:20:41.784815 ncdv-master-1 devstack@n-api.service[130903]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11af18b5-c620-4e8c-9b06-4a70f2ff4468] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 18 23:20:41.785422 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_api:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:41.786189 ncdv-master-1 devstack@n-api.service[130903]: DEBUG dbcounter [-] [130903] Writing DB stats nova_cell1:SELECT=2 {{(pid=130903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:41.787675 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_api:SELECT=2 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:41.788689 ncdv-master-1 devstack@n-api.service[130902]: DEBUG dbcounter [-] [130902] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130902) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 18 23:20:41.793614 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:41.794091 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:41.794983 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:41.795657 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:41.825690 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Going to try to terminate instance {{(pid=130902) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:20:41.848722 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-2a109c9b-6d34-4d5f-81c7-5b45d18aed22 req-02c4522a-2f47-432f-8d5f-21988ea3a6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:41.857373 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2a109c9b-6d34-4d5f-81c7-5b45d18aed22 req-02c4522a-2f47-432f-8d5f-21988ea3a6b4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:41.857596 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-2a109c9b-6d34-4d5f-81c7-5b45d18aed22 req-02c4522a-2f47-432f-8d5f-21988ea3a6b4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:41.872412 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-2a109c9b-6d34-4d5f-81c7-5b45d18aed22 req-02c4522a-2f47-432f-8d5f-21988ea3a6b4 service nova] Creating event network-changed:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:20:41.878146 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-2a109c9b-6d34-4d5f-81c7-5b45d18aed22 req-02c4522a-2f47-432f-8d5f-21988ea3a6b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095537 Jun 18 23:20:41.879039 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3607/7189] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 18 23:20:41.917851 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-f40aec6e-54e4-4f68-b179-2accef8fced2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 204 len: 0 microversion: 2.1 time: 0.140189 Jun 18 23:20:41.922321 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3583/7190] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:20:41 2022] DELETE /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:20:41.941270 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:41.942006 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:41.949119 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:41.949592 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:41.950387 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:41.950840 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:42.104621 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:20:42.113210 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-5372caa4-e7f3-4104-977f-8ee41e029feb tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1683 microversion: 2.1 time: 0.188920 Jun 18 23:20:42.113784 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3608/7191] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:41 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:20:43.131678 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:43.132543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:43.139850 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:43.140303 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:43.141104 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:43.141543 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:43.276316 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:20:43.284257 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-663d2e18-69f8-426b-b29d-7a28cd3b7874 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1683 microversion: 2.1 time: 0.156939 Jun 18 23:20:43.284837 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3584/7192] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:43 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:20:43.457904 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-05193417-f079-4bd9-b1e5-295baebc1539 req-c273955b-f33d-4134-87bb-f442e8cb0d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "name": "network-vif-unplugged", "status": "completed", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:43.472540 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-05193417-f079-4bd9-b1e5-295baebc1539 req-c273955b-f33d-4134-87bb-f442e8cb0d41 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:43.473150 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-05193417-f079-4bd9-b1e5-295baebc1539 req-c273955b-f33d-4134-87bb-f442e8cb0d41 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:43.487009 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa28b31b-680e-43c3-b969-f3270b284fb4] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50292. Jun 18 23:20:43.490352 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-05193417-f079-4bd9-b1e5-295baebc1539 req-c273955b-f33d-4134-87bb-f442e8cb0d41 service nova] Creating event network-vif-unplugged:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:20:43.494197 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] [11af18b5-c620-4e8c-9b06-4a70f2ff4468] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 50294. Jun 18 23:20:43.496152 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-05193417-f079-4bd9-b1e5-295baebc1539 req-c273955b-f33d-4134-87bb-f442e8cb0d41 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042729 Jun 18 23:20:43.498042 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3609/7193] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:20:44.068523 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-f5b24f90-01f3-40c8-ab4b-7ddae96fc559 req-66759652-ead0-4bba-a492-bc59787722f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b7d318-d964-42f2-9ddb-f98e1e87a8dd", "name": "network-vif-deleted", "tag": "fcbb00f0-0ca0-4a83-a39e-f78099b2f893"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:44.077056 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f5b24f90-01f3-40c8-ab4b-7ddae96fc559 req-66759652-ead0-4bba-a492-bc59787722f4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:44.077512 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-f5b24f90-01f3-40c8-ab4b-7ddae96fc559 req-66759652-ead0-4bba-a492-bc59787722f4 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:44.089355 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-f5b24f90-01f3-40c8-ab4b-7ddae96fc559 req-66759652-ead0-4bba-a492-bc59787722f4 service nova] Creating event network-vif-deleted:fcbb00f0-0ca0-4a83-a39e-f78099b2f893 for instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd on nch1-master-1 Jun 18 23:20:44.095013 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-f5b24f90-01f3-40c8-ab4b-7ddae96fc559 req-66759652-ead0-4bba-a492-bc59787722f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030309 Jun 18 23:20:44.097131 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3585/7194] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:20:44.307834 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:44.309308 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:44.321526 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:44.322043 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:44.322902 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:44.323400 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:44.358069 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:44.358531 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:44.359004 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.objects.instance [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lazy-loading 'fault' on Instance uuid e2b7d318-d964-42f2-9ddb-f98e1e87a8dd {{(pid=130903) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 18 23:20:44.403980 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.policy [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130903) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:20:44.412100 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-cfd8ba37-7e81-4b57-9f13-420366090951 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 200 len: 1339 microversion: 2.1 time: 0.112744 Jun 18 23:20:44.412902 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3610/7195] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:44 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:20:45.432607 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:45.433219 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: e2b7d318-d964-42f2-9ddb-f98e1e87a8dd] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:45.440266 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:45.440712 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:45.441582 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:45.442017 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:45.455638 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.wsgi [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] HTTP exception thrown: Instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd could not be found. Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Request method failure captured: Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: request: GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd HTTP/1.1 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Accept: application/json Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Accept-Encoding: identity Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Connection: close Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Content-Length: 0 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Content-Type: application/json Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Host: 10.222.0.30 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: Openstack-System-Scope: None Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: User-Agent: python-urllib3/1.26.9 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Auth-Token: gAAAAABirlyGSqYZGEq4x_lI57yez8qHBBUiAdTAPKa0H_sbzJJ-xX82RsZD2uNDBICGR9bemC37VskIS1hK02S1YRT-7NUKGVLtXxphcNBu3r6raAH0qZEWpLGB9D9_-S5d9Ygw4lXiY1N9o0xsS1S-g4vYR2yP0AHEV51mj5qvKnpdGSizlP8 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Id: None Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Domain-Name: None Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Identity-Status: Confirmed Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Is-Admin-Project: True Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Id: default Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Domain-Name: Default Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Id: 581ddd3109e54ced88db078ddc164100 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Project-Name: tempest-TestSnapshotPattern-2060764526 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Role: member,reader Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Roles: member,reader Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/581ddd3109e54ced88db078ddc164100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/581ddd3109e54ced88db078ddc164100"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/581ddd3109e54ced88db078ddc164100"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_581ddd3109e54ced88db078ddc164100", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant: tempest-TestSnapshotPattern-2060764526 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Id: 581ddd3109e54ced88db078ddc164100 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-Tenant-Name: tempest-TestSnapshotPattern-2060764526 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-User: tempest-TestSnapshotPattern-2060764526-project Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Id: default Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-User-Domain-Name: Default Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-User-Id: d7c9524120a94412be5120a292e5e875 Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: X-User-Name: tempest-TestSnapshotPattern-2060764526-project Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: method: > Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: exception: Instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd could not be found. Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: action_args: {'id': 'e2b7d318-d964-42f2-9ddb-f98e1e87a8dd'} Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd could not be found. Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd could not be found. Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:20:45.457441 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd could not be found. Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: ERROR nova.api.openstack.wsgi Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Returning 404 to user: Instance e2b7d318-d964-42f2-9ddb-f98e1e87a8dd could not be found. {{(pid=130902) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-609c3513-2db4-4353-83b7-430b20453a49 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd" status: 404 len: 111 microversion: 2.1 time: 0.031675 Jun 18 23:20:45.463640 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3586/7196] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:45 2022] GET /compute/v2.1/servers/e2b7d318-d964-42f2-9ddb-f98e1e87a8dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:20:46.837341 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:46.837880 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:46.840271 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [req-fd94105f-93e2-4666-a74f-9ee17554b587 req-f4f8fea4-f25e-41e7-aad2-d1847a6ecbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:46.845427 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:46.845917 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:46.846694 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:46.847152 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:46.850115 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fd94105f-93e2-4666-a74f-9ee17554b587 req-f4f8fea4-f25e-41e7-aad2-d1847a6ecbf0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:46.850778 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [req-fd94105f-93e2-4666-a74f-9ee17554b587 req-f4f8fea4-f25e-41e7-aad2-d1847a6ecbf0 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:46.866342 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.compute.server_external_events [req-fd94105f-93e2-4666-a74f-9ee17554b587 req-f4f8fea4-f25e-41e7-aad2-d1847a6ecbf0 service nova] Creating event network-changed:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:20:46.872424 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [req-fd94105f-93e2-4666-a74f-9ee17554b587 req-f4f8fea4-f25e-41e7-aad2-d1847a6ecbf0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036251 Jun 18 23:20:46.873785 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3587/7197] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:20:46.874116 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Going to try to terminate instance {{(pid=130903) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 18 23:20:46.978358 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-c9992c1e-2697-43ec-81e7-619d668a60ff tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 204 len: 0 microversion: 2.1 time: 0.144514 Jun 18 23:20:46.982312 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3611/7198] 10.222.0.30 () {58 vars in 1238 bytes} [Sat Jun 18 23:20:46 2022] DELETE /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 18 23:20:46.990122 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:46.991130 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:46.999240 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:46.999737 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:47.000666 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:47.001313 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:47.153081 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:20:47.161023 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-55b8d542-1c13-4aea-91d5-6a985273ba19 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1684 microversion: 2.1 time: 0.177318 Jun 18 23:20:47.161630 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3588/7199] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:46 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:20:48.178130 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [req-39f0618b-0cbe-49df-b335-bab3c59ac8cc req-a34a5d75-3d45-4495-a95a-80c60d46bc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4637ff07-f34e-49d4-99e4-356a83793c57", "name": "network-vif-deleted", "tag": "8b61ae99-db12-4f28-aad7-f71a1622eda9"}]} {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 18 23:20:48.178705 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:48.179084 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.compute.api [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130902) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:48.188212 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-39f0618b-0cbe-49df-b335-bab3c59ac8cc req-a34a5d75-3d45-4495-a95a-80c60d46bc02 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:48.188681 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [req-39f0618b-0cbe-49df-b335-bab3c59ac8cc req-a34a5d75-3d45-4495-a95a-80c60d46bc02 service nova] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:48.196053 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:48.196521 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:48.197333 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:48.197809 ncdv-master-1 devstack@n-api.service[130902]: DEBUG oslo_concurrency.lockutils [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130902) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:48.200153 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.compute.server_external_events [req-39f0618b-0cbe-49df-b335-bab3c59ac8cc req-a34a5d75-3d45-4495-a95a-80c60d46bc02 service nova] Creating event network-vif-deleted:8b61ae99-db12-4f28-aad7-f71a1622eda9 for instance 4637ff07-f34e-49d4-99e4-356a83793c57 on nch2-master-1 Jun 18 23:20:48.206529 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [req-39f0618b-0cbe-49df-b335-bab3c59ac8cc req-a34a5d75-3d45-4495-a95a-80c60d46bc02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 Jun 18 23:20:48.207145 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3612/7200] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Jun 18 23:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 18 23:20:48.267147 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.policy [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7c9524120a94412be5120a292e5e875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581ddd3109e54ced88db078ddc164100', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130902) authorize /opt/stack/nova/nova/policy.py:199}} Jun 18 23:20:48.274932 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-1c54e239-46e5-4d7e-bc8c-3744a429d1c2 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 200 len: 1334 microversion: 2.1 time: 0.100786 Jun 18 23:20:48.275513 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3589/7201] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:48 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 18 23:20:49.298421 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '>' {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:49.299462 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.compute.api [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] [instance: 4637ff07-f34e-49d4-99e4-356a83793c57] Fetching instance by UUID {{(pid=130903) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 18 23:20:49.308350 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:49.308821 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:49.309631 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 18 23:20:49.310075 ncdv-master-1 devstack@n-api.service[130903]: DEBUG oslo_concurrency.lockutils [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Lock "d349766c-949b-4923-9574-b93ba690371c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 18 23:20:49.323538 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.wsgi [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] HTTP exception thrown: Instance 4637ff07-f34e-49d4-99e4-356a83793c57 could not be found. Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Request method failure captured: Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: request: GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 HTTP/1.1 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Accept: application/json Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Accept-Encoding: identity Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Connection: close Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Content-Length: 0 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Content-Type: application/json Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Host: 10.222.0.30 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: Openstack-System-Scope: None Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: User-Agent: python-urllib3/1.26.9 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Auth-Token: gAAAAABirlyGSqYZGEq4x_lI57yez8qHBBUiAdTAPKa0H_sbzJJ-xX82RsZD2uNDBICGR9bemC37VskIS1hK02S1YRT-7NUKGVLtXxphcNBu3r6raAH0qZEWpLGB9D9_-S5d9Ygw4lXiY1N9o0xsS1S-g4vYR2yP0AHEV51mj5qvKnpdGSizlP8 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Id: None Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Domain-Name: None Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Identity-Status: Confirmed Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Is-Admin-Project: True Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Id: default Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Domain-Name: Default Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Id: 581ddd3109e54ced88db078ddc164100 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Project-Name: tempest-TestSnapshotPattern-2060764526 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Role: member,reader Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Roles: member,reader Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/581ddd3109e54ced88db078ddc164100"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/581ddd3109e54ced88db078ddc164100"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/581ddd3109e54ced88db078ddc164100"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_581ddd3109e54ced88db078ddc164100", "adminURL": "http://10.222.0.30:8080"}]}] Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant: tempest-TestSnapshotPattern-2060764526 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Id: 581ddd3109e54ced88db078ddc164100 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-Tenant-Name: tempest-TestSnapshotPattern-2060764526 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-User: tempest-TestSnapshotPattern-2060764526-project Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Id: default Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-User-Domain-Name: Default Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-User-Id: d7c9524120a94412be5120a292e5e875 Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: X-User-Name: tempest-TestSnapshotPattern-2060764526-project Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: method: > Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: exception: Instance 4637ff07-f34e-49d4-99e4-356a83793c57 could not be found. Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: action_args: {'id': '4637ff07-f34e-49d4-99e4-356a83793c57'} Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: {{(pid=130903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4637ff07-f34e-49d4-99e4-356a83793c57 could not be found. Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4637ff07-f34e-49d4-99e4-356a83793c57 could not be found. Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 18 23:20:49.325193 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4637ff07-f34e-49d4-99e4-356a83793c57 could not be found. Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: ERROR nova.api.openstack.wsgi Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: DEBUG nova.api.openstack.wsgi [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Returning 404 to user: Instance 4637ff07-f34e-49d4-99e4-356a83793c57 could not be found. {{(pid=130903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: INFO nova.api.openstack.requestlog [None req-ef881e48-7a65-40c5-8434-f528a089ef80 tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57" status: 404 len: 111 microversion: 2.1 time: 0.036987 Jun 18 23:20:49.330013 ncdv-master-1 devstack@n-api.service[130903]: [pid: 130903|app: 0|req: 3613/7202] 10.222.0.30 () {58 vars in 1235 bytes} [Sat Jun 18 23:20:49 2022] GET /compute/v2.1/servers/4637ff07-f34e-49d4-99e4-356a83793c57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 18 23:20:49.495838 ncdv-master-1 devstack@n-api.service[130902]: DEBUG nova.api.openstack.wsgi [None req-8cf0cd5d-0e36-47e4-af1d-21f54f24cabe tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] Calling method '.version_select at 0x7fea076373a0>' {{(pid=130902) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 18 23:20:49.519252 ncdv-master-1 devstack@n-api.service[130902]: INFO nova.api.openstack.requestlog [None req-8cf0cd5d-0e36-47e4-af1d-21f54f24cabe tempest-TestSnapshotPattern-2060764526 tempest-TestSnapshotPattern-2060764526-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1297536550" status: 202 len: 0 microversion: 2.1 time: 0.027380 Jun 18 23:20:49.521062 ncdv-master-1 devstack@n-api.service[130902]: [pid: 130902|app: 0|req: 3590/7203] 10.222.0.30 () {58 vars in 1256 bytes} [Sat Jun 18 23:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1297536550 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 18 23:21:14.448127 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:21:14.448833 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:22:54.523001 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:22:54.524250 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:22:54.984826 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:22:54.986148 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:22:55.018904 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:22:55.019069 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:22:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:23:14.640778 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:23:14.641785 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:24:34.458537 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:24:34.459566 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:26:14.536792 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:26:14.537948 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:26:14.999091 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:26:14.999996 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:26:15.027078 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:26:15.027332 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:26:34.652483 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:26:34.653228 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:26:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:26:37.514035 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:26:37.515023 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:27:54.472847 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:27:54.474086 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:29:34.550012 ncdv-master-1 devstack@n-api.service[130903]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:29:34.550816 ncdv-master-1 devstack@n-api.service[130903]: Sat Jun 18 23:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:29:35.013045 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:29:35.013681 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 18 23:29:35.036118 ncdv-master-1 devstack@n-api.service[130902]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 18 23:29:35.036281 ncdv-master-1 devstack@n-api.service[130902]: Sat Jun 18 23:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!